Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Appearance settings

shimo-lab/Universal-Geometry-with-ICA

Open more actions menu

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

24 Commits
24 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Universal-Geometry-with-ICA

Discovering Universal Geometry in Embeddings with ICA
Hiroaki Yamagiwa*, Momose Oyama*, Hidetoshi Shimodaira
EMNLP 2023

English word embeddings

Heatmap of ICA-transformed word embeddings

heatmap

Cross-lingual embeddings

Heatmaps of ICA-transformed word embeddings

cross-lingual heatmap

Spiky shape of embedding distributions

ica shape

Scatter plots of ICA-transformed word embeddings

English Spanish
ica en ica es
Russian Arabic Hindi Chinese Japanese
ica ru ica ar ica hi ica zh ica ja

Code and Data

  • The code for English embeddings is available in the geometry directory.
  • For cross-lingual embeddings, dynamic embeddings, and image model embeddings, please refer to the universal directory.

Citation

If you find our code or data useful in your research, please cite our paper:

@inproceedings{DBLP:conf/emnlp/YamagiwaOS23,
  author       = {Hiroaki Yamagiwa and
                  Momose Oyama and
                  Hidetoshi Shimodaira},
  editor       = {Houda Bouamor and
                  Juan Pino and
                  Kalika Bali},
  title        = {Discovering Universal Geometry in Embeddings with {ICA}},
  booktitle    = {Proceedings of the 2023 Conference on Empirical Methods in Natural
                  Language Processing, {EMNLP} 2023, Singapore, December 6-10, 2023},
  pages        = {4647--4675},
  publisher    = {Association for Computational Linguistics},
  year         = {2023},
  url          = {https://aclanthology.org/2023.emnlp-main.283},
  timestamp    = {Wed, 13 Dec 2023 17:20:20 +0100},
  biburl       = {https://dblp.org/rec/conf/emnlp/YamagiwaOS23.bib},
  bibsource    = {dblp computer science bibliography, https://dblp.org}
}
Morty Proxy This is a proxified and sanitized view of the page, visit original site.