MTEB: Massive Text Embedding Benchmark
Crosslingual Generalization through Multitask Finetuning
EMNLP 2023 Papers: Explore cutting-edge research from EMNLP 2023, the premier conference for advancing empirical methods in natural language processing. Stay updated on the latest in machine learning, deep learning, and natural language processing with code included. ⭐ support NLP!
Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
[EMNLP 2023] The Vault: A Comprehensive Multilingual Dataset for Advancing Code Understanding and Generation
This repo supports various cross-lingual transfer learning & multilingual NLP models.
Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
This repository contains the code, data, and models of the paper titled "CrossSum: Beyond English-Centric Cross-Lingual Summarization for 1,500+ Language Pairs" published in Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL’23), July 9-14, 2023.
WorkRB: Work Research Benchmark
An open-source Python package that uses AI to predict Nigerian languages, including English, Pidgin, Yoruba, Hausa, and Igbo.
TUMLU: A Unified and Native Language Understanding Benchmark for Turkic Languages
Official codebase for the ACL 2025 Findings paper: Optimized Text Embedding Models and Benchmarks for Amharic Passage Retrieval.
Generate synthetic labeled data for extremely low-resource languages using bilingual lexicons.
Parity-Aware Byte-Pair Encoding: Improving Cross-lingual Fairness in Tokenization [arXiv 2025]
Code for "Preference Tuning For Toxicity Mitigation Generalizes Across Languages." Paper accepted at Findings of EMNLP 2024
🔍 Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignment
On Bilingual Lexicon Induction with Large Language Models (EMNLP 2023). Keywords: Bilingual Lexicon Induction, Word Translation, Large Language Models, LLMs.
Cross Lingual Language models for making search engines for Holy Quran and Sahih Hadiths
This repository provides the official resources for EMNLP 2025 Paper Grounding Multilingual Multimodal LLMs With Cultural Knowledge
M-ABSA: A Multilingual Dataset for Aspect-Based Sentiment Analysis
Add a description, image, and links to the multilingual-nlp topic page so that developers can more easily learn about it.
To associate your repository with the multilingual-nlp topic, visit your repo's landing page and select "manage topics."