MTEB: Massive Text Embedding Benchmark
-
Updated
Oct 24, 2024 - Jupyter Notebook
MTEB: Massive Text Embedding Benchmark
Crosslingual Generalization through Multitask Finetuning
Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
This repo supports various cross-lingual transfer learning & multilingual NLP models.
[EMNLP 2023] The Vault: A Comprehensive Multilingual Dataset for Advancing Code Understanding and Generation
This repository contains the code, data, and models of the paper titled "CrossSum: Beyond English-Centric Cross-Lingual Summarization for 1,500+ Language Pairs" published in Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL’23), July 9-14, 2023.
EMNLP 2023 Papers: Explore cutting-edge research from EMNLP 2023, the premier conference for advancing empirical methods in natural language processing. Stay updated on the latest in machine learning, deep learning, and natural language processing with code included. ⭐ support NLP!
Generate synthetic labeled data for extremely low-resource languages using bilingual lexicons.
Whisper is an automatic speech recognition (ASR) system trained on 680,000 hours of multilingual and multitask supervised data collected from the web. We show that the use of such a large and diverse dataset leads to improved robustness to accents, background noise and technical language. Moreover, it enables transcription in multiple languages, as
Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
On Bilingual Lexicon Induction with Large Language Models (EMNLP 2023). Keywords: Bilingual Lexicon Induction, Word Translation, Large Language Models, LLMs.
R library for Harmony
Self-Augmented In-Context Learning for Unsupervised Word Translation (ACL 2024). Keywords: Bilingual Lexicon Induction, Word Translation, Large Language Models, LLMs.
[EMNLP 2022] Discovering Language-neutral Sub-networks in Multilingual Language Models.
Data Repository for LexC-Gen: Generating Data for Extremely Low-Resource Languages with Large Language Models and Bilingual Lexicons
MultiSpider: Towards Benchmarking Multilingual Text-to-SQL Semantic Parsing
Solutions of the CMU Multilingual Natural Language Processing Course
IITK at SemEval Task 1: Semantic Textual Relatedness for African and Asian Languages
This project covers POS tagging using HMMs and neural networks (LSTM, BiLSTM) across multiple languages, and explores autocorrection methods with various n-gram models and error correction techniques.
MaLA-500: Massive Language Adaptation of Large Language Models
Add a description, image, and links to the multilingual-nlp topic page so that developers can more easily learn about it.
To associate your repository with the multilingual-nlp topic, visit your repo's landing page and select "manage topics."