YAYI 2 是中科闻歌研发的新一代开源大语言模型，采用了超过 2 万亿 Tokens 的高质量、多语言语料进行预训练。(Repo for YaYi 2 Chinese LLMs)
-
Updated
Apr 7, 2024 - Python
#
pretrained-language-model
Here are 134 public repositories matching this topic...
Foundation Architecture for (M)LLMs
machine-learning natural-language-processing translation computer-vision transformer speech-processing multimodal pretrained-language-model
-
Updated
Apr 11, 2024 - Python
A curated list of pretrained sentence and word embedding models
nlp awesome natural-language word-embeddings awesome-list pretrained-models unsupervised-learning embedding-models language-model bert cross-lingual wordembedding sentence-embeddings pretrained-embedding sentence-representations contextualized-representation pretrained-language-model subword-models
-
Updated
Apr 23, 2021 - Python
An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks
natural-language-processing pretrained-language-model prompt-tuning p-tuning parameter-efficient-learning
-
Updated
Nov 16, 2023 - Python
A plug-and-play library for parameter-efficient-tuning (Delta Tuning)
-
Updated
Sep 19, 2024 - Python
Summarization Papers
-
Updated
Jul 15, 2023 - TeX
中文法律LLaMA (LLaMA for Chinese legel domain)
-
Updated
Aug 28, 2024 - Python
word2vec, sentence2vec, machine reading comprehension, dialog system, text classification, pretrained language model (i.e., XLNet, BERT, ELMo, GPT), sequence labeling, information retrieval, information extraction (i.e., entity, relation and event extraction), knowledge graph, text generation, network embedding
information-retrieval text-classification word2vec text-generation information-extraction knowledge-graph network-embedding sequence-labeling dialogue-systems sentence2vec machine-reading-comprehension pretrained-language-model
-
Updated
Jan 11, 2021 - OpenEdge ABL
Code associated with the Don't Stop Pretraining ACL 2020 paper
-
Updated
Nov 15, 2021 - Python
Live Training for Open-source Big Models
nlp natural-language-processing deep-learning natural-language-generation natural-language-understanding multi-task-learning pretrained-language-model parameter-efficient-learning
-
Updated
May 30, 2023 - Python
Papers and Datasets on Instruction Tuning and Following. ✨✨✨
prompt survey awesome-list datasets instruction paper-list pretrained-language-model in-context-learning large-language-models instruction-tuning instruction-learning
-
Updated
Apr 4, 2024 - Python
ACL'2023: DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models
text-generation bert diffusion-models pretrained-language-model conditional-generation unconditional-generation
-
Updated
Feb 17, 2024 - Python
MWPToolkit is an open-source framework for math word problem(MWP) solvers.
deep-learning pytorch sequence-to-sequence pretrained-language-model graph-to-tree sequence-to-tree math-word-problem
-
Updated
Sep 28, 2022 - Python
[NeurIPS 2023] This is the code for the paper `Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias`.
natural-language-processing text-classification zero-shot-learning pretrained-language-model training-data-generation attributed-text data-centric-ai large-language-models
-
Updated
Nov 2, 2023 - Python
EMNLP'23 survey: a curation of awesome papers and resources on refreshing large language models (LLMs) without expensive retraining.
nlp review natural-language-processing paper survey awesome-list continual-learning refreshing pretrained-language-model large-language-models llm llms knowledge-editing retrieval-augmented-generation update-llm
-
Updated
Dec 12, 2023
Worth-reading papers and related resources on attention mechanism, Transformer and pretrained language model (PLM) such as BERT. 值得一读的注意力机制、Transformer和预训练语言模型论文与相关资源集合
-
Updated
Mar 27, 2021
[ACM Computing Surveys 2025] This repository collects awesome survey, resource, and paper for Lifelong Learning with Large Language Models. (Updated Regularly)
incremental-learning lifelong-learning continual-learning pretrained-language-model large-language-models
-
Updated
Feb 4, 2025
[NeurIPS 2021] COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining
natural-language-processing deep-learning transformers representation-learning language-model natural-language-understanding pretraining pretrained-language-model contrastive-learning
-
Updated
Jul 25, 2023 - Python
The official code for "TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecasting (ICLR 2024)". TEMPO is one of the very first open source Time Series Foundation Models for forecasting task v1.0 version.
time-series transformers transformer forecasting gpt pretrained-models forecasting-models time-series-analysis pretrained-language-model forecasting-time-series transformers-models foundation-models
-
Updated
Feb 23, 2025 - Python
BERT4ETH: A Pre-trained Transformer for Ethereum Fraud Detection (WWW23)
ethereum blockchain transformer bert fraud-detection deanonymization phishing-detection pretrained-language-model www2023
-
Updated
Jun 21, 2024 - Python
Improve this page
Add a description, image, and links to the pretrained-language-model topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the pretrained-language-model topic, visit your repo's landing page and select "manage topics."