#

attention

Here are 1,304 public repositories matching this topic...

annotated_deep_learning_paper_implementations

labmlai / annotated_deep_learning_paper_implementations

🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

machine-learning reinforcement-learning deep-learning transformers pytorch transformer gan neural-networks literate-programming attention lora deep-learning-tutorial optimizers

Updated Nov 11, 2025
Python

ddbourgin / numpy-ml

Machine learning, in numpy

machine-learning reinforcement-learning word2vec lstm neural-networks gaussian-mixture-models vae topic-modeling attention resnet bayesian-inference wavenet mfcc knn gaussian-processes hidden-markov-models gradient-boosting wgan-gp good-turing-smoothing

Updated Oct 29, 2023
Python

graykode / nlp-tutorial

Natural Language Processing Tutorial for Deep Learning Researchers

nlp natural-language-processing tutorial tensorflow paper pytorch transformer attention bert

Updated Feb 21, 2024
Jupyter Notebook

xmu-xiaoma666 / External-Attention-pytorch

🍀 Pytorch implementation of various Attention Mechanisms, MLP, Re-parameter, Convolution, which is helpful to further understand papers.⭐⭐⭐

paper pytorch attention squeeze excitation-networks cbam linear-layers visual-tasks

Updated Dec 6, 2024
Python

jadore801120 / attention-is-all-you-need-pytorch

A PyTorch implementation of the Transformer model in "Attention is All You Need".

nlp natural-language-processing deep-learning pytorch attention attention-is-all-you-need

Updated Apr 16, 2024
Python

bentrevett / pytorch-seq2seq

Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.

Updated Jan 20, 2024
Jupyter Notebook

flashinfer-ai / flashinfer

FlashInfer: Kernel Library for LLM Serving

gpu cuda jit pytorch nvidia moe attention llm-inference large-large-models distributed-inference

Updated Dec 24, 2025
Cuda

hyunwoongko / transformer

Transformer: PyTorch Implementation of "Attention Is All You Need"

pytorch dataset transformer attention

Updated Jul 15, 2025
Python

km1994 / nlp_paper_study

该仓库主要记录 NLP 算法工程师相关的顶会论文研读笔记

attention bert gcn relation-extraction entity-recognition

Updated Aug 18, 2023
C++

google-research / scenic

Scenic: A Jax Library for Computer Vision Research and Beyond

research computer-vision deep-learning transformers attention jax vision-transformer

Updated Dec 19, 2025
Python

anseki / leader-line

Draw a leader line in your web page.

svg line arrow markup spotlight mouse leader attention highlight bubble

Updated Apr 11, 2025
JavaScript

thu-ml / SageAttention

[ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-to-end metrics across language, image, and video models.

cuda triton attention vit quantization video-generation mlsys inference-acceleration efficient-attention llm llm-infra video-generate

Updated Dec 22, 2025
Cuda

pytorch-GAT

gordicaleksa / pytorch-GAT

My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I've supported both Cora (transductive) and PPI (inductive) examples!

python deep-learning jupyter pytorch attention attention-mechanism graph-attention-networks self-attention pytorch-implementation gat graph-attention-network pytorch-gat gat-tutorial

Updated Nov 17, 2022
Jupyter Notebook

songyouwei / ABSA-PyTorch

Aspect Based Sentiment Analysis, PyTorch Implementations. 基于方面的情感分析，使用PyTorch实现。

nlp natural-language-processing sentiment-analysis attention bert sentiment-classification aspect-based-sentiment-analysis

Updated Jun 12, 2023
Python

mesolitica / NLP-Models-Tensorflow

Gathers machine learning and Tensorflow deep learning models for NLP problems, 1.13 < Tensorflow < 2.0

nlp machine-learning embedded deep-learning chatbot language-detection lstm summarization attention speech-to-text neural-machine-translation optical-character-recognition pos-tagging lstm-seq2seq-tf dnc-seq2seq luong-api

Updated Jul 20, 2020
Jupyter Notebook

argusswift / YOLOv4-pytorch

This is a pytorch repository of YOLOv4, attentive YOLOv4 and mobilenet YOLOv4 with PASCAL VOC and COCO

pytorch attention object-detection senet mobilenetv2 cbam mobilenetv3 yolov4

Updated May 3, 2024
Python

lucidrains / lambda-networks

Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute

computer-vision deep-learning artificial-intelligence attention attention-mechanism

Updated Nov 18, 2020
Python

szagoruyko / attention-transfer

Improving Convolutional Networks via Attention Transfer (ICLR 2017)

deep-learning pytorch attention knowledge-distillation

Updated Jul 11, 2018
Jupyter Notebook

dorarad / gansformer

Generative Adversarial Transformers

transformers attention image-generation gans generative-adversarial-networks compositionality scene-generation

Updated Jun 14, 2022
Python

lucidrains / transfusion-pytorch

Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-Modal Model", from MetaAI

deep-learning transformers artificial-intelligence attention multi-modal flow-matching

Updated Dec 4, 2025
Python

Improve this page

Add a description, image, and links to the attention topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the attention topic, visit your repo's landing page and select "manage topics."