An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework. Website: https://swarms.ai

Fast inference engine for Transformer models

Flops counter for neural networks in pytorch framework

[NeurIPS‘2021] "TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Up", Yifan Jiang, Shiyu Chang, Zhangyang Wang

solo-learn: a library of self-supervised methods for visual representation learning powered by Pytorch Lightning

A curated list of foundation models for vision and language tasks

LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.

Universal Graph Transformer Self-Attention Networks (TheWebConf WWW 2022) (Pytorch and Tensorflow)

[VLDB'22] Anomaly Detection using Transformers, self-conditioning and adversarial training.

💭 Aspect-Based-Sentiment-Analysis: Transformer & Explainable ML (TensorFlow)

🌕 [BMVC 2022] You Only Need 90K Parameters to Adapt Light: A Light Weight Transformer for Image Enhancement and Exposure Correction. SOTA for low light enhancement, 0.004 seconds try this for pre-processing.

How to use our public wav2vec2 dimensional emotion model

FlashAttention (Metal Port)

Efficient Inference of Transformer models

Models to perform neural summarization (extractive and abstractive) using machine learning transformers and a tool to convert abstractive summarization datasets to the extractive task.

The official code repo of "HTS-AT: A Hierarchical Token-Semantic Audio Transformer for Sound Classification and Detection"

Based on the Pytorch-Transformers library by HuggingFace. To be used as a starting point for employing Transformer models in text classification tasks. Contains code to easily train BERT, XLNet, RoBERTa, and XLM models for text classification.

MinT: Minimal Transformer Library and Tutorials

Punctuation Restoration using Transformer Models for High-and Low-Resource Languages