A harness optimized to smaller LLMs

Running any GGUF SLMs/LLMs locally, on-device in Android

Active Learning for Text Classification in Python

Local LLM Powered Recursive Search & Smart Knowledge Explorer

Survey of Small Language Models from Penn State, ...

Doge Family of Small Language Models

[ICML 2026] effGen: Enabling Small Language Models as Capable Autonomous Agents

"Generative AI in Action" book's code repository

[𝗜𝗖𝗠𝗟 𝟮𝟬𝟮𝟲] Dispersion loss counteracts embedding condensation and improves generalization in small language models

Small Language Model Inference, Fine-Tuning and Observability.

Repository for the companion Colab notebook of the Domain-Specific Small Language Models book.

This Repository provides a Jupyter Notebook for building a small language model from scratch using 'TinyStories' dataset. Covers data preprocessing, BPE tokenization, binary storage, GPU memory management, and training a Transformer in PyTorch. Generate sample stories to test your model. Ideal for learning NLP and PyTorch.

Wonderful Matrices to Build Small Language Models

Remma-O1: An open-source Language Model with 1.17B Params, built on pytorch from scratch. Work in Progress!!! Open for collaboration.

A governed local AI build-and-memory system that trains small brains, compares them, protects the better one, archives the worse one, and preserves the evidence of why. v1.0.0/governed-v2.2.0+

xLM is a modular, research-friendly framework for developing and comparing non-autoregressive language models. Built on PyTorch and PyTorch Lightning, with Hydra for configuration management, XLM makes it effortless to experiment with cutting-edge NAR LM architectures.

Dataset Generation Code for SimpleStories

Ollama RAG using SQL Database

An open-source agent harness that makes small models do big work.

An HF's Smolagent to automate molecular dynamics simulations using GROMACS.