Popular repositories Loading

1. IMoE IMoE Public

   Pytorch official implementation of IMoE: Indefinacy Mixture of Experts. IMoE dynamically selects neurons. This implementation replicates the neurons which is dynamically changing synapses and enabl…

   Python 4

2. Stable-Static-Embedding-Models Stable-Static-Embedding-Models Public

   SSE (Stable Static Embedding): Unlocking the Potential of Static Embeddings, A Dynamic Tanh Normalization Approach without Speed Penalty

   Python 4

3. Liquid_Time_nanochat Liquid_Time_nanochat Public

   Forked from karpathy/nanochat

   The best ChatGPT that $80 can buy. reducing training time by more than 30 minutes and lowering computational costs by over $10. Original Faster Nanochat: SEA Model Series Op.0: Saint Iberis.

   Python 3 1

4. Nova-Nox-Neural-Network Nova-Nox-Neural-Network Public

   N4: Nova Nox Neural Network official pytorch implementation. A simplified Selective copying mechanism + Attention mechanism.

   Python 2

5. Accelerated_Hadamard Accelerated_Hadamard Public

   AHT: Accelerated Hadamard Transform optimized for GPU. Original implementation for the models using hadamard transformation such as BitNet v2

   Python 2

6. Liquid_Time_nanochat_jp Liquid_Time_nanochat_jp Public

   Repository for creating a bilingual English-Japanese nanochat. The best ChatGPT that $100 can buy.

   Python 2