AdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant Weights (ICLR 2021)
-
Updated
Jan 13, 2021 - Python
#
optimizer-algorithms
Here are 24 public repositories matching this topic...
🌹 Rose: Range-Of-Slice Equilibration PyTorch optimizer. Stateless optimization through range-normalized gradient updates.
machine-learning ai deep-learning transformers optimizer pytorch artificial-intelligence sgd gradient-descent gpt lora adam-optimizer fine-tuning diffusion-models pretraining optimizers optimizer-algorithms large-language-models llm
-
Updated
Apr 28, 2026 - Python
This project implements optimizers for TensorFlow and Keras, which can be used in the same way as Keras optimizers. Machine learning, Deep learning
machine-learning reinforcement-learning deep-learning tensorflow keras deep-reinforcement-learning optimizer machinelearning deeplearning optimizer-algorithms
-
Updated
Jun 19, 2026 - Python
Unofficial implementation of the Adan optimizer with Schedule-Free
-
Updated
Jul 8, 2024 - Python
NEAT (Nash-Equilibrium Adaptive Training) is a Keras first optimizer for conflict aware training, with an explicit NumPy reference engine, a small practical API, and optional native CPU acceleration.
-
Updated
Jul 21, 2026 - Python
AeroAttention is an innovative, quantum-enhanced attention mechanism designed for transformer models. It offers optimized memory usage and accelerated computations, enabling scalable and efficient training for advanced neural network architectures
-
Updated
Sep 28, 2025 - Python
AixrOptima is an artificial intelligence startup that speeds up the process process by integrating quantum circuits.
machine-learning quantum machine-learning-algorithms optimizer quantum-algorithms quantum-machine-learning artifical-neural-network artifical-intelligence optimizer-algorithms quantumalgorithms
-
Updated
Mar 19, 2025 - Python
Muon is an optimizer for hidden layers in neural networks
-
Updated
Jun 18, 2026 - Python
The Bird Species Classifier is an application built using a Convolutional Neural Network (CNN) to classify images of birds into one of 525 different species. It allows users to upload an image of a bird and receive a prediction of the bird species. Along with analysing the performance of various optimising algorithms.
-
Updated
Jun 28, 2024 - Jupyter Notebook
Learning about the algorithms used in machine learning, along with techniques for training and testing models.
python nlp html learning data-science gradient-descent backpropagation-learning-algorithm ia feature-engineering regression-models loss-functions metrics-visualization normalization-techniques optimizer-algorithms neuronal-networks preprocessing-data
-
Updated
May 10, 2025 - Jupyter Notebook
Deep learning on class
deep-learning tensorflow keras lstm convolutional-neural-network pooling-layers resnet50 fpt-university optimizer-algorithms
-
Updated
Sep 27, 2025 - Jupyter Notebook
Training the fully connected neural network (FCNN) using different optimizers for the backpropagation algorithm and compare the number of epochs that it takes for convergence along with their classification performance. Also building an autoencoder to obtain the hidden representation and use it for classification.
-
Updated
Jul 13, 2022 - Jupyter Notebook
COVID-19-Xray-Dataset Deep Learning using 3 models
deep-learning metrics tensorflow keras warnings cnn-model loss-functions imagedatagenerator optimizer-algorithms mobilenetv2-model resnet50-model
-
Updated
Oct 7, 2024 - Jupyter Notebook
Generating a TensorFlow model that predicts values in a sinewave
-
Updated
Dec 8, 2021 - Jupyter Notebook
A fast ML library for experimentation and training on consumer hardware
machine-learning configuration ml datasets language-model inference-server finetuning consumer-hardware pretraining optimizer-algorithms llm
-
Updated
Jun 16, 2026 - Python
A NumPy based Neural Network Package Implementation
python neural-network numpy optimizer derivatives loss-functions activation-functions optimizer-algorithms
-
Updated
Jun 22, 2022 - Python
Mandatory practice works (MPWs) for MSE module Deep Learning (Spring 2026)
deep-learning linear-regression optimizer cnn pytorch image-captioning computational-graphs data-augmentation error-analysis gradcam torchvision optimizer-algorithms wandb tuning-hyperparameters
-
Updated
Jun 10, 2026 - Jupyter Notebook
AdaRankGrad: Adaptive Gradient Rank and Moments for Memory-Efficient LLMs Training and Fine-Tuning
-
Updated
Apr 22, 2025 - Python
Experimented with and compared DFW neural network optimizer with SGD and ADAM on both vision and language tasks
pytorch densenet dfw cifar10 back-propagation wide-resnet bilstm infersent optimizer-algorithms deep-frank-wolfie
-
Updated
May 21, 2021 - Jupyter Notebook
Introduction to the Adam Optimizer with examples
-
Updated
Dec 21, 2022 - Jupyter Notebook
Improve this page
Add a description, image, and links to the optimizer-algorithms topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the optimizer-algorithms topic, visit your repo's landing page and select "manage topics."