On the Variance of the Adaptive Learning Rate and Beyond
-
Updated
Jul 31, 2021 - Python
#
adam
Here are 149 public repositories matching this topic...
Adam (or adm) is a coroutine-friendly Android Debug Bridge client written in Kotlin
android kotlin testing adb coroutines instrumentation testing-tools hacktoberfest adam adm ddmlib adblib
-
Updated
Feb 10, 2025 - Kotlin
Learning Rate Warmup in PyTorch
-
Updated
Jun 19, 2025 - Python
ADAM - A Question Answering System. Inspired from IBM Watson
python elasticsearch natural-language-processing wikipedia scikit-learn pandas spacy question-answering gensim adam spacy-extension
-
Updated
Feb 6, 2020 - Python
RAdam implemented in Keras & TensorFlow
-
Updated
Jan 22, 2022 - Python
Pytorch LSTM RNN for reinforcement learning to play Atari games from OpenAI Universe. We also use Google Deep Mind's Asynchronous Advantage Actor-Critic (A3C) Algorithm. This is much superior and efficient than DQN and obsoletes it. Can play on many games
python reinforcement-learning deep-reinforcement-learning openai-gym pytorch lstm reinforcement-learning-algorithms a3c universe adam rmsprop actor-critic asynchronous-advantage-actor-critic reinforcement-agents a3c-lstm
-
Updated
Sep 19, 2024 - Python
Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch
-
Updated
Oct 15, 2025 - Python
A Deep Learning and preprocessing framework in Rust with support for CPU and GPU.
rust machine-learning deep-learning gpu opencl cuda nn ml pipelines regression dropout sgd neural-networks classification data-analysis gpu-computing adam nalgebra
-
Updated
Oct 3, 2023 - Rust
A tour of different optimization algorithms in PyTorch.
-
Updated
Dec 11, 2021 - Jupyter Notebook
ADAS is short for Adaptive Step Size, it's an optimizer that unlike other optimizers that just normalize the derivative, it fine-tunes the step size, truly making step size scheduling obsolete, achieving state-of-the-art training performance
-
Updated
Jan 19, 2021 - C++
Easy-to-use AdaHessian optimizer (PyTorch)
-
Updated
Nov 12, 2020 - Python
Lion and Adam optimization comparison
-
Updated
Feb 23, 2023 - Jupyter Notebook
Easy-to-use linear and non-linear solver
wrapper newton cpp eigen pardiso suitesparse solvers nonlinear-optimization adam stochastic-gradient-descent linear-solvers linesearch hypre iterative-solvers amgcl lbfgs-optimizer
-
Updated
Jun 24, 2025 - C++
Toy implementations of some popular ML optimizers using Python/JAX
machine-learning momentum gradient-descent optimization-algorithms adam adam-optimizer jax optimizers
-
Updated
Jun 20, 2021 - Python
Deep learning projects including applications (face recognition, neural style transfer, autonomous driving, sign language reading, music generation, translation, speech recognition and NLP) and theories (CNNs, RNNs, LSTM, Adam, Dropout, BatchNorm, Xavier/He initialization, hyperparameter tuning, regularization, optimization, Residual Networks). …
natural-language-processing translation tensorflow keras cnn lstm dropout speech-recognition yolo rnn face-recognition regularization autonomous-driving music-generation residual-networks hyperparameter-tuning adam batchnorm neural-style-transfer xavier-he-initialization
-
Updated
Oct 3, 2018 - Jupyter Notebook
Partially Adaptive Momentum Estimation method in the paper "Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep Neural Networks" (accepted by IJCAI 2020)
-
Updated
Apr 13, 2023 - Python
Improve this page
Add a description, image, and links to the adam topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the adam topic, visit your repo's landing page and select "manage topics."