A curated list of papers of interesting empirical study and insight on deep learning. Continually updating...

skscope: Sparse-Constrained OPtimization via itErative-solvers

A Julia/JuMP-based Global Optimization Solver for Non-convex Programs

MoveIt kinematics_base plugin based on particle optimization & GA

A collection of Benchmark functions for numerical optimization problems

A generic optimization method for any integer programming problem

Awesome list for Neural Network Optimization methods.

Safe Pontryagin Differentiable Programming (Safe PDP) is a new theoretical and algorithmic safe differentiable framework to solve a broad class of safety-critical learning and control tasks.

Riemannian stochastic optimization algorithms: Version 1.0.3

Visualization of various deep learning optimization algorithms using PyTorch automatic differentiation and optimizers.

Simulation code for "Achievable Rate Maximization for Underlay Spectrum Sharing MIMO System with Intelligent Reflecting Surface," by V. Kumar, M. F. Flanagan, R. Zhang, and L. -N. Tran, IEEE Wireless Communications Letters, 2022, doi: 10.1109/LWC.2022.3180988.

Codes for the paper "Deep Neural Networks with Multi-Branch Architectures Are Less Non-Convex"

Numerical illustration of a novel analysis framework for consensus-based optimization (CBO) and numerical experiments demonstrating the practicability of the method

Simulation code for "On the Secrecy Rate under Statistical QoS Provisioning for RIS-assisted MISO Wiretap Channel," by V. Kumar, M. F. Flanagan, D. W. Kwan Ng, and L. -N. Tran, IEEE Global Communications Conference (GLOBECOM), 2021, pp. 1-6, doi: 10.1109/GLOBECOM46510.2021.9685957.

Every Call is Precious: Global Optimization of Black-Box Functions with Unknown Lipschitz Constants

Pyoneer is a Python 3 package for the continuous recovery of non-bandlimited periodic signals with finite rates of innovation (e.g. Dirac streams) from generalised measurements.

New Matrix Factorization Algorithms based on Bregman Proximal Gradient: BPG-MF, CoCaIn BPG-MF, BPG-MF-WB

an R package implementing the grid search optimization algorithm with a zoom

Semi-blind deconvolution for fMRI (BOLD signal)

Fast Inertial Algorithm for Phase Retrieval