Popular repositories Loading

1. backpack backpack Public

   BackPACK - a backpropagation package built on top of PyTorch which efficiently computes quantities other than the gradient.

   Python 614 57

2. cockpit cockpit Public

   Cockpit: A Practical Debugging Tool for Training Deep Neural Networks

   Python 489 20

3. unfoldNd unfoldNd Public

   (N=1,2,3)-dimensional unfold (im2col) and fold (col2im) in PyTorch

   Python 109 12

4. curvlinops curvlinops Public

   PyTorch linear operators for curvature matrices (Hessian, Fisher/GGN, KFAC, ...)

   Python 69 16

5. singd singd Public

   [ICML 2024] SINGD: KFAC-like Structured Inverse-Free Natural Gradient Descent (http://arxiv.org/abs/2312.05705)

   Python 24

6. hbp hbp Public

   Hessian backpropagation (HBP): PyTorch extension of backpropagation for block-diagonal curvature matrix approximations

   Python 22 2