v1.5.4
New features
Improvments
- Support of
register_full_backward_hook
(#720, #750) - Add hook function of
RMSNorm
(#755) - Numpy 2.0 support (#746)
Bug fixes
- Fix failing tests (#727, #739)
- Fix lint issues (#741, #760)
- Fix the norm calculation of bias under ghost clipping (#751)
- Fix 'to_standard_module' under ghost clipping (#754)
- Fix the return type of 'make_private' (#759)