autoclip.py update for ignite >=0.4.0 Nov 13, 2020 autoclip_tf.py tensorflow implementation of autoclip Nov 16, 2020 This repository accompanies thepaper: Prem Seetharaman, Gordon Wichern, Bryan Pardo, Jonathan Le Roux. "AutoClip: Adaptive Gradient Clipping for Source Separation Networks." ...
🚀 Feature See code here: https://github.com/pseeth/autoclip Motivation a simple method for automatically and adaptively choosing a gradient clipping threshold, based on the history of gradient norms observed during training. Experimental...