Norm matters: efficient and accurate normalization schemes in deep networks. - Elad Hoffer; Ron Banner; Itay Golan; Daniel Soudry (NeurIPS, 2018)

Bayesian Gradient Descent: Online Variational Bayes Learning with Increased Robustness to Catastrophic Forgetting and Weight Pruning. - Chen Zeno; Itay Golan; Elad Hoffer; Daniel Soudry (CoRR, 2018)

Kernel and Rich Regimes in Overparametrized Models. - Blake E. Woodworth; Suriya Gunasekar; Jason D. Lee; Edward Moroshko; Pedro Savarese; Itay Golan; Daniel Soudry; Nathan Srebro (COLT, 2020)

Task-Agnostic Continual Learning Using Online Variational Bayes With Fixed-Point Updates. - Chen Zeno; Itay Golan; Elad Hoffer; Daniel Soudry (Neural Comput., 2021)