BAM! Just Like That: Simple and Efficient Parameter Upcycling for Mixture of Experts. - Qizhen (Irene) Zhang; Nikolas Gritsch; Dwaraknath Gnaneshwar; Simon Guo 003; David Cairuz; Bharat Venkitesh; Jakob N. Foerster; Phil Blunsom; Sebastian Ruder; Ahmet Üstün; Acyr Locatelli (NeurIPS, 2024)