Zephyr: Direct Distillation of LM Alignment. - Lewis Tunstall; Edward Beeching; Nathan Lambert 001; Nazneen Rajani; Kashif Rasul; Younes Belkada; Shengyi Huang; Leandro von Werra; Clémentine Fourrier; Nathan Habib; Nathan Sarrazin; Omar Sanseviero; et al. (CoRR, 2023)