Certifiable Safe RLHF: Fixed-Penalty Constraint Optimization for Safer Language Models. - Kartik Pandit; Sourav Ganguly; Arnesh Banerjee; Shaahin Angizi; Arnob Ghosh (CoRR, 2025)