Bias Out-of-the-Box: An Empirical Analysis of Intersectional Occupational Biases in Popular Generative Language Models. - Hannah Rose Kirk; Yennie Jun; Filippo Volpin; Haider Iqbal; Elias Benussi; Frédéric A. Dreyer; Aleksandar Shtedritski; Yuki M. Asano (NeurIPS, 2021)

How True is GPT-2? An Empirical Analysis of Intersectional Occupational Biases. - Hannah Kirk; Yennie Jun; Haider Iqbal; Elias Benussi; Filippo Volpin; Frédéric A. Dreyer; Aleksandar Shtedritski; Yuki Markus Asano (CoRR, 2021)

Memes in the Wild: Assessing the Generalizability of the Hateful Memes Challenge Dataset. - Hannah Rose Kirk; Yennie Jun; Paulius Rauba; Gal Wachtel; Ruining Li; Xingjian Bai; Noah Broestl; Martin Doff-Sotta; Aleksandar Shtedritski; Yuki Markus Asano (CoRR, 2021)

Handling and Presenting Harmful Text in NLP Research. - Hannah Kirk; Abeba Birhane; Bertie Vidgen; Leon Derczynski (EMNLP (Findings), 2022)

A Prompt Array Keeps the Bias Away: Debiasing Vision-Language Models with Adversarial Learning. - Hugo Berg; Siobhan Mackenzie Hall; Yash Bhalgat; Hannah Kirk; Aleksandar Shtedritski; Max Bain (AACL/IJCNLP (1), 2022)

Hatemoji: A Test Suite and Adversarially-Generated Dataset for Benchmarking and Detecting Emoji-Based Hate. - Hannah Kirk; Bertie Vidgen; Paul Röttger; Tristan Thrush; Scott Hale (NAACL-HLT, 2022)

A Prompt Array Keeps the Bias Away: Debiasing Vision-Language Models with Adversarial Learning. - Hugo Berg; Siobhan Mackenzie Hall; Yash Bhalgat; Wonsuk Yang; Hannah Rose Kirk; Aleksandar Shtedritski; Max Bain (CoRR, 2022)

Handling and Presenting Harmful Text. - Leon Derczynski; Hannah Rose Kirk; Abeba Birhane; Bertie Vidgen (CoRR, 2022)

Looking for a Handsome Carpenter! Debiasing GPT-3 Job Advertisements. - Conrad Borchers; Dalia Sara Gala; Benjamin Gilburt; Eduard Oravkin; Wilfried Bounsi; Yuki M. Asano; Hannah Rose Kirk (CoRR, 2022)

Is More Data Better? Re-thinking the Importance of Efficiency in Abusive Language Detection with Transformers-Based Active Learning. - Hannah Rose Kirk; Bertie Vidgen; Scott A. Hale (CoRR, 2022)

The Past, Present and Better Future of Feedback Learning in Large Language Models for Subjective Human Preferences and Values. - Hannah Kirk; Andrew M. Bean; Bertie Vidgen; Paul Röttger; Scott Hale (EMNLP, 2023)

VisoGender: A dataset for benchmarking gender bias in image-text pronoun resolution. - Siobhan Mackenzie Hall; Fernanda Gonçalves Abrantes; Hanwen Zhu; Grace Sodunke; Aleksandar Shtedritski; Hannah Rose Kirk (NeurIPS, 2023)

DataPerf: Benchmarks for Data-Centric AI Development. - Mark Mazumder; Colby R. Banbury; Xiaozhe Yao; Bojan Karlas; William Gaviria Rojas; Sudnya Frederick Diamos; Greg Diamos; Lynn He; Alicia Parrish; Hannah Rose Kirk; Jessica Quaye; Charvi Rastogi; et al. (NeurIPS, 2023)

SemEval-2023 Task 10: Explainable Detection of Online Sexism. - Hannah Kirk; Wenjie Yin; Bertie Vidgen; Paul Röttger (SemEval@ACL, 2023)

Personalisation within bounds: A risk taxonomy and policy framework for the alignment of large language models with personalised feedback. - Hannah Rose Kirk; Bertie Vidgen; Paul Röttger; Scott A. Hale (CoRR, 2023)

Assessing Language Model Deployment with Risk Cards. - Leon Derczynski; Hannah Rose Kirk; Vidhisha Balachandran; Sachin Kumar 009; Yulia Tsvetkov; Mark R. Leiser; Saif Mohammad (CoRR, 2023)

Adversarial Nibbler: A Data-Centric Challenge for Improving the Safety of Text-to-Image Models. - Alicia Parrish; Hannah Rose Kirk; Jessica Quaye; Charvi Rastogi; Max Bartolo; Oana Inel; Juan Ciro; Rafael Mosquera; Addison Howard; Will Cukierski; D. Sculley; Vijay Janapa Reddi; et al. (CoRR, 2023)

Balancing the Picture: Debiasing Vision-Language Datasets with Synthetic Contrast Sets. - Brandon Smith; Miguel Farinha; Siobhan Mackenzie Hall; Hannah Rose Kirk; Aleksandar Shtedritski; Max Bain (CoRR, 2023)

DoDo Learning: DOmain-DemOgraphic Transfer in Language Models for Detecting Abuse Targeted at Public Figures. - Hannah Rose Kirk; Angus R. Williams; Liam Burke 001; Yi-Ling Chung; Ivan Debono; Pica Johansson; Francesca Stevens; Jonathan Bright; Scott A. Hale (CoRR, 2023)

Casteist but Not Racist? Quantifying Disparities in Large Language Model Bias between India and the West. - Khyati Khandelwal; Manuel Tonneau; Andrew M. Bean; Hannah Rose Kirk; Scott A. Hale (CoRR, 2023)

The Empty Signifier Problem: Towards Clearer Paradigms for Operationalising "Alignment" in Large Language Models. - Hannah Rose Kirk; Bertie Vidgen; Paul Röttger; Scott A. Hale (CoRR, 2023)

SimpleSafetyTests: a Test Suite for Identifying Critical Safety Risks in Large Language Models. - Bertie Vidgen; Hannah Rose Kirk; Rebecca Qian; Nino Scherrer; Anand Kannappan; Scott A. Hale; Paul Röttger (CoRR, 2023)

Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Models. - Paul Röttger; Valentin Hofmann; Valentina Pyatkin; Musashi Hinck; Hannah Kirk; Hinrich Schütze; Dirk Hovy (ACL (1), 2024)

Adversarial Nibbler: An Open Red-Teaming Method for Identifying Diverse Harms in Text-to-Image Generation. - Jessica Quaye; Alicia Parrish; Oana Inel; Charvi Rastogi; Hannah Rose Kirk; Minsuk Kahng; Erin van Liemt; Max Bartolo; Jess Tsang; Justin White; Nathan Clement; Rafael Mosquera; et al. (FAccT, 2024)

Indian-BhED: A Dataset for Measuring India-Centric Biases in Large Language Models. - Khyati Khandelwal; Manuel Tonneau; Andrew M. Bean; Hannah Rose Kirk; Scott A. Hale (GoodIT, 2024)

XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models. - Paul Röttger; Hannah Kirk; Bertie Vidgen; Giuseppe Attanasio; Federico Bianchi 001; Dirk Hovy (NAACL-HLT, 2024)

LINGOLY: A Benchmark of Olympiad-Level Linguistic Reasoning Puzzles in Low Resource and Extinct Languages. - Andrew M. Bean; Simi Hellsten; Harry Mayne; Jabez Magomere; Ethan Chi; Ryan Chi; Scott Hale; Hannah Rose Kirk (NeurIPS, 2024)

The PRISM Alignment Dataset: What Participatory, Representative and Individualised Human Feedback Reveals About the Subjective and Multicultural Alignment of Large Language Models. - Hannah Rose Kirk; Alexander Whitefield; Paul Röttger; Andrew M. Bean; Katerina Margatina; Rafael Mosquera Gómez; Juan Ciro; Max Bartolo; Adina Williams; He He 001; Bertie Vidgen; Scott Hale (NeurIPS, 2024)

Introducing v0.5 of the AI Safety Benchmark from MLCommons. - Bertie Vidgen; Adarsh Agrawal; Ahmed M. Ahmed 004; Victor Akinwande; Namir Al-Nuaimi; Najla Alfaraj; Elie Alhajjar; Lora Aroyo; Trupti Bavalatti; Borhane Blili-Hamelin; Kurt D. Bollacker; Rishi Bomassani; et al. (CoRR, 2024)

The PRISM Alignment Project: What Participatory, Representative and Individualised Human Feedback Reveals About the Subjective and Multicultural Alignment of Large Language Models. - Hannah Rose Kirk; Alexander Whitefield; Paul Röttger; Andrew M. Bean; Katerina Margatina; Juan Ciro; Rafael Mosquera; Max Bartolo; Adina Williams; He He 001; Bertie Vidgen; Scott A. Hale (CoRR, 2024)

Modulating Language Model Experiences through Frictions. - Katherine M. Collins; Valerie Chen; Ilia Sucholutsky; Hannah Rose Kirk; Malak Sadek; Holli Sargeant; Ameet Talwalkar; Adrian Weller; Umang Bhatt (CoRR, 2024)

The Future of Open Human Feedback. - Shachar Don-Yehiya; Ben Burtenshaw; Ramón Fernandez Astudillo; Cailean Osborne; Mimansa Jaiswal; Tzu-Sheng Kuo; Wenting Zhao; Idan Shenfeld; Andi Peng; Mikhail Yurochkin; Atoosa Kasirzadeh; Yangsibo Huang; et al. (CoRR, 2024)

Beyond the Binary: Capturing Diverse Preferences With Reward Regularization. - Vishakh Padmakumar; Chuanyang Jin; Hannah Rose Kirk; He He 001 (CoRR, 2024)

The benefits, risks and bounds of personalizing the alignment of large language models to individuals. - Hannah Rose Kirk; Bertie Vidgen; Paul Röttger; Scott A. Hale (Nat. Mac. Intell., 2024)

The AI community building the future? A quantitative analysis of development activity on Hugging Face Hub. - Cailean Osborne; Jennifer Ding; Hannah Rose Kirk (J. Comput. Soc. Sci., 2024)

Correction to: The AI community building the future? A quantitative analysis of development activity on Hugging Face Hub. - Cailean Osborne; Jennifer Ding; Hannah Rose Kirk (J. Comput. Soc. Sci., 2024)

Auditing large language models: a three-layered approach. - Jakob Mökander; Jonas Schuett; Hannah Rose Kirk; Luciano Floridi (AI Ethics, 2024)

Reward Model Interpretability via Optimal and Pessimal Tokens. - Brian Christian; Hannah Rose Kirk; Jessica A. F. Thompson; Christopher Summerfield; Tsvetomira Dumbalska (FAccT, 2025)

Why human-AI relationships need socioaffective alignment. - Hannah Rose Kirk; Iason Gabriel; Christopher Summerfield; Bertie Vidgen; Scott A. Hale (CoRR, 2025)

Multilingual != Multicultural: Evaluating Gaps Between Multilingual Capabilities and Cultural Alignment in LLMs. - Jonathan Rystrøm; Hannah Rose Kirk; Scott Hale (CoRR, 2025)

Clinical knowledge in LLMs does not translate to human interactions. - Andrew M. Bean; Rebecca Payne; Guy Parsons; Hannah Rose Kirk; Juan Ciro; Rafael Mosquera; Sara Hincapié Monsalve; Aruna S. Ekanayaka; Lionel Tarassenko; Luc Rocher; Adam Mahdi (CoRR, 2025)

Lessons from a Chimp: AI "Scheming" and the Quest for Ape Language. - Christopher Summerfield; Lennart Luettgau; Magda Dubois; Hannah Rose Kirk; Kobi Hackenburg; Catherine Fist; Katarina Slama; Nicola Ding; Rebecca Anselmetti; Andrew Strait; Mario Giulianelli; Cozmin Ududec (CoRR, 2025)