Paul Röttger

According to our database, Paul Röttger authored at least 20 papers between 2021 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Improving Adversarial Data Collection by Supporting Annotators: Lessons from GAHD, a German Hate Speech Dataset.

Janis Goldzycher, Paul Röttger, Gerold Schneider

CoRR, 2024

Evaluating the Elementary Multilingual Capabilities of Large Language Models with MultiQ.

Carolin Holtermann, Paul Röttger, Timm Dill, Anne Lauscher

CoRR, 2024

Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Models.

Paul Röttger, Valentin Hofmann, Valentina Pyatkin, Musashi Hinck, Hannah Rose Kirk, Hinrich Schütze, Dirk Hovy

CoRR, 2024

"My Answer is C": First-Token Probabilities Do Not Match Text Answers in Instruction-Tuned Language Models.

Xinpeng Wang, Bolei Ma, Chengzhi Hu, Leon Weber-Genzel, Paul Röttger, Frauke Kreuter, Dirk Hovy, Barbara Plank

CoRR, 2024

2023

SimpleSafetyTests: a Test Suite for Identifying Critical Safety Risks in Large Language Models.

Bertie Vidgen, Hannah Rose Kirk, Rebecca Qian, Nino Scherrer, Anand Kannappan, Scott A. Hale, Paul Röttger

CoRR, 2023

The Empty Signifier Problem: Towards Clearer Paradigms for Operationalising "Alignment" in Large Language Models.

Hannah Rose Kirk, Bertie Vidgen, Paul Röttger, Scott A. Hale

CoRR, 2023

Safety-Tuned LLaMAs: Lessons From Improving the Safety of Large Language Models that Follow Instructions.

Federico Bianchi, Mirac Suzgun, Giuseppe Attanasio, Paul Röttger, Dan Jurafsky, Tatsunori Hashimoto, James Zou

CoRR, 2023

XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models.

Paul Röttger, Hannah Rose Kirk, Bertie Vidgen, Giuseppe Attanasio, Federico Bianchi, Dirk Hovy

CoRR, 2023

The Ecological Fallacy in Annotation: Modelling Human Label Variation goes beyond Sociodemographics.

Matthias Orlikowski, Paul Röttger, Philipp Cimiano, Dirk Hovy

CoRR, 2023

Personalisation within bounds: A risk taxonomy and policy framework for the alignment of large language models with personalised feedback.

Hannah Rose Kirk, Bertie Vidgen, Paul Röttger, Scott A. Hale

CoRR, 2023

SemEval-2023 Task 10: Explainable Detection of Online Sexism.

Hannah Kirk, Wenjie Yin, Bertie Vidgen, Paul Röttger

Proceedings of the The 17th International Workshop on Semantic Evaluation, 2023

The Past, Present and Better Future of Feedback Learning in Large Language Models for Subjective Human Preferences and Values.

Hannah Kirk, Andrew M. Bean, Bertie Vidgen, Paul Röttger, Scott A. Hale

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

The Ecological Fallacy in Annotation: Modeling Human Label Variation goes beyond Sociodemographics.

Matthias Orlikowski, Paul Röttger, Philipp Cimiano, Dirk Hovy

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2023

Improving the Detection of Multilingual Online Attacks with Rich Social Media Data from Singapore.

Janosch Haber, Bertie Vidgen, Matthew Chapman, Vibhor Agarwal, Roy Ka-Wei Lee, Yong Keong Yap, Paul Röttger

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

2022

Multilingual HateCheck: Functional Tests for Multilingual Hate Speech Detection Models.

Paul Röttger, Haitham Seelawi, Debora Nozza, Zeerak Talat, Bertie Vidgen

CoRR, 2022

Two Contrasting Data Annotation Paradigms for Subjective NLP Tasks.

Paul Röttger, Bertie Vidgen, Dirk Hovy, Janet B. Pierrehumbert

Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022

Hatemoji: A Test Suite and Adversarially-Generated Dataset for Benchmarking and Detecting Emoji-Based Hate.

Hannah Kirk, Bertie Vidgen, Paul Röttger, Tristan Thrush, Scott A. Hale

Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022

Data-Efficient Strategies for Expanding Hate Speech Detection into Under-Resourced Languages.

Paul Röttger, Debora Nozza, Federico Bianchi, Dirk Hovy

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

2021

Temporal Adaptation of BERT and Performance on Downstream Document Classification: Insights from Social Media.

Paul Röttger, Janet B. Pierrehumbert

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2021, 2021

HateCheck: Functional Tests for Hate Speech Detection Models.

Paul Röttger, Bertie Vidgen, Dong Nguyen, Zeerak Waseem, Helen Z. Margetts, Janet B. Pierrehumbert

Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021