Crowdsourcing Subjective Tasks: The Case Study of Understanding Toxicity in Online Discussions. - Lora Aroyo; Lucas Dixon; Nithum Thain; Olivia Redfield; Rachel Rosen (WWW (Companion Volume), 2019)

Whose Ground Truth? Accounting for Individual and Collective Identities Underlying Dataset Annotation. - Emily Denton; Mark Díaz; Ian Kivlichan; Vinodkumar Prabhakaran; Rachel Rosen (CoRR, 2021)

CrowdWorkSheets: Accounting for Individual and Collective Identities Underlying Crowdsourced Dataset Annotation. - Mark Díaz; Ian D. Kivlichan; Rachel Rosen; Dylan K. Baker; Razvan Amironesei; Vinodkumar Prabhakaran; Emily Denton (FAccT, 2022)

Is Your Toxicity My Toxicity? Exploring the Impact of Rater Identity on Toxicity Annotation. - Nitesh Goyal; Ian D. Kivlichan; Rachel Rosen; Lucy Vasserman (Proc. ACM Hum. Comput. Interact., 2022)