Abstract: Können wir Rankings vertrauen? Eine systematische Analyse biomedizinischer Challenges hinsichtlich Reporting und Design. - Matthias Eisenmann; Patrick Scholz 001; Marko Stankovic 002; Pierre Jannin; Christian Stock; Lena Maier-Hein (Bildverarbeitung für die Medizin, 2017)

How to Exploit Weaknesses in Biomedical Challenge Design and Organization. - Annika Reinke; Matthias Eisenmann; Sinan Onogur; Marko Stankovic 002; Patrick Scholz 001; Peter M. Full; Hrvoje Bogunovic; Bennett A. Landman; Oskar Maier; Bjoern H. Menze; Gregory C. Sharp; Korsuk Sirinukunwattana; et al. (MICCAI (4), 2018)

Is the winner really the best? A critical analysis of common research practice in biomedical image analysis competitions. - Lena Maier-Hein; Matthias Eisenmann; Annika Reinke; Sinan Onogur; Marko Stankovic 002; Patrick Scholz 001; Tal Arbel; Hrvoje Bogunovic; Andrew P. Bradley; Aaron Carass; Carolin Feldmann; Alejandro F. Frangi; et al. (CoRR, 2018)

Is the winner really the best? A critical analysis of common research practice in biomedical image analysis competitions. - Lena Maier-Hein; Matthias Eisenmann; Annika Reinke; Sinan Onogur; Marko Stankovic 002; Patrick Scholz 001; Peter M. Full (Zenodo, 2018)

Robust Medical Instrument Segmentation Challenge 2019. - Tobias Roß; Annika Reinke; Peter M. Full; Martin Wagner 001; Hannes Kenngott; Martin Apitz; Hellena Hempe; Diana Mîndroc-Filimon; Patrick Scholz 001; Thuy Nuong Tran; Pierangela Bruno; Pablo Arbeláez; et al. (CoRR, 2020)

Heidelberg Colorectal Data Set for Surgical Data Science in the Sensor Operating Room. - Lena Maier-Hein; Martin Wagner 001; Tobias Roß; Annika Reinke; Sebastian Bodenstedt; Peter M. Full; Hellena Hempe; Diana Mîndroc-Filimon; Patrick Scholz 001; Thuy Nuong Tran; Pierangela Bruno; Anna Kisilenko; et al. (CoRR, 2020)

Task Fingerprinting for Meta Learning inBiomedical Image Analysis. - Patrick Godau; Lena Maier-Hein (MICCAI (4), 2021)

Machine learning-based analysis of hyperspectral images for automated sepsis diagnosis. - Maximilian Dietrich; Silvia Seidlitz; Nicholas Schreck; Manuel Wiesenfarth; Patrick Godau; Minu Tizabi; Jan Sellner; Sebastian Marx; Samuel Knödler; Michael M. Allers; Leonardo Ayala; Karsten Schmidt 007; et al. (CoRR, 2021)

How can we learn (more) from challenges? A statistical approach to driving future algorithm development. - Tobias Roß; Pierangela Bruno; Annika Reinke; Manuel Wiesenfarth; Lisa Koeppel; Peter M. Full; Bünyamin Pekdemir; Patrick Godau; Darya Trofimova; Fabian Isensee; Sara Moccia; Francesco Calimeri; et al. (CoRR, 2021)

Task Fingerprinting for Meta Learning in Biomedical Image Analysis. - Patrick Godau; Lena Maier-Hein (CoRR, 2021)

Comparative validation of multi-instance instrument segmentation in endoscopy: Results of the ROBUST-MIS 2019 challenge. - Tobias Roß; Annika Reinke; Peter M. Full; Martin Wagner 001; Hannes Kenngott; Martin Apitz; Hellena Hempe; Diana Mîndroc-Filimon; Patrick Scholz 001; Thuy Nuong Tran; Pierangela Bruno; Pablo Arbeláez; et al. (Medical Image Anal., 2021)

Abstract: Task Fingerprinting for Meta Learning in Biomedical Image Analysis. - Patrick Godau; Lena Maier-Hein (Bildverarbeitung für die Medizin, 2022)

Heterogeneous Model Ensemble For Automatic Polyp Segmentation In Endoscopic Video Sequences. - Thuy Nuong Tran; Fabian Isensee; Lars Krämer; Amine Yamlahi; Tim Adler; Patrick Godau; Minu Tizabi; Lena Maier-Hein (EndoCV@ISBI, 2022)

Heterogeneous Model Ensemble For Automatic Polyp Detection and Tracking In Colonoscopy. - Amine Yamlahi; Patrick Godau; Thuy Nuong Tran; Lucas-Raphael Muller; Tim Adler; Minu Tizabi; Michael Baumgartner 001; Paul Jäger 002; Lena Maier-Hein (EndoCV@ISBI, 2022)

Metrics reloaded: Pitfalls and recommendations for image analysis validation. - Lena Maier-Hein; Annika Reinke; Evangelia Christodoulou; Ben Glocker; Patrick Godau; Fabian Isensee; Jens Kleesiek; Michal Kozubek 001; Mauricio Reyes 001; Michael A. Riegler; Manuel Wiesenfarth; Michael Baumgartner 001; et al. (CoRR, 2022)

Biomedical image analysis competitions: The state of current participation practice. - Matthias Eisenmann; Annika Reinke; Vivienn Weru; Minu Dietlinde Tizabi; Fabian Isensee; Tim J. Adler; Patrick Godau; Veronika Cheplygina; Michal Kozubek 001; Sharib Ali; Anubha Gupta; Jan Kybic; et al. (CoRR, 2022)

Why is the Winner the Best? - Matthias Eisenmann; Annika Reinke; Vivienn Weru; Minu Dietlinde Tizabi; Fabian Isensee; Tim J. Adler; Sharib Ali; Vincent Andrearczyk; Marc Aubreville; Ujjwal Baid; Spyridon Bakas; Niranjan Balu; et al. (CVPR, 2023)

Deployment of Image Analysis Algorithms Under Prevalence Shifts. - Patrick Godau; Piotr Kalinowski; Evangelia Christodoulou; Annika Reinke; Minu Tizabi; Luciana Ferrer; Paul F. Jäger; Lena Maier-Hein (MICCAI (3), 2023)

Self-distillation for Surgical Action Recognition. - Amine Yamlahi; Thuy Nuong Tran; Patrick Godau; Melanie Schellenberg; Dominik Michael; Finn-Henri Smidt; Jan-Hinrich Nölke; Tim J. Adler; Minu Dietlinde Tizabi; Chinedu Innocent Nwoye; Nicolas Padoy; Lena Maier-Hein (MICCAI (9), 2023)

Understanding metric-related pitfalls in image analysis validation. - Annika Reinke; Minu Tizabi; Michael Baumgartner 001; Matthias Eisenmann; Doreen Heckmann-Nötzel; A. Emre Kavur; Tim Rädsch; Carole H. Sudre; Laura Ación; Michela Antonelli; Tal Arbel; Spyridon Bakas; et al. (CoRR, 2023)

Why is the winner the best? - Matthias Eisenmann; Annika Reinke; Vivienn Weru; Minu Dietlinde Tizabi; Fabian Isensee; Tim J. Adler; Sharib Ali; Vincent Andrearczyk; Marc Aubreville; Ujjwal Baid; Spyridon Bakas; Niranjan Balu; et al. (CoRR, 2023)

Beyond rankings: Learning (more) from algorithm validation. - Tobias Roß; Pierangela Bruno; Annika Reinke; Manuel Wiesenfarth; Lisa Koeppel; Peter M. Full; Bünyamin Pekdemir; Patrick Godau; Darya Trofimova; Fabian Isensee; Tim J. Adler; Thuy Nuong Tran; et al. (Medical Image Anal., 2023)

Sources of performance variability in deep learning-based polyp detection. - Thuy Nuong Tran; Tim J. Adler; Amine Yamlahi; Evangelia Christodoulou; Patrick Godau; Annika Reinke; Minu Dietlinde Tizabi; Peter Sauer; Tillmann Persicke; Jörg Gerhard Albert; Lena Maier-Hein (Int. J. Comput. Assist. Radiol. Surg., 2023)

CholecTriplet2022: Show me a tool and tell me the triplet - An endoscopic vision challenge for surgical action triplet detection. - Chinedu Innocent Nwoye; Tong Yu 009; Saurav Sharma; Aditya Murali; Deepak Alapatt; Armine Vardazaryan; Kun Yuan 004; Jonas Hajek; Wolfgang Reiter; Amine Yamlahi; Finn-Henri Smidt; Xiaoyang Zou; et al. (Medical Image Anal., 2023)

PitVis-2023 Challenge: Workflow Recognition in videos of Endoscopic Pituitary Surgery. - Adrito Das; Danyal Z. Khan; Dimitrios Psychogyios; Yitong Zhang; John G. Hanrahan; Francisco Vasconcelos 001; You Pang; Zhen Chen 018; Jinlin Wu; Xiaoyang Zou; Guoyan Zheng; Abdul Qayyum; et al. (CoRR, 2024)

Beyond Knowledge Silos: Task Fingerprinting for Democratization of Medical Imaging AI. - Patrick Godau; Akriti Srivastava; Tim Adler; Lena Maier-Hein (CoRR, 2024)

PitVis-2023 challenge: Workflow recognition in videos of endoscopic pituitary surgery. - Adrito Das; Danyal Z. Khan; Dimitrios Psychogyios; Yitong Zhang; John G. Hanrahan; Francisco Vasconcelos 001; You Pang; Zhen Chen 018; Jinlin Wu; Xiaoyang Zou; Guoyan Zheng; Abdul Qayyum; et al. (Medical Image Anal., 2025)

Navigating prevalence shifts in image analysis algorithm deployment. - Patrick Godau; Piotr Kalinowski; Evangelia Christodoulou; Annika Reinke; Minu Tizabi; Luciana Ferrer; Paul Jäger 002; Lena Maier-Hein (Medical Image Anal., 2025)

False Promises in Medical Imaging AI? Assessing Validity of Outperformance Claims. - Evangelia Christodoulou; Annika Reinke; Pascaline Andrè; Patrick Godau; Piotr Kalinowski; Rola Houhou; Selen Erkan; Carole H. Sudre; Ninon Burgos; Sofiène Boutaj; Sophie Loizillon; Maëlys Solal; et al. (CoRR, 2025)

Challenging Vision-Language Models with Surgical Data: A New Dataset and Broad Benchmarking Study. - Leon D. Mayer; Tim Rädsch; Dominik Michael; Lucas Luttner; Amine Yamlahi; Evangelia Christodoulou; Patrick Godau; Marcel Knopp; Annika Reinke; Fiona R. Kolbinger; Lena Maier-Hein (CoRR, 2025)

Benchmarking and Evaluation of AI Models in Biology: Outcomes and Recommendations from the CZI Virtual Cells Workshop. - Elizabeth Fahsbender; Alma Andersson; Jeremy Ash; Polina Binder; Daniel Burkhardt; Benjamin Chang 009; Georg K. Gerber; Anthony Gitter; Patrick Godau; Ankit Gupta; Genevieve Haliburton; Siyu He; et al. (CoRR, 2025)