Ben Carterette

Orcid: 0000-0001-9538-047X

Affiliations:
  • Spotify, Wilmington, USA
  • University of Delaware, Newark, DE, USA (former)


According to our database1, Ben Carterette authored at least 151 papers between 2005 and 2024.

Collaborative distances:

Timeline

Legend:

Book 
In proceedings 
Article 
PhD thesis 
Dataset
Other 

Links

Online presence:

On csauthors.net:

Bibliography

2024
Distributionally-Informed Recommender System Evaluation.
Trans. Recomm. Syst., March, 2024

ForTune: Running Offline Scenarios to Estimate Impact on Business Metrics.
CoRR, 2024

2023
Report on the Dagstuhl Seminar on Frontiers of Information Access Experimentation for Research and Education.
SIGIR Forum, June, 2023

Frontiers of Information Access Experimentation for Research and Education (Dagstuhl Seminar 23031).
Dagstuhl Reports, January, 2023

Report from Dagstuhl Seminar 23031: Frontiers of Information Access Experimentation for Research and Education.
CoRR, 2023

Calibrated Recommendations as a Minimum-Cost Flow Problem.
Proceedings of the Sixteenth ACM International Conference on Web Search and Data Mining, 2023

A is for Adele: An Offline Evaluation Metric for Instant Search.
Proceedings of the 2023 ACM SIGIR International Conference on Theory of Information Retrieval, 2023

Graph Learning for Exploratory Query Suggestions in an Instant Search System.
Proceedings of the 32nd ACM International Conference on Information and Knowledge Management, 2023

2022
Report on the 1st Workshop on Audio Collection Human Interaction (AudioCHI 2022) at CHIIR 2022.
SIGIR Forum, June, 2022

Chair's Letter.
SIGIR Forum, June, 2022

Choice of Implicit Signal Matters: Accounting for User Aspirations in Podcast Recommendations.
Proceedings of the WWW '22: The ACM Web Conference 2022, Virtual Event, Lyon, France, April 25, 2022

Using Survival Models to Estimate User Engagement in Online Experiments.
Proceedings of the WWW '22: The ACM Web Conference 2022, Virtual Event, Lyon, France, April 25, 2022

Variational User Modeling with Slow and Fast Features.
Proceedings of the WSDM '22: The Fifteenth ACM International Conference on Web Search and Data Mining, Virtual Event / Tempe, AZ, USA, February 21, 2022

CHIIR Workshop on Audio Collection Human Interaction (AudioCHI 2022): http: //speechretrievalworkshop.github.io.
Proceedings of the CHIIR '22: ACM SIGIR Conference on Human Information Interaction and Retrieval, Regensburg, Germany, March 14, 2022

2021
How Am I Doing?: Evaluating Conversational Search Systems Offline.
ACM Trans. Inf. Syst., 2021

Podcast Metadata and Content: Episode Relevance andAttractiveness in Ad Hoc Search.
CoRR, 2021

Estimation of Fair Ranking Metrics with Incomplete Judgments.
Proceedings of the WWW '21: The Web Conference 2021, 2021

Target-aware Aggregate Diversification in Recommendation.
Proceedings of the Adjunct Publication of the 29th ACM Conference on User Modeling, 2021

TREC 2021 Podcasts Track Overview.
Proceedings of the Thirtieth Text REtrieval Conference, 2021

Current Challenges and Future Directions in Podcast Information Access.
Proceedings of the SIGIR '21: The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2021

Podcast Metadata and Content: Episode Relevance and Attractiveness in Ad Hoc Search.
Proceedings of the SIGIR '21: The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2021

Neural Instant Search for Music and Podcast.
Proceedings of the KDD '21: The 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 2021

Leveraging Semantic Information to Facilitate the Discovery of Underserved Podcasts.
Proceedings of the CIKM '21: The 30th ACM International Conference on Information and Knowledge Management, Virtual Event, Queensland, Australia, November 1, 2021

2020
Report on the 2nd ACM SIGIR/SIGKDD Africa school on machine learning for data mining and search.
SIGIR Forum, 2020

A Topological Method for Comparing Document Semantics.
CoRR, 2020

Trajectory Based Podcast Recommendation.
CoRR, 2020

Methods for Individual Treatment Assignment: An Application and Comparison for Playlist Generation.
CoRR, 2020

The Spotify Podcasts Dataset.
CoRR, 2020

Leveraging Behavioral Heterogeneity Across Markets for Cross-Market Training of Recommender Systems.
Proceedings of the Companion of The 2020 Web Conference 2020, 2020

Do podcasts and music compete with one another? Understanding users' audio streaming habits.
Proceedings of the WWW '20: The Web Conference 2020, Taipei, Taiwan, April 20-24, 2020, 2020

TREC 2020 Podcasts Track Overview.
Proceedings of the Twenty-Ninth Text REtrieval Conference, 2020

Recommending Podcasts for Cold-Start Users Based on Music Listening and Taste.
Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval, 2020

Bayesian Inferential Risk Evaluation On Multiple IR Systems.
Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval, 2020

The Engagement-Diversity Connection: Evidence from a Field Experiment on Spotify.
Proceedings of the EC '20: The 21st ACM Conference on Economics and Computation, 2020

Investigating Listeners' Responses to Divergent Recommendations.
Proceedings of the RecSys 2020: Fourteenth ACM Conference on Recommender Systems, 2020

Model Selection for Production System via Automated Online Experiments.
Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

Advances in Recommender Systems: From Multi-stakeholder Marketplaces to Automated RecSys.
Proceedings of the KDD '20: The 26th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 2020

Counterfactual Evaluation of Slate Recommendations with Sequential Reward Interactions.
Proceedings of the KDD '20: The 26th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 2020

100, 000 Podcasts: A Spoken English Document Corpus.
Proceedings of the 28th International Conference on Computational Linguistics, 2020

Evaluating Stochastic Rankings with Expected Exposure.
Proceedings of the CIKM '20: The 29th ACM International Conference on Information and Knowledge Management, 2020

2019
Report on the 1st ACM SIGIR/SIGKDD Africa School on Machine Learning for Data Mining and Search.
SIGIR Forum, 2019

Offline Evaluation to Make Decisions About PlaylistRecommendation Algorithms.
Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining, 2019

Recommendations in a marketplace.
Proceedings of the 13th ACM Conference on Recommender Systems, 2019

From a User Model for Query Sessions to Session Rank Biased Precision (sRBP).
Proceedings of the 2019 ACM SIGIR International Conference on Theory of Information Retrieval, 2019

Statistical Significance Testing in Theory and in Practice.
Proceedings of the 2019 ACM SIGIR International Conference on Theory of Information Retrieval, 2019

Taking Risks with Confidence.
Proceedings of the 24th Australasian Document Computing Symposium, 2019

2018
Test Collection.
Proceedings of the Encyclopedia of Database Systems, Second Edition, 2018

Search Engine Metrics.
Proceedings of the Encyclopedia of Database Systems, Second Edition, 2018

Precision and Recall.
Proceedings of the Encyclopedia of Database Systems, Second Edition, 2018

Offline Comparative Evaluation with Incremental, Minimally-Invasive Online Feedback.
Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, 2018

Mixed methods for evaluating user satisfaction.
Proceedings of the 12th ACM Conference on Recommender Systems, 2018

Estimating Clickthrough Bias in the Cascade Model.
Proceedings of the 27th ACM International Conference on Information and Knowledge Management, 2018

Improving medical search tasks using learning to rank.
Proceedings of the 2018 IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology, 2018

2017
TREC 2017 Tasks Track Overview.
Proceedings of The Twenty-Sixth Text REtrieval Conference, 2017

But Is It Statistically Significant?: Statistical Significance in IR Research, 1995-2014.
Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2017

Learning to Rate Clinical Concepts Using Simulated Clinician Feedback.
Proceedings of the 22nd International Conference on Intelligent User Interfaces, 2017

User Click Detection in Ideal Sessions.
Proceedings of the 2017 Conference on Conference Human Information Interaction and Retrieval, 2017

2016
Information retrieval evaluation using test collections.
Inf. Retr. J., 2016

Fusing Search Results from Possible Alternative Queries.
Proceedings of the 2016 IEEE/WIC/ACM International Conference on Web Intelligence, 2016

Overview of the TREC Tasks Track 2016.
Proceedings of The Twenty-Fifth Text REtrieval Conference, 2016

Evaluating Retrieval over Sessions: The TREC Session Track 2011-2014.
Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval, 2016

PDF: A Probabilistic Data Fusion Framework for Retrieval and Ranking.
Proceedings of the 2016 ACM on International Conference on the Theory of Information Retrieval, 2016

Generating Pseudo Search History Data in the Absence of Real Search History.
Proceedings of the Database and Expert Systems Applications, 2016

Learning to predict the performance of clinical queries using an integrated approach.
Proceedings of the IEEE International Conference on Bioinformatics and Biomedicine, 2016

Improving clinical case search using semantic based query reformulations.
Proceedings of the IEEE International Conference on Bioinformatics and Biomedicine, 2016

Reformulate or Quit: Predicting User Abandonment in Ideal Sessions.
Proceedings of the Information Retrieval Technology, 2016

2015
Overview of the TREC 2015 Tasks Track.
Proceedings of The Twenty-Fourth Text REtrieval Conference, 2015

The Best Published Result is Random: Sequential Testing and its Effect on Reported Effectiveness.
Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2015

Document Comprehensiveness and User Preferences in Novelty Search Tasks.
Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2015

Dynamic Test Collections for Retrieval Evaluation.
Proceedings of the 2015 International Conference on The Theory of Information Retrieval, 2015

Bayesian Inference for Information Retrieval Evaluation.
Proceedings of the 2015 International Conference on The Theory of Information Retrieval, 2015

Learning User Preferences for Topically Similar Documents.
Proceedings of the 24th ACM International Conference on Information and Knowledge Management, 2015

Improving Ranking and Robustness of Search Systems by Exploiting the Popularity of Documents.
Proceedings of the Information Retrieval Technology, 2015

2014
Using large clinical corpora for query expansion in text-based cohort identification.
J. Biomed. Informatics, 2014

Integrating information retrieval with distant supervision for Gene Ontology annotation.
Database J. Biol. Databases Curation, 2014

Overview of the TREC 2014 Session Track.
Proceedings of The Twenty-Third Text REtrieval Conference, 2014

University of Delaware at TREC 2014.
Proceedings of The Twenty-Third Text REtrieval Conference, 2014

Statistical significance testing in information retrieval: theory and practice.
Proceedings of the 37th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2014

Udel @ NTCIR-11 MobileClick Track.
Proceedings of the 11th NTCIR Conference on Evaluation of Information Access Technologies, 2014

Udel @ NTCIR-11 IMine Track.
Proceedings of the 11th NTCIR Conference on Evaluation of Information Access Technologies, 2014

Aggregating Results from Multiple Related Queries to Improve Web Search over Sessions.
Proceedings of the Information Retrieval Technology, 2014

2013
An overview of the BioCreative 2012 Workshop Track III: interactive text mining task.
Database J. Biol. Databases Curation, 2013

Overview of the TREC 2013 Session Track.
Proceedings of The Twenty-Second Text REtrieval Conference, 2013

MayoClinicNLP-CORE: Semantic representations for textual similarity.
Proceedings of the Second Joint Conference on Lexical and Computational Semantics, 2013

An adaptive evidence weighting method for medical record search.
Proceedings of the 36th International ACM SIGIR conference on research and development in Information Retrieval, 2013

Document features predicting assessor disagreement.
Proceedings of the 36th International ACM SIGIR conference on research and development in Information Retrieval, 2013

Preference based evaluation measures for novelty and diversity.
Proceedings of the 36th International ACM SIGIR conference on research and development in Information Retrieval, 2013

Time Based Feedback and Query Expansion for Twitter Search.
Proceedings of the Advances in Information Retrieval, 2013

Using Discharge Summaries to Improve Information Retrieval in Clinical Domain.
Proceedings of the Working Notes for CLEF 2013 Conference , 2013

An Incremental Approach for MEDLINE MeSH Indexing.
Proceedings of the first Workshop on Bio-Medical Semantic Indexing and Question Answering, 2013

Joint search in text and concept spaces for EMR-based cohort identification.
Proceedings of the 2013 IEEE International Conference on Bioinformatics and Biomedicine, 2013

2012
Multiple testing in statistical analysis of systems-based information retrieval experiments.
ACM Trans. Inf. Syst., 2012

Exploring Evidence Aggregation Methods and External Expansion Sources for Medical Record Search.
Proceedings of The Twenty-First Text REtrieval Conference, 2012

Overview of the TREC 2012 Session Track.
Proceedings of The Twenty-First Text REtrieval Conference, 2012

Using PageRank to infer user preferences.
Proceedings of the 35th International ACM SIGIR conference on research and development in Information Retrieval, 2012

Using preference judgments for novel document retrieval.
Proceedings of the 35th International ACM SIGIR conference on research and development in Information Retrieval, 2012

Advances on the development of evaluation measures.
Proceedings of the 35th International ACM SIGIR conference on research and development in Information Retrieval, 2012

Combining multi-level evidence for medical record retrieval.
Proceedings of the 2012 International Workshop on Smart Health and Wellbeing, 2012

Alternative assessor disagreement and retrieval depth.
Proceedings of the 21st ACM International Conference on Information and Knowledge Management, 2012

Predicting baby feeding method from unstructured electronic health record data.
Proceedings of the ACM sixth international workshop on Data and text mining in biomedical informatics, 2012

Incorporating variability in user behavior into systems based evaluation.
Proceedings of the 21st ACM International Conference on Information and Knowledge Management, 2012

Improving health records search using multiple query expansion collections.
Proceedings of the 2012 IEEE International Conference on Bioinformatics and Biomedicine, 2012

2011
Report on the ECIR 2011 workshop on information retrieval over query sessions.
SIGIR Forum, 2011

An analysis of NP-completeness in novelty and diversity ranking.
Inf. Retr., 2011

Using Multiple External Collections for Query Expansion.
Proceedings of The Twentieth Text REtrieval Conference, 2011

Overview of the TREC 2011 Session Track.
Proceedings of The Twentieth Text REtrieval Conference, 2011

Simple Rank-Based Filtering for Microblog Retrieval: Implications for Evaluation and Test Collections.
Proceedings of The Twentieth Text REtrieval Conference, 2011

Implicit Feedback and Document Filtering for Retrieval Over Query Sessions.
Proceedings of The Twentieth Text REtrieval Conference, 2011

Evaluating multi-query sessions.
Proceedings of the Proceeding of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2011

System effectiveness, user models, and user utility: a conceptual framework for investigation.
Proceedings of the Proceeding of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2011

Model-Based Inference about IR Systems.
Proceedings of the Advances in Information Retrieval Theory, 2011

Within-Document Term-Based Index Pruning with Statistical Hypothesis Testing.
Proceedings of the Advances in Information Retrieval, 2011

A Methodology for Evaluating Aggregated Search Results.
Proceedings of the Advances in Information Retrieval, 2011

Simulating simple user behavior for system effectiveness evaluation.
Proceedings of the 20th ACM Conference on Information and Knowledge Management, 2011

Overview of Information Retrieval Evaluation.
Proceedings of the Current Challenges in Patent Information Retrieval, 2011

2010
Measuring the reusability of test collections.
Proceedings of the Third International Conference on Web Search and Web Data Mining, 2010

Overview of the TREC 2010 Session Track.
Proceedings of The Nineteenth Text REtrieval Conference, 2010

Diversification of search results using webgraphs.
Proceedings of the Proceeding of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval, 2010

The effect of assessor error on IR system evaluation.
Proceedings of the Proceeding of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval, 2010

Low cost evaluation in information retrieval.
Proceedings of the Proceeding of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval, 2010

Reusable test collections through experimental design.
Proceedings of the Proceeding of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval, 2010

2009
Test Collection.
Proceedings of the Encyclopedia of Database Systems, 2009

Search Engine Metrics.
Proceedings of the Encyclopedia of Database Systems, 2009

Precision and Recall.
Proceedings of the Encyclopedia of Database Systems, 2009

Redundancy, diversity and interdependent document relevance.
SIGIR Forum, 2009

Ad Hoc and Diversity Retrieval at the University of Delaware.
Proceedings of The Eighteenth Text REtrieval Conference, 2009

Million Query Track 2009 Overview.
Proceedings of The Eighteenth Text REtrieval Conference, 2009

Minimal Test Collections for Relevance Feedback.
Proceedings of The Eighteenth Text REtrieval Conference, 2009

Agreement among statistical significance tests for information retrieval evaluation at varying sample sizes.
Proceedings of the 32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2009

On rank correlation and the distance between rankings.
Proceedings of the 32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2009

If I Had a Million Queries.
Proceedings of the Advances in Information Retrieval, 2009

Probabilistic models of ranking novel documents for faceted topic retrieval.
Proceedings of the 18th ACM Conference on Information and Knowledge Management, 2009

2008
Low-cost and robust evaluation of information retrieval systems.
SIGIR Forum, 2008

Beyond binary relevance: preferences, diversity, and set-level judgments.
SIGIR Forum, 2008

Million Query Track 2008 Overview.
Proceedings of The Seventeenth Text REtrieval Conference, 2008

Evaluation over thousands of queries.
Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2008

Evaluation measures for preference judgments.
Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2008

Here or There.
Proceedings of the Advances in Information Retrieval , 2008

2007
Million Query Track 2007 Overview.
Proceedings of The Sixteenth Text REtrieval Conference, 2007

Robust test collections for retrieval evaluation.
Proceedings of the SIGIR 2007: Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2007

Research Methodology in Studies of Information Retrieval Evaluation.
Proceedings of the Computer-Assisted Information Retrieval (Recherche d'Information et ses Applications) - RIAO 2007, 8th International Conference, Carnegie Mellon University, Pittsburgh, PA, USA, May 30, 2007

Evaluating Search Engines by Modeling the Relationship Between Relevance and Clicks.
Proceedings of the Advances in Neural Information Processing Systems 20, 2007

A comparison of statistical significance tests for information retrieval evaluation.
Proceedings of the Sixteenth ACM Conference on Information and Knowledge Management, 2007

Hypothesis testing with incomplete relevance judgments.
Proceedings of the Sixteenth ACM Conference on Information and Knowledge Management, 2007

Semiautomatic evaluation of retrieval systems using document similarities.
Proceedings of the Sixteenth ACM Conference on Information and Knowledge Management, 2007

2006
Learning a ranking from pairwise preferences.
Proceedings of the SIGIR 2006: Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2006

Minimal test collections for retrieval evaluation.
Proceedings of the SIGIR 2006: Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2006

N Semantic Classes are Harder than Two.
Proceedings of the ACL 2006, 2006

2005
Comparing inverted files and signature files for searching a large lexicon.
Inf. Process. Manag., 2005

When will information retrieval be "good enough"?
Proceedings of the SIGIR 2005: Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2005

Incremental test collections.
Proceedings of the 2005 ACM CIKM International Conference on Information and Knowledge Management, Bremen, Germany, October 31, 2005


  Loading...