References (Selected)

On Test Collection

• Voorhees, E.M. and Harman, D.K. (Eds.) TREC: Experiment and Evaluation in Information Retrieval. 2005. MIT Press.
• Sanderson, M. Test Collection Based Evaluation of Information Retrieval Systems. Foundations and Trends in Information Retrieval, 2010, 4(4): 247–375.
• Ferro, N. and Peters, C. (Eds.) Information Retrieval Evaluation in a Changing World: Lessons Learned from 20 Years of CLEF. 2019. Springer Nature.
• Sakai, T., Oard, D.W., and Kando, N. (Eds.) Evaluating Information Retrieval and Access Tasks: NTCIR's Legacy of Research Impact. 2021. Springer Nature.

On User Studies

• Kelly, D. Methods for evaluating interactive information retrieval systems with users. Foundations and Trends in Information Retrieval, 2009, 3(1-2): 1-224.

On Statistical Testing

• Sakai, T. Laboratory Experiments in Information Retrieval: Sample Sizes, Effect Sizes, and Statistical Power. 2018. Springer Nature.