Back to the Fundamentals: Extend the Rational Assumptions

Jiqun Liu⁸

Part of the book series: The Information Retrieval Series ((INRE,volume 48))

573 Accesses

Abstract

In this chapter, we revisit the fundamental formal models of IR and associated simplified assumptions, with the goal of exploring and introducing actionable directions toward which the assumptions can be extended to at least partially cover the triggers and characteristics of bounded rationality. To this end, we first categorize different types of explicit and implicit assumptions into three groups, pre-search, within-search, and post-search, and discuss their conflicts with empirical findings on bounded rationality. Within each group, we discuss possible ways to extend and revise existing rational assumptions, as a key preparation for enhancing formal user models and IR evaluation techniques. When explaining the methods for extending rational assumptions, we also discuss related boundaries and explain the implications for user modeling and evaluation and how these potential boundaries are related to IIR-specific factors.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+

from $39.99 /Month

Starting from 10 chapters or articles per month
Access and download chapters and articles from more than 300k books and 2,500 journals
Cancel anytime

Buy Now

Chapter: USD 29.95; Price excludes VAT (Canada)

eBook: USD 139.00; Price excludes VAT (Canada)

Softcover Book: USD 179.99; Price excludes VAT (Canada)

Hardcover Book: USD 179.99; Price excludes VAT (Canada)

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

Agarwal, A., Zaitsev, I., Wang, X., Li, C., Najork, M., & Joachims, T. (2019). Estimating position bias without intrusive interventions. In Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining (pp. 474–482). ACM. https://doi.org/10.1145/3289600.3291017
Chapter Google Scholar
André, P., Teevan, J., & Dumais, S. T. (2009). From x-rays to silly putty via Uranus: serendipity and its role in web search. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 2033–2036). ACM. https://doi.org/10.1145/1518701.1519009
Chapter Google Scholar
Azzopardi, L. (2011). The economics in interactive information retrieval. In Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 15–24). ACM. https://doi.org/10.1145/2009916.2009923
Chapter Google Scholar
Azzopardi, L. (2014). Modelling interaction with economic models of search. In Proceedings of the 37th ACM SIGIR Conference on Research & Development in Information Retrieval (pp. 3–12). ACM. https://doi.org/10.1145/2600428.2609574
Chapter Google Scholar
Azzopardi, L. (2021). Cognitive biases in search: A review and reflection of cognitive biases in information retrieval. In Proceedings of the 2021 ACM SIGIR Conference on Human Information Interaction and Retrieval (pp. 27–37). ACM. https://doi.org/10.1145/3406522.3446023
Chapter Google Scholar
Caputo, A. (2014). Relevant information, personality traits and anchoring effect. International Journal of Management and Decision Making, 13(1), 62–76.
Article Google Scholar
Chapelle, O., Metlzer, D., Zhang, Y., & Grinspan, P. (2009). Expected reciprocal rank for graded relevance. In Proceedings of the 18th ACM Conference on Information and Knowledge Management (pp. 621–630). ACM. https://doi.org/10.1145/1645953.1646033
Chapter Google Scholar
Chen, Y., Zhou, K., Liu, Y., Zhang, M., & Ma, S. (2017). Meta-evaluation of online and offline web search evaluation metrics. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 15–24). ACM. https://doi.org/10.1145/3077136.3080804
Chapter Google Scholar
Cheng, H., & Cantú-Paz, E. (2010). Personalized click prediction in sponsored search. In Proceedings of the Third ACM International Conference on Web Search and Data Mining (pp. 351–360). ACM. https://doi.org/10.1145/1718487.1718531
Chapter Google Scholar
Collins-Thompson, K., Bennett, P. N., White, R. W., De La Chica, S., & Sontag, D. (2011). Personalizing web search results by reading level. In Proceedings of the 20th ACM International Conference on Information and Knowledge Management (pp. 403–412). ACM. https://doi.org/10.1145/2063576.2063639
Chapter Google Scholar
Draws, T., Rieger, A., Inel, O., Gadiraju, U., & Tintarev, N. (2021). A checklist to combat cognitive biases in crowdsourcing. In Proceedings of the AAAI Conference on Human Computation and Crowdsourcing (Vol. 9, pp. 48–59). https://ojs.aaai.org/index.php/HCOMP/article/view/18939
Fredrickson, B. L., & Kahneman, D. (1993). Duration neglect in retrospective evaluations of affective episodes. Journal of Personality and Social Psychology, 65(1), 45–55. https://doi.org/10.1037/0022-3514.65.1.45
Article Google Scholar
Gäde, M., Koolen, M., Hall, M., Bogers, T., & Petras, V. (2021). A manifesto on resource re-use in interactive information retrieval. In Proceedings of the 2021 International ACM SIGIR Conference on Human Information Interaction and Retrieval (pp. 141–149). ACM. https://doi.org/10.1145/3406522.3446056
Chapter Google Scholar
Gilboa, I., & Schmeidler, D. (1995). Case-based decision theory. The Quarterly Journal of Economics, 110(3), 605–639. https://doi.org/10.2307/2946694
Article MATH Google Scholar
Gneezy, U., Goette, L., Sprenger, C., & Zimmermann, F. (2017). The limits of expectations-based reference dependence. Journal of the European Economic Association, 15(4), 861–876. https://doi.org/10.1093/jeea/jvw020
Article Google Scholar
Hands, D. S., & Avons, S. E. (2001). Recency and duration neglect in subjective assessment of television picture quality. Applied Cognitive Psychology: The Official Journal of the Society for Applied Research in Memory and Cognition, 15(6), 639–657. https://doi.org/10.1002/acp.731
Article Google Scholar
Hilligoss, B., & Rieh, S. Y. (2008). Developing a unifying framework of credibility assessment: Construct, heuristics, and interaction in context. Information Processing & Management, 44(4), 1467–1484. https://doi.org/10.1016/j.ipm.2007.10.001
Article Google Scholar
Jansen, B. J., Booth, D. L., & Spink, A. (2007). Determining the user intent of web search engine queries. In Proceedings of the 16th International Conference on World Wide Web (pp. 1149–1150). https://doi.org/10.1145/1242572.1242739
Järvelin, K., Price, S. L., Delcambre, L. M., & Nielsen, M. L. (2008). Discounted cumulated gain based evaluation of multiple-query IR sessions. In European Conference on Information Retrieval (pp. 4–15). Springer.
Google Scholar
Kahneman, D. (2003). Maps of bounded rationality: Psychology for behavioral economics. American Economic Review, 93(5), 1449–1475. https://doi.org/10.1257/000282803322655392
Article Google Scholar
Kelly, D. (2009). Methods for evaluating interactive information retrieval systems with users. Foundations and Trends in Information Retrieval, 3(1–2), 1–224. https://doi.org/10.1561/1500000012
Article Google Scholar
Kelly, D., & Sugimoto, C. R. (2013). A systematic review of interactive information retrieval evaluation studies, 1967–2006. Journal of the American Society for Information Science and Technology, 64(4), 745–770. https://doi.org/10.1002/asi.22799
Article Google Scholar
Knobloch-Westerwick, S., Johnson, B. K., & Westerwick, A. (2015). Confirmation bias in online searches: Impacts of selective exposure before an election on political attitude strength and shifts. Journal of Computer-Mediated Communication, 20(2), 171–187. https://doi.org/10.1111/jcc4.12105
Article Google Scholar
Koskela, M., Luukkonen, P., Ruotsalo, T., Sjöberg, M., & Floréen, P. (2018). Proactive information retrieval by capturing search intent from primary task context. ACM Transactions on Interactive Intelligent Systems (TiiS), 8(3), 1–25. https://doi.org/10.1145/3150975
Article Google Scholar
Langer, T., Sarin, R., & Weber, M. (2005). The retrospective evaluation of payment sequences: Duration neglect and peak-and-end effects. Journal of Economic Behavior & Organization, 58(1), 157–175. https://doi.org/10.1016/j.jebo.2004.01.001
Article Google Scholar
Lin, J., Liu, W., Dai, X., Zhang, W., Li, S., Tang, R., He, X., Hao, J., & Yu, Y. (2021). A graph-enhanced click model for web search. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 1259–1268). ACM. https://doi.org/10.1145/3404835.3462895
Chapter Google Scholar
Liu, J. (2021). Deconstructing search tasks in interactive information retrieval: A systematic review of task dimensions and predictors. Information Processing & Management, 58(3), 102522. https://doi.org/10.1016/j.ipm.2021.102522
Article Google Scholar
Liu, J. (2022). Toward Cranfield-inspired reusability assessment in interactive information retrieval evaluation. Information Processing & Management, 59(5), 103007. https://doi.org/10.1016/j.ipm.2022.103007
Article MathSciNet Google Scholar
Liu, C., Belkin, N. J., & Cole, M. J. (2012). Personalization of search results using interaction behaviors in search sessions. In Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 205–214). ACM. https://doi.org/10.1145/2348283.2348314
Chapter Google Scholar
Liu, J., Mitsui, M., Belkin, N. J., & Shah, C. (2019). Task, information seeking intentions, and user behavior: Toward a multi-level understanding of Web search. In Proceedings of the 2019 ACM SIGIR Conference on Human Information Interaction and Retrieval (pp. 123–132). ACM. https://doi.org/10.1145/3295750.3298922
Chapter Google Scholar
Liu, J., Sarkar, S., & Shah, C. (2020). Identifying and predicting the states of complex search tasks. In Proceedings of the 2020 ACM SIGIR Conference on Human Information Interaction and Retrieval (pp. 193–202). ACM. https://doi.org/10.1145/3343413.3377976
Chapter Google Scholar
Liu, J., & Shah, C. (2019). Interactive IR user study design, evaluation, and reporting. Synthesis Lectures on Information Concepts, Retrieval, and Services, 11(2), i–93. https://doi.org/10.2200/S00923ED1V01Y201905ICR067
Article Google Scholar
Mao, J., Liu, Y., Luan, H., Zhang, M., Ma, S., Luo, H., & Zhang, Y. (2017). Understanding and predicting usefulness judgment in web search. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 1169–1172). ACM. https://doi.org/10.1145/3077136.3080750
Chapter Google Scholar
Mitsui, M., Liu, J., Belkin, N. J., & Shah, C. (2017). Predicting information seeking intentions from search behaviors. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 1121–1124). ACM. https://doi.org/10.1145/3077136.3080737
Chapter Google Scholar
Mitsui, M., Liu, J., & Shah, C. (2018). How much is too much? Whole session vs. first query behaviors in task type prediction. In Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval (pp. 1141–1144). ACM. https://doi.org/10.1145/3209978.3210105
Chapter Google Scholar
Moffat, A., Scholer, F., & Thomas, P. (2012). Models and metrics: IR evaluation as a user process. In Proceedings of the Seventeenth Australasian Document Computing Symposium (pp. 47–54). https://doi.org/10.1145/2407085.2407092
Moffat, A., & Zobel, J. (2008). Rank-biased precision for measurement of retrieval effectiveness. ACM Transactions on Information Systems (TOIS), 27(1), 1–27. https://doi.org/10.1145/1416950.1416952
Article Google Scholar
Montazeralghaem, A., Zamani, H., & Shakery, A. (2018). Theoretical analysis of interdependent constraints in pseudo-relevance feedback. In Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval (pp. 1249–1252). ACM. https://doi.org/10.1145/3209978.3210156
Chapter Google Scholar
Nickerson, R. S. (1998). Confirmation bias: A ubiquitous phenomenon in many guises. Review of General Psychology, 2(2), 175–220. https://doi.org/10.1037/1089-2680.2.2.175
Article Google Scholar
Oliver, R. L. (1980). A cognitive model of the antecedents and consequences of satisfaction decisions. Journal of Marketing Research, 17(4), 460–469. https://doi.org/10.1177/002224378001700405
Article Google Scholar
Radlinski, F., Bennett, P. N., Carterette, B., & Joachims, T. (2009). Redundancy, diversity and interdependent document relevance. In ACM SIGIR Forum (Vol. 43, No. 2, pp. 46–52). ACM. https://doi.org/10.1145/1670564.1670572
Rahman, A., & Wilson, M. L. (2015). Exploring opportunities to facilitate serendipity in search. In Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 939–942). ACM. https://doi.org/10.1145/2766462.2767783
Chapter Google Scholar
Redelmeier, D. A., Katz, J., & Kahneman, D. (2003). Memories of colonoscopy: A randomized trial. Pain, 104(1–2), 187–194. https://doi.org/10.1016/S0304-3959(03)00003-4
Article Google Scholar
Rieger, A., Draws, T., Theune, M., & Tintarev, N. (2021). This item might reinforce your opinion: Obfuscation and labeling of search results to mitigate confirmation bias. In Proceedings of the 32nd ACM Conference on Hypertext and Social Media (pp. 189–199). ACM. https://doi.org/10.1145/3465336.3475101
Chapter Google Scholar
Schneider, S., Stone, A. A., Schwartz, J. E., & Broderick, J. E. (2011). Peak and end effects in patients’ daily recall of pain and fatigue: A within-subjects analysis. The Journal of Pain, 12(2), 228–235.