Assessing Level of Difficulty in Web Search Questions

TL;DRAbstract

This article focuses on assessing the level of difficulty of search questions for Web searching, looking at variations in judgments by type of questions and the reasons underlying these judgments. It analyzes the decisions and reasoning of fifty-four experienced Web searchers on sixteen search questions of four types: closed/predictable source, closed/unpredictable source, open/predictable source, and open/unpredictable source. The research uses a mixed mode of analysis--quantitative on the first research question and qualitative on the second. Participants consider closed/predictable source questions easy, open/unpredictable source questions difficult. Raters of individual questions agree strongly on ratings of most questions. Reasoning indicates that participants consider, besides the question variables addressed specifically, six (searchability, clarity, familiarity/currency, public knowledge, simplicity, and specificity) and eleven (searchability problems, diffusion of information,

Chat with Paper

AI Agents for this Paper