Average Positive of User Clicks as an Automated and Not-Intrusive Way of Evaluating Ranking Methods

TL;DRAbstract

Abstract : The need for an objective and automated way of evaluating the performance of different ranking/ methods is becoming increasingly important in the web search domain. There are various methods for ranking search results ranging from traditional information retrieval approaches to more recent methods based on link analysis and other quality measures that can be derived from the documents. There are also a number of strategies for combining different heuristics and answers from multiple experts. With all of these possibilities it is becoming increasingly difficult cult to find the best parameters, the best method, or the best mixture of methods that will maximize the quality for a particular query type or domain. This paper addresses the problem of automatically comparing the quality of the ordering of documents that are presented to the user as a sorted list according to believed relevance for a given topic or query. We introduce the average position of user clicks metric as an

Chat with Paper

AI Agents for this Paper