Content area

Abstract

Query processing in search engines can be optimized for use for all queries. For this, system component parameters such as the weighting function or the automatic query expansion model can be optimized or learned from past queries. However, it may be more interesting to optimize the processing thread on a query-by-query basis by adjusting the component parameters; this is what selective query processing does. Selective query processing uses one of the candidate processing threads chosen at query time. The choice is based on query features. In this paper, we examine selective query processing in different settings, both in terms of effectiveness and efficiency; this includes selective query expansion and other forms of selective query processing (e.g., when the term weighting function varies or when the expansion model varies). We found that the best trade-off between effectiveness and efficiency is obtained when using the best trained processing thread and its query expansion counter part. This seems to be also the most natural for a real-word engine since the two threads use the same core engine (e.g., same term weighting function).

Details

1009240
Identifier / keyword
Title
Effectiveness and Efficiency Trade-off in Selective Query Processing
Publication title
arXiv.org; Ithaca
Publication year
2023
Publication date
Feb 22, 2023
Section
Computer Science
Publisher
Cornell University Library, arXiv.org
Source
arXiv.org
Place of publication
Ithaca
Country of publication
United States
University/institution
Cornell University Library arXiv.org
e-ISSN
2331-8422
Source type
Working Paper
Language of publication
English
Document type
Working Paper
Publication history
 
 
Online publication date
2023-02-23
Milestone dates
2023-02-22 (Submission v1)
Publication history
 
 
   First posting date
23 Feb 2023
ProQuest document ID
2779280078
Document URL
https://www.proquest.com/working-papers/effectiveness-efficiency-trade-off-selective/docview/2779280078/se-2?accountid=208611
Full text outside of ProQuest
Copyright
© 2023. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
Last updated
2023-03-08
Database
ProQuest One Academic