scholarly journals Is the Reign of Interactive Search Eternal? Findings from the Video Browser Showdown 2020

2021 ◽  
Vol 17 (3) ◽  
pp. 1-26
Author(s):  
Jakub Lokoč ◽  
Patrik Veselý ◽  
František Mejzlík ◽  
Gregor Kovalčík ◽  
Tomáš Souček ◽  
...  
Keyword(s):  
Retrieval Models ◽  
Interactive Search ◽  
Search Tasks ◽  
Retrieval Systems ◽  
Query Logs ◽  
Information Retrieval Systems ◽  
Interactive Nature ◽  
Benchmark Datasets ◽  
Future Events ◽  
Search Approach

Comprehensive and fair performance evaluation of information retrieval systems represents an essential task for the current information age. Whereas Cranfield-based evaluations with benchmark datasets support development of retrieval models, significant evaluation efforts are required also for user-oriented systems that try to boost performance with an interactive search approach. This article presents findings from the 9th Video Browser Showdown, a competition that focuses on a legitimate comparison of interactive search systems designed for challenging known-item search tasks over a large video collection. During previous installments of the competition, the interactive nature of participating systems was a key feature to satisfy known-item search needs, and this article continues to support this hypothesis. Despite the fact that top-performing systems integrate the most recent deep learning models into their retrieval process, interactive searching remains a necessary component of successful strategies for known-item search tasks. Alongside the description of competition settings, evaluated tasks, participating teams, and overall results, this article presents a detailed analysis of query logs collected by the top three performing systems, SOMHunter, VIRET, and vitrivr. The analysis provides a quantitative insight to the observed performance of the systems and constitutes a new baseline methodology for future events. The results reveal that the top two systems mostly relied on temporal queries before a correct frame was identified. An interaction log analysis complements the result log findings and points to the importance of result set and video browsing approaches. Finally, various outlooks are discussed in order to improve the Video Browser Showdown challenge in the future.

scholarly journals A Comparison of Retrieval Result Relevance Judgments Between American and Chinese Users

2020 ◽  
Vol 28 (3) ◽  
pp. 148-168
Author(s):  
Jin Zhang ◽  
Yuehua Zhao ◽  
Xin Cai ◽  
Taowen Le ◽  
Wei Fei ◽  
...  
Keyword(s):  
Information Retrieval ◽  
Relevance Judgment ◽  
Search Tasks ◽  
Retrieval Systems ◽  
Relevance Judgments ◽  
Cross Language Information Retrieval ◽  
Subject Categories ◽  
Information Retrieval Systems ◽  
Retrieval Result ◽  
Cross Language

Relevance judgment plays an extremely significant role in information retrieval. This study investigates the differences between American users and Chinese users in relevance judgment during the information retrieval process. 384 sets of relevance scores with 50 scores in each set were collected from 16 American users and 16 Chinese users as they judged retrieval records from two major search engines based on 24 predefined search tasks from 4 domain categories. Statistical analyses reveal that there are significant differences between American assessors and Chinese assessors in relevance judgments. Significant gender differences also appear within both the American and the Chinese assessor groups. The study also revealed significant interactions among cultures, genders, and subject categories. These findings can enhance the understanding of cultural impact on information retrieval and can assist in the design of effective cross-language information retrieval systems.

Information Retrieval Models

2017 ◽  
pp. 17-42 ◽  
Author(s):  
Saruladha Krishnamurthy ◽  
Akila V
Keyword(s):  
Information Retrieval ◽  
Research Field ◽  
Process Models ◽  
Retrieval Models ◽  
Retrieval Systems ◽  
Information Retrieval Systems ◽  
External Sources ◽  
Active Research ◽  
Cross Lingual

Information retrieval is currently an active research field with the evolution of World wide web. The objective of this chapter is to provide an insight into the information retrieval definitions, process, models. Further how traditional information retrieval has evolved and adapted for search engines is also discussed. The information retrieval models have not only been used for search purpose it also supports cross lingual translation and retrieval tasks. This chapter also outlines the CLIR process in a brief manner. The tools which are usually used for experimental and research purpose is also discussed. This chapter is organized as Introduction to the concepts of information retrieval. Description of the information retrieval process, the information retrieval models, the role of external sources like ontologies in information retrieval systems. Finally the chapter provides an overview of CLIR and the tools used in developing IR systems is mentioned. Further the latest research directions in IR is explained.

scholarly journals Information Retrieval Models

2018 ◽  
pp. 995-1015
Author(s):  
Saruladha Krishnamurthy ◽  
Akila V
Keyword(s):  
Information Retrieval ◽  
Research Field ◽  
Process Models ◽  
Retrieval Models ◽  
Retrieval Systems ◽  
Information Retrieval Systems ◽  
External Sources ◽  
Active Research ◽  
Cross Lingual

Information retrieval is currently an active research field with the evolution of World wide web. The objective of this chapter is to provide an insight into the information retrieval definitions, process, models. Further how traditional information retrieval has evolved and adapted for search engines is also discussed. The information retrieval models have not only been used for search purpose it also supports cross lingual translation and retrieval tasks. This chapter also outlines the CLIR process in a brief manner. The tools which are usually used for experimental and research purpose is also discussed. This chapter is organized as Introduction to the concepts of information retrieval. Description of the information retrieval process, the information retrieval models, the role of external sources like ontologies in information retrieval systems. Finally the chapter provides an overview of CLIR and the tools used in developing IR systems is mentioned. Further the latest research directions in IR is explained.

scholarly journals Functional Partitioning of Ontologies for Natural Language Query Completion in Question Answering Systems

2018 ◽  
Author(s):  
Jaydeep Sen ◽  
Ashish Mittal ◽  
Diptikalyan Saha ◽  
Karthik Sankaranarayanan
Keyword(s):  
Natural Language ◽  
Question Answering ◽  
Completion Problem ◽  
Question Answering Systems ◽  
Query Logs ◽  
Natural Language Query ◽  
Information Retrieval Systems ◽  
Benchmark Datasets ◽  
Novel Concept ◽  
Functional Partitioning

Query completion systems are well studied in the context of information retrieval systems that handle keyword queries. However, Natural Language Interface to Databases (NLIDB) systems that focus on syntactically correct and semantically complete queries to obtain high precision answers require a fundamentally different approach to the query completion problem as opposed to IR systems. To the best of our knowledge, we are first to focus on the problem of query completion for NLIDB systems. In particular, we introduce a novel concept of functional partitioning of an ontology and then design algorithms to intelligently use the components obtained from functional partitioning to extend a state-of-the-art NLIDB system to produce accurate and semantically meaningful query completions in the absence of query logs. We test the proposed query completion framework on multiple benchmark datasets and demonstrate the efficacy of our technique empirically.

scholarly journals Current trends in information retrieval systems: review of fuzzy set theory and fuzzy Boolean retrieval models

2020 ◽  
Vol 2 (2) ◽  
pp. 48-56
Author(s):  
Jonathan N. Chimah ◽  
Friday Ibiam Ude
Keyword(s):  
Information Retrieval ◽  
Set Theory ◽  
Fuzzy Set ◽  
Fuzzy Set Theory ◽  
Information Needs ◽  
Query Languages ◽  
Retrieval Models ◽  
Current Trends ◽  
Retrieval Systems ◽  
Information Retrieval Systems

This paper reviews the concept and goal of Information Retrieval Systems (IRSs). It also explains the synonymous concepts in Information Retrieval (IR)which include such terms as: imprecision, vagueness, uncertainty, and inconsistency. Current trends in IRSs are discussed. Fuzzy Set Theory, Fuzzy Retrieval Modelsare reviewed. The paper also discusses extensions of Fuzzy Boolean Retrieval Models including Fuzzy techniques for documents’ indexingandFlexible query languages. Fuzzy associative mechanisms were identified to include:(1)fuzzy pseudothesauri and fuzzy ontologies which can be used to contextualize the search by expanding the set of index terms of documents;(2)an alternative use of fuzzy pseudothesarui and fuzzy ontologies is to expand the query with related terms by taking into account their varying importance of an additional termand (3)fuzzy clustering techniques, where each document can be placed within several clusters with a given strength of belonging to each cluster, can be used to expand the set of the documents retrieved in response to a query.The paper concludesby recommending that in an electronic library environment, the librarians and information scientists should acquaint themselves with these terms in order to be more equipped in helping library users retrieve online documents relevant to their information needs.

scholarly journals A study on query terms proximity embedding for information retrieval

2017 ◽  
Vol 13 (2) ◽  
pp. 155014771769489 ◽  
Author(s):  
Ya-nan Qiao ◽  
Qinghe Du ◽  
Di-fang Wan
Keyword(s):  
Wireless Networks ◽  
Information Retrieval ◽  
Cyber Physical Systems ◽  
Query Term ◽  
Retrieval Models ◽  
Physical Systems ◽  
Retrieval Systems ◽  
Information Retrieval Systems ◽  
Original Information ◽  
Term Field

Information retrieval is applied widely to models and algorithms in wireless networks for cyber-physical systems. Query terms proximity has proved that it is a very useful information to improve the performance of information retrieval systems. Query terms proximity cannot retrieve documents independently, and it must be incorporated into original information retrieval models. This article proposes the concept of query term proximity embedding, which is a new method to incorporate query term proximity into original information retrieval models. Moreover, term-field-convolutions frequency framework, which is an implementation of query term proximity embedding, is proposed in this article, and experimental results show that this framework can improve the performance effectively compared with traditional proximity retrieval models.

scholarly journals A semantic search approach for hyper relational knowledge graphs

2021 ◽  
Author(s):  
Veronica dos Santos ◽  
Sérgio Lifschitz
Keyword(s):  
Information Retrieval ◽  
Semantic Search ◽  
Similarity Function ◽  
Search Results ◽  
Relational Knowledge ◽  
Retrieval Systems ◽  
User Query ◽  
Information Retrieval Systems ◽  
Knowledge Graphs ◽  
Search Approach

Information Retrieval Systems usually employ syntactic search techniques to match a set of keywords with the indexed content to retrieve results. But pure keyword-based matching lacks on capturing user's search intention and context and suffers of natural language ambiguity and vocabulary mismatch. Considering this scenario, the hypothesis raised is that the use of embeddings in a semantic search approach will make search results more meaningfully. Embeddings allow to minimize problems arising from terminology and context mismatch. This work proposes a semantic similarity function to support semantic search based on hyper relational knowledge graphs. This function uses embeddings in order to find the most similar nodes that satisfy a user query.

Relevance Predictability in Information Retrieval Systems

1967 ◽  
Vol 06 (02) ◽  
pp. 45-51 ◽  
Author(s):  
A. Kent ◽  
J. Belzer ◽  
M. Kuhfeerst ◽  
E. D. Dym ◽  
D. L. Shirey ◽  
...  
Keyword(s):  
Information Retrieval ◽  
Experimental Conditions ◽  
Treatment Groups ◽  
Retrieval Systems ◽  
Significant Difference ◽  
Information Retrieval Systems ◽  
High Predictability ◽  
Intermediate Response ◽  
Quantitative Indicators ◽  
Level Of Processing

An experiment is described which attempts to derive quantitative indicators regarding the potential relevance predictability of the intermediate stimuli used to represent documents in information retrieval systems. In effect, since the decision to peruse an entire document is often predicated upon the examination of one »level of processing« of the document (e.g., the citation and/or abstract), it became interesting to analyze the properties of what constitutes »relevance«. However, prior to such an analysis, an even more elementary step had to be made, namely, to determine what portions of a document should be examined.An evaluation of the ability of intermediate response products (IRPs), functioning as cues to the information content of full documents, to predict the relevance determination that would be subsequently made on these documents by motivated users of information retrieval systems, was made under controlled experimental conditions. The hypothesis that there might be other intermediate response products (selected extracts from the document, i.e., first paragraph, last paragraph, and the combination of first and last paragraph), that would be as representative of the full document as the traditional IRPs (citation and abstract) was tested systematically. The results showed that:1. there is no significant difference among the several IRP treatment groups on the number of cue evaluations of relevancy which match the subsequent user relevancy decision on the document;2. first and last paragraph combinations have consistently predicted relevancy to a higher degree than the other IRPs;3. abstracts were undistinguished as predictors; and4. the apparent high predictability rating for citations was not substantive.Some of these results are quite different than would be expected from previous work with unmotivated subjects.

Sign in / Sign up

Export Citation Format

Share Document