DC Field | Value | Language |
---|---|---|
dc.contributor.author | Sauchuk, Artsiom | ko |
dc.contributor.author | Thorne, James | ko |
dc.contributor.author | Halevy, Alon | ko |
dc.contributor.author | Tonellotto, Nicola | ko |
dc.contributor.author | Silvestri, Fabrizio | ko |
dc.date.accessioned | 2022-12-27T07:01:53Z | - |
dc.date.available | 2022-12-27T07:01:53Z | - |
dc.date.created | 2022-12-23 | - |
dc.date.issued | 2022-07-14 | - |
dc.identifier.citation | 45th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2022, pp.1785 - 1789 | - |
dc.identifier.uri | http://hdl.handle.net/10203/303806 | - |
dc.description.abstract | Many recent Natural Language Processing (NLP) task formulations, such as question answering and fact verification, are implemented as a two-stage cascading architecture. In the first stage an IR system retrieves "relevant'' documents containing the knowledge, and in the second stage an NLP system performs reasoning to solve the task. Optimizing the IR system for retrieving relevant documents ensures that the NLP system has sufficient information to operate over. These recent NLP task formulations raise interesting and exciting challenges for IR, where the end-user of an IR system is not a human with an information need, but another system exploiting the documents retrieved by the IR system to perform reasoning and address the user information need. Among these challenges, as we will show, is that noise from the IR system, such as retrieving spurious or irrelevant documents, can negatively impact the accuracy of the downstream reasoning module. Hence, there is the need to balance maximizing relevance while minimizing noise in the IR system. This paper presents experimental results on two NLP tasks implemented as a two-stage cascading architecture. We show how spurious or irrelevant retrieved results from the first stage can induce errors in the second stage. We use these results to ground our discussion of the research challenges that the IR community should address in the context of these knowledge-intensive NLP tasks. | - |
dc.language | English | - |
dc.publisher | Association for Computing Machinery, Inc | - |
dc.title | On the Role of Relevance in Natural Language Processing Tasks | - |
dc.type | Conference | - |
dc.identifier.wosid | 000852715901079 | - |
dc.identifier.scopusid | 2-s2.0-85135055227 | - |
dc.type.rims | CONF | - |
dc.citation.beginningpage | 1785 | - |
dc.citation.endingpage | 1789 | - |
dc.citation.publicationname | 45th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2022 | - |
dc.identifier.conferencecountry | SP | - |
dc.identifier.conferencelocation | Madrid | - |
dc.identifier.doi | 10.1145/3477495.3532034 | - |
dc.contributor.localauthor | Thorne, James | - |
dc.contributor.nonIdAuthor | Sauchuk, Artsiom | - |
dc.contributor.nonIdAuthor | Halevy, Alon | - |
dc.contributor.nonIdAuthor | Tonellotto, Nicola | - |
dc.contributor.nonIdAuthor | Silvestri, Fabrizio | - |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.