uva-irlab-conv at SemEval-2026 Task 8: Multi-Turn RAG with Learned Sparse Retrieval and Listwise Reranking
This paper proposes a multi-turn retrieval-augmented generation pipeline for conversational systems across four domains.
This paper presents a novel multi-turn retrieval-augmented generation pipeline that improves robustness across domains.
Before reading this…
Applications
- →Conversational AI systems
- →Virtual assistants
To understand this paper, make sure you know these concepts first:
- Conversational AIfind papers →
- Natural Language Processingfind papers →
Abstract
More Like ThisThis report describes our participation in SemEval-2026 Task 8 on multi-turn retrieval and question answering. The task evaluates conversational systems across four domains (finance, cloud documentation, government, Wikipedia), and includes unanswerable queries where the available collection does not contain sufficient evidence to produce a complete response. We propose a multi-turn retrieval-augmented generation pipeline that combines learned sparse retrieval with LLM-based reranking and generation. Using sparse retrieval as the primary retrieval method, we leverage its strong generalization across domains. In addition, we make use of the long-context capabilities of LLMs for conversational query rewriting, pointwise and listwise reranking, and generating the final response, each conditioned on the full conversational history. This multi-step design enables effective integration of conversational context throughout retrieval and generation, improving robustness across domains.