User preference choices for complex question answering

Wu, M, Scholer, F and Turpin, A 2008, 'User preference choices for complex question answering', in Thirty-first Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Singapore, Singapore, 20-24 July 2008.


Document type: Conference Paper
Collection: Conference Papers

Title User preference choices for complex question answering
Author(s) Wu, M
Scholer, F
Turpin, A
Year 2008
Conference name 31st Annual International ACM SIGIR Comference on Research and Development in Information Retrieval
Conference location Singapore, Singapore
Conference dates 20-24 July 2008
Proceedings title Thirty-first Annual International ACM SIGIR Conference on Research and Development in Information Retrieval
Publisher ACM
Place of publication New York, USA
Abstract Question answering systems increasingly need to deal with complex information needs that require more than simple factoid answers. The evaluation of such systems is usually carried out using precision- or recall-based system performance metrics. Previous work has demonstrated that when users are shown two search result lists side-by-side, they can reliably differentiate between the qualities of the lists. We investigate the consistency between this user-based approach and system-oriented metrics in the question answering environment. Our initial results indicate that the two methodologies show a high level of disagreement
Subjects Information Systems Organisation
DOI - identifier 10.1145/1390334.1390467
Copyright notice © ACM 2008
Versions
Version Filter Type
Citation counts: Scopus Citation Count Cited 2 times in Scopus Article | Citations
Altmetric details:
Access Statistics: 176 Abstract Views  -  Detailed Statistics
Created: Fri, 09 Oct 2009, 08:09:01 EST by Catalyst Administrator
© 2014 RMIT Research Repository • Powered by Fez SoftwareContact us