H5 at TREC 2008 Legal Interactive: User Modeling, Assessment & Measurement
H5 SAN FRANCISCO CA
Pagination or Media Count:
Treating the information retrieval task as one of classification has been shown to be the most effective way to achieve high performance on a particular task. In this paper, we describe a hybrid human-computer system that addresses the problem of achieving high performance on IR tasks by systematically and replicably creating large numbers of document assessments. We demonstrate how User Modeling, Document Assessment and Measurement combine to provide a shared understanding of relevance, a means for representing that understanding to an automated system, and a mechanism for iterating and correcting such a system so as to converge on a desired result.
- Operations Research
- Computer Programming and Software
- Computer Hardware