Accession Number:

ADA599415

Title:

Overview of the TREC 2013 Contextual Suggestion Track

Descriptive Note:

Conference paper

Corporate Author:

WATERLOO UNIV (ONTARIO)

Report Date:

2013-11-01

Pagination or Media Count:

14.0

Abstract:

For participants familiar with the 2012 Contextual Suggestion Track we have provided a list of the main changes to this years track Contexts no longer include a temporal component day of week, time of day, and season, contexts consist of only a location. Users were recruited from a crowdsourcing service Mechanical Turk as well as from the University of Waterloo student body. Suggestion attractiveness judgements are given on a 5-point, rather than a 3-point, scale. Submissions based off of the ClueWeb12 corpus were allowed in addition to submissions based off of the open web. A modified Time-Biased Gain TBG metric was used in addition to P5 and MRR. This metric is described in section 4.3. The option to submit solely based on context or solely based or user profiles was removed. The file format used for profiles, contexts, and suggestions was switched from XML to CSV and JSON.

Subject Categories:

  • Information Science

Distribution Statement:

APPROVED FOR PUBLIC RELEASE