TREC 2016
As part of the National Institute of Standards and Technology (NIST) Text REtrieval Conference (TREC), the Contextual Suggestion Track deals with complex information needs which are highly dependent on context and user interests.
Mailing list: https://groups.google.com/forum/#!forum/treccontext
Twitter: @treccontext
Register for TREC in order to participate in this track: http://trec.nist.gov/pubs/call2016.html
Slides of the TREC'16 Contextual Suggestion Track Overview Talk
Slides of the presentations at TREC'16
Track Organizers
Charles L. A. Clarke, University of Waterloo
S. Hadi Hashemi, University of Amsterdam
Jaap Kamps, University of Amsterdam
Julia Kiseleva, Eindhoven University of Technology
Timeline
Contexts available: since 2015
Collection available: since 2015
Crawled collection released: June 15
Guidelines finalized: June 15
Phase 1 experiment profiles release: July 11
Phase 1 experiment results deadline: July 26
Phase 1 results available: August
Phase 2 experiment profiles released: August 15
Phase 2 experiment result deadline: September 8
Phase 2 results available: late September
The TREC 2016's Contextual Suggestion Track will run a variant of last year's track. We will retain the 2015 "Batch" task making it the main task of the track in 2016 (Phase 2 in August). In order to get new profiles to judge, we will run a variant of last year's live task without the requirement for participants to set up a live system (Phase 1 in July). We will also make available a richer set of data (crawled pages for the whole collection, endorsements for pages in the batch/phase 2 task). For details of the 2015 track see last year's guidelines.
TREC 2016 Contextual Suggestion Guidelines
Contexts
The contexts (target cities) for 2016 and 2015 are available for download below. Lat/long coordinates have been provided in a separate file for convenience, these do not represent the exact position of the user but rather are analogous to the name of the city.