TREC 2016

As part of the National Institute of Standards and Technology (NIST) Text REtrieval Conference (TREC), the Contextual Suggestion Track deals with complex information needs which are highly dependent on context and user interests.

Mailing list: https://groups.google.com/forum/#!forum/treccontext

Twitter: @treccontext

Register for TREC in order to participate in this track: http://trec.nist.gov/pubs/call2016.html


Slides of the presentations at TREC'16

Track Organizers

  • Charles L. A. Clarke, University of Waterloo
  • S. Hadi Hashemi, University of Amsterdam
  • Jaap Kamps, University of Amsterdam
  • Julia Kiseleva, Eindhoven University of Technology

Timeline

  • Contexts available: since 2015
  • Collection available: since 2015
  • Crawled collection released: June 15
  • Guidelines finalized: June 15
  • Phase 1 experiment profiles release: July 11 
  • Phase 1 experiment results deadline: July 26
  • Phase 1 results available: August
  • Phase 2 experiment profiles released: August 15
  • Phase 2 experiment result deadline: September 8
  • Phase 2 results available: late September

The TREC 2016's Contextual Suggestion Track will run a variant of last year's track.  We will retain the 2015 "Batch" task making it the main task of the track in 2016 (Phase 2 in August).   In order to get new profiles to judge, we will run a variant of last year's live task without the requirement for participants to set up a live system (Phase 1 in July).   We will also make available a richer set of data (crawled pages for the whole collection, endorsements for pages in the batch/phase 2 task).  For details of the 2015 track see last year's guidelines.

TREC 2016 Contextual Suggestion Guidelines

Contexts

The contexts (target cities) for 2016 and 2015 are available for download below. Lat/long coordinates have been provided in a separate file for convenience, these do not represent the exact position of the user but rather are analogous to the name of the city.

ċ
Phase1_requests.json
(1352k)
Hadi Hashemi,
Jul 19, 2016, 12:11 PM
ċ
Phase1_validate.py
(1k)
Hadi Hashemi,
Jul 24, 2016, 4:49 PM
ċ
Phase2_requests.json
(3417k)
Hadi Hashemi,
Aug 17, 2016, 7:20 AM
ċ
Phase2_validate.py
(1k)
Hadi Hashemi,
Aug 29, 2016, 3:45 AM
ċ
contexts2015.csv
(4k)
Jaap Kamps,
Apr 11, 2016, 6:09 AM
ċ
contexts2015coordinates.csv
(6k)
Jaap Kamps,
Apr 11, 2016, 6:09 AM