Similar Documents Search Track
The purpose of this track is to evaluate methods of document retrieval which use feedback from the user. In the context of this track we evaluate methods of search of similar documents by a sample document.
For this track the standard procedure is used.
Test CollectionThe source dataset is a union of BY.web, KM.ru and legal documents 2007 collections.
Task Description for Participating Systems
Each participant is granted access to the collections and a set of tasks. Each task is a (query, relevant document) pair. The tasks are based on the set of queries used in the ROMIP'2007 workshop. Evaluation is based on strong relevance criteria, i.e. a document is considered relevant if all of the assessors mark it as relevant.
Expected result is an ordered list of document URLs. Maximum list size is 100 per (query, relevant document) pair.