ROMIP: Russian Information Retrieval Evaluation Seminar

 General principles 
 Test collections 
 Relevance tables 


Format of results for ad hoc search tracks

Results should be returned as one or several XML files. Each XML file contains answers for one or several tasks.

XML must have the following structure:

<?xml version="1.0"?>
<romip:taskresult xmlns:romip="" collectionId="BY.WEB-2007" trackId="web-adhoc-2008">
                <!-- for ad hoc search in the KM.RU collection collectionId="KM.RU-2007" trackId="web-adhoc-2008">     
                <!-- for ad hoc search in the collection of legal documents collectionId="ROMIP-Legal2007" trackId="legal-adhoc-2008" -->
		<!-- for ad hoc search in the mixed collection collectionId="ROMIP-Mixed2007" trackId="mixed-adhoc-2008"-->
		<!-- for similar documents search collectionId="ROMIP-Mixed2007" trackId="mixed-feedback-2008"-->

<doclist taskID="1">
 <doclist taskID="2">
 <doclist taskID="3">

Tag run is descriprion of the system produced the result.
  • systemID - system identifier provided by ROMIP organizing commitee.
  • runID - run identifier to distinguish between different runs of same participant. Value is up to participant.
Order of docID tags in the doclist is the order of estimated relevance of result URLs to the query.

docID and taskID should match ids defined in the collection (collectionId) and task set (trackId).

IMPORTANT: if the collection has docURL tags then the docURL values should be used as the value of docID tags in the results.