Test collections

Relevance tables

History

2003

2004

2005

Format of results for content-based image retrieval track

Results should be returned as one or several XML files. Each XML file contains answers for one or several tasks.

XML must have the following structure:

<?xml version="1.0"?>
<romip:taskresult xmlns:romip="http://www.romip.ru/data/adhoc" collectionId="ROMIP_IMG-FLICKR" trackId="image-cbir-2008">
<romip:run>
  <romip:systemID>Yellow</romip:systemID>
  <romip:runID>RunId</romip:runID>
</romip:run>

<doclist taskID="1">
      <docID>img01242</docID>
      <docID>img19001</docID>
 </doclist>
 <doclist taskID="2">
 </doclist>
 <doclist taskID="3">
 <docID>img03984</docID>
 </doclist> 
</romip:taskresult>

Tag run is descriprion of the system produced the result.

systemID - system identifier provided by ROMIP organizing commitee.
runID - run identifier to distinguish between different runs of same participant. Value is up to participant.

Order of docID tags in the doclist is the order of estimated relevance of result URLs to the query.

docID and taskID should match ids defined in the collection (collectionId) and task set (trackId).