| The tables show two metrics, best, and oot, and then the systems are ranked according to recall. The metrics as well as the mode variations are described in our documentation. The oot tables contain an additional column showing the number of duplicates used by that particular participant.
The rank order of systems changes based on which measures are used. Also note that the system responses have not yet been analyzed to see the relative strengths and weaknesses of the different systems. For example, IRST-1 and IRSTbs did considerably better on precision compared to recall since they did not cover all test items.
As another example, note that UBA-T has the highest ranking for the mode scores in oot.
|