Task 3: Cross-lingual Word Sense Disambiguation

Best Evaluation

Systemname Precision Recall Spanish UvT-WSD1 23.42 24.98 UvT-WSD2 19.92 19.92 ColEur1 19.78 19.59 UHD-1 20.48 16.33 UHD-2 20.2 16.09 FCC-WSD1 15.09 15.09 FCC-WSD3 14.43 14.43 French ColEur1 21.96 21.73 UHD-2 20.93 16.65 UHD-1 20.22 16.21 DL-WNS2 16.05 16.05 WNS1 16.05 16.05 DL-WNS3 12.53 12.53 DL-WNS4 10.49 10.49 Italian ColEur1 15.55 15.4 UHD-2 16.28 13.03 UHD-1 15.94 12.78 Dutch UvT-WSD1 17.7 17.7 UvT-WSD2 15.93 15.93 ColEur1 10.71 10.56 German ColEur1 13.79 13.63 UHD-1 12.2 9.32 UHD-2 12.03 9.23

Out-of-five Evaluation

Systemname Precision Recall Spanish UvT-WSD2 43.12 43.12 UvT-WSD1 42.17 42.17 FCC-WSD2 40.76 40.76 FCC-WSD4 38.46 38.46 ColEur2 35.84 35.46 UHD-1 38.78 31.81 UHD-2 37.74 31.3 French ColEur2 49.44 48.96 DL-WNS1 43.11 43.11 WNS2 38.74 38.74 UHD-1 39.06 32 UHD-2 37.92 31.38 Italian ColEur2 40.7 40.34 MLG-1 33.72 27.49 MLG-J 32.68 27.42 Dutch UvT-WSD1 34.95 34.95 UvT-WSD2 34.92 34.92 ColEur2 21.47 21.27 German ColEur2 33.21 32.82 UHD-1 27.62 22.82 UHD-2 27.24 22.55