BASELINE DETAILED SCORES



SEMEVAL 2015 TASK 15: CPA - DETAILED SCORES

TEAM: BASELINE

%%%%%%%%%%%%%%%%

TASK 1 / MICROCHECK / RUN-1
----------------
operate sem 53 252 220 0.240909090909 0.210317460317 0.224576271186
operate syn 153 252 227 0.674008810573 0.607142857143 0.638830897704
operate all 206 504 447 0.460850111857 0.40873015873 0.433228180862
apprehend sem 98 216 170 0.576470588235 0.453703703704 0.507772020725
apprehend syn 143 216 173 0.826589595376 0.662037037037 0.735218508997
apprehend all 241 432 343 0.702623906706 0.55787037037 0.621935483871
appreciate sem 215 442 384 0.559895833333 0.486425339367 0.520581113801
appreciate syn 331 442 389 0.850899742931 0.748868778281 0.796630565584
appreciate all 546 884 773 0.706338939198 0.617647058824 0.659022329511
decline sem 168 327 302 0.556291390728 0.51376146789 0.534181240064
decline syn 290 327 301 0.963455149502 0.886850152905 0.923566878981
decline all 458 654 603 0.759535655058 0.700305810398 0.728719172633
crush sem 106 280 238 0.445378151261 0.378571428571 0.409266409266
crush syn 204 280 232 0.879310344828 0.728571428571 0.796875
crush all 310 560 470 0.659574468085 0.553571428571 0.601941747573
undertake sem 190 410 361 0.526315789474 0.463414634146 0.492866407263
undertake syn 278 410 367 0.757493188011 0.678048780488 0.715572715573
undertake all 468 820 728 0.642857142857 0.570731707317 0.604651162791
continue sem 245 455 436 0.561926605505 0.538461538462 0.549943883277
continue syn 396 455 434 0.912442396313 0.87032967033 0.89088863892
continue all 641 910 870 0.736781609195 0.704395604396 0.720224719101
----------------
AVERAGE score: 0.624246113763

%%%%%%%%%%%%%%%%

TASK 2 / MICROCHECK / RUN-1
----------------
appreciate 0.619253650622 1.0 0.764863059452
crush 0.26 1.0 0.412698412698
continue 0.251085927831 1.0 0.401388781131
undertake 0.81163434903 1.0 0.896024464832
operate 0.176224489796 1.0 0.299644313351
apprehend 0.484169475841 1.0 0.652444998664
decline 0.526843394965 1.0 0.690107966151
----------------
AVERAGE score: 0.58816742804

%%%%%%%%%%%%%%%%

TASK 2 / WINGSPREAD / RUN-1
----------------
boo 0.625 1.0 0.769230769231
adapt 0.411484120275 1.0 0.5830517175
teeter 0.706632653061 1.0 0.828101644245
begrudge 0.512465373961 1.0 0.677655677656
avert 0.920138888889 1.0 0.958408679928
breeze 0.513888888889 1.0 0.678899082569
ask 0.349828982514 1.0 0.518330821232
wing 0.764462809917 1.0 0.866510538642
tense 0.45799853908 1.0 0.628256513026
brag 0.529131985731 1.0 0.692068429238
sue 0.960333721254 1.0 0.979765547919
belch 0.440972222222 1.0 0.612048192771
advise 0.242759924386 1.0 0.39067871376
attain 0.713333333333 1.0 0.832684824903
bluff 0.5072 1.0 0.673036093418
avoid 0.572809234342 1.0 0.728389968516
bludgeon 0.5 1.0 0.666666666667
afflict 0.92484629069 1.0 0.960955994422
ascertain 0.510204081633 1.0 0.675675675676
totter 0.534626038781 1.0 0.696750902527
----------------
AVERAGE score: 0.720858322692

%%%%%%%%%%%%%%%%

TASK 3 / MICROCHECK / RUN-1
----------------
appreciate 0.675
operate 0.611363636364
apprehend 0.703125
crush 0.557692307692
continue 0.733333333333
undertake 0.633333333333
decline 0.722222222222
----------------
AVERAGE score: 0.662295690421

%%%%%%%%%%%%%%%%

TASK 3 / WINGSPREAD / RUN-1
----------------
ascertain 0.125
breeze 0.733333333333
totter 0.45
adapt 0.351851851852
boo 0.416666666667
wing 0.166666666667
brag 0.683333333333
tense 0.6
ask 0.51380952381
afflict 0.5
avert 0.375
avoid 0.410714285714
attain 0.125
bluff 0.5
teeter 0.48
begrudge 0.55
advise 0.5796875
bludgeon 0.366666666667
sue 0.620192307692
belch 0.311904761905
----------------
AVERAGE score: 0.442991344882

Contact Info

  • Vít Baisa (Masaryk University, Brno, CZ),
  • Jane Bradbury (University of Wolverhampton, UK),
  • Ismaïl El Maarouf (University of Wolverhampton, UK),
  • Patrick Hanks (University of Wolverhampton, UK),
  • Adam Kilgarriff (Lexical Computing Ltd, UK),
  • Octavian Popescu (FBK, Trento, IT)

Announcements

  • September, 29th: Train data has been updated!
  • August, 19th: Train data has been released!
  • June, 3rd: Trial data has been released!
  • June, 5th: Google group for discussion has been created, you can send us an email, use the address: semeval2015task15@googlegroups.com