Results

The results for RumourEval 2017 were as follows.

A higher score is better. A lower RMSE is better. Results are given in order of team name. The gold standard data can be downloaded from the Data page, and used with the scorer program.

subtask A  
Team Score  
DFKI DKT 0.635  
ECNU 0.778  
IITP 0.641  
IKM 0.701  
Mama Edha 0.749  
NileTMRG 0.709  
Turing 0.784  
Uwaterloo 0.780  
     
subtask B open
Team Score RMSE
IITP 0.393 0.746
     
subtask B closed
Team Score RMSE
DFKI DKT 0.393 0.845
ECNU 0.464 0.736
IITP 0.286 0.807
IKM 0.536 0.763
NileTMRG 0.536 0.672

The task papers are now online.

Contact Info

Leon Derczynski (leon.d@sheffield.ac.uk)
Kalina Bontcheva (k.bontcheva@sheffield.ac.uk)
Maria Liakata (m.liakata@warwick.ac.uk)
Arkaitz Zubiaga (a.zubiaga@warwick.ac.uk)
Rob Procter (rob.procter@warwick.ac.uk)
Geraldine Wong Sak Hoi (geraldine.wongsakhoi@swissinfo.ch)

Other Info

Announcements

  • No announcements yet...