English
-
Data:
-
(OLD) Trial: 100 examples: 50 general questions and ~50 yes/no questions; download (Excel) (XML)
-
(NEW) Training+dev: 2600 training + 300 development questions (~10% are yes/no), including 16,541 training + 1,645 development comments; download (XML); check the README file for a detailed description, and also here
-
(NEW) Raw text of questions and comments from Qatar Living: question subjects+bodies, and comment subjects+bodies.
-
(NEW) Test: 329 test questions (~8% are yes/no), including 1,976 comments, both input files and gold labels, are here
-
Scorer:
-
download the scorers (for subtasks A and B, for both English and Arabic) here.
-
Format checker:
-
download the English format checkers (for subtasks A and B) here.
-
Baseline system:
-
download the English baseline systems (for subtasks A and B) here.
Arabic
-
Data:
-
(OLD) Trial: 30 examples of yes/no questions; download (XML)
-
(NEW) Training+dev: 1300 training + 200 development questions (yes/no questions have been dropped); download (XML); check the README file for a detailed description
-
(NEW) Test: input files and gold labels are here
-
Scorer:
-
download the scorers (for subtasks A and B, for both English and Arabic) here.
-
Format checker:
-
download the Arabic format checkers (for subtasks A and B) here.