Papers

 

1. You are strongly encouraged to submit a short system description paper by February 27, 2017. For submission intructions, formatting, FAQ, etc. please check the general SemEval-2017 webpage.

 

2. You can write a paper regardless of whether you plan to attend SemEval-2017 at Vancouver (registration for SemEval-2017 and participation are optional, but strongly encouraged). Your paper will be published even if you do not register for SemEval-2017 (provided that reviewers find it to be of acceptable quality).

 

3. For your paper, you are allowed to use 4 pages, excluding references. However, if you have participated in more than one subtask, you can use up to 6 pages (excluding references).

 

4. There is no need to describe the task in much detail, as you can point to the system description paper instead (BibTex below), which will contain a detailed description of the corpora and subtasks, together with an overall discussion of the results and participant systems. You can concentrate on the description of your system and experiments. Please, make sure to use the exact following BibTex citation for the task description paper. We will cite back your system description paper in the task description paper:

 

@InProceedings{SemEval-2017:task3,

     author    = {Nakov, Preslav and Hoogeveen, Doris and M\`{a}rquez, Llu\'{i}s and Moschitti, Alessandro and Mubarak, Hamdy and Baldwin, Timothy and Verspoor, Karin},
     title     = {{SemEval}-2017 Task 3: Community Question Answering},
     booktitle = {Proceedings of the 11th International Workshop on Semantic Evaluation},
     series    = {SemEval '17},
     month     = {August},
     year      = {2017},
     address   = {Vancouver, Canada},
     publisher = {Association for Computational Linguistics},
   }
 

 

 

 

 

Contact Info

Organizers


  • Preslav Nakov, Qatar Computing Research Institute, HBKU
  • Lluís Màrquez, Qatar Computing Research Institute, HBKU
  • Alessandro Moschitti, Qatar Computing Research Institute, HBKU
  • Hamdy Mubarak, Qatar Computing Research Institute, HBKU
  • Timothy Baldwin, The University of Melbourne
  • Doris Hoogeveen, The University of Melbourne
  • Karin Verspoor, The University of Melbourne

email : semeval-cqa@googlegroups.com

Other Info

Announcements


  • 14 Feb. 2017: Submit your paper by February 27
  • 11 Feb. 2017: The results and all scores are released
  • 30 Jan. 2017: The closing date for test submissions is January 30th midnight UTC-12.
  • 24 Jan. 2017: Test set for subtask E is available now. (here)
  • 12 Jan. 2017: Test sets for subtasks A-D are available now. (data webpage)
  • 9 Jan. 2017: The release of test data for subtasks A-D is delayed by some days. Apologies for the inconvenience.
  • 5 Jan. 2017: Submission deadline is set to be January 30.
  • 5 Jan. 2017: New web page created with instructions on how to submit system results.
  • 8 Dec 2016: Separate competitions for the subtasks have been set up at CodaLab, where you can submit your results: Subtask A, Subtask B, Subtask C, Subtask D, and Subtask E. You can submit results both for the development set and the test set here, receive scores and choose what to publish on the leaderboard.
  • 8 Dec 2016: A new scorer is now available from the Data and Tools page, which can also be used for subtask E
  • Register to participate here