SemEval-2017

SemEval (Semantic Evaluation) is an ongoing series of evaluations of computational semantic analysis systems, organized under the umbrella of SIGLEX, the Special Interest Group on the Lexicon of the Association for Computational Linguistics. SemEval has evolved from the SensEval word sense disambiguation evaluation series. The SemEval wikipedia entry and the ACL SemEval Wiki provide a more detailed historical overview. SemEval-2017 will be the 11th workshop on semantic evaluation and will be collocated with the 55th annual meeting of the Association for Computational Linguistics (ACL). SemEval will  be held in Vancouver, Canada, at the Westin Bayshore Hotel August 3rd and 4th, 2017.

Program and Proceedings

The program is available here: http://aclweb.org/anthology/S17-2000#page=21

The proceedings are available here: http://aclanthology.info/events/semeval-2017#S17-2

Important Dates

• Mon 01 Aug 2016: Trial data ready
• Mon 05 Sep 2016: Training data ready
• Mon 05 Dec 2016: CodaLab competitions ready
• Mon 09 Jan 2017: Evaluation start*
• Mon 30 Jan 2017: Evaluation end*
• Mon 06 Feb 2017: Results posted
• Mon 27 Feb 2017: System description paper submissions due by 23:59 GMT -12:00
• Mon 06 Mar 2017: Task description paper submissions due by 23:59 GMT -12:00
• Mon 20 Mar 2017: Paper reviews due (for both systems and tasks)
• Mon 03 Apr 2017: Author notifications
• Mon 17 Apr 2017: Camera ready submissions due

9 Jan to 30 Jan 2017 is the period during which the task organizers must schedule the evaluation periods for their individual tasks. Usually, evaluation periods for individual tasks is 7 to 14 days, but there is no hard and fast rule about this. Contact the task organizers for the tasks you are interested in for the exact time frame when they will conduct their evaluations. They should tell you the date by which they will release the test data, and the date by which participant submissions are to be uploaded. Note that some tasks may involve more than one sub-tasks, each having a separate evaluation time frame.

Discussion Group

Please join our discussion group at
semeval3@googlegroups.com
to receive announcements and participate in discussions. 
For details, questions, and discussion on a particular task, visit the task website. You will also find there a link for the task mailing list.

Anti-Harassment policy

SemEval highly values the open exchange of ideas, the freedom of thought and expression, and respectful scientific debate. We support and uphold the NAACL Anti-Harassment policy. Participants are encouraged to send any concerns or questions to the NAACL Board members, Priscilla Rasmussen and/or the workshop organizers.