Data and Tools
Test Data & Gold Standard
- Download the full gold standard [NEW! ]
- Download the test data as it was first released to participants
Trial Data
Tools
-
Download the tools (Previous version here). These consist of:
- Python Library for reading/writing our XML format
- Python example for using the format library
- Evaluation tool [NEW VERSION AS OF March 4th and April 8th!]
- Set view tool
- Make sure to read the README file!
- Extra Machine Translation Evaluation metrics (BLEU, NIST, METEOR, TER, WER,PER). Can be invoked by the evaluation tool
XML Format Specification
Make sure to read the XML Format specification, especially if you're not using the provided Python library.