Welcome to OCELoT!
OCELoT stands for Open, Competitive Evaluation Leaderboard of Translations. This project started as part of the Fifth Machine Translation Marathon in the Americas. Project OCELoT aims to create an open platform for competitive evaluation of machine translation output, based on both automatic metrics and human evalation. It has been used for several shared tasks, including the WMT General MT Task since 2020 as well as IWSLT shared tasks. Code is available from GitHub and shared under an open license.
Competitions
# | Competition | Test sets | Submissions | Start time | Deadline |
---|---|---|---|---|---|
1 | WMT24: Translation into Low-Resource Languages of Spain | 3 | 178 | July 3, 2024, noon | July 13, 2024, 11:59 p.m. |
2 | WMT24: Biomedical Translation Task | 12 | 4 | June 27, 2024, 6 p.m. | July 12, 2024, 11:59 p.m. |
3 | WMT24: General MT Task | 11 | 480 | June 27, 2024, 6 p.m. | July 5, 2024, 11:59 p.m. |
All times in UTC timezone.