Welcome to OCELoT!

OCELoT stands for Open, Competitive Evaluation Leaderboard of Translations. This project started as part of the Fifth Machine Translation Marathon in the Americas. Project OCELoT aims to create an open platform for competitive evaluation of machine translation output, based on both automatic metrics and human evalation. It has been used for several shared tasks, including the WMT General MT Task since 2020 as well as IWSLT shared tasks. Code is available from GitHub and shared under an open license.

Download test sets Register your team Create submission Competition updates

Competitions

# Competition Test sets Submissions Start time Deadline
1 WMT24: Translation into Low-Resource Languages of Spain 3 178 July 3, 2024, noon July 13, 2024, 11:59 p.m.
2 WMT24: Biomedical Translation Task 12 4 June 27, 2024, 6 p.m. July 12, 2024, 11:59 p.m.
3 WMT24: General MT Task 11 480 June 27, 2024, 6 p.m. July 5, 2024, 11:59 p.m.

All times in UTC timezone.