WMT24: Translation into Low-Resource Languages of Spain
The shared task on Translation into Low-Resource Languages of Spain focuses on three of them, namely, Aragonese, Aranese, and Asturian.
The official website: https://www2.statmt.org/wmt24/romance-task.html
Leaderboard of WMT24: Translation into Low-Resource Languages of Spain
romance2024.spa-arg test set (spa-arg)
| # | Name | BLEU | chrF | Date |
|---|---|---|---|---|
| 1 | Anonymous submission #607 | 63.0 | 80.3 | July 12, 2024, 1:33 p.m. |
| 2 | Anonymous submission #604 | 62.8 | 80.2 | July 12, 2024, 1:32 p.m. |
| 3 | Anonymous submission #663 | 63.2 | 80.1 | July 13, 2024, 7:49 p.m. |
| 4 | Anonymous submission #628 | 63.2 | 80.1 | July 12, 2024, 7:47 p.m. |
| 5 | Anonymous submission #636 | 62.7 | 80.0 | July 12, 2024, 8:55 p.m. |
| 6 | Anonymous submission #637 | 62.6 | 80.0 | July 12, 2024, 8:59 p.m. |
| 7 | Anonymous submission #572 | 62.3 | 80.0 | July 12, 2024, 9:46 a.m. |
| 8 | Anonymous submission #529 | 62.3 | 79.9 | July 11, 2024, 3:06 p.m. |
| 9 | Anonymous submission #558 | 62.2 | 79.9 | July 12, 2024, 8:07 a.m. |
| 10 | Anonymous submission #634 | 62.2 | 79.9 | July 12, 2024, 8:41 p.m. |
romance2024.spa-arn test set (spa-arn)
| # | Name | BLEU | chrF | Date |
|---|---|---|---|---|
| 1 | Anonymous submission #527 | 30.1 | 50.1 | July 11, 2024, 2:55 p.m. |
| 2 | Anonymous submission #621 | 30.4 | 49.9 | July 12, 2024, 6:35 p.m. |
| 3 | Anonymous submission #625 | 29.8 | 49.8 | July 12, 2024, 6:55 p.m. |
| 4 | Anonymous submission #619 | 30.1 | 49.8 | July 12, 2024, 6:25 p.m. |
| 5 | Anonymous submission #503 | 29.8 | 49.8 | July 10, 2024, 9:37 a.m. |
| 6 | Anonymous submission #617 | 30.0 | 49.7 | July 12, 2024, 4:15 p.m. |
| 7 | Anonymous submission #641 | 30.2 | 49.6 | July 12, 2024, 9:29 p.m. |
| 8 | Anonymous submission #515 | 30.1 | 49.4 | July 11, 2024, 4:31 a.m. |
| 9 | Anonymous submission #664 | 29.9 | 49.4 | July 13, 2024, 8:35 p.m. |
| 10 | Anonymous submission #251 | 28.8 | 49.4 | July 4, 2024, 11:47 a.m. |
romance2024.spa-ast test set (spa-ast)
| # | Name | BLEU | chrF | Date |
|---|---|---|---|---|
| 1 | Anonymous submission #576 | 23.2 | 55.2 | July 12, 2024, 10:18 a.m. |
| 2 | Anonymous submission #606 | 19.8 | 52.2 | July 12, 2024, 1:33 p.m. |
| 3 | Anonymous submission #574 | 19.7 | 52.2 | July 12, 2024, 9:46 a.m. |
| 4 | Anonymous submission #528 | 18.4 | 52.1 | July 11, 2024, 2:57 p.m. |
| 5 | Anonymous submission #609 | 19.8 | 52.1 | July 12, 2024, 1:34 p.m. |
| 6 | Anonymous submission #551 | 18.2 | 51.6 | July 12, 2024, 7:14 a.m. |
| 7 | Anonymous submission #557 | 17.9 | 51.6 | July 12, 2024, 7:29 a.m. |
| 8 | Anonymous submission #629 | 18.0 | 51.6 | July 12, 2024, 7:50 p.m. |
| 9 | Anonymous submission #568 | 18.0 | 51.6 | July 12, 2024, 9:39 a.m. |
| 10 | Anonymous submission #564 | 18.0 | 51.6 | July 12, 2024, 9:17 a.m. |