Findings of the WMT 2024 Biomedical Translation Shared Task: Test Sets on Abstract Level

Abstract

We present the results of the ninth edition of the Biomedical Translation Task at WMT’24. We released test sets for six language pairs, namely, French, German, Italian, Portuguese, Russian, and Spanish, from and into English. Eachtest set consists of 50 abstracts from PubMed. Differently from previous years, we did not split abstracts into sentences. We received submissions from five teams, and for almost all language directions. We used a baseline/comparison system based on Llama 3.1 and share the source code at https://github.com/cgrozea/wmt24biomed-ref.

Type
Publication
Proceedings of the Ninth Conference on Machine Translation
Philippe Thomas
Philippe Thomas
Senior Researcher
Roland Roller
Roland Roller
Senior Researcher
Steffen Castle
Steffen Castle
PhD Candidate