default search action
Tom Kocmi
Person information
Refine list
refinements active!
zoomed in on ?? of ?? records
view refined list in
export refined list as
showing all ?? records
2020 – today
- 2024
- [c47]Tom Kocmi, Vilém Zouhar, Christian Federmann, Matt Post:
Navigating the Metrics Maze: Reconciling Score Magnitudes and Accuracies. ACL (1) 2024: 1999-2014 - [c46]Qingyu Lu, Baopu Qiu, Liang Ding, Kanjian Zhang, Tom Kocmi, Dacheng Tao:
Error Analysis Prompting Enables Human-Like Translation Evaluation in Large Language Models. ACL (Findings) 2024: 8801-8816 - [c45]Vikas Raunak, Tom Kocmi, Matt Post:
SLIDE: Reference-free Evaluation for Machine Translation using a Sliding Document Window. NAACL (Short Papers) 2024: 205-211 - [c44]Tianyi Tang, Hongyuan Lu, Yuchen Jiang, Haoyang Huang, Dongdong Zhang, Wayne Xin Zhao, Tom Kocmi, Furu Wei:
Not All Metrics Are Guilty: Improving NLG Evaluation by Diversifying References. NAACL-HLT 2024: 6596-6610 - [c43]Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, Ondrej Bojar, Anton Dvorkovich, Christian Federmann, Mark Fishel, Markus Freitag, Thamme Gowda, Roman Grundkiewicz, Barry Haddow, Marzena Karpinska, Philipp Koehn, Benjamin Marie, Christof Monz, Kenton Murray, Masaaki Nagata, Martin Popel, Maja Popovic, Mariya Shmatova, Steinthór Steingrímsson, Vilém Zouhar:
Findings of the WMT24 General Machine Translation Shared Task: The LLM Era Is Here but MT Is Not Solved Yet. WMT 2024: 1-46 - [c42]Markus Freitag, Nitika Mathur, Daniel Deutsch, Chi-kiu Lo, Eleftherios Avramidis, Ricardo Rei, Brian Thompson, Frédéric Blain, Tom Kocmi, Jiayi Wang, David Ifeoluwa Adelani, Marianna Buchicchio, Chrysoula Zerva, Alon Lavie:
Are LLMs Breaking MT Metrics? Results of the WMT24 Metrics Shared Task. WMT 2024: 47-81 - [c41]Tom Kocmi, Vilém Zouhar, Eleftherios Avramidis, Roman Grundkiewicz, Marzena Karpinska, Maja Popovic, Mrinmaya Sachan, Mariya Shmatova:
Error Span Annotation: A Balanced Approach for Human Evaluation of Machine Translation. WMT 2024: 1440-1453 - [e4]Barry Haddow, Tom Kocmi, Philipp Koehn, Christof Monz:
Proceedings of the Ninth Conference on Machine Translation, WMT 2024, Miami, FL, USA, November 15-16, 2024. Association for Computational Linguistics 2024, ISBN 979-8-89176-179-7 [contents] - [i25]Tom Kocmi, Vilém Zouhar, Christian Federmann, Matt Post:
Navigating the Metrics Maze: Reconciling Score Magnitudes and Accuracies. CoRR abs/2401.06760 (2024) - [i24]Nikita Moghe, Arnisa Fazla, Chantal Amrhein, Tom Kocmi, Mark Steedman, Alexandra Birch, Rico Sennrich, Liane Guillou:
Machine Translation Meta Evaluation through Translation Accuracy Challenge Sets. CoRR abs/2401.16313 (2024) - [i23]Tom Kocmi, Vilém Zouhar, Eleftherios Avramidis, Roman Grundkiewicz, Marzena Karpinska, Maja Popovic, Mrinmaya Sachan, Mariya Shmatova:
Error Span Annotation: A Balanced Approach for Human Evaluation of Machine Translation. CoRR abs/2406.11580 (2024) - [i22]Vilém Zouhar, Tom Kocmi, Mrinmaya Sachan:
AI-Assisted Human Evaluation of Machine Translation. CoRR abs/2406.12419 (2024) - [i21]Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, Ondrej Bojar, Anton Dvorkovich, Christian Federmann, Mark Fishel, Markus Freitag, Thamme Gowda, Roman Grundkiewicz, Barry Haddow, Marzena Karpinska, Philipp Koehn, Benjamin Marie, Kenton Murray, Masaaki Nagata, Martin Popel, Maja Popovic, Mariya Shmatova, Steinþór Steingrímsson, Vilém Zouhar:
Preliminary WMT24 Ranking of General MT Systems and LLMs. CoRR abs/2407.19884 (2024) - 2023
- [c40]Vilém Zouhar, Shehzaad Dhuliawala, Wangchunshu Zhou, Nico Daheim, Tom Kocmi, Yuchen Eleanor Jiang, Mrinmaya Sachan:
Poor Man's Quality Estimation: Predicting Reference-Based MT Metrics Without the Reference. EACL 2023: 1303-1317 - [c39]Tom Kocmi, Christian Federmann:
Large Language Models Are State-of-the-Art Evaluators of Translation Quality. EAMT 2023: 193-203 - [c38]Tirthankar Ghosal, Ondrej Bojar, Marie Hledíková, Tom Kocmi, Anna Nedoluzhko:
Overview of the Second Shared Task on Automatic Minuting (AutoMin) at INLG 2023. INLG (Generation Challenges) 2023: 138-167 - [c37]Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, Ondrej Bojar, Anton Dvorkovich, Christian Federmann, Mark Fishel, Markus Freitag, Thamme Gowda, Roman Grundkiewicz, Barry Haddow, Philipp Koehn, Benjamin Marie, Christof Monz, Makoto Morishita, Kenton Murray, Makoto Nagata, Toshiaki Nakazawa, Martin Popel, Maja Popovic, Mariya Shmatova:
Findings of the 2023 Conference on Machine Translation (WMT23): LLMs Are Here but Not Quite There Yet. WMT 2023: 1-42 - [c36]Markus Freitag, Nitika Mathur, Chi-kiu Lo, Eleftherios Avramidis, Ricardo Rei
, Brian Thompson, Tom Kocmi, Frédéric Blain, Daniel Deutsch, Craig Stewart, Chrysoula Zerva, Sheila Castilho, Alon Lavie, George F. Foster:
Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not Innocent. WMT 2023: 578-628 - [c35]Kirill Semenov, Vilém Zouhar, Tom Kocmi, Dongdong Zhang, Wangchunshu Zhou, Yuchen Eleanor Jiang:
Findings of the WMT 2023 Shared Task on Machine Translation with Terminologies. WMT 2023: 663-671 - [c34]Muhammad N. ElNokrashy, Tom Kocmi:
eBLEU: Unexpectedly Good Machine Translation Evaluation Using Simple Word Embeddings. WMT 2023: 746-750 - [c33]Thamme Gowda, Tom Kocmi, Marcin Junczys-Dowmunt:
Cometoid: Distilling Strong Reference-based Machine Translation Metrics into Even Stronger Quality Estimation Metrics. WMT 2023: 751-755 - [c32]Tom Kocmi, Christian Federmann:
GEMBA-MQM: Detecting Translation Quality Error Spans with GPT-4. WMT 2023: 768-775 - [c31]Vikas Raunak, Tom Kocmi, Matt Post:
Evaluating Metrics for Document-context Evaluation in Machine Translation. WMT 2023: 812-814 - [e3]Philipp Koehn, Barry Haddon, Tom Kocmi, Christof Monz:
Proceedings of the Eighth Conference on Machine Translation, WMT 2023, Singapore, December 6-7, 2023. Association for Computational Linguistics 2023, ISBN 979-8-89176-041-7 [contents] - [i20]Vilém Zouhar, Shehzaad Dhuliawala, Wangchunshu Zhou, Nico Daheim, Tom Kocmi, Yuchen Eleanor Jiang, Mrinmaya Sachan:
Poor Man's Quality Estimation: Predicting Reference-Based MT Metrics Without the Reference. CoRR abs/2301.09008 (2023) - [i19]Tom Kocmi, Christian Federmann:
Large Language Models Are State-of-the-Art Evaluators of Translation Quality. CoRR abs/2302.14520 (2023) - [i18]Vikas Raunak, Tom Kocmi, Matt Post:
SLIDE: Reference-free Evaluation for Machine Translation using a Sliding Document Window. CoRR abs/2309.08832 (2023) - [i17]Tom Kocmi, Christian Federmann:
GEMBA-MQM: Detecting Translation Quality Error Spans with GPT-4. CoRR abs/2310.13988 (2023) - 2022
- [c30]Tom Kocmi, Rachel Bawden, Ondrej Bojar, Anton Dvorkovich, Christian Federmann, Mark Fishel, Thamme Gowda, Yvette Graham, Roman Grundkiewicz, Barry Haddow, Rebecca Knowles, Philipp Koehn, Christof Monz, Makoto Morishita, Masaaki Nagata, Toshiaki Nakazawa, Michal Novák, Martin Popel, Maja Popovic:
Findings of the 2022 Conference on Machine Translation (WMT22). WMT 2022: 1-45 - [c29]Markus Freitag, Ricardo Rei, Nitika Mathur, Chi-kiu Lo, Craig Stewart, Eleftherios Avramidis
Results of WMT22 Metrics Shared Task: Stop Using BLEU - Neural Metrics Are Better and More Robust. WMT 2022: 46-68 - [c28]Johnny Tian-Zheng Wei, Tom Kocmi, Christian Federmann:
Searching for a Higher Power in the Human Evaluation of MT. WMT 2022: 129-139 - [c27]Tom Kocmi, Hitokazu Matsushita, Christian Federmann:
MS-COMET: More and Better Human Judgements Improve Metric Performance. WMT 2022: 541-548 - [e2]Philipp Koehn, Loïc Barrault, Ondrej Bojar, Fethi Bougares, Rajen Chatterjee, Marta R. Costa-jussà, Christian Federmann, Mark Fishel, Alexander Fraser, Markus Freitag, Yvette Graham, Roman Grundkiewicz, Paco Guzman, Barry Haddow, Matthias Huck, Antonio Jimeno-Yepes, Tom Kocmi, André Martins, Makoto Morishita, Christof Monz, Masaaki Nagata, Toshiaki Nakazawa, Matteo Negri, Aurélie Névéol, Mariana Neves, Martin Popel, Marco Turchi, Marcos Zampieri:
Proceedings of the Seventh Conference on Machine Translation, WMT 2022, Abu Dhabi, United Arab Emirates (Hybrid), December 7-8, 2022. Association for Computational Linguistics 2022, ISBN 978-1-959429-29-6 [contents] - [i16]Tom Kocmi, Dominik Machácek, Ondrej Bojar:
The Reality of Multi-Lingual Machine Translation. CoRR abs/2202.12814 (2022) - [i15]Johnny Tian-Zheng Wei, Tom Kocmi, Christian Federmann:
Searching for a higher power in the human evaluation of MT. CoRR abs/2210.11612 (2022) - 2021
- [c26]Rudolf Rosa, Tomás Musil, Ondrej Dusek, Dominik Jurko, Patrícia Schmidtová, David Marecek, Ondrej Bojar, Tom Kocmi, Daniel Hrbek, David Kosták, Martina Kinská, Marie Nováková, Josef Dolezal, Klára Vosecká, Tomás Studeník, Petr Zabka:
THEaiTRE 1.0: Interactive Generation of Theatre Play Scripts. Text2Story@ECIR 2021: 71-76 - [c25]Rudolf Rosa
When a Robot Writes a Play: Automatically Generating a Theatre Play Script. ALIFE 2021: 60 - [c24]Farhad Akhbardeh, Arkady Arkhangorodsky, Magdalena Biesialska
Findings of the 2021 Conference on Machine Translation (WMT21). WMT@EMNLP 2021: 1-88 - [c23]Tom Kocmi, Christian Federmann, Roman Grundkiewicz, Marcin Junczys-Dowmunt, Hitokazu Matsushita, Arul Menezes:
To Ship or Not to Ship: An Extensive Evaluation of Automatic Metrics for Machine Translation. WMT@EMNLP 2021: 478-494 - [e1]Loïc Barrault, Ondrej Bojar, Fethi Bougares, Rajen Chatterjee, Marta R. Costa-jussà, Christian Federmann, Mark Fishel, Alexander Fraser, Markus Freitag, Yvette Graham, Roman Grundkiewicz, Paco Guzman, Barry Haddow, Matthias Huck, Antonio Jimeno-Yepes, Philipp Koehn, Tom Kocmi, André Martins, Makoto Morishita, Christof Monz:
Proceedings of the Sixth Conference on Machine Translation, WMT@EMNLP 2021, Online Event, November 10-11, 2021. Association for Computational Linguistics 2021, ISBN 978-1-954085-94-7 [contents] - [i14]Rudolf Rosa, Tomás Musil, Ondrej Dusek, Dominik Jurko, Patrícia Schmidtová, David Marecek, Ondrej Bojar, Tom Kocmi, Daniel Hrbek, David Kosták, Martina Kinská, Marie Nováková, Josef Dolezal, Klára Vosecká, Tomás Studeník, Petr Zabka:
THEaiTRE 1.0: Interactive generation of theatre play scripts. CoRR abs/2102.08892 (2021) - [i13]Roman Grundkiewicz, Marcin Junczys-Dowmunt, Christian Federmann, Tom Kocmi:
On User Interfaces for Large-Scale Document-Level Human Evaluation of Machine Translation Outputs. CoRR abs/2104.10408 (2021) - [i12]Tom Kocmi, Christian Federmann, Roman Grundkiewicz, Marcin Junczys-Dowmunt, Hitokazu Matsushita, Arul Menezes:
To Ship or Not to Ship: An Extensive Evaluation of Automatic Metrics for Machine Translation. CoRR abs/2107.10821 (2021) - 2020
- [c22]Tom Kocmi, Ondrej Bojar:
Efficiently Reusing Old Models Across Languages via Transfer Learning. EAMT 2020: 19-28 - [c21]Rudolf Rosa, Ondrej Dusek, Tom Kocmi, David Marecek, Tomás Musil, Patrícia Schmidtová, Dominik Jurko, Ondrej Bojar, Daniel Hrbek, David Kosták, Martina Kinská, Josef Dolezal, Klára Vosecká:
THEaiTRE: Artificial Intelligence to Write a Theatre Play. AI4Narratives@IJCAI 2020: 9-13 - [c20]Loïc Barrault, Magdalena Biesialska, Ondrej Bojar, Marta R. Costa-jussà, Christian Federmann, Yvette Graham, Roman Grundkiewicz, Barry Haddow, Matthias Huck, Eric Joanis, Tom Kocmi, Philipp Koehn, Chi-kiu Lo, Nikola Ljubesic, Christof Monz, Makoto Morishita, Masaaki Nagata, Toshiaki Nakazawa, Santanu Pal, Matt Post, Marcos Zampieri:
Findings of the 2020 Conference on Machine Translation (WMT20). WMT@EMNLP 2020: 1-55 - [c19]Tom Kocmi:
CUNI Submission for the Inuktitut Language in WMT News 2020. WMT@EMNLP 2020: 171-174 - [c18]Tom Kocmi, Tomasz Limisiewicz, Gabriel Stanovsky:
Gender Coreference and Bias Evaluation at WMT 2020. WMT@EMNLP 2020: 357-364 - [c17]Ivana Kvapilíková, Tom Kocmi, Ondrej Bojar:
CUNI Systems for the Unsupervised and Very Low Resource Translation Task in WMT20. WMT@EMNLP 2020: 1123-1128 - [i11]Tom Kocmi:
Exploring Benefits of Transfer Learning in Neural Machine Translation. CoRR abs/2001.01622 (2020) - [i10]Rudolf Rosa
THEaiTRE: Artificial Intelligence to Write a Theatre Play. CoRR abs/2006.14668 (2020) - [i9]Tom Kocmi, Martin Popel
Announcing CzEng 2.0 Parallel Corpus with over 2 Gigawords. CoRR abs/2007.03006 (2020) - [i8]Tom Kocmi, Tomasz Limisiewicz
Gender Coreference and Bias Evaluation at WMT 2020. CoRR abs/2010.06018 (2020) - [i7]Ivana Kvapilíková, Tom Kocmi, Ondrej Bojar:
CUNI Systems for the Unsupervised and Very Low Resource Translation Task in WMT20. CoRR abs/2010.11747 (2020)
2010 – 2019
- 2019
- [c16]Tom Kocmi, Ondrej Bojar:
CUNI Submission for Low-Resource Languages in WMT News 2019. WMT (2) 2019: 234-240 - [i6]Tom Kocmi
Transfer Learning across Languages from Someone Else's NMT Model. CoRR abs/1909.10955 (2019) - 2018
- [c15]Tom Kocmi, Shantipriya Parida, Ondrej Bojar:
CUNI NMT System for WAT 2018 Translation Tasks. WAT@PACLIC 2018 - [c14]Jindrich Helcl, Jindrich Libovický, Tom Kocmi, Tomás Musil, Ondrej Cífka, Dusan Varis, Ondrej Bojar:
Neural Monkey: The Current State and Beyond. AMTA (1) 2018: 168-176 - [c13]Tom Kocmi, Dusan Varis, Ondrej Bojar:
CUNI Basque-to-English Submission in IWSLT18. IWSLT 2018: 142-146 - [c12]Milan Straka, Nikita Mediankin, Tom Kocmi, Zdenek Zabokrtský, Vojtech Hudecek, Jan Hajic:
SumeCzech: Large Czech News-Based Summarization Dataset. LREC 2018 - [c11]Tom Kocmi, Ondrej Bojar:
Trivial Transfer Learning for Low-Resource Neural Machine Translation. WMT 2018: 244-252 - [c10]Tom Kocmi, Roman Sudarikov, Ondrej Bojar:
CUNI Submissions in WMT18. WMT (shared task) 2018: 431-437 - [i5]Tom Kocmi, Ondrej Bojar:
SubGram: Extending Skip-gram Word Representation with Substrings. CoRR abs/1806.06571 (2018) - [i4]Tom Kocmi, Ondrej Bojar:
Trivial Transfer Learning for Low-Resource Neural Machine Translation. CoRR abs/1809.00357 (2018) - 2017
- [c9]Tom Kocmi, Dusan Varis, Ondrej Bojar:
CUNI NMT System for WAT 2017 Translation Tasks. WAT@IJCNLP 2017: 154-159 - [c8]Tom Kocmi
LanideNN: Multilingual Language Identification on Text Stream. EACL (1) 2017: 927-936 - [c7]Tom Kocmi, Ondrej Bojar:
An Exploration of Word Embedding Initialization in Deep-Learning Tasks. ICON 2017: 56-64 - [c6]Tom Kocmi, Ondrej Bojar:
Curriculum Learning and Minibatch Bucketing in Neural Machine Translation. RANLP 2017: 379-386 - [c5]Roman Sudarikov, David Marecek, Tom Kocmi, Dusan Varis, Ondrej Bojar:
CUNI submission in WMT17: Chimera goes neural. WMT 2017: 248-256 - [c4]Ondrej Bojar, Jindrich Helcl, Tom Kocmi, Jindrich Libovický, Tomás Musil
Results of the WMT17 Neural MT Training Task. WMT 2017: 525-533 - [i3]Tom Kocmi, Ondrej Bojar:
LanideNN: Multilingual Language Identification on Character Window. CoRR abs/1701.03338 (2017) - [i2]Tom Kocmi, Ondrej Bojar:
Curriculum Learning and Minibatch Bucketing in Neural Machine Translation. CoRR abs/1707.09533 (2017) - [i1]Tom Kocmi, Ondrej Bojar:
An Exploration of Word Embedding Initialization in Deep-Learning Tasks. CoRR abs/1711.09160 (2017) - 2016
- [c3]Ondrej Bojar, Ondrej Cífka, Jindrich Helcl, Tom Kocmi, Roman Sudarikov:
UFAL Submissions to the IWSLT 2016 MT Track. IWSLT 2016 - [c2]Tom Kocmi
SubGram: Extending Skip-Gram Word Representation with Substrings. TSD 2016: 182-189 - [c1]Ondrej Bojar
CzEng 1.6: Enlarged Czech-English Parallel Corpus with Processing Tools Dockered. TSD 2016: 231-238
Coauthor Index
manage site settings
To protect your privacy, all features that rely on external API calls from your browser are turned off by default. You need to opt-in for them to become active. All settings here will be stored as cookies with your web browser. For more information see our F.A.Q.
Unpaywalled article links
Add open access links from to the list of external document links (if available).
Privacy notice: By enabling the option above, your browser will contact the API of unpaywall.org to load hyperlinks to open access articles. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the Unpaywall privacy policy.
Archived links via Wayback Machine
For web page which are no longer available, try to retrieve content from the of the Internet Archive (if available).
Privacy notice: By enabling the option above, your browser will contact the API of archive.org to check for archived content of web pages that are no longer available. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the Internet Archive privacy policy.
Reference lists
Add a list of references from ,
, and
to record detail pages.
load references from crossref.org and opencitations.net
Privacy notice: By enabling the option above, your browser will contact the APIs of crossref.org, opencitations.net, and semanticscholar.org to load article reference information. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the Crossref privacy policy and the OpenCitations privacy policy, as well as the AI2 Privacy Policy covering Semantic Scholar.
Citation data
Add a list of citing articles from and
to record detail pages.
load citations from opencitations.net
Privacy notice: By enabling the option above, your browser will contact the API of opencitations.net and semanticscholar.org to load citation information. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the OpenCitations privacy policy as well as the AI2 Privacy Policy covering Semantic Scholar.
OpenAlex data
Load additional information about publications from .
Privacy notice: By enabling the option above, your browser will contact the API of openalex.org to load additional information. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the information given by OpenAlex.
last updated on 2024-11-22 19:40 CET by the dblp team
all metadata released as open data under CC0 1.0 license
see also: Terms of Use | Privacy Policy | Imprint
dblp was originally created in 1993 at:
since 2018, dblp has been operated and maintained by:
the dblp computer science bibliography is funded and supported by: