Papers
arxiv:2611.04949

HERIT: Enabling Global Access to Hanja-to-English Historical Translation by Mitigating Temporal Bias

Published on Nov 3
· Submitted by
JeongDayeon
on Nov 5
Authors:

Abstract

HERIT adapts machine translation to historical archives via retrieval-augmented pseudo-labeling, improving accuracy across time periods and unlocking global access.

Historical archives are invaluable for multidisciplinary research but remain inaccessible globally due to severe language barriers. While manual translation is prohibitively expensive and time-consuming, simply applying existing machine translation models is inadequate due to unique linguistic nuances and the temporal bias inherent in scarce human-labeled corpora. To address these challenges, we propose HERIT, a systematic domain-adaptation pipeline that leverages retrieval-augmented generation (RAG) to generate high-quality pseudo-labeled data from abundant Hanja-Korean corpora. This approach substantially expands the training dataset, mitigating both data scarcity and temporal overfitting across different historical periods. Extensive automated and human evaluations demonstrate that HERIT consistently outperforms baselines. Finally, we translate previously untranslated portions of the archives using our model, thereby enabling global access to these resources for researchers.

Community

Paper author Paper submitter

HERIT, a Hanja-English RAG-based Intelligent Translation model for historical archives, is a systematic domain-adaptation pipeline that leverages retrieval-augmented generation (RAG) to generate high-quality pseudo-labeled data from abundant Hanja-Korean corpora.

  • High-Quality Synthetic Corpus: Scaled up domain-adapted Hanja–English parallel pairs using pseudo-labeling.
  • Effective Two-Stage Scheduling: HERIT consistently outperforms human-only baselines across extensive evaluations.
  • Mitigation of Temporal Bias: First to observe and address historical temporal bias in Hanja → English translation.
  • Large-Scale Public Release: Fully translated 2.09M entries spanning the entire corpora of AJD and JRS.

This is an automated message from the Librarian Bot. I found the following papers similar to this paper.

The following papers were recommended by the Semantic Scholar API

Please give a thumbs up to this comment if you found it helpful!

If you want recommendations for any Paper on Hugging Face checkout this Space

You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend

Sign up or log in to comment

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2611.04949 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2611.04949 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2611.04949 in a Space README.md to link it from this page.

Collections including this paper 1