Do they need this? Modern LLMs are trained on text in many languages and even if I throw medieval Gallician poetry at them[1] they can handle it.

[1]https://genius.com/Qntal-vedes-amigo-lyrics