Multilingual Tokenization

Papers investigating how tokenizers handle phonetic, orthographic, and linguistic properties across languages, and how tokenization choices affect cross-lingual alignment and representation learning.