#linguistics

Why Language Models Still Can't Spell: The Case for Morphologically-Aware Tokenization

Language models can write poetry but struggle with basic spelling. Discover why current tokenization breaks language, and how morphology-aware approaches fix it.