The Geometry of Grammar: An Investigation into Interpretable Dimensions in Word Embeddings
•12 min read
Does a simple 'tense axis' exist in word embeddings? Explore the geometric reality of grammatical structure in AI language models, from Word2Vec's elegant linear analogies to BERT's complex contextual transformations.