Today's Sharp Thought: Transformers are Hiding in Plain Sight

I'm fascinated by Transformers as an example of the hidden architectures that shape our world

Author’s note: I think it’s helpful to understand transformers better, because they lie at the heart of how LLMs work. This post is all about them, and it’s designed to be info heavy.

The transformer models of 2024, like Google’s Gemini and Meta’s Llama 3.1, have revolutionized the way AI handles information. These models process text, images, video, and…