How Does Tokenization Work? How AI Reads Text
Before an AI model can understand your words, it has to chop them into pieces. That chopping — called tokenization — is…
Hi, I'm Ethan. I write about artificial intelligence — not the sci-fi version, the real one that's already in your phone, your inbox, and probably your job description.
My background is in enterprise software, so I read the research papers and test the tools before I write about them. If I say something works, it's because I tried it.
My goal is simple: no hype, no jargon. Just honest explanations of what AI can actually do for you.
Before an AI model can understand your words, it has to chop them into pieces. That chopping — called tokenization — is…
The voice reading your audiobook, announcing your train stop, or narrating that video didn’t come from a recording studio — at least,…
Type a sentence, get a painting. Midjourney turned AI image generation from a research curiosity into something millions of people use for…
Everyone talks about AI agents like they’re magic. They’re not. Under the hood, an AI agent is a language model running in…
Of all the AI tools I’ve tested, Stable Diffusion is the one I recommend most often to people who want to actually…
AI bias is one of those terms that gets thrown around constantly and explained rarely. I’ve tested enough AI systems to see…
I get asked this constantly: “Ethan, where do I even start with AI?” Usually by smart people who opened a machine learning…
“AI for business” has become a phrase that means everything and nothing. Vendors slap it on dashboards, consultants sell it in slide…
You say “hey Siri” and your phone wakes up. You dictate a text and the words appear, mostly right. It feels like…
“How does ChatGPT work?” is one of the most-asked questions I hear, and most answers fall into two useless camps: either “it’s…