Will the Model Eat Your Stack? | Drew Breunig
May 30, 2025
The haunting question facing every AI product team: what can you build today that won’t be subsumed by tomorrow’s model?A good chunk of the first wave of AI-powered products got crushed by this dynamic. They invested significant efforts to build, tune, and test prompts against their specific domain. At the time (circa ChatGPT 3.5), models were powerful but picky. Endlessly tweaking prompts in your pet domain was worthwhile and enabled brand new applications.
But then the GPT-4 level models arrived and nailed many of these challenges with one casual prompt.
We’re still very much focusing on the technology go LLMs for the most part. But the question of what products built with these technologies will have lasting value is a much more challenging one.
