But nobody has nailed "this is a game anyone wants to play" or "professional game development life cycles are shorter" so it's not particularly impressive.
I'm still waiting for any evidence of LLM economic impact in the real world.
Yeah, well I doubt any economic impact will from LLMs will ever come. I doubt anyone is working on nailing those things as we speak. I doubt the results my team and I are getting with agentic engineering are real. I doubt anyone can take increasingly better tools and translate that to economic value.
Those demos are put out by non-engineer AI-bros who start from a blank slate and just test raw one-shot performance of the model.
In comparison I'm aware of how much additional performance you can extract out of models with a team of professional engineers that are balls-deep in harness engineering.
its in the training data, probably many times, and it was then, too