Pretty much the same point I made: https://news.ycombinator.com/item?id=48403908

Their apparent inability to get the basics right makes me severely doubt their claims of self-improving AI. The humans at Anthropic wouldn't know improvement if it landed on their lap and started twerking, and AI cannot do a job without strong human intervention into what the goals and guardrails actually are.

I'm kind of reminded of when Microsoft claimed it took a team of Ph.D.s to write a terminal application that updated at 60fps, and then Casey Muratori did it over a weekend. And this was before AI was writing code in earnest; when LLM-induced brainrot really sets in, civilization is in for a world of fresh hurt: lots more generated code, almost all of it garbage. And the promised AI crossover point where it becomes AGI, or indistinguishable from for software design purposes, recedes into the infinite future.