AI researchers debate how close we are to recursive self-improvement
isn't it weird how Sonnet 5 and Opus 5 are like almost objectively worse models than like GLM 5.3, Kimi K3, even though they've had access to like not only distillation but logic distillation from like mythos. And so the counter here was that like, okay, the prompt distribution really, really matters.
maybe we're just in this weird like uncanny valley where [...] the student teacher gap [...] is just like too large [...] the difference between Opus 4.6 and Opus 5, is that Opus 5 really feels like it's got this like AI as a judge checking every possible thing it's done
it does seem like model providers are going domain by domain and trying to strengthen the models in the highest value domain. And I'd say that that's one of the answers to why the models have gotten so much better. It's just because the model providers have covered a lot of the high value domains and the most common types of skills.