Dwarkesh Podcast · episode page

AI researchers debate how close we are to recursive self-improvement

…these intuitions into the weights. So the model would be more efficient at runtime. Yeah, I'd say in practice, it does seem like model providers are going domain by domain and trying to strengthen the models in the highest value domain. And I'd say that that's one of the answers to why the models have gotten so much better. It's just because the model providers have covered a lot of the high value domains and the most common types of skills. mean, I think another thing is just that it's not that expensive to do both at the same time, right? Because the models are massive. They can easily afford, in terms of their parameters, to learn everything.…