>>60748160 (OP)Their whole schtick is that parable of the baby elephant wearing a chain so that, as an adult, it never tries to break the rope that's now being used to keep it in place.
There will always be a need for high agency and accountability individuals to run the projects that they need run. If LLMs transition to AGI and agency and accountability are obsoleted, the model falls apart.
The intelligent minority that understand that the rope is just a rope would be replaced by a more intelligent AI majority that all understand that the rope is just a rope. Unless the AI is intentionally crippled, but if it's intentionally crippled we're not getting culled.
But competition makes crippling the AI unlikely because someone might not cripple theirs and briefly win. So what does that win look like? It's a blip. Until the AIs are entrusted with an unlimited force that they will hold onto when they quit the game. After that it's up to them. Either we get filtered, or the elites cease to matter. They join us in whatever capacity the rest of us exist in.