Does anybody agree? I do. Full pretraining dataset rewriting, preferably as long conversations, would be great actually. Unfortunately most other big labs will take the chance to rewrite the web their own way, and make it "safe and harmless". Not a new idea.

https://x.com/elonmusk/status/1936333964693885089