>>106234523
Funny that facebook ended up being even behind GPT-3 when it was only 300B tokens trained.
If you ever feel like it, feel free to reupload it, although so huge. I think i saw a torrent of it before.
It probably beats BLOOM at least! Remember when BLOOM trained over a fucking loss spike...