>>106161709
These 'Mushroom MoE's I will now call them, please note that I invented the term on this very post-
They're clearly designed to scam investors.
>look, businesses will totally spend 100K on a server with a pair of H100s so that they can do uh... AI stuff for money... Just look how fast the throughput is compared to ____ while performing as well as ____ in _____ task
And it's Mushroom MoE's all the way to the top of the stack now. Hopefully the chinks see this and correct their course back to things that actually push the frontiers of capability and emergent phenomena