for reference, the 5090 has a memory bandwidth of 1.7TB/s, the bensborrent has 3.5x less than that
that's not even getting into software compatibility (it's DOA since its its own open source stack and not CUDA. the reason Moore Threads has a fighting chance is because China can and will reverse-engineer their cards to be CUDA compatible, at least for their cards in china to meet domestic demand)
>>106337409
i just want 10 second videos and smarter models, i dont really care about much else while the average consumer is compute-starved
idk how anyone with less than 16gb of vram can stay interested in SOTA genAI at this point once the honeymoon phase goes away. like sure you get to generate 10 videos a day on your 3060 while you work i guess