Anonymous
7/13/2025, 7:41:20 PM
No.105893279
>>105893207
Huge doubt about this.
There are analog hardware designs for doing fast multiplication and additions, maybe you get 2 orders ofmagnitude less power cost. Which is fine, if his shit does as good, okay, but you know tht's not the limiting factor?
The limiting factor is DAM, memory. And that requires area on a wafer, you can't avoid this, getting below 3-5k$/device for sub-1TB of RAM might be very hard. Nowadays everyone has far larger margins for us to even have reached anywhere near the close of what the current hardware paradigm has to offer. Might still be expensive for local though.when models only start getting really good at hundreds of billions of params.
Huge doubt about this.
There are analog hardware designs for doing fast multiplication and additions, maybe you get 2 orders ofmagnitude less power cost. Which is fine, if his shit does as good, okay, but you know tht's not the limiting factor?
The limiting factor is DAM, memory. And that requires area on a wafer, you can't avoid this, getting below 3-5k$/device for sub-1TB of RAM might be very hard. Nowadays everyone has far larger margins for us to even have reached anywhere near the close of what the current hardware paradigm has to offer. Might still be expensive for local though.when models only start getting really good at hundreds of billions of params.