Anonymous
6/14/2025, 10:10:24 PM
No.105594476
>>105594013
>I just want to fuck about with private LLMs
It's all about ram these days. vram, really. moar vram.
The best consumer config coming up is the B60 DUAL:
https://www.techpowerup.com/336966/maxsun-arc-pro-b60-dual-48gb-graphics-card-hands-on
So far, no hardware company is interested in making pro class LLM run locally. The B60 DUAL is literally two arc B60 glued together so they can fit 2 per slot.
>I just want to fuck about with private LLMs
It's all about ram these days. vram, really. moar vram.
The best consumer config coming up is the B60 DUAL:
https://www.techpowerup.com/336966/maxsun-arc-pro-b60-dual-48gb-graphics-card-hands-on
So far, no hardware company is interested in making pro class LLM run locally. The B60 DUAL is literally two arc B60 glued together so they can fit 2 per slot.