← Home ← Back to /g/

Thread 106502608

16 posts 10 images /g/
Anonymous 9/6/2025, 5:27:45 PM No.106502608 >>106502645 >>106502668 >>106502709 >>106502831
GIGABYTE-AI-TOP-CXL-DDR5-EXPANSION-CARD-HERO-1536x799.jpg md5: 74d71ad7... 🔍
Finally a CXL card for consumer
Anonymous 9/6/2025, 5:30:52 PM No.106502645 >>106502657
screen.png md5: 9ac4c048... 🔍
>>106502608 (OP)
Anonymous 9/6/2025, 5:31:53 PM No.106502657
1730632627107453.png md5: aeb1b8d6... 🔍
>>106502645
Anonymous 9/6/2025, 5:32:47 PM No.106502668
>>106502608 (OP)
Only for 2 motherboards tho.
Anonymous 9/6/2025, 5:37:53 PM No.106502709 >>106502746 >>106502769 >>106505341
>>106502608 (OP)
Gonna piggyback this shit thread and ask: if I don't care about gaming and my main interest is LLMs, couldn't I just get some AI accelerator? Do those even exist as an add-on card?
Anonymous 9/6/2025, 5:43:03 PM No.106502746 >>106502756
>>106502709
>couldn't I just get some AI accelerator?
Sure if you have the money you can just buy a H100 or H200.
Anonymous 9/6/2025, 5:44:21 PM No.106502756 >>106502779
>>106502746
Isn't that just a rebadged GPU with tons of RAM and (((corporate))) agreements?
Anonymous 9/6/2025, 5:45:34 PM No.106502769 >>106503540
h200-kv-bb580_440-p@2x.jpg md5: 1e3d87c6... 🔍
>>106502709
sure, they exist, but not for normies like us. and probably won't ever unless china has some kind of fab breakthrough. nvidia has no market motivation to take away from high paying institutional customers for individuals.
Anonymous 9/6/2025, 5:46:34 PM No.106502779 >>106502798
>>106502756
what do you think an "ai accelerator" would actually be, anon?
Anonymous 9/6/2025, 5:49:32 PM No.106502798 >>106502960
Apple-M4-chip-new-CPU-240507_big.jpg.large.jpg md5: 75ebb554... 🔍
>>106502779
I mean this shit. Just extract that part and give it to me as a PCIe card.
I don't mean Apple branded. It's just an example.
Anonymous 9/6/2025, 5:53:02 PM No.106502831
>>106502608 (OP)
What can it do?
Why not just put more memory to the dimm sockets on the motherboard?
Anonymous 9/6/2025, 6:05:05 PM No.106502960 >>106504806
>>106502798
anon those are just "tensor cores", which have variously been called "cuda cores" or "shader units" and various otherr things, that make up the bulk of a gpu. it's not some special "ai only bonus" the way it seems you think it is.
Anonymous 9/6/2025, 6:56:05 PM No.106503540 >>106503553
>>106502769
You can literally buy them on ebay they usually go for a pretty hefty mark up even compared to what they cost with OEMs when bought as a complete system though.
Anonymous 9/6/2025, 6:57:08 PM No.106503553
>>106503540
And yes those listings are legit, I know because I bought two H100s with gains from shitcoin gambling.
Anonymous 9/6/2025, 8:50:00 PM No.106504806
>>106502960
Then what are the NPU's supposed to be?
Anonymous 9/6/2025, 9:47:32 PM No.106505341
>>106502709
You can get those, but they perform worse than a gaming GPU and cost more.
Does it make sense? No it doesn't. Now is a really good time to get a 3090 though, especially if you're in Europe. NVIDIA dumped 50 series stock here because it isn't selling well so lots of people are upgrading and the price in the secondhand market has fallen hard. I got one for 500 a few days ago.