AI MAX+ 395 APUs - /g/ (#106216635)

Anonymous
8/10/2025, 11:55:28 PM No.106216635
GMKtec_EVO_X2
GMKtec_EVO_X2
md5: da498f650192b84428e7260ccc2c0103🔍
>Ryzen AI MAX+ 395
>RADEON 8090S iGPU
>128GB of shared LPDDR5X memory
>can run gpt-oss-120b super fast
>can run Qwen3 235B 4bit
>costs $2000
Why don't you own one? You do want to run a 235B model locally without government interference, right? You aren't poor, right?
Replies: >>106216670 >>106216682 >>106216732 >>106216745 >>106217869 >>106218003 >>106218504 >>106219173 >>106219235 >>106219964
Anonymous
8/10/2025, 11:59:53 PM No.106216670
>>106216635 (OP)
>without government interference, right?
>chinese PC
Replies: >>106216743
Anonymous
8/11/2025, 12:00:44 AM No.106216682
>>106216635 (OP)
i remember reading somewhere the ai inference slower than a 2060. also you cant run 235B 4bit on it. i think only about 90gb are usable rest are reserved
Replies: >>106216808
Anonymous
8/11/2025, 12:06:13 AM No.106216732
>>106216635 (OP)
>sends your data to Beijing every 1.6 attoseconds
No thanks
Replies: >>106216763 >>106218113
Anonymous
8/11/2025, 12:07:22 AM No.106216743
>>106216670
what makes a pc chinese?
Replies: >>106216756
Anonymous
8/11/2025, 12:07:35 AM No.106216745
>>106216635 (OP)
128 isn't enough. if this is supposed to be an ai computer it really needs 256.
Replies: >>106217270
Anonymous
8/11/2025, 12:08:37 AM No.106216756
>>106216743
Being sold by Chinese owned company
Replies: >>106216776
Anonymous
8/11/2025, 12:08:51 AM No.106216763
>>106216732
>*disconnects it from the internet*
what now?
Replies: >>106216778
Anonymous
8/11/2025, 12:09:38 AM No.106216776
>>106216756
so like your favorite lenovo stinkpads?
Replies: >>106216983 >>106216997 >>106217013
Anonymous
8/11/2025, 12:09:43 AM No.106216778
>>106216763
>disconnects
>implying
Replies: >>106216822
Anonymous
8/11/2025, 12:11:22 AM No.106216808
>>106216682
It can run the Q3 qwen-235b at 13 tokens per second and the Q4 at around 1.5 tokens per second. Yes Q4 is slow but still useable with telling it to generate shorter answers.
Replies: >>106218066
Anonymous
8/11/2025, 12:11:51 AM No.106216822
>>106216778
what, it cracks its nearest wi-fi password through pure i-ching seethe and silently connects and pings?
Replies: >>106216952
Anonymous
8/11/2025, 12:23:44 AM No.106216952
>>106216822
>What is GSM
Replies: >>106218474
Anonymous
8/11/2025, 12:26:32 AM No.106216983
>>106216776
lmao
Anonymous
8/11/2025, 12:27:52 AM No.106216997
>>106216776
I prefer HP
Anonymous
8/11/2025, 12:29:37 AM No.106217013
>>106216776
you can't just drop a trvke like that on /g/ sir
Anonymous
8/11/2025, 12:55:16 AM No.106217270
>>106216745
It costs $1,999 for a full blown PC with 128GB of unified memory. Nvidia gives you 96GB for $7000 and that's just the GPU.
Replies: >>106217405
Anonymous
8/11/2025, 1:10:46 AM No.106217405
>>106217270
i expected this. if you really want to run large models you put certain things on the gpu and overflow onto the cpu for less used stuff. this thing only has one memory pool, so it needs more. sure it can run larger models, but if you want something like the real thing you're gonna need more ram. this thing falls into the gap between "playing around for fun" and "useful for real work" because of ram limits.
Anonymous
8/11/2025, 1:54:42 AM No.106217869
>>106216635 (OP)
Mobile cpu is a stopgap. You can get 4 AMD Mi50 cards with 32gb vram for $200 each. $800 plus another $1200 for an epyc build and you can host the whole model in vram with like 4x the bandwidth. Vulkan is a little slower than native cuda but you can easily get 30t/s instead of the <10 you'd have on a mobile build.
I wouldn't bother with rocm.
Anonymous
8/11/2025, 2:08:07 AM No.106218003
>>106216635 (OP)
what can I do with it besides asking it to estimate the calories in food and generate porn? seems kind of gimmicky
Replies: >>106218038
Anonymous
8/11/2025, 2:11:36 AM No.106218038
>>106218003
Anything, it's still a full blown miniPC. The Radeon 8060S is even half decent at gaming, around RTX 4060 level.
Anonymous
8/11/2025, 2:14:01 AM No.106218066
>>106216808
>13 tokens per second and the
> Q4 at around 1.5 tokens per second
Lmao lmao lmao
Replies: >>106218108
Anonymous
8/11/2025, 2:18:30 AM No.106218108
>>106218066
https://kyuz0.github.io/amd-strix-halo-toolboxes/
Anonymous
8/11/2025, 2:18:49 AM No.106218113
>>106216732
glowie hands typed this
Anonymous
8/11/2025, 3:03:34 AM No.106218470
How well would this thing work for local image generation?
Replies: >>106218589
Anonymous
8/11/2025, 3:04:27 AM No.106218474
>>106216952
>what is a faraday cage
Anonymous
8/11/2025, 3:08:29 AM No.106218504
>>106216635 (OP)
>$2000
>for chinkshit support and horrible cooling
The HP one is 2500 on sale, that 500 dollar difference is worth it to avoid the chinesium.
Anonymous
8/11/2025, 3:12:11 AM No.106218540
AI is fucking retarded, OP is a faggot.
Anonymous
8/11/2025, 3:17:33 AM No.106218589
>>106218470
not even subtle
Replies: >>106218599
Anonymous
8/11/2025, 3:18:10 AM No.106218599
>>106218589
?
Anonymous
8/11/2025, 4:37:01 AM No.106219173
>>106216635 (OP)
the bandwidth is too low
Anonymous
8/11/2025, 4:39:47 AM No.106219196
i'm so tired of /g/ hostility toward AI. you idiots should be the most hyped by far. this is THE MOMENT, it's here and you all cry like xitter cartoonists. it's pathetic.
Replies: >>106219409
Anonymous
8/11/2025, 4:42:22 AM No.106219217
memories
memories
md5: 20911771223fc1abdcbab3c5d8d5cab5🔍
put them in a credible 16-18" workstation laptop and I'll consider it.

>2x faster then normal CPU inference due to doubled memory bandwidth.
I mean it's not bad but it's not great either.
Anonymous
8/11/2025, 4:44:01 AM No.106219235
>>106216635 (OP)
My current PC runs circles around it. Why would I?
Anonymous
8/11/2025, 4:45:05 AM No.106219247
Trash. This isn't unified ram, so the inference is slower than dogshit
Anonymous
8/11/2025, 4:57:59 AM No.106219362
Waiting-Skeleton
Waiting-Skeleton
md5: 0eef934549392da6aa193fb86f9a8ab2🔍
Thanks but I'll wait for Nova Lake AX
Anonymous
8/11/2025, 5:04:06 AM No.106219409
>>106219196
I've lost some hype some post-GPT-5, seems like we're only going to get marginal upgrades until some new breakthrough.
Replies: >>106219980
Anonymous
8/11/2025, 5:06:12 AM No.106219436
>quad channel lpddr5
isn't DDR6 due out soon which should double speeds anyway?
Anonymous
8/11/2025, 6:10:38 AM No.106219964
>>106216635 (OP)
>AMD
Anonymous
8/11/2025, 6:12:36 AM No.106219980
>>106219409
This is great news, because it implies the technology can finally trickle down to the edge. GPU prices are finally starting to stabilize