ryzen ai HX 370 (Radeon 890m) + ROCm 6.3.2, Am I using it wrong?

[bear8203]

I compared the 4060ti 16GB eGPU (self-made with TH3P4G2), the 7840HS (Firebat MN56), and the newly purchased Ryzen AI HX370 (Beelink SER9).

I'm comparing these two because their combined prices are similar. Also, I'm using the eGPU (the Firebat) for Deepseek R1 or IBM Granite tests, and the newly purchased HX370 has faster memory speeds than the Firebat (5600 vs. 7500 MT/s). Even though it is a bit slower than the RTX eGPU combination when using ROCm GPU, I ended up buying it because I was swayed by AMD's flashy advertising (bought it on discount for $899)...

The environment is the first workflow of the comfyUI (512x512px + SD1.5 base model - v1-5-pruned-maonly.ckpt)

• 1. RTX4060ti + 7840HS (Cuda & CPU Offloading) = takes 2 seconds
• 2. (I bought 2nd hands) 7840HS (Micron Crucial DDR5-5600 CL46 - 32GB dual channel) = takes 40~50 seconds
• 3. Pretty New Ryzen 9 AI - Our Shiny Expensive HX370 (LPDDR5X 7500MHz 32GB(8GB 4 Channel!!) = takes 30~40 seconds

Be honest (From today's price)

• 1. Price is $750.00 (the RTX $480.00 + egpu $120.00 + 2nd hands 7840HS $150.00) = took 2 seconds
• 2. Price is $150.00 (the 2nd hands 7840HS $150.00) = took, let's say 45 seconds
• 3. Price is $999.00 (beelink SER9 shiny pretty new Ryzen 9 AI HX370 with more memory with channels) = took, 35 seconds

---

What is better for a typical user right now? I'll share my service recipe, and I'd love to hear your creative and challenging ideas! (for my shame $899.00 😭 )

[Unit]
Description=ComfyUI Service
After=network.target

[Service]
Type=simple
User=root
WorkingDirectory=/root/ComfyUI
Environment=VIRTUAL_ENV=/root/ComfyUI/.venv
Environment=PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin:/root/ComfyUI/.venv/bin
Environment=HSA_OVERRIDE_GFX_VERSION=11.0.1
Environment=GIT_PYTHON_GIT_EXECUTABLE=/usr/bin/git
Environment=GIT_PYTHON_REFRESH=quiet
ExecStartPre=/bin/chmod 666 /dev/dri/card1 /dev/dri/renderD128 /dev/kfd
ExecStart=/root/ComfyUI/.venv/bin/python3 /root/ComfyUI/main.py --force-fp32 --use-split-cross-attention --listen 0.0.0.0 --port 8188 --enable-cors-header "*"
Restart=always

[Install]
WantedBy=multi-user.target

Capture

???

I've been thinking, if I buy four used 7840HS devices ($150.00 x 4 = $600.00) and try Kubernetes on them, which is known to be challenging, would that be a more cost-effective way to experiment?

[ivoras]

Looks like AMD HX370 is a dud as far as AI tasks are concerned: https://www.reddit.com/r/LocalLLaMA/comments/1i7cj11/amd_hx370_llm_performance/ . Neither the NPU or GPU are supported by official ROCMs drivers at this time.

[donaldkuck]

https://community.amd.com/t5/ai/experience-the-deepseek-r1-distilled-reasoning-models-on-amd/ba-p/740593 Npu is supported

[ivoras]

That looks like a very experimental edition, maybe hard-coded just for these CPUs/GPUs. That's a long way away from official support in ROCm/HIP.

Today, RDNA3.5 architecture products are not supported by ROCm: https://rocm.docs.amd.com/projects/install-on-windows/en/latest/reference/system-requirements.html

Update: ROCM 6.3.3 included support for ROCM3.5 in AI Max 380/385/390/395 on 2025-03-05, but still no support for HX 370 APUs ("gfx1150").

[zakyhassani]

looks like i bought a dud too hhhhh

[liszper]

What a dud 🥹