>>106988826
the pro cards are in a much better place than the rdna cards, at least for LLMs. I'd be curious the hoops you'd need to jump through to get it working in comfy, I think rocm should take care of most of it. That said, compute on that thing is laughably low.