>>106158711
Honestly don't know that much (please honor kill me if this seems incorrect,) but it's Vulkan on a 6800XT on Gemma-3-27b. Ran a quick prompt and it showed around ~7-ish tokens per second output. Probably slow compared to other setups, ChatGPT web is about 10x that, but I was happy that it even worked.