>>106304275
>>106304264
>>106304188
> LLM on SBC
Nothing that I'd find remotely interesting would run on an SBC.
Given the low cost of hosted LLMs and the bleeding edge of the technology, it's not worth buying equipment to run local inference at hobby scales.