>>105952341
I just got into self hosting llms.
I use Ubuntu, is there a better way than llama or is there something that can be put in docker or k8s?

Also I tried with webgl based solution, for example smollm and it answers nonsense even if I bring the temperature to 0. What am I doing wrong?