>>106157732
oh anon you can definitely get better speeds on that rig, go on linux disable swap, turn on --no-mmap , get smaller quant, use vulkan/rocm
win
you dont need a fork or anything, it got support recently
u can use llama-server for ST