>>106156802
koboldcpp doesn't even support batching parallelism
it's essentially for coomers and not a serious inference tool