>>29684209

Use the GGUF models. Pretty sure they go down to relatively small sizes. Google huggingface and should be able to find em pretty easily.