>>715703180
Yes - Mistral Nemo Instruct Q_6_K gguf - https://huggingface.co/bartowski/Mistral-Nemo-Instruct-2407-GGUF?show_file_info=Mistral-Nemo-Instruct-2407-Q6_K_L.gguf

So install SillyTavern first if you haven't already.

Download koboldCCP, open it, set the context size to 4096. Set the BLAS size in the Hardware section to 1024. Then launch it after loading the gguf Make sure Use ContextShift and Use CuBLAS are ticked. You don't need the browser page it opens so just close that or untick the option to open it

Connect to the API in SillyTavern - in Connection Profile, API - Text Completion, API Type - KoboldCpp, API URL is whatever Kobold is using and tick "Derive context size from backend"

Download Sphiratrioth's Presets - https://huggingface.co/sphiratrioth666/SillyTavern-Presets-Sphiratrioth - follow instructions to install. Once done, in the Advanced Formatting menu, set the Context, Instruct Templates to Sphiratrioth -Mistral V3-Tekken. Set the System Prompt to Sphiratrioth - Roleplay 1st Person.

Copy these words into the Banned tokens / strings section in SillyTavern - https://huggingface.co/Sukino/SillyTavern-Settings-and-Presets/raw/main/Banned%20Tokens.txt

And then you can RP with pretty much most cards.