lmpw
11/5/2025, 4:07:01 PM
No.942144881
>>942144549
That would be fun, unfortunately I'm still working and just genning inbetween tasks, so cannot really allocate time for that now. Good idea though!
>>942144621
Yes, it's local. The easiest to start with is "ollama" in my opinion which lets you pull models from their library: https://ollama.com/library (or from Huggingface afaik)
You can use it in a command line directly, or via a GUI, or you can also try their new "app" they have released I guess. I am using "Open WebUI" to connect to ollama and log my "conversations". (If you're on Linux, there's at least 3 GUIs for it in Flathub.)
I am using an abliterated version of Gemma3 for these (abliteration is a kind of uncensoring, briefly). Exact model name is in the pics.
If you want to have conversations with characters, check SillyTavern - also connects to ollama and can use it as a backend. For characters, check characterhub.org for example.
That would be fun, unfortunately I'm still working and just genning inbetween tasks, so cannot really allocate time for that now. Good idea though!
>>942144621
Yes, it's local. The easiest to start with is "ollama" in my opinion which lets you pull models from their library: https://ollama.com/library (or from Huggingface afaik)
You can use it in a command line directly, or via a GUI, or you can also try their new "app" they have released I guess. I am using "Open WebUI" to connect to ollama and log my "conversations". (If you're on Linux, there's at least 3 GUIs for it in Flathub.)
I am using an abliterated version of Gemma3 for these (abliteration is a kind of uncensoring, briefly). Exact model name is in the pics.
If you want to have conversations with characters, check SillyTavern - also connects to ollama and can use it as a backend. For characters, check characterhub.org for example.