Search Results

Found 1 results for "a714476d33da164a782ea882450478e1" across all boards searching md5.

Anonymous /g/105594506#105597704
6/15/2025, 5:41:06 AM
I imagine this has been going on for a while but it's only really starting to bother me, but I have an issue with infinitely long textgen using SillyTavern and Ollama. The way I usually work things is I have my responses set to streaming so I'll watch it gen and then hit stop somewhere where I feel like it's getting off track and I'll trim it, then write a response to steer it or just have the AI create responses off of what it just said and reroll those until I get something good.
If I just hit send and let the AI fire off while I walk away it will never stop. I just did so when I started making this message and pic related just kept going when I wanted only a 60 token response, getting stuck in a death spiral repeating the same sentence over and over again. It doesn't always death spiral like that though, usually it doesn't get stuck in a hard loop like that but it will just keep generating story. Just fired another one off and since I just found the token counter extension I can check, it gave me a response that 1625 tokens and would still be continuing if I didn't stop it.
Addendum, I don't have a deep understanding of tuning the Sillytavern settings, I just switch between presets and mess with things to try and get a more varied response when I reroll outside of the AI just giving me more or less the same message again, occasionally toggling Instruct mode on and off to see if anything seems like it changes.