Search Results
7/24/2025, 1:53:41 AM
Should I configure my python script to use sequence breakers with llama-server or not?
>"stop": ["\n", ":", "\"", "*"],
or chatgpt used these
>"stop": [f"{user_name}:", f"{char_name}:"],
I disabled all of them because at some point I could not generate anything. Might take a look at it now that my script is otherwise functional.
I learn as I go.
>"stop": ["\n", ":", "\"", "*"],
or chatgpt used these
>"stop": [f"{user_name}:", f"{char_name}:"],
I disabled all of them because at some point I could not generate anything. Might take a look at it now that my script is otherwise functional.
I learn as I go.
Page 1