Anonymous
10/24/2025, 10:09:00 PM
No.106997510
>>106997125
Chat completion is a subset of text completion. Chat completion with a specific model's template is a subset of chat completion.
When using OAI style APIs you are not locked in to chat completion, you are locked in to chat completion with a specific model's template. There's no reason models couldn't work with an ad hoc chat template and each model requires their own special snowflake template.
>>106997150
I am the anon that guy responded to. I don't use ST, I use my own custom python assistant.
Chat completion is a subset of text completion. Chat completion with a specific model's template is a subset of chat completion.
When using OAI style APIs you are not locked in to chat completion, you are locked in to chat completion with a specific model's template. There's no reason models couldn't work with an ad hoc chat template and each model requires their own special snowflake template.
>>106997150
I am the anon that guy responded to. I don't use ST, I use my own custom python assistant.