Search Results
7/7/2025, 5:15:55 AM
>>42332947
Thanks
>>42332990
Would you really put the summary behind the chat itself? I would expect that to just confuse the model even more.
But structuring things a bit more is a pretty good idea, time to reword the preset again.
>32 cents per message
$0.32 per million input token. Which sounds too low. But I did doublecheck the .csv exports, summation and it all fits as far as I can see. See pic related. And yes I know the input context is too big, I was too lazy to summarize yesterday.
Thoughts on lorebooks when caching? I feel like stuff is either so irrelevant it doesn't need an entry/can be mentioned in the summary, or is so important it should be active all the time, so I don't really see a need for them.
Thanks
>>42332990
Would you really put the summary behind the chat itself? I would expect that to just confuse the model even more.
But structuring things a bit more is a pretty good idea, time to reword the preset again.
>32 cents per message
$0.32 per million input token. Which sounds too low. But I did doublecheck the .csv exports, summation and it all fits as far as I can see. See pic related. And yes I know the input context is too big, I was too lazy to summarize yesterday.
Thoughts on lorebooks when caching? I feel like stuff is either so irrelevant it doesn't need an entry/can be mentioned in the summary, or is so important it should be active all the time, so I don't really see a need for them.
Page 1