>>106345101
This is the only way to do it right. Using a cloud-based service for ERP is just plain stupid. You can try to convince yourself that Deepseek and Claude are "so much smarter than dumb local models," but the reality is that all of these so-called AIs are retarded in their own special way. Finding a good finetune, using a well-written system prompt or character card matters far more. Also, putting more effort into a response beyond just "Rapes {{char}}" goes a long way. Use RAG and authors notes to keep the less sophisticated models on track. You'd be surprised how much the little 12B mistral finetunes get right vs. the cloud-based ones. Also, you have the added benefit of the model not changing on you with an update, as is the case with OP.
