>>725299623
It's a cool idea, but not worth the hassle, anon. Your implementation is a fun gimmick and, while it's cool, it pales before the hardware requirements needed to run any decent LLM, especially in a genre that a lot of people with toasters play. That, and the negative PR from all the stupid people. You could do something like allow users to enter their own API and use a service like gemini, but, again, too much work for the kind of silly little comments you are implementing.
Spin it as a PR stunt. Go "AI Free!" and allow the dumbos to send you le funny things for people to say in-game. In truth, anti-AI fags are a very loud minority, but in your particular case, the benefits of AI would heavily outweigh the negatives of increased hardware requirements.