>>105593935i know it reprompts itself and thats how it may run out of tokens so fast/be so inefficient with tokens
but the client doesnt fucking care
and your experience is the result.
i think the paid tier is another tier which goal is actually advertisement-
this one aimed at execs and such
i bet theres another "extra pro" tier with no limits, or deals for companies
and the broken code is kinda unavoidable given how an LLM works
especially when your code allows for side effects
the code is subdivided into contexts, but side effects are cross context relations and LLMs just are bad at that