>>11327979
>I don't think we're going anywhere for a while from what I'm hearing people mention about chroma too.
I feel that, but you still simply expect too much imo. And with all the slop poisoning future datasets and shit going closed source and being censored it feels like we'll look back at today and consider it the both the wild west and golden age of genai. Idk, I just try to enjoy the shit we have considering that newer 'better' local models will also probably need even more expensive hardware.
>>11327977
>if renting a GPU were a option, i wouldn't be saying my hardware were the bottleneck here
I have no idea how that works but yeah, I think you wouldn't even need a dedicated gpu.