>>107144617
its destructive compared to sage attention 2 so who cares

local needs a new base model and cheaper compute (buy all the memory you will need until 2029 sooner rather than later. nvme, ram, vram everything. all prices are going up and all manufacturing capacity is booked)

>>107144648
oh ok. python dependency management is the antichrist