>>105635796
>a 3090
>chroma q8
why do you run Q8? Chroma is small enough to be run on bf16