>>716291350
>You can run a decent model if you offload layers to RAM/CPU, although that's going to be a lot slower than running entirely on GPU.
nta but I honestly have no idea what to even set for these settings or if its even using my GPU at all. Pretty sure i've just been going full RAM/CPU this entire time, or what 5 layers even means.