>>106879820
https://github.com/turboderp-org/exllamav3/blob/master/doc/exl3.md
exl2 was trash below 4bpw. easily noticable difference.