>>107145536
FP16 T5_XXL is 0.03% better than Q8_0, while being 8% slower
So your claim that "Fast will rape it more than Q8 lol." is demonstably false.
I am REALLY fucking impressed with how close the difference is
https://pastebin.com/vt0Q4hLr
https://rentry.org/t5_xxl-q8-versus-fp16fast
code:
https://pastebin.com/AGQ8ghgp