sageattn_qk_int8_pv_fp8_cuda: INT8 quantization for
Q
K
⊤
and FP8 for
P
V
using CUDA backend. (Note that setting pv_accum_dtype=fp32+fp16 corresponds to SageAttention2++.)
so how are we supposed to use sageattn2++?