>>105903151
I was able to make it work using /api/v1/completions and targon/fp8 as provider, but not sure if I'm doing it right.

Maybe the other providers have an extra layer?