In The Witcher they canonically taste really bad and are super high in alcohol, so I assume strong liquor with a shitty gas-like flavor profile, like Chinese Baijiu or shoddy moonshine.

But in most RPGs I'd like to think they taste nice. The anon that said blue probably tastes like sprite is on the money.