>>717044990
I would try any 8B model and see if it runs. And if it does, if it actually generates responses quick enough. So like, any model around 6 or 7 GB. Try the Q3_K_M or less versions of the Bartowski or MaziyarPanahi versions in the pic you posted (top left and right)