Trying Air a bit more and encountered some forgetfulness, at around 12k. That's a shame. The old GLM-4 32B had memory issues as well and I guess that's the main weakness for THUDM. VRAMlets just can't catch a break, although we're pretty close now. 2 more model generations.