>>105891224
just a few disappointing syntetic data moes and mamba support added to llamacpp (but it reprocesses the entire context every message so it's unusable and mamba models aren't great either). and the one trillion parameter moe released two days ago but no goofs yet