Anonymous
7/13/2025, 10:08:04 PM
No.105894560
>>105894550
This. MoEs can work if they have a decent amount of active parameters, but with too few active parameters, they suck.
This. MoEs can work if they have a decent amount of active parameters, but with too few active parameters, they suck.