There's a new version of Chroma out, where he's trained the model to rescale CFG, so that CFG 1 is the same as CFG 5 from previous models. Using a CFG of 1 disables the negative prompt but increases performance by 2x.

https://huggingface.co/lodestones/chroma-debug-development-only/tree/main/staging_cfg_3