Google released T5Gemma today. I'm bettting this is what is going to be the next text encoder every new model uses after T5. But dunno if this is better or worse than doing what Lumina did with adapting an LLM as its text "encoder" instead when it is really just a decoder.
https://huggingface.co/collections/google/t5gemma-686ba262fe290b881d21ec86