TLDR: How do you guys decide what rarity to pick up from each card?

I wasn't a huge fan of QCRs but picked up a few like base Yubel, Neos etc.
Now there are starlight bystials, I already have secrets, but they are currently the same price, thinking it might be worthwhile to get them, but idk.
Collectors and PURs are great I think, but they tend to curl worse, especially PURs.
Secrets I like because most good cards are secrets so they mesh well with the rest of my stuff that is coming out in normal sets.
I'd rank them probably as normal ultis #1, RC ultis #2, collectors #3 secrets #4 maybe.

I'm really just looking to downsize and keep a lean collection, but I keep getting trapped in these looped thoughts of wanting everything because of indecision.
Subjective shit is the death of me.
Also "max rarity" is another killer. I like heroes, but why should I bother picking up all kinds of QCRs that I find look like shit just have max rarity...