Fixed my issue with cascade shadow maps. Turns out I was mistakenly using frag pos from the camera instead of view space depth which ended up selecting the wrong cascade in certain scenarios. Now I can move onto my choice of SSAO, SS shadows, or HDR rendering (which leads to bloom)