SOLVED! Turns out my lights had a bad "Shadow Depth Bias". This can be found on each lights reference under the Light Data tab. Hitting Default seems to take care of it.

So, I've run into an odd bug. I was setting up a new cell playing around with the new dynamic shadow lights. When I went in game to test it I ran into these sorta flickering zones. If I stand in just the right spot and look in the right direction the light just winks out. Soon as I look away / move it comes back. I've also noticed that the same thing seems to happen if I look at a light through a transparent object. though I've not yet tried to duplicate that one.

Its happening in the middle of a hallway if I look at the wall which is hardly ideal. If anyone knows whats going on I'd be grateful, maybe I toggled something on in the lights settings I shouldn't have?