It makes sense, actually. This reality is more of a video game than anything. In a game, the laws of physics don't really apply.

Like, time is frozen while we are not in our respective universes. It can't go on until we go back.

Then you also gotta think about games: they glitch. Our consciousness escapes might escape what keeps us here, but not for long.