You won't be allowed to enter the shelter until the last second. Just stand by the shelter and wait for the time to run out. Ted will automatically jump in at the last second.