Physical Relativity: Space-Time Structure from a Dynamical Perspective