Driving without sway bar end links can be dangerous because as you've noticed, the vehicle will not steer correctly.