removed rigidbody and now just do physics stuff with raycasts which should be a lot better for this type of game