> Is there a paper I can cite which states why Ridge is invariant?

it's fairly easy to see (just multiply X by a rotation R : X <-
np.dot(X, R)) and it shouldn't change the output.

maybe : http://dl.acm.org/citation.cfm?id=1015435