Move public keys into our secret directory.

Exposing public keys is not a big issue but it's unecessary in this case.