Revert "gpg/zsh: use gpg-agent to cache ssh keys too"

This reverts commit 5e26d82afc096c30f0375ac6449b7a755ed0dc0a.
zsh: remove comment

gpg-agent sucks for SSH. One tool, one thing for now.