ssh-agent can be disabled with $skip_ssh_agent

Define it in ~/.{ba,z}shrc before sourcing shellrc