Fix starting multiple gpg-agents once more

Even though commit 711e96b1a277b1d5b9771c2eec19fa34f796839b fixed
checking for gpg-agents already running, there was one pre-existing
problem due to which my gpg-agents were still spawning multiple times.
The only thing missing was exporting the variables sourced from the
environment file.

Even though double checking for the agent, before and after (possible)
sourcing, seems redundant to me, I'm keeping it in and only fixing
that one thing.