Ignore signing key when not building

Closes #1503.