Deploy key extraction should happen before we switch dirs