Add always_run config to fix unusable —check mode