Add always_run for --check compatibility