Do command execution logging in one place

Fixes an issue where --offline still generates a bunch of log
message about stuff that is not changed in any way