Implementing the `skip_push` feature

Since sometimes app and base containers are actually multiple tags of
the same container