(PUP-1106) Check for failed deps on refresh

Retarget of #3079 onto master post puppet-4 merge down.