Only copy files and change permissions with non bindmount

Fixes #1930

ping @creack @shykes 

We should probably do 0.6.3 with this change if approved.