Add simple support for post install files overwriting.