Added support to clean up the configured folder

Mostly to always have fresh version