Remove build directory only if empty
Remove dll files aswell