Remove files as they end up pointing to invaliud folders which puppet librarian has removed.