Smarter way of checking for new and removed files