Remove stuff that should have been handled by git ignore