Add more ignore for caches and egg-info