Remove unneeded ignore patterns.