Fix directory patterns to be ignored