Actually ignore .diff and .patch files