Don't report files as updated if only mtime changes

This seems to happen with vfat filesystems (like on my USB drive), and I only
want to see files with *contents* that changed.