diff: flatten also atime nanoseconds

When not considering atime changes, flatten also the nanoseconds.

Followup of commit 8664337cc39c8575ccb60abb8c6e30f92828ea51.