Do not mark a file as dirty if it only loaded images