This is where white-/blacklisting could be implemented as described. Then the confirm dialogs would only be shown for example for files in `~/Downloads`.