We should reload the addon here (the `File` creation might have changed something on it)