# Supporting Appropriate Reliance in XAI-Assisted Decision-Making

José Cezar Junior de Souza Filho, Rafik Belloum, Káthia Marçal de Oliveira

► To cite this version:

José Cezar Junior de Souza Filho, Rafik Belloum, Káthia Marçal de Oliveira. Supporting Appropriate Reliance in XAI-Assisted Decision-Making. Mardi des chercheurs 2024, Mar 2024, Mons, Belgium. hal-04642262

HAL Id: hal-04642262

https://hal.science/hal-04642262v1

Submitted on 9 Jul 2024

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
<figure><img src="image_2.png" /></figure>

<figure><img src="image_3.png" /></figure>

# Supporting Appropriate Reliance in XAI-Assisted Decision-Making

José Cezar JUNIOR DE SOUZA FILHO
Rafik BELLOUM, Káthia MARÇAL DE OLIVEIRA
UPHF, LAMIH UMR CNRS 8201, France

## XAI System

<figure><img src="image_4.png" /></figure>

## Reliance-Awareness

Capacity of user interface design to support appropriate reliance of users in detecting errors in XAI recommendations for informed decision-making.

<figure><img src="image_5.png" /></figure>

## Research Goal

**Analyze reliance**

for the purpose of characterizing

with respect to its explanation designs, concepts, and impact factors

from the point of view of HCI researchers

in the context of XAI-assisted decision-making.

## Research Questions

<table><tr><td>RQ1</td><td>How is reliance discussed in XAI-assisted decision-making?</td></tr><tr><td>RQ2</td><td>What are the types of explanation designs used to provide reliance in XAI-assisted decision-making?</td></tr><tr><td>RQ3</td><td>What are the factors that impact reliance in XAI-assisted decision-making? (design/human/etc.)</td></tr><tr><td>RQ4</td><td>How are explanation designs evaluated regarding reliance in XAI-assisted decision-making?</td></tr></table>

## Systematic Literature Review

<figure><img src="image_6.png" /></figure>

## Findings

<figure><img src="image_7.png" /></figure>

### Characterization

No studies focused on characterizing reliance on explainable UIs.

<figure><img src="image_8.png" /></figure>

### Explanations

Inconclusive evidence about explanation effects on reliance.

<figure><img src="image_9.png" /></figure>

### Impact Factors

Existing studies focused only on the automation context.

## Ongoing Work

### Primary Studies

To identify impact factors, types of explanation designs, and how they are evaluated regarding reliance in XAI-assisted decision-making.

### Qualitative Tool

Design principles and guiding questions to support design and evaluation of reliance-awareness on explainable user interfaces.

<figure><img src="image_10.png" /></figure>