# A Smart Telecare System at Digital Home: Perceived Usefulness, Satisfaction, and Expectations for Healthcare Professionals

Authors: Laura Vadillo; María Luisa Martín-Ruiz; Iván Pau; Rafael Conde; Miguel Ángel Valero
Journal: Journal of Sensors
 (2017)

---

## Abstract

Sensors, combined with intelligent systems, can enhance the quality of the Telecare services deployed at home, improving the capability for detection of risk situations and the users care. However, there are no specific studies that evaluate this kind of Telecare systems by professionals that work in a Telecare center. This paper shows the results of an assessment of the current satisfaction and future expectations of the Telecare professionals when using advanced Telecare solutions deployed at home. The study has been conducted through structured interviews with 24 Telecare experts working in the Telecare center of the Spanish Red Cross for attending alarm calls for elderly people. The interviews had the support of the TALISMAN Telecare system that is a next-generation Telecare service deployed in the accessible digital home of Universidad Politécnica de Madrid. All participants showed overall satisfaction with TALISMAN and their intention to use it. Results showed that perceived usefulness is an important influencing factor to the intention to use it and the Quality of the Information is a key factor in the perceived usefulness. TALISMAN, as an example of a next-generation Telecare system, is seen as a tool with high potential for improving the care of elderly people at home.


---

## Body

## 1. Introduction

The population pyramid has changed in the last years. According to the United Nations, the number of an ageing population is projected to grow to more than 2 billion by 2050 [1]. This growth has important economic and social consequences. An ageing population demands new efficient strategies in the health service provision to enable the growing health needs arising from the aging of the population to be effectively solved.Advances in sensors and home automation technologies combined with proper reasoning systems can offer significant benefits enhancing the local and remote detection and management of risk situations for the inhabitant at home, one of the main aims of the Telecare systems [2–4]. However, the availability of the technology does not necessarily involve their use. The provision of effective Telecare services depends on a set of human factors in addition to purely technological factors [5]. User acceptance is a crucial factor for the successful implementation of a new technology [6], including final users, healthcare professionals, and healthcare providers.Some studies have been developed to understand the acceptance of these technologies by patients or elderly people [7–10]. Although acceptance of information technologies in the telehealth/Telecare field has been an important issue in the last years, it is relatively unknown what factors affect the acceptance by Telecare professionals of a health care telemonitoring system at smart home [11].Telecare professionals are pivotal in the process of adoption of new Telecare solutions. However, studies carried out in the health field are more centered in users or health professional satisfaction with telemonitoring or telemedicine systems [11–13]. Other works analyze factors that have influence on the successful implementation of technology for ageing people at home or for healthcare professionals [14, 15].There are also studies which analyze the key factors influencing the intention of adoption for Telecare services [16, 17]. However, these studies are focused on an organization-environment perspective, skipping the operator point of view. On the other hand, there are different works focused on factors influencing adoption of home Telecare solutions by elderly using traditional Telecare systems. Nevertheless, these studies do not analyze a smart Telecare system using sensors to detect risk situations [18, 19].Finally, there are other studies that analyze quality attributes and barriers to the adoption of Telecare solutions based on the smart home concept, but they are usually centered in administrative and technical factors with a human factor perspective, omitting the Telecare problematic and the Telecare professionals’ opinions [20, 21].This study is the first to evaluate the satisfaction, expectations, and needs of Telecare professional working in a Telecare center. Results obtained in this study are relevant to knowing key elements that should be considered to implement the next generation of Telecare systems at home.This paper presents a study oriented to understand the satisfaction and expectations of Telecare professionals with advanced Telecare systems. For this study development, professionals have been trained with a next-generation Telecare system called TALISMAN. TALISMAN is a context aware Telecare system developed by the TSIC (Telematics Systems for the Information and Knowledge Society), a research group of the Universidad Politécnica de Madrid.


## 2. Background

One of the cornerstones of the research is the selection of the accepted model. Several acceptance models applied in the healthcare field were evaluated.The technology acceptance model (TAM) [22] is probably the most recognized, used, and validated model to measure and explain the factors that have influence on the acceptance of technology. Many other models are based on TAM [12, 23, 24]. This model (see Figure 1) takes the perceived usefulness (PU) and perceived ease of use (PEOU) as key factors to define the behavioral intention (BI) to using a system [22].Figure 1
Technology acceptance model (TAM) [39].TAM has been validated in many scenarios and used as a good predictive model for defining the intention to be used by healthcare professionals [13, 25]. However, significant studies have suggested that TAM should integrate other factors in its acceptance model such as the perception of the environment and social influence, facilitators, factors related to relationships with the patients, and the applicability or compatibility of technology with the current practices, routines, and standards [25–30]. Although some studies have removed the significance on subjective norm and image in professionals when deciding to adopt health care technologies [31], these factors have been included in the majority of technology acceptance models.Another popular model to measure the user satisfaction is the information system (IS) success DeLone and McLean model [32, 33]. This model does not include factors related to the organization and compatibility. However, it evaluates the user satisfaction in terms of satisfaction with the system (system quality), with the information (information provided by the system compared with information that the user needs), with the software and with the decision making. Yusof et al. [34] propose a more complete model, adopting the IS success model to evaluate factors that have influence in health information systems (HIS). They divide factors in three dimensions: human factors (system use and user satisfaction), organizational factors (structure and environment), and technology factors (system quality, information quality, and service quality). Yusof’s model is a complete method to measure the satisfaction with a telemonitoring system, the information quality, and the general system quality.


## 3. Methods

### 3.1. TALISMAN: Advanced Telecare System

TALISMAN is a platform which collects and manages the environmental data of the user’s home to detect risky situations for the inhabitant. TALISMAN can interact with home elements and can provide information for helping Telecare professionals to take more efficient and quickly decisions.TALISMAN is currently deployed in the accessible digital home (ADH) of the Universidad Politécnica de Madrid (UPM). ADH is a real home around 80 m2, formed by a hall, a living-room, an equipped kitchen, a bathroom, and one bedroom. TALISMAN includes a group of sensors deployed in the house and a central unit with a multiagent platform to manage the information collected by sensors. Figure 2 shows the different components of TALISMAN system.Figure 2
TALISMAN system installed at accessible digital home of UPM.First 5 images (see Figure2) show rooms of the house with some sensor elements controlled by TALISMAN. The last 2 images include the CM15 controller (interface X10 for TALISMAN), a Raspberry that captures data and executes the TALISMAN reasoning, and a Telecare unit with MyLife X10 to collect data about Tunstall Telecare sensors 868 MHz and traduce them at X10 signals.The interaction with users and the decision making is based on intelligent agents able to infer knowledge based on a reasoning engine. The reasoning model used by the intelligent agents is formalized by an ontology based on OWL (Web Ontology Language). This ontology maps the information obtained by sensors with potential hazards. TALISMAN, through intelligence agents, infers the state at home and proposes actions oriented to solve the inferred problem.The information collected by the system can be displayed locally or remotely in real time. Figure3 shows the monitor interface of TALISMAN. The interface provides the most relevant information about the inhabitant clinical profile, personal, and environmental sensors and finally the current action proposals based on the home and inhabitant situation.Figure 3
Complete interface of the TALISMAN system for a user’s house.One of the main advantages of the design of TALISMAN is that professionals can obtain a full report of the current state of the home in case any alarm is fired. This information, in properly managed, can lead to a more accurate response to the real situation.


### 3.2. Study Context

The study was conducted through a questionnaire to Telecare professionals after using the TALISMAN system. The questionnaire was designed to measure the expectations and satisfaction of the professionals related to the use of TALISMAN and its comparison with the current system deployed in the Spanish Red Cross Telecare center. This questionnaire was validated by an equipment of sociologists who are specialists in methodology and research techniques and by members of the coordination, equipment of the attention center of the Spanish Red Cross.The traditional Telecare system (TTS) used in the Spanish Red Cross is based on a pendant and a home unit. Home unit is a device with a button connected to the home phone. This device allows establishing oral communication with a Telecare professional of the Telecare center when user presses the button. The pendant is a small device, which can be worn as a necklace, and the user can always wear it, even while in the shower or during sleep. Pendant includes a button that the user can press in any moment inside home to ask for help at Telecare center.The TALISMAN system is shown to the staff to offer them a more advanced version of Telecare. It is a real instrument that they can use to observe the possibilities that these systems can offer in comparison with the traditional Telecare. Table1 shows an objective comparison about TTS and TALISMAN.Table 1
TTS and TALISMAN comparison.
TTS
TALISMAN
Components
Home unit + pendant
It also includes presence, smoke, dioxide carbon and flood detectors, fall detector, bed and chair occupancy sensors, contact sensors, glucometer, electrocardiogram, pulse and oxygen, movement, activity, pulse, body temperature and airflow sensors, and a processing and reasoning device
Way to notify a possible problem for the user
Press the button
It includes environment detection through sensors and reasoning over collected data
Quantity of information about a dangerous situation
Information obtained through communication with the user. If the user is not near to the home unit or is fainting, it is not possible to know the situation’s gravity
With the TALISMAN system, it is possible to obtain data collected from the environment. The Telecare center can obtain information about place at home, environment situation, and last activities carried out by the user
Possibility to detect possible health risk
Only by means of information obtained through communication with the user
The TALISMAN system could include a history of daily life activities and timelines. This register of facts could help to detect a new health symptom (user waking up often at night, problematic patters of sleeping, lack of alimentation, etc.) or dangerous situations like staying too long in bedroom without going out and so on
Possibility to interact with the house of the user in case of gas scape or flood, for example
It is not possible for the Telecare staff
Telecare staff could stop some actuators at home through gas/water electrovalves, for example
Action proposals when a risk situation occurs
None
TALISMAN can propose some actions to the Telecare staff, according to the detected situationThe TALISMAN system characteristics were exposed to the Red Cross Telecare professionals. They could observe the system behavior and their capabilities to use the interface of the system (showed in Figure3) and test how the system would react with different sensors states possibilities chosen by them.The questionnaire was developed following the original TAM model, including other relevant factors provided by acceptance theories of UTAUT, DeLone and McLean and Yusof models. User satisfaction was measured by a self-developed 24-item user satisfaction questionnaire in terms of PU, PEOU, system quality, information quality, compatibility, facilitating conditions, and intention to use. Table2 lists the group of factors analyzed in this research and definitions. The questionnaire results (shown in Table 3) are based on this list of factors and include all unopened questions.Table 2
Proposed evaluation framework.
Scope
Factor
Definition
Evaluation
User profile
User characteristics [22]
Attitude to use (motivation, resistance)Gender and ageExperience/expertise
Technology acceptance model factors
Perceived ease of use
“The degree to which a person believes that using a particular system would be free of effort” [22]“The measure to determine the degree in which a product can be used easily by certain persons and, thus, to obtain a few proposed aims” [35]
It is easy to use, learn, and rememberIt is easy to achieve the system to does what I wantThe interaction with the system is clear and understandableThe TALISMAN system does not demand much care and attention
Perceived usefulness
“The degree to which a person believes that using a particular system would enhance his or her performance” [22] Relative advantage is defined as “the degree which an innovation is perceived as being better than its precursor” [36, 37]
It is useful to the jobIt increases productivity, job performance, and efficiency It increases the work qualityIt improves patients care and managementIt provides a relative advantage
Intention to use
“The subjective possibility that a person will perform a behavior” [12]
If I have the option to use the system, I would use it
Compatibility
Compatibility
“The degree to which an innovation is perceived as being consistent with existing values, needs, and experiences of potential adopters” [36, 37]. It includes compatibility with the organizational structure and environment (politics, business strategy, service delivery protocols, technologies, communications, etc.)”
It impacts on my work structureIt changes habits of the workersIt changes structures, protocols, or norms of the service
System quality
Efficiency
It is evaluated as correct functionality, precision, and quick response. This variable is measured when the system has been used. The use of the system can have positive or negative influence over the system quality perception [32, 33]
It offers a quick responseIt requires low time and effort It works correctly (detection of the patient status)It is accurate in response
Reliability
The confidence in that the system works as it should, without faults or outages of the system [32, 33]
I trust in the system
Flexibility
The capability to adapt the system to the telemonitoring needs [32, 33]
I worry that the system cannot be adapted to my need
Information quality
DeLone and McLean model [32, 33]
Accuracy, clarity, efficiency, completeness, and relevance
Facilitating conditions
Intention to use
“Objective factors in the environment that observers agree to make an act easy to accomplish” [38]
Some financial and time constraintsTable 3
Evaluation of each indicator.
Factor
Indicators
Question
MO
ME
Q3
P80
P90
P95
P99
Perceived ease of use
It is easy to use, learn, and remember.It is easy to achieve the system to do what I want.The interaction with the system is clear and understandable.I am comfortable when using the system and it does not demand extreme care and attention.
Q1. About the general use of TALISMAN: ((a) all available elements are easy to use and understand the system interface. (b) The system is easy to use for me, but some elements are more difficult to understand. (c) Almost all elements are easy to understand, but some elements are more difficult to use, requiring several attempts to understand completely. (d) I could use a part of the system, but I do not understand many elements. (e) It is not possible to use the system for me)
a (70.8%)
a
b
b
b
c
c
Q2. You are comfortable when you are using TALISMAN system (“(a) extremely agree” to “(e) extremely disagree”)
a (70.8%)
a
b
b
b
c
c
Q5. The use of the system involves too much time and effort (“(a) extremely agree” to “(e) extremely disagree”)
e (54.1%)
e
e
e
e
e
e
Perceived usefulness
Useful for the job.Increases job performance and efficiency.Increases the work quality.Improves the service to the patients and its management.Provides a relative advantage over the current solution.
Q8. TALISMAN could improve the care and attention of the person at home (“(a) extremely agree” to “(e) extremely disagree”)
a (87.5%)
a
a
a
b
b
c
Q9. TALISMAN provides important information to know the state of the user at home, which is useful to attend the alarm by the Telecare center (“(a) extremely agree” to “(e) extremely disagree”)
a (91.6%)
a
a
a
a
b
b
Q10. I consider that TALISMAN would increase my work quality (“(a) extremely agree” to “(e) extremely disagree”)
a (91.6%)
a
a
a
a
b
b
Q18. If you have an older relative, do you consider that it is interesting to provide him with a Telecare system like TALISMAN?” (yes/no)
Yes (100%)
Compatibility
Impact on the work planning.Change in the habits of the workers.Change in the planning and protocols of the service.
Q6. TALISMAN is aligned with the structure of the system that I use now. For this reason, the use of TALISMAN would not result in a considerable change in my habits (“(a) extremely agree” to “(e) extremely disagree”)
e (29.1%)
d
e
e
e
e
e
Q7. TALISMAN system supposes a change in the protocols or rules governing the current Telecare service (yes/no)
Yes (58.3%)
Efficiency
Quick response.Correct functionality (detection of the patient status). Accuracy in response.Low time and effort required.
Q3. TALISMAN system processes information quickly (“(a) extremely agree” to “(e) extremely disagree”)
a (91.6%)
a
a
a
a
b
b
Q4. The system allows the detection of the user state when she/he is asking for assistance (“(a) extremely agree” to “(e) extremely disagree”)
a (41.6%)
b
c
c
d
d
d
Q5. The use of the system involves too much time and effort (“(a) extremely agree” to “(e) extremely disagree”)
e (54.1%)
e
e
e
e
e
e
Information quality
Relevance.
Q11. Relevance of user profile to know the state of an incident (“(a) very important” to “(e) nothing relevant”)
a (100%)
a
a
a
a
a
a
Q12. Information about the state of the person: fall detection, bed occupation, unconsciousness sensor (inactivity), remaining on the floor after fall detection, and medication intakes (“(a) very important” to “(e) nothing relevant”)
a (100%)
a
a
a
a
a
a
Q13. Relevance of information collected by biomedical sensors (“(a) very important” to “(e) nothing relevant”)
a (58.3%)
a
a
a
a
b
c
Q14. Environmental factors such as fire, carbon dioxide, temperature, and flood (“(a) very important” to “(e) nothing relevant”)
a (79.1%)
a
a
b
b
b
b
Q15. The importance of knowing if the person is alone at home when an alarm occurs (“(a) very important” to “(e) nothing relevant”)
a (83.3%)
a
a
a
b
b
c
Q16. Action proposal’s relevance (“(a) very important” to “(e) nothing relevant”)
a (62.5%)
a
b
b
c
d
d
Intention to use
If I had the option of using the system, I would use it.
Q17. If I had the option to use the system, I would use it (yes/no)
Yes (95.83)
Q20. Do you believe it is necessary that Telecare should evolve towards a system like TALISMAN? (yes/no)
Yes (100%)In a total of 15 questions, responses have been rated on a five-point Likert scale anchored at strongly agree and strongly disagree. The questionnaire also includes four questions that can be answered with yes or no that need a positioning of the interviewee. Moreover, the questionnaire contains five open-ended questions to identify the user’s perception of the Telecare system and the opinion about the lack of relevant information or the data representation. Information about age, years of experience, and specialty of studies of the interviewee was also collected.The interviews were performed individually following the questionnaire design. The answers were recorded digitally for their subsequent analysis. In addition, interviewees’ comments were collected during the questionnaire to complete and justify the results.


## 3.1. TALISMAN: Advanced Telecare System

TALISMAN is a platform which collects and manages the environmental data of the user’s home to detect risky situations for the inhabitant. TALISMAN can interact with home elements and can provide information for helping Telecare professionals to take more efficient and quickly decisions.TALISMAN is currently deployed in the accessible digital home (ADH) of the Universidad Politécnica de Madrid (UPM). ADH is a real home around 80 m2, formed by a hall, a living-room, an equipped kitchen, a bathroom, and one bedroom. TALISMAN includes a group of sensors deployed in the house and a central unit with a multiagent platform to manage the information collected by sensors. Figure 2 shows the different components of TALISMAN system.Figure 2
TALISMAN system installed at accessible digital home of UPM.First 5 images (see Figure2) show rooms of the house with some sensor elements controlled by TALISMAN. The last 2 images include the CM15 controller (interface X10 for TALISMAN), a Raspberry that captures data and executes the TALISMAN reasoning, and a Telecare unit with MyLife X10 to collect data about Tunstall Telecare sensors 868 MHz and traduce them at X10 signals.The interaction with users and the decision making is based on intelligent agents able to infer knowledge based on a reasoning engine. The reasoning model used by the intelligent agents is formalized by an ontology based on OWL (Web Ontology Language). This ontology maps the information obtained by sensors with potential hazards. TALISMAN, through intelligence agents, infers the state at home and proposes actions oriented to solve the inferred problem.The information collected by the system can be displayed locally or remotely in real time. Figure3 shows the monitor interface of TALISMAN. The interface provides the most relevant information about the inhabitant clinical profile, personal, and environmental sensors and finally the current action proposals based on the home and inhabitant situation.Figure 3
Complete interface of the TALISMAN system for a user’s house.One of the main advantages of the design of TALISMAN is that professionals can obtain a full report of the current state of the home in case any alarm is fired. This information, in properly managed, can lead to a more accurate response to the real situation.


## 3.2. Study Context

The study was conducted through a questionnaire to Telecare professionals after using the TALISMAN system. The questionnaire was designed to measure the expectations and satisfaction of the professionals related to the use of TALISMAN and its comparison with the current system deployed in the Spanish Red Cross Telecare center. This questionnaire was validated by an equipment of sociologists who are specialists in methodology and research techniques and by members of the coordination, equipment of the attention center of the Spanish Red Cross.The traditional Telecare system (TTS) used in the Spanish Red Cross is based on a pendant and a home unit. Home unit is a device with a button connected to the home phone. This device allows establishing oral communication with a Telecare professional of the Telecare center when user presses the button. The pendant is a small device, which can be worn as a necklace, and the user can always wear it, even while in the shower or during sleep. Pendant includes a button that the user can press in any moment inside home to ask for help at Telecare center.The TALISMAN system is shown to the staff to offer them a more advanced version of Telecare. It is a real instrument that they can use to observe the possibilities that these systems can offer in comparison with the traditional Telecare. Table1 shows an objective comparison about TTS and TALISMAN.Table 1
TTS and TALISMAN comparison.
TTS
TALISMAN
Components
Home unit + pendant
It also includes presence, smoke, dioxide carbon and flood detectors, fall detector, bed and chair occupancy sensors, contact sensors, glucometer, electrocardiogram, pulse and oxygen, movement, activity, pulse, body temperature and airflow sensors, and a processing and reasoning device
Way to notify a possible problem for the user
Press the button
It includes environment detection through sensors and reasoning over collected data
Quantity of information about a dangerous situation
Information obtained through communication with the user. If the user is not near to the home unit or is fainting, it is not possible to know the situation’s gravity
With the TALISMAN system, it is possible to obtain data collected from the environment. The Telecare center can obtain information about place at home, environment situation, and last activities carried out by the user
Possibility to detect possible health risk
Only by means of information obtained through communication with the user
The TALISMAN system could include a history of daily life activities and timelines. This register of facts could help to detect a new health symptom (user waking up often at night, problematic patters of sleeping, lack of alimentation, etc.) or dangerous situations like staying too long in bedroom without going out and so on
Possibility to interact with the house of the user in case of gas scape or flood, for example
It is not possible for the Telecare staff
Telecare staff could stop some actuators at home through gas/water electrovalves, for example
Action proposals when a risk situation occurs
None
TALISMAN can propose some actions to the Telecare staff, according to the detected situationThe TALISMAN system characteristics were exposed to the Red Cross Telecare professionals. They could observe the system behavior and their capabilities to use the interface of the system (showed in Figure3) and test how the system would react with different sensors states possibilities chosen by them.The questionnaire was developed following the original TAM model, including other relevant factors provided by acceptance theories of UTAUT, DeLone and McLean and Yusof models. User satisfaction was measured by a self-developed 24-item user satisfaction questionnaire in terms of PU, PEOU, system quality, information quality, compatibility, facilitating conditions, and intention to use. Table2 lists the group of factors analyzed in this research and definitions. The questionnaire results (shown in Table 3) are based on this list of factors and include all unopened questions.Table 2
Proposed evaluation framework.
Scope
Factor
Definition
Evaluation
User profile
User characteristics [22]
Attitude to use (motivation, resistance)Gender and ageExperience/expertise
Technology acceptance model factors
Perceived ease of use
“The degree to which a person believes that using a particular system would be free of effort” [22]“The measure to determine the degree in which a product can be used easily by certain persons and, thus, to obtain a few proposed aims” [35]
It is easy to use, learn, and rememberIt is easy to achieve the system to does what I wantThe interaction with the system is clear and understandableThe TALISMAN system does not demand much care and attention
Perceived usefulness
“The degree to which a person believes that using a particular system would enhance his or her performance” [22] Relative advantage is defined as “the degree which an innovation is perceived as being better than its precursor” [36, 37]
It is useful to the jobIt increases productivity, job performance, and efficiency It increases the work qualityIt improves patients care and managementIt provides a relative advantage
Intention to use
“The subjective possibility that a person will perform a behavior” [12]
If I have the option to use the system, I would use it
Compatibility
Compatibility
“The degree to which an innovation is perceived as being consistent with existing values, needs, and experiences of potential adopters” [36, 37]. It includes compatibility with the organizational structure and environment (politics, business strategy, service delivery protocols, technologies, communications, etc.)”
It impacts on my work structureIt changes habits of the workersIt changes structures, protocols, or norms of the service
System quality
Efficiency
It is evaluated as correct functionality, precision, and quick response. This variable is measured when the system has been used. The use of the system can have positive or negative influence over the system quality perception [32, 33]
It offers a quick responseIt requires low time and effort It works correctly (detection of the patient status)It is accurate in response
Reliability
The confidence in that the system works as it should, without faults or outages of the system [32, 33]
I trust in the system
Flexibility
The capability to adapt the system to the telemonitoring needs [32, 33]
I worry that the system cannot be adapted to my need
Information quality
DeLone and McLean model [32, 33]
Accuracy, clarity, efficiency, completeness, and relevance
Facilitating conditions
Intention to use
“Objective factors in the environment that observers agree to make an act easy to accomplish” [38]
Some financial and time constraintsTable 3
Evaluation of each indicator.
Factor
Indicators
Question
MO
ME
Q3
P80
P90
P95
P99
Perceived ease of use
It is easy to use, learn, and remember.It is easy to achieve the system to do what I want.The interaction with the system is clear and understandable.I am comfortable when using the system and it does not demand extreme care and attention.
Q1. About the general use of TALISMAN: ((a) all available elements are easy to use and understand the system interface. (b) The system is easy to use for me, but some elements are more difficult to understand. (c) Almost all elements are easy to understand, but some elements are more difficult to use, requiring several attempts to understand completely. (d) I could use a part of the system, but I do not understand many elements. (e) It is not possible to use the system for me)
a (70.8%)
a
b
b
b
c
c
Q2. You are comfortable when you are using TALISMAN system (“(a) extremely agree” to “(e) extremely disagree”)
a (70.8%)
a
b
b
b
c
c
Q5. The use of the system involves too much time and effort (“(a) extremely agree” to “(e) extremely disagree”)
e (54.1%)
e
e
e
e
e
e
Perceived usefulness
Useful for the job.Increases job performance and efficiency.Increases the work quality.Improves the service to the patients and its management.Provides a relative advantage over the current solution.
Q8. TALISMAN could improve the care and attention of the person at home (“(a) extremely agree” to “(e) extremely disagree”)
a (87.5%)
a
a
a
b
b
c
Q9. TALISMAN provides important information to know the state of the user at home, which is useful to attend the alarm by the Telecare center (“(a) extremely agree” to “(e) extremely disagree”)
a (91.6%)
a
a
a
a
b
b
Q10. I consider that TALISMAN would increase my work quality (“(a) extremely agree” to “(e) extremely disagree”)
a (91.6%)
a
a
a
a
b
b
Q18. If you have an older relative, do you consider that it is interesting to provide him with a Telecare system like TALISMAN?” (yes/no)
Yes (100%)
Compatibility
Impact on the work planning.Change in the habits of the workers.Change in the planning and protocols of the service.
Q6. TALISMAN is aligned with the structure of the system that I use now. For this reason, the use of TALISMAN would not result in a considerable change in my habits (“(a) extremely agree” to “(e) extremely disagree”)
e (29.1%)
d
e
e
e
e
e
Q7. TALISMAN system supposes a change in the protocols or rules governing the current Telecare service (yes/no)
Yes (58.3%)
Efficiency
Quick response.Correct functionality (detection of the patient status). Accuracy in response.Low time and effort required.
Q3. TALISMAN system processes information quickly (“(a) extremely agree” to “(e) extremely disagree”)
a (91.6%)
a
a
a
a
b
b
Q4. The system allows the detection of the user state when she/he is asking for assistance (“(a) extremely agree” to “(e) extremely disagree”)
a (41.6%)
b
c
c
d
d
d
Q5. The use of the system involves too much time and effort (“(a) extremely agree” to “(e) extremely disagree”)
e (54.1%)
e
e
e
e
e
e
Information quality
Relevance.
Q11. Relevance of user profile to know the state of an incident (“(a) very important” to “(e) nothing relevant”)
a (100%)
a
a
a
a
a
a
Q12. Information about the state of the person: fall detection, bed occupation, unconsciousness sensor (inactivity), remaining on the floor after fall detection, and medication intakes (“(a) very important” to “(e) nothing relevant”)
a (100%)
a
a
a
a
a
a
Q13. Relevance of information collected by biomedical sensors (“(a) very important” to “(e) nothing relevant”)
a (58.3%)
a
a
a
a
b
c
Q14. Environmental factors such as fire, carbon dioxide, temperature, and flood (“(a) very important” to “(e) nothing relevant”)
a (79.1%)
a
a
b
b
b
b
Q15. The importance of knowing if the person is alone at home when an alarm occurs (“(a) very important” to “(e) nothing relevant”)
a (83.3%)
a
a
a
b
b
c
Q16. Action proposal’s relevance (“(a) very important” to “(e) nothing relevant”)
a (62.5%)
a
b
b
c
d
d
Intention to use
If I had the option of using the system, I would use it.
Q17. If I had the option to use the system, I would use it (yes/no)
Yes (95.83)
Q20. Do you believe it is necessary that Telecare should evolve towards a system like TALISMAN? (yes/no)
Yes (100%)In a total of 15 questions, responses have been rated on a five-point Likert scale anchored at strongly agree and strongly disagree. The questionnaire also includes four questions that can be answered with yes or no that need a positioning of the interviewee. Moreover, the questionnaire contains five open-ended questions to identify the user’s perception of the Telecare system and the opinion about the lack of relevant information or the data representation. Information about age, years of experience, and specialty of studies of the interviewee was also collected.The interviews were performed individually following the questionnaire design. The answers were recorded digitally for their subsequent analysis. In addition, interviewees’ comments were collected during the questionnaire to complete and justify the results.


## 4. Results

The study was conducted during the months of March and April 2015 with 24 workers, 40% of the total, of the Telecare center of the Spanish Red Cross. All the participants had experience, between 10 months and 10 years, as Telecare professionals in Telecare centers. A total of 5 men and 19 women were interviewed and the average age was 43 years. The academic training was diverse: psychologists, social workers, teachers, and professional training mostly.Table3 presents the information related to the questionnaire and the answers collected from the Telecare professionals. The questionnaire has been designed to obtain indicators for the factors shown in Table 2. As previously commented, each indicator is evaluated through several questions summing up 19 measurable questions. Fifteen of the questions are rated on a five-point Likert scale: strongly agree labeled as “a,” agree as “b,” indifferent as “c,” disagree as “d,” and strongly disagree as “e.” The remaining four are yes/no questions.To visualize the evaluation of each indicator, Table3 shows the mode, median, quartile 3, and percentiles 80, 90, 95, and 99 of each descriptive question analyzed in the questionnaire. The value of the percentiles has been calculated scoring each label with a numerical value (from “a” = 4 to “e” = 0). In the case of the statistical mode, its percentage is also provided with respect to all possible answers for that question (mode “a” with an associated percentage of 70,80% means than the most frequent answer to that question was “a” having the 70,80% of all answers).


### 4.1. Perceived Ease of Use

Usability and presentation of data have a significant influence on the quality of the service. According to the professionals, the interface is understandable and its use does not require excessive effort. However, professionals add more valuable information in this case. Several participants stated that the TALISMAN interfaces are inefficient, demanding more attention and time than the current system in use in Red Cross. These participants suggest that this issue can be solved with an interface with the most important information highlighted alone at the top of the screen. This way the professional would not waste time searching for this information, improving the response time (acritical factor in emergencies).


### 4.2. Perceived Usefulness and System Efficiency

Telemonitoring is associated with the improvement of the user quality of life by increasing the patient involvement in her/his house. In addition, it improves the efficiency of the call center since professionals have a more precise understanding of the user state. Furthermore, participants show their opinions with the decision making process performed by TALISMAN. In summary, the contestants think that the TALISMAN system provides very important information to know the state of the user at home and to detect risk situation and to support an appropriated professional action. They are also satisfied with unsupervised decisions made by the system. They think that TALISMAN can be very useful to help to take important decisions for several situations. (1) When the user presses the Telecare button accidentally, in this moment, he/she is not close to Telecare unit and he/she does not hear the Red Cross call. The system offers information whether the user is moving into another room of the house or if he is using the kitchen and so on, and it cannot activate unnecessary services for this reason. (2) The system can detect potential risk situation to the person and it can directly call Telecare center without the user activation (if the user remains for too long on the floor and spends too many hours in bed and so on). (3) The system can control medication and the detection of previous symptoms of Alzheimer’s or other diseases through environmental control. (4) In addition, for talking with the user, TALISMAN provides more information to manage better the alarm (“TALISMAN is a very important complement to improve the service, to detect possible risk of the person at home, and to help us make better decisions, for example, when the person does not answer”).Relating to the efficiency of the system, the professionals stated that TALISMAN can process information quickly. However, respondents are conscious that the system could have limitations in the detection. Although 41.66% of respondents strongly agree with the affirmation that “the system allows detecting the user state when she/he is asking for assistance,” other respondents are more cautious in their response (25% “agree,” 12.5% “indifferent,” and 16.66% “disagree”). This variability can be justified through some comments provided by respondents: “TALISMAN can help to know the user state at home, but not 100%” or “to know exactly what happened, it is necessary to put cameras or to speak with the user or with another person.”


### 4.3. Compatibility

Telecare professionals do not consider that there are major compatibility problems between the TALISMAN and the current Telecare system, proposing a future integration with the current TTS. In addition, they think that the current procedures can be properly adapted to the new functionalities and functions received from TALISMAN. However, participants insisted on the fact that “any system can replace oral communication with the user or their contacts, and whenever an alarm is received, Spanish Red Cross will try to talk with them.” In this way, interviewees see TALISMAN like a system that can be configured and adapted to the person, with more possibilities to evolve.


### 4.4. Information Quality

This factor is a key point for the acceptance of TALISMAN system. There were six questions (Q11–Q16) related to the relevance of the information managed by the system: user profile, status of personal sensors, status of biomedical sensors, status of biomedical sensors, status of environmental sensors, and action proposals. Furthermore, there were two opened questions (Q23 and Q24) related to the quality of information, the lack or relevance of information, and the utility of the way representing the information.Figure4 shows a radar chart where all the variables are related to the importance of the different types of information defined in Q11–Q16. The numerical value of each variable corresponds to the mean of all the answers of the specific question (e.g., Q11 for profile) scoring the “a” label as 4 points, “b” as 3, “c” as 2, “b” as 1, and “e” label as 0 points.Figure 4
Relevance of information showed by the interface.As can we see in Figure4, the information provided by biomedical sensors was considered less important than others because of lack of understanding (“we have not understood these measures”) or small relevance to the final action (“this fact cannot have influence in the way of attend the alarm”).The most relevant information according to the professional is the one related to daily life actions of the patients: fall detection, bed occupation, inactivity, remaining on the floor, and medication intakes. They also considered very useful the environmental sensors (like fire, carbon monoxide, temperature, and flood). However, some of them showed their displeasure with the improper performance of some sensors (“some of these sensors switch on with the minimum detection, for example, when the person is cooking”). One of the most innovative features of the system, the action proposals, had good scores in satisfaction by a majority of the participants. Although some of the participants argued that it is a good idea, they know the protocols that they should follow, and this information is unnecessary. However, the majority of participants believe that it is a good idea always, both for new operators, that they are starting and all professionals to know what to do in any moment. Finally, the participants propose the use of all the profile information already included in the current system such as the user’s telephone numbers and contacts and kind of health insurance.


#### 4.4.1. Accuracy, Clarity, Efficiency, and Completeness of the Information

The questions 23 and 24 of the questionnaire were trying to measure the quality of information provided by the system, accuracy, clarity, and information that can lack or unnecessary and useless information to know the status of the person.All participants agreed with the simplicity of the interface. However, they indicated that the information presented was not efficient for them. They point out that the interface showed too much information on the screen, and it was necessary to look at the screen to see clearly what was happening. They only proposed to show important information (only sensors that have been activated) highlighted at the top of the screen with icons, as we pointed out in “Perceived Ease of Use.” Moreover, they considered important to show on the main screen the activated sensors together with the personal profile of the user (name, age, social security number, and contacts, among others) and action proposals by the TALISMAN system linked with the facility to call to contacts. For them, it is very inefficient to press several buttons to acquire this kind of information. Finally, some of them proposed to include an extra text box in order to complete the incidence with observations of Telecare center professionals.When they were asked about “the completeness of the information and what elements they think that are missing and what are relevant or unnecessary,” the majority of them answered that the system is very complete. However, professionals pointed to the necessity of having the actual personal profile that they collected in Spanish Cross Red integrated with the possibilities of TALISMAN and maintaining a history of advices and alerts.For that, professionals proposed that the interface would include a button to extend information and to show previous events, which occurred at home, but using another screen.Moreover, some of them proposed new sensors, like movement sensors in terraces or courtyard, and a personalization of no response time, depending on personal profile. Only two people believed that the use of cameras is necessary to know completely what is happening at the house. Another person suggested the importance of including new techniques, like GPS, to achieve amplified Telecare outside house.


### 4.5. Intention to Use and Expectation

Participants perceived TALISMAN as a solution to improve current Telecare. They concluded that TALISMAN would allow obtaining a great quantity of information to detect and manage incidents that traditional Telecare cannot. TALISMAN could be integrated with the current interface and protocols used by Spanish Red Cross so that the alarm call center can receive in each case a report with the complete situation with regard to what it is happening at home. Several participants stated the following intention to use: “current Telecare is good, but only is activated when the person presses the Telecare button.” Others stated that “with a system like TALISMAN a world of possibilities can be open to improve the care of the people that use this service.” Besides, they stated that “the current Telecare service has not changed in many years, and it is necessary to take advance of the new technologies to complete the service.”


### 4.6. Price

Price is a possible barrier factor for using this service. Therefore, we asked about what price/month could be reasonable to pay for this service by user (Q19 of questionnaire). Around 30% set the price nearby30€ (present cost of the service in Spain). Almost half of them considered that the price should be established according to the income of the person, taking into account that older people usually have very low income. 8.3% of responses established the price around 50–60€.


### 4.7. Advantages

Q21 was “what advantages you think that the system has?” All users refer to the safety for the user (better detection of risk situations), more valuable and objective information, and the speed to mobilize resources.The factor flexibility repeatedly emerged during the interviews like advantage of the system. Interviewers see TALISMAN like a system that can be configured and adapted to the person, with more possibilities to evolve.


### 4.8. Barriers

When interviewers were asking about barriers to adopt the TALISMAN system (Q 22 of the questionnaire), problems that interviewers detected were as follows:(i)
Price (ageing people typically have low retirement pay)(ii)
Possible rejection of some users: there are users that are uncomfortable with many devices. The lack of information and unknown possibilities of TALISMAN and how it works could induce insecurity, lack of privacy, or control in certain users(iii)
Too many devices: therefore, TALISMAN would be perceived like being too intrusive(iv)
Configuration problems, by customizing to each user(v)
Possible technical problems (many false positives, no detection of a sensor, sensors reliability, battery failure, etc.)


### 4.9. Human Factor

A key factor to the success of any Telecare service is the human factor. Participant insisted on the usefulness of the TALISMAN but it never can replace the oral communication with the user or any of their contacts. “TALISMAN is a very important complement to improve the service, to detect possible risk of the person at home, and to help us to make decisions, for example, when the person does not answer.”


## 4.1. Perceived Ease of Use

Usability and presentation of data have a significant influence on the quality of the service. According to the professionals, the interface is understandable and its use does not require excessive effort. However, professionals add more valuable information in this case. Several participants stated that the TALISMAN interfaces are inefficient, demanding more attention and time than the current system in use in Red Cross. These participants suggest that this issue can be solved with an interface with the most important information highlighted alone at the top of the screen. This way the professional would not waste time searching for this information, improving the response time (acritical factor in emergencies).


## 4.2. Perceived Usefulness and System Efficiency

Telemonitoring is associated with the improvement of the user quality of life by increasing the patient involvement in her/his house. In addition, it improves the efficiency of the call center since professionals have a more precise understanding of the user state. Furthermore, participants show their opinions with the decision making process performed by TALISMAN. In summary, the contestants think that the TALISMAN system provides very important information to know the state of the user at home and to detect risk situation and to support an appropriated professional action. They are also satisfied with unsupervised decisions made by the system. They think that TALISMAN can be very useful to help to take important decisions for several situations. (1) When the user presses the Telecare button accidentally, in this moment, he/she is not close to Telecare unit and he/she does not hear the Red Cross call. The system offers information whether the user is moving into another room of the house or if he is using the kitchen and so on, and it cannot activate unnecessary services for this reason. (2) The system can detect potential risk situation to the person and it can directly call Telecare center without the user activation (if the user remains for too long on the floor and spends too many hours in bed and so on). (3) The system can control medication and the detection of previous symptoms of Alzheimer’s or other diseases through environmental control. (4) In addition, for talking with the user, TALISMAN provides more information to manage better the alarm (“TALISMAN is a very important complement to improve the service, to detect possible risk of the person at home, and to help us make better decisions, for example, when the person does not answer”).Relating to the efficiency of the system, the professionals stated that TALISMAN can process information quickly. However, respondents are conscious that the system could have limitations in the detection. Although 41.66% of respondents strongly agree with the affirmation that “the system allows detecting the user state when she/he is asking for assistance,” other respondents are more cautious in their response (25% “agree,” 12.5% “indifferent,” and 16.66% “disagree”). This variability can be justified through some comments provided by respondents: “TALISMAN can help to know the user state at home, but not 100%” or “to know exactly what happened, it is necessary to put cameras or to speak with the user or with another person.”


## 4.3. Compatibility

Telecare professionals do not consider that there are major compatibility problems between the TALISMAN and the current Telecare system, proposing a future integration with the current TTS. In addition, they think that the current procedures can be properly adapted to the new functionalities and functions received from TALISMAN. However, participants insisted on the fact that “any system can replace oral communication with the user or their contacts, and whenever an alarm is received, Spanish Red Cross will try to talk with them.” In this way, interviewees see TALISMAN like a system that can be configured and adapted to the person, with more possibilities to evolve.


## 4.4. Information Quality

This factor is a key point for the acceptance of TALISMAN system. There were six questions (Q11–Q16) related to the relevance of the information managed by the system: user profile, status of personal sensors, status of biomedical sensors, status of biomedical sensors, status of environmental sensors, and action proposals. Furthermore, there were two opened questions (Q23 and Q24) related to the quality of information, the lack or relevance of information, and the utility of the way representing the information.Figure4 shows a radar chart where all the variables are related to the importance of the different types of information defined in Q11–Q16. The numerical value of each variable corresponds to the mean of all the answers of the specific question (e.g., Q11 for profile) scoring the “a” label as 4 points, “b” as 3, “c” as 2, “b” as 1, and “e” label as 0 points.Figure 4
Relevance of information showed by the interface.As can we see in Figure4, the information provided by biomedical sensors was considered less important than others because of lack of understanding (“we have not understood these measures”) or small relevance to the final action (“this fact cannot have influence in the way of attend the alarm”).The most relevant information according to the professional is the one related to daily life actions of the patients: fall detection, bed occupation, inactivity, remaining on the floor, and medication intakes. They also considered very useful the environmental sensors (like fire, carbon monoxide, temperature, and flood). However, some of them showed their displeasure with the improper performance of some sensors (“some of these sensors switch on with the minimum detection, for example, when the person is cooking”). One of the most innovative features of the system, the action proposals, had good scores in satisfaction by a majority of the participants. Although some of the participants argued that it is a good idea, they know the protocols that they should follow, and this information is unnecessary. However, the majority of participants believe that it is a good idea always, both for new operators, that they are starting and all professionals to know what to do in any moment. Finally, the participants propose the use of all the profile information already included in the current system such as the user’s telephone numbers and contacts and kind of health insurance.


### 4.4.1. Accuracy, Clarity, Efficiency, and Completeness of the Information

The questions 23 and 24 of the questionnaire were trying to measure the quality of information provided by the system, accuracy, clarity, and information that can lack or unnecessary and useless information to know the status of the person.All participants agreed with the simplicity of the interface. However, they indicated that the information presented was not efficient for them. They point out that the interface showed too much information on the screen, and it was necessary to look at the screen to see clearly what was happening. They only proposed to show important information (only sensors that have been activated) highlighted at the top of the screen with icons, as we pointed out in “Perceived Ease of Use.” Moreover, they considered important to show on the main screen the activated sensors together with the personal profile of the user (name, age, social security number, and contacts, among others) and action proposals by the TALISMAN system linked with the facility to call to contacts. For them, it is very inefficient to press several buttons to acquire this kind of information. Finally, some of them proposed to include an extra text box in order to complete the incidence with observations of Telecare center professionals.When they were asked about “the completeness of the information and what elements they think that are missing and what are relevant or unnecessary,” the majority of them answered that the system is very complete. However, professionals pointed to the necessity of having the actual personal profile that they collected in Spanish Cross Red integrated with the possibilities of TALISMAN and maintaining a history of advices and alerts.For that, professionals proposed that the interface would include a button to extend information and to show previous events, which occurred at home, but using another screen.Moreover, some of them proposed new sensors, like movement sensors in terraces or courtyard, and a personalization of no response time, depending on personal profile. Only two people believed that the use of cameras is necessary to know completely what is happening at the house. Another person suggested the importance of including new techniques, like GPS, to achieve amplified Telecare outside house.


## 4.4.1. Accuracy, Clarity, Efficiency, and Completeness of the Information

The questions 23 and 24 of the questionnaire were trying to measure the quality of information provided by the system, accuracy, clarity, and information that can lack or unnecessary and useless information to know the status of the person.All participants agreed with the simplicity of the interface. However, they indicated that the information presented was not efficient for them. They point out that the interface showed too much information on the screen, and it was necessary to look at the screen to see clearly what was happening. They only proposed to show important information (only sensors that have been activated) highlighted at the top of the screen with icons, as we pointed out in “Perceived Ease of Use.” Moreover, they considered important to show on the main screen the activated sensors together with the personal profile of the user (name, age, social security number, and contacts, among others) and action proposals by the TALISMAN system linked with the facility to call to contacts. For them, it is very inefficient to press several buttons to acquire this kind of information. Finally, some of them proposed to include an extra text box in order to complete the incidence with observations of Telecare center professionals.When they were asked about “the completeness of the information and what elements they think that are missing and what are relevant or unnecessary,” the majority of them answered that the system is very complete. However, professionals pointed to the necessity of having the actual personal profile that they collected in Spanish Cross Red integrated with the possibilities of TALISMAN and maintaining a history of advices and alerts.For that, professionals proposed that the interface would include a button to extend information and to show previous events, which occurred at home, but using another screen.Moreover, some of them proposed new sensors, like movement sensors in terraces or courtyard, and a personalization of no response time, depending on personal profile. Only two people believed that the use of cameras is necessary to know completely what is happening at the house. Another person suggested the importance of including new techniques, like GPS, to achieve amplified Telecare outside house.


## 4.5. Intention to Use and Expectation

Participants perceived TALISMAN as a solution to improve current Telecare. They concluded that TALISMAN would allow obtaining a great quantity of information to detect and manage incidents that traditional Telecare cannot. TALISMAN could be integrated with the current interface and protocols used by Spanish Red Cross so that the alarm call center can receive in each case a report with the complete situation with regard to what it is happening at home. Several participants stated the following intention to use: “current Telecare is good, but only is activated when the person presses the Telecare button.” Others stated that “with a system like TALISMAN a world of possibilities can be open to improve the care of the people that use this service.” Besides, they stated that “the current Telecare service has not changed in many years, and it is necessary to take advance of the new technologies to complete the service.”


## 4.6. Price

Price is a possible barrier factor for using this service. Therefore, we asked about what price/month could be reasonable to pay for this service by user (Q19 of questionnaire). Around 30% set the price nearby30€ (present cost of the service in Spain). Almost half of them considered that the price should be established according to the income of the person, taking into account that older people usually have very low income. 8.3% of responses established the price around 50–60€.


## 4.7. Advantages

Q21 was “what advantages you think that the system has?” All users refer to the safety for the user (better detection of risk situations), more valuable and objective information, and the speed to mobilize resources.The factor flexibility repeatedly emerged during the interviews like advantage of the system. Interviewers see TALISMAN like a system that can be configured and adapted to the person, with more possibilities to evolve.


## 4.8. Barriers

When interviewers were asking about barriers to adopt the TALISMAN system (Q 22 of the questionnaire), problems that interviewers detected were as follows:(i)
Price (ageing people typically have low retirement pay)(ii)
Possible rejection of some users: there are users that are uncomfortable with many devices. The lack of information and unknown possibilities of TALISMAN and how it works could induce insecurity, lack of privacy, or control in certain users(iii)
Too many devices: therefore, TALISMAN would be perceived like being too intrusive(iv)
Configuration problems, by customizing to each user(v)
Possible technical problems (many false positives, no detection of a sensor, sensors reliability, battery failure, etc.)


## 4.9. Human Factor

A key factor to the success of any Telecare service is the human factor. Participant insisted on the usefulness of the TALISMAN but it never can replace the oral communication with the user or any of their contacts. “TALISMAN is a very important complement to improve the service, to detect possible risk of the person at home, and to help us to make decisions, for example, when the person does not answer.”


## 5. Limitations

TALISMAN is a prototype currently running in a lab under controlled conditions. At the moment of writing this paper, it has not been integrated in the infrastructure of the Spanish Red Cross. This condition complicates the part of the evaluation of the service quality (reliability and efficiency of the service).This study is part of a global study in which we have analyzed acceptance and satisfaction factors of other relevant stakeholders: final users, family members or informal caregivers, and Telecare technical installers.


## 6. Conclusions

Telecare professionals are pivotal actors in the provision of the Telecare service. The measure of professionals’ satisfaction is a key issue in the successful deployment of the next-generation Telecare systems like TALISMAN.This study points to factors having influence on the use and user satisfaction of smart telemonitoring systems. It is centered on the analysis of best practices, drivers, and barriers with the aim to improve the assistance provided and the professionals’ work. These factors offer valuable information for the design and refinement of advanced Telecare systems of new generation.



---

*Source: 8972350-2017-08-03.xml*