# Partial Commitment – “Try Before You Buy” and “Buyer’s Remorse” for Personal Data in Big Data & Machine Learning

Lothar Fritsch

► To cite this version:

Lothar Fritsch. Partial Commitment – “Try Before You Buy” and “Buyer’s Remorse” for Personal Data in Big Data & Machine Learning. 11th IFIP International Conference on Trust Management (TM), Jun 2017, Gothenburg, Sweden. pp.3-11, 10.1007/978-3-319-59171-1_1 . hal-01651157

HAL Id: hal-01651157

https://inria.hal.science/hal-01651157

Submitted on 28 Nov 2017

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
Partial commitment – “Try before you buy” and
“Buyer’s remorse” for personal data in Big Data &
Machine learning

Lothar Fritsch, Karlstad University, Sweden

**Abstract.** The concept of partial commitment is discussed in the context of personal privacy management in data science. Uncommitted, promiscuous or partially committed user's data may either have a negative impact on model or data quality, or it may impose higher privacy compliance cost on data service providers. Many Big Data (BD) and Machine Learning (ML) scenarios involve the collection and processing of large volumes of person-related data. Data is gathered about many individuals as well as about many parameters in individuals. ML and BD both spend considerable resources on model building, learning, and data handling. It is therefore important to any BD/ML system that the input data trained and processed is of high quality, represents the use case, and is legally processes in the system. Additional cost is imposed by data protection regulation with transparency, revocation and correction rights for data subjects. Data subjects may, for several reasons, only partially accept a privacy policy, and chose to opt out, request data deletion or revoke their consent for data processing. This article discusses the concept of partial commitment and its possible applications from both the data subject and the data controller perspective in Big Data and Machine Learning.

**Keywords:** Big Data, Machine learning, data sharing, personal information, information privacy, commitment, consent, data processing, user interface, interaction

# 1 Introduction

Collection and processing of personal data is an important component of contemporary IT services. Many contemporary services are free of financial charge for end users, however they demand collection of personal data and the provisioning of advertising services as compensation. A new emerging business model for free-of-charge services is the accumulation, elaboration, analysis and selling of data provided by the users. The handling of personal data is regulated according to data protection legislation. In Europe's General Data Protection regulation (GDPR)[1], data processors shall collect legally valid informed consent from the data subjects before they collect and process their personal data. Such informed consent should specify the scope of data collection, provide details about storage and processing, specify the purpose of data use, and indicate other parties that will get access to the data. Users are usually presented with a privacy policy text in prose which they will have to accept and confirm as it is. Privacy policies are known to misinform[2], and to impose a high burden of
responsibility on the data subjects[3]. Automatic negotiation of privacy policy refer-
ences has been explored with P3P and EPAL, however is rarely found in existing
systems[4]. The provision of consent is therefore, in practice, YES-NO binary deci-
sion. Service providers fulfill their legal obligation, while data subjects usually skip
reading the privacy policy on their way to access the free-of-charge service. Many
reasons for such behavior are found – lack of time, lack of legal understanding, pseu-
donymous use of services with fake identities, and non-commitment, for example for
the purpose of testing the service. Data subjects might, therefore, be unaware of or
ignorant about the nature of data collection and processing the service relies upon.
They might accept a privacy policy with a “maybe” intention, just to proceed into
using the service.

The collection of data from non-committed data subjects may, however, pose a risk
to the intentions of the service provider. Dependent on the purpose of data collection,
the provisioning of fake identities, incomplete or fabricated data or data patterns cre-
ated through playful testing of a service may reduce the quality of the collected data.
In addition, the accumulation of non-committed data subject’s data into a sample that
shall represent the user population may misrepresent users upon opt-out of the un-
committed users. Non-commitment poses therefore a hazard for data quality, may
endanger training data sets, statistical norm data sets, and may cause long-stranding
data protection compliance obligations with respect to data protection enquiries and
transparency rights.

As a solution to this problem, we suggest the introduction of partial commitment
into the handling of data processing consent. We propose to extend the YES-NO
choice offered today by a MAYBE option that expresses partial commitment. The
remainder of the article will elaborate the background of partial commitment, discuss
particular benefits both data subjects and data processors might receive from partial
commitment, and drafts a research agenda for the further investigation of partial
commitment to personal data processing.

## 1.1 Background

Commitment, or the lack thereof, has been the subject of research in many disci-
plines. This section reviews the results of literature research for the concept of partial
commitment, delayed commitment, non-commitment and promiscuous commitment.
Examples from the technology domain are the reachability manager for mobile com-
munications which contains numerous options for policies for personal reachability
for direct communications [5]. Another variant is a customer self-care interface for
location services in mobile networks where customers can control fine-grained opt-in
and opt-out functions against any third-party service provider [6] . One base technol-
ogy for partial commitment is a reference storage for various policies which can then
be, under the commitment process, referenced by the negotiating stakeholders [7].
Commitment has been discussed in the areas of risk acceptance, choice and decision-
making. In psychology, a known phenomenon is a preference for the status quo. Hu-
man beings seem, when confronted with decision-making, show a preference for the
status quo[8]. Reasons for this are uncertainty, incomplete information, loss aversion,
complexity of the alternatives and many other aspects discussed in literature. Recent research on choice architecture deepens insight into how information presentation supports decision-making[9]. Another influential aspect of commitment is fairness in interaction. Procedural justice may improve user cooperation and data quality, as found in [10]. In addition, procedural fairness is found to increase trust in on-line applications[11]. From a trust management perspective, trust partial commitment can be assumed an integral part of pessimistic and investigative trust-building strategies [12]. A connection between privacy policies and the level of customer loyalty has been observed in recurring consumer studies on web portals[13]. Consequently, giving consent to the processing of personal data can be seen as a dialogue, not a monologue over the particularities of releasing personal data and engaging into a contract with a service provider [14]. Lack of information may cause decision procrastination in search for more information [15]. From this perspective, the usability of privacy policies can be decisive for data subject commitment, as they are part of end-user decision making [16]. There is evidence about a tight binding between good stakeholder relationship and commitment. Customer relationship management is concerned strongly with customer commitment. The importance of commitment in relationship marketing was described in [17] as : "Commitment is an important variable in the relationship marketing goal system. It is a prerequisite for the customer to proactively seek relationship maintenance whereas uncommitted customers can only be kept in relationships through instruments such as use of power, long-term contracts or in monopoly situations."

## 1.2 Challenges

Many users of internet services who accept service terms & conditions and the related privacy policies are not committed at the time they sign up. They test the service, and may resign or opt out a short time in the future. Such leaving customers' data may cause a number of issues in BD/ML systems:

* According to upcoming European data protection legislation [1], data subjects will have extensive rights concerning data protection inquiries, data export and data deletion requests from 2018 on. A BD/ML operator will have to prepare all data processing systems to comply with such requests, even for uncommitted short-term users of the services. This will cause major liabilities and compliance efforts.

* Machine Learning models trained with data gathered from non-committed data subjects may not make as good decisions as those trained with committed data subjects' data. Service providers may be interested in separation of data acquired from committed and non-committed users. Uncommitted data subjects may "pollute" the data pool and the models.

* "Roll-back" of learning models or data collections that collect aggregated data in the case of data subject opt-out may be difficult performed on simple data bases. A roll-back mechanism for ML and for various forms for BD data aggregation should support opt-out of data subjects, including their contribution to the models and data-related costs.
tabases. Roll-back may prove useful when trying to fight pollution of models and data sets by uncommitted data subjects.

* Resulting models and databases should provide sufficient audit information about personal data processed into them, and how it contributed to model building and decision-making. Quality insurance and demonstrability of correct data processing might be essential once analysis results are questioned.

The handling of the aforementioned challenges requires strategies and techniques to handle them in an application processing data from uncommitted data subjects. In the following section, we suggest and investigate the concept of partial commitment, and how its conceptualization as a classification tools could be used to solve the challenges above.

## 2 Partial commitment as a concept: the MAYBE button

In this section, the concept of partial commitment into processing of personal data is presented. The concept of partial commitment was suggested by Elena Barrantes for the rump session on the 11th IFIP Summer School on Privacy and Identity Management in Karlstad, Sweden, in August 2015. Lothar Fritsch moderated the discussion following the presentation. The participants – researchers, industry participants and PhD students – brainstormed about the concept, its interpretation and its uses.

The suggestion starting the

brainstorming was the question whether there should be a “MAYBE button” next to the accept /decline choices when providing consent to a privacy policy (see Figure 1). In the following sections, we will discuss the stakeholder perspectives on partial commitment. We focus on the two stakeholders “data subjects” (delivering data, expected to accept a privacy policy to access a service) and “service provider” (a personal data consuming service that expects a data subject to give some form of consent to data processing. On the rump session workshop at the 11th IFIP Summer School on Privacy and Identity Management, the participants were asked to brainstorm possible beneficial uses and implications of a “Maybe” option on privacy policies, both for data subjects and for service providers. The results were collected, analyzed and used to formulate benefits from both stakeholder groups’ perspectives, which are summarized in the following two sections.

<figure><img src="image_2.png" /><figcaption>Fig. 1. partial commitment through the MAYBE option.</figcaption></figure>
## 2.1 Data subjects' perspective

On the rump session workshop, the participants produced four different data subject perspectives on partial commitment.

**First:** Why should one commit at all? Concerns were raised about how realistic a policy reflects actual data processing, how much a – yet unknown – service is worth the commitment, and about how little trust information is known about the service provider. Participants partially voiced a strong wish of ownership over their data, and voiced concerns about granting too many privileges to service providers. It was stated that there is no time to read and comprehend privacy policies, which should get compensated by possibly committing later.

**Second:** Inappropriateness of the privacy policy. Participants expressed concern over the appropriateness, fairness, or truthfulness of the presented privacy policy. They voiced usefulness of delayed or partial commitment where confronted with policies that are either incomprehensible (too complicated, too long, poorly written), unfair (too general, one-sided, too much power transferred to the service provider), poorly specified (written for another legal system) or technically unusable (display on devices not suitable for reading).

**Third:** Promiscuity - Exploration and experimentation. Participants expressed the usefulness of unconditional, playful trial options and exploration of new services. In addition, they stated that they want to be able to use several services without much consideration about the implications of their privacy policies in intersection.

**Fourth:** Counteraction and retaliation when faced with no choices. Participants expressed that they, in cases where they find privacy policies unacceptable, but where they have to use the services for some reason, chose obfuscation or sabotage strategies such as entering fake identities, fake data, and the intentional provocation of false profiles. The possibility of partial commitment could reduce the need for such strategies.

From the data subject's perspective, a partial commitment can implement three different modes of interaction with a data-consuming service:

* **Promiscuity against yet unknown services or providers.** In this mode, the data subject has principal objections against commitment to a service provider. Why give exclusive rights over data and possible profits generated with it to a single stakeholder one has not yet established a relationship to, or built up trust in? Data subjects may wish to "sell" their data to several stakeholders, and chose how their data gets used freely. Depending on choices they get offered, they may delay commitment as they are not yet convinced that they have found the one service provider that suits best for their needs and requirements.

* **Test-before-commitment.** In this mode, a data subject executes the "try before you buy" philosophy. Reasons may be the satisfaction of curiosity, simple playful exploration of new services without serious commitment intentions, or mistrust in the quality of delivered service. "Try before you buy" schemes are implemented in various areas of life. In consumer protection law, when buying at the door, via telephone or on the internet, buyers can leave the contract for a certain period. Commercial providers of subscriptions, ranging from newspapers to telecommunication
services, often offer discounted trial subscriptions for limited time periods to get
customers to try out new products or services.

* **Verify realities behind privacy promises.** Often, the privacy policies and service descriptions are incomprehensible to data subjects. It is hard to evaluate the implications, consequences and accuracy of privacy policies [18] and their technical and administrative enforcement [4, 19]. Data subjects may use partial commitment for the purpose of exploring and evaluation of the reality of personal data processing in the service.

The presented modes of partial commitment may help data subjects therefore help with trust establishment, help with the playful exploration and adaption of new services, and can establish a dialogue between data subjects and service providers about privacy preferences.

## 2.2 Service providers’ perspective

On the rump session workshop, the participants produced four different service provider perspectives on partial commitment.

First: Measurement of privacy policy reception by data subjects. Delayed commitment could be used as a signal for poor readability or unacceptable privacy policies. Various forms of signals could help to understand customer objections. As a hypothesis, the measurement of frequencies of partial commitment was suggested: The more "maybe" commitments, the more confused or hesitant are the data subjects.

Second: Isolation of data from committed and little/not committed users. Using partial commitment, data processing services can manage separate pools of data, dependent on levels of commitment. Participants suggested that varying levels of data quality, service usage intensity and motivation of providing personal data will have a measureable impact on data quality and service quality.

Third: Focus on data consumption for Big Data applications and training sets for ML. Participants voiced concern over the accuracy of forecasting applications, ML based decisions and BD analytics when based on a data set that contains data from uncommitted or partially committed data sets. Separate data sets and models were suggested.

Fourth: Provision commitment metadata that enable rollback end reduces data management cost. Participants expected that, through available metadata on commitment levels, all forms of data management obligations (quality insurance, privacy transparency request handling, proof of foundations of automated decision-making) could be supported effectively.

From the service provider perspective, partial commitment can implement therefore three different benefits:

* **Measure the quality of privacy policies.** By assessing frequencies and detail aspects of various offered forms of partial commitment, service providers can assess the end user perspective on their privacy policies. A measurement resulting in low acceptance could then initiate a process with the aim to remove the problem. This
can be seen as the start of a communication and negotiation process for a more ac-
ceptable, and hence more customer-friendly service.

* **Separate data into classes of commitment.** Partial commitment can help with data separation along several dimensions. It can help keeping committed and uncommitted data pools separate, and may thereby improve the quality of data analysis, machine learning data sets, and decision-making. Commitment metadata may help with the deployment of services with better target population match, and may help improving the overall quality of data sets.

* **Prevent future separation and management cost.** Through suitable data classification, separation and labeling, the assessment of BD/ML decisions can better get planned, investigated, rolled back, or proven to 3rd parties. Compliance issues such as transparency and data deletion (data protection) and fairness (consumer law) can get managed better, with higher precision, and improved audibility. Systematic documentation and consideration of commitment levels may therefore prevent future cost.

In summary, partial commitment can be a tool for service providers to assess the acceptance of their privacy policies. It can be used as a tool for data separation and quality insurance, and it could, in addition, get deployed as a strategy for cost reduction, service quality improvement, and better transparency in analytics and automated decision-making.

3 Research opportunities

From the above observation, I propose the scientific examination of the value of
partial commitment in research activities. We propose to:

* Develop interaction patterns and architecture patterns for partial commitment;

* Map stakeholder needs and priorities;

* Perform usability research on user interface for partial commitment;

* Build a model for dynamic privacy management and data management with changing user commitment;

* Evaluate a prototypical implementation.

Additional interdisciplinary research opportunities can be included with:

* Research on the legal foundations, constraints and opportunities of partial commitment, e.g. through the construction of an analog to remorse periods in e-commerce or test subscriptions in telecommunications and Pay TV;

* Research on psychological aspects of usability and trust establishment between data collectors and data subjects;

* Information systems research on the influence of partial commitment on technology acceptance, diffusion, business model alignment, customer satisfaction, customer engagement, data crowdsourcing, and ad-hoc consent to data processing.
Both theoretical and applied research opportunities can be realized. In particular industry partners in the areas of Big Data, Machine Learning, Smart and autonomous networks cars, mobile telecommunications, Internet of Things, electronic health ser- vices and marketing and customer management services should be interested in the opportunities provided by partial commitment.

4 Conclusion

I introduced the concept of partial commitment to the collection and processing of
personal data. We analyzed the data subject and data processor perspective on partial
commitment, followed by an identification of stakeholder benefits, including possible
acceptance and trust increasing effects on the customer relationship in business mod-
els based on personal data. We showed the foundations of the concept in scientific
literature, and identified a research agenda that will investigate the concept of partial
commitment in the context of information privacy and data protection further, both in
theory and in applied research.

5 References

1. [1] Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (General Data Protection Regulation), European Union L 119/1, 2016.

2. [2] A. I. Antón, J. B. Earp, and A. Reese, "Analyzing Website Privacy Requirements Using a Privacy Goal Taxonomy," presented at the Proceedings of the 10th Anniversary IEEE Joint International Conference on Requirements Engineering, 2002.

3. [3] T. Vila, R. Greenstadt, and D. Molnar, "Why we can't be bothered to read privacy policies: models of privacy economics as a lemons market," ed Pittsburgh, USA: ACM Press, 2003, pp. 403-407.

4. [4] W. H. Stufflebeam, A. I. Antón, Q. He, and N. Jain, "Specifying privacy policies with P3P and EPAL: lessons learned," presented at the Proceedings of the 2004 ACM workshop on Privacy in the electronic society, Washington DC, USA, 2004.

5. [5] M. Reichenbach, H. Damker, H. Federrath, and K. Rannenberg, "Individual Management of Personal Reachability in Mobile Communication," in *Information Security in Research and Business: Proceedings of the IFIP TC11 13th international conference on Information Security (SEC'97)*, London, 1997, pp. 164-174.

6. [6] J. Zibuschka, L. Fritsch, M. Radmacher, T. Scherner, and K. Rannenberg, "Privacy-Friendly LBS: A Prototype-supported Case Study," in *13th Americas Conference on Information Systems (AMCIS)*, Keystone, Colorado, USA, 2007.

7. [7] A. Jøsang, L. Fritsch, and T. Mahler, "Privacy Policy Referencing," in *Trust, Privacy and Security in Digital Business*. vol. 6264, S. Katsikas, J. Lopez, and M. Soriano, Eds., ed Berlin / Heidelberg: Springer, 2010, pp. 129-140.

8. [8] W. Samuelson and R. Zeckhauser, "Status quo bias in decision making," *Journal of Risk and Uncertainty*, vol. 1, pp. 7-59, 1988.
9. [9] R. Münscher, M. Vetter, and T. Scheuerle, "A Review and Taxonomy of Choice Architecture Techniques," *Journal of Behavioral Decision Making*, vol. 29, pp. 511-524, 2016.

10. [10] A. Muthoo, "A Bargaining Model Based on the Commitment Tactic," *Journal of Economic Theory*, vol. 69, pp. 134-152, 1996/04/01 1996.

11. [11] T. W. Lauer and X. Deng, "Building online trust through privacy practices," *International Journal of Information Security*, vol. 6, pp. 323-331, 2007.

12. [12] L. Fritsch, A.-K. Groven, and T. Schulz, "On the Internet of Things, Trust is Relative," in *Constructing Ambient Intelligence*. vol. 277, R. Wichert, K. V. Laerhoven, and J. Gelissen, Eds., ed Amsterdam: Springer, 2012, pp. 267-273.

13. [13] C. Flavián and M. Guinalíu, "Consumer trust, perceived security and privacy policy: Three basic elements of loyalty to a web site," *Industrial Management & Data Systems*, vol. 106, pp. 601-620, 2006.

14. [14] L. Coles-Kemp and E. Kani-Zabihi, "On-line privacy and consent: a dialogue, not a monologue," presented at the Proceedings of the 2010 workshop on New security paradigms, Concord, Massachusetts, USA, 2010.

15. [15] J. R. Ferrari and J. F. Dovidio, "Examining Behavioral Processes in Indecision: Decisional Procrastination and Decision-Making Style," *Journal of Research in Personality*, vol. 34, pp. 127-137, 2000/03/01 2000.

16. [16] C. Jensen and C. Potts, "Privacy policies as decision-making tools: an evaluation of online privacy notices," presented at the Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Vienna, Austria, 2004.

17. [17] B. S. Ivens and C. Pardo, "Are key account relationships different? Empirical results on supplier strategies and customer reactions," *Industrial Marketing Management*, vol. 36, pp. 470-482, 5// 2007.

18. [18] A. Sunyaev, T. Dehling, P. L. Taylor, and K. D. Mandl, "Availability and quality of mobile health app privacy policies," *Journal of the American Medical Informatics Association*, vol. 22, pp. 1-4, 2014.

19. [19] J. B. Earp, A. I. Antón, L. Aiman-Smith, and W. H. Stufflebeam, "Examining Internet privacy policies within the context of user privacy values," *IEEE Transactions on Engineering Management*, vol. 52, pp. 227-237, 2005.