ModelChain: Decentralized Privacy-Preserving Healthcare Predictive Modeling Framework on Private Blockchain Networks

Cross-institutional healthcare predictive modeling can accelerate research and facilitate quality improvement initiatives, and thus is important for national healthcare delivery priorities. For example, a model that predicts risk of re-admission for a particular set of patients will be more generalizable if developed with data from multiple institutions. While privacy-protecting methods to build predictive models exist, most are based on a centralized architecture, which presents security and robustness vulnerabilities such as single-point-of-failure (and single-point-of-breach) and accidental or malicious modification of records. In this article, we describe a new framework, ModelChain, to adapt Blockchain technology for privacy-preserving machine learning. Each participating site contributes to model parameter estimation without revealing any patient health information (i.e., only model data, no observation-level data, are exchanged across institutions). We integrate privacypreserving online machine learning with a private Blockchain network, apply transaction metadata to disseminate partial models, and design a new proof-of-information algorithm to determine the order of the online learning process. We also discuss the benefits and potential issues of applying Blockchain technology to solve the privacy-preserving healthcare predictive modeling task and to increase interoperability between institutions, to support the Nationwide Interoperability Roadmap and national healthcare delivery priorities such as Patient-Centered Outcomes Research (PCOR).  healthcare provider may be able to predict certain outcome even if her institution has few or none related patient records. A predictive model can be “learned” (i.e., its parameters can be estimated) from data originating from the other institutions. However, improper data disclosure could place sensitive personal health information at risk. To protect the privacy of individuals, several algorithms (such as GLORE, EXPLORER, and VERTIGO) have been proposed to conduct predictive modeling by transfer of partially-trained machine learning models instead of disseminating individual patient-level data. However, these state-of-the-art distributed privacypreserving predictive modeling frameworks are centralized (i.e., require a central server to intermediate the modeling process and aggregate the global model), as shown in Figure 1(a). Such a client-server architecture carries the following risks: ● Institutional policies. For example, a site may not want to cede control to a single central server. ● Single-point-of-failure. For example, if the central server is shut down for maintenance, the whole network stops working. Furthermore, if the admin user account of the central server gets compromised, the entire network is also under the risk of being compromised. ● Participating sites cannot join/leave the network at any time. If any site joins or leaves the network for a short period of time, the analysis process is disrupted and the server needs to deal with the recovering issue. A new site may not participate in the network without the authentication and reconfiguration on the central server. Figure 1. (a): Centralized topology. (b): Decentralized topology (Blockchain). ● The data being disseminated and the transfer records are mutable. An attacker could change the partial models without being noticed. The transfer records may also be modified so that no audit trail is available to identify such malicious change of data. ● The client-server architecture may present consensus/synchronization issues on distributed networks. Specifically, the issue is the combination of two problems: the Byzantine Generals Problem, in which the participating sites need to agree upon the aggregated model under the constraint that each site may fail due to accidental or even malicious ways, and the Sybil Attack Problem, of which the attacker comprises a large fraction of the seemingly independent participants and exerts unfairly disproportionate influence during the process of predictive modeling. To address the abovementioned risks, one plausible solution is to adapt the Blockchain technology (in this article, we use “Blockchain” to denote the technology, and “blockchain” to indicate the actual chain of blocks). A Blockchain-based distributed network has the following desirable features that make it suitable to mitigate the risks of centralized privacy-preserving healthcare predictive modeling networks. First, Blockchain is by design a decentralized (i.e., a peer-to-peer, non-intermediated) architecture ; the verification of transactions is achieved by majority proof-of-work voting. Each institution can keep full control of their own computational resources. Also, there is no risk of single-point-of-failure. Second, each site (including new sites) can join/leave the network freely without imposing overhead on a central server or disrupting the machine learning process. Finally, the proof-of-work blockchain provides an immutable audit trail. That is, changing the data or records is very difficult; the attacker needs to redo proof-of-work of the target block and all blocks after it, and then surpass all honest sites. As shown by Satoshi Nakamoto, the inventor of Blockchain and Bitcoin, given that the probability that an honest node finds the next block is larger than the probability that an attacker finds the next block, the probability the attacker will ever catch up drops exponentially as the number of the blocks by which the attacker lags behind increases. This is also the reason why the Blockchain mechanism also solves the relaxed version of Byzantine Generals Problem and the Sybil Attack Problem, as formally proved by Miller et al. Site 1 Site 2 Site 3 Site 4 Site 1 Site 2 Site 3 Site 4 Central Server (a) Centralized (b) Decentralized (Blockchain) Although Blockchain provides the abovementioned security and robustness benefits, a reasonable approach to integrate Blockchain with the privacy-preserving healthcare predictive modeling algorithms is yet to be devised. In this article, we propose ModelChain, a private-Blockchain-based privacy-preserving healthcare predictive modeling framework, to combine these two important technologies. First, we apply privacy-preserving online machine learning algorithms on blockchains. Intuitively, the incremental characteristic of online machine learning makes it feasible for peer-to-peer networks like Blockchain. Then, we utilize metadata in the transactions to disseminate the partial models and other meta information (i.e., flag (which indicates the type of action) of the model, hash of the model, and error of the model), and thus integrate private blockchains (i.e., the network is available only for participating institutions) with privacy-preserving online machine learning. Finally, we design a new proof-of-information algorithm on top of the original proof-of-work consensus protocol, to determine the order of the online machine learning on blockchains, aiming at increasing efficiency and accuracy. The basic idea of proof-of-information is similar to the concept of Boosting: the site that contains data that cannot be predicted accurately using a current partial model contains more information to improve the model, and thus that site should be assigned a higher priority to be chosen as the next model-updating site. We start with the best model to prevent error propagation, choose the site with highest error for current model to update the model, and repeat the process to update the model until a site cannot find any other site with higher error to update the model. In this case, we consider the model as the consensus model. ModelChain can advance the following interoperability needs stated in the Nationwide Interoperability Roadmap of the Office of the National Coordinator for Health Information Technology (ONC): ● “Build upon the existing health IT infrastructure.” ModelChain exploits the existing healthcare data in Clinical Data Research Networks (CDRNs) such as the Patient-centered SCAlable National Network for Effectiveness Research (pSCANNER), which is one of the Clinical Data Research Networks (CDRNs) in the PCORI-launched PCORnet and includes three networks: VA Informatics and Computing Infrastructure (VINCI), University of California Research eXchange (UCReX), and SCANNER. With the support of the Blockchain backbone, ModelChain can leverage all existing patient data storage infrastructures, while improving the healthcare prediction power for every site. ● “Maintain modularity.” Comparing to traditional client-server architecture, ModelChain inherits the peer-to-peer architecture of Blockchain, allowing each site to remain modular while interoperating with other sites. Also, each site has control about how its data are accessed (instead of ceding control to the central server), thus can keep up with institutional policies. Moreover, Blockchain provides the native ability to automatically coordinate the joining or leaving of each site, further improving the independence and modularity for the participating institutions. ● “Protect privacy and security in all aspects of interoperability.” ModelChain is designed to provide a secure, robust and privacy-preserving interoperability platform. Specifically, Blockchain increases the security by avoiding single-point-of-failure, proving immutable audit trails, and mitigating the Byzantine Generals and the Sybil Attack problems, while preserving the privacy by exchanging zero patient data during the predictive modeling process. The expected benefits of ModelChain can also be linked to the