Package: tno.mpc.protocols.kaplan-meier
TNO MPC Lab - Protocols - Kaplan-MeierThe TNO MPC lab consists of generic software components, procedures, and functionalities developed and maintained on a regular basis to facilitate and aid in the development of MPC solutions. The lab is a cross-project initiative allowing us to integrate and reuse previously developed MPC functionalities to boost the development of new protocols and solutions.The package tno.mpc.protocols.kaplan_meier is part of the TNO Python Toolbox.This MPC protocol securely computes the log-rank statistics associated with the Kaplan-Meier estimator on vertically partitioned data. It has been developed within theCONVINCEDproject, a research collaboration between TNO and IKNL, and the project SELECTED. These projects were partly funded by TNOs Appl.AI and the Netherlands AI Coalition. In the future, this will be integrated in IKNLs open sourceVantage6infrastructure.Limitations in (end-)use: the content of this software package may solely be used for applications that comply with international export control laws.This implementation of cryptographic software has not been audited. Use at your own risk.DocumentationDocumentation of the tno.mpc.protocols.kaplan_meier package can be foundhere.
InERCIM News 126 (July 2021), we presented some extra context.InstallEasily install the tno.mpc.protocols.kaplan_meier package using pip:$python-mpipinstalltno.mpc.protocols.kaplan_meierNote:A significant performance improvement can be achieved by installing the GMPY2 library.$python-mpipinstall'tno.mpc.protocols.kaplan_meier[gmpy]'If you wish to run the tests you can use:$python-mpipinstall'tno.mpc.protocols.kaplan_meier[tests]'Protocol descriptionA more elaborate protocol description can be found inCONVINCED -- Enabling privacy-preserving survival analyses using Multi-Party Computation.Figure 1.The protocol to securely compute the log-rank statistic for vertically-partitioned data. One party (Blue) owns data on patient groups, the other party (Orange) owns data on event times (did the patient experience an event ‘1’ or not ‘0’, and when did this occur). Protocol outline: Blue encrypts its data using additive homomorphic encryption and the encrypted data is sent to Orange. Orange is able to securely, without decryption, split its data in the patient groups specified by Blue (1) using the additive homomorphic properties of the encryptions. Orange performs some preparatory, local, computations (2) and with the help of Blue secret-shares the data (3) between Blue, Orange and Purple, where Purple is introduced for efficiency purposes. All parties together securely compute the log-rank statistic associated with the (never revealed) Kaplan-Meier curves (4) and only reveal the final statistical result (5).UsageThe protocol is asymmetric. To run the protocol you need to run three separate instances.example_usage.py"""Example usage for performing Kaplan-Meier analysisRun three separate instances e.g.,$ ./script/example_usage.py -M3 -I0 -p Alice$ ./script/example_usage.py -M3 -I1 -p Bob$ ./script/example_usage.py -M3 -I2 -p HelperAll but the last argument are passed to MPyC."""importargparseimportasyncioimportlifelinesimportpandasaspdfromtno.mpc.communicationimportPoolfromtno.mpc.protocols.kaplan_meierimportAlice,Bob,Helperdefparse_args():parser=argparse.ArgumentParser()parser.add_argument("-p","--player",help="Name of the sending player",type=str,required=True)args=parser.parse_args()returnargsasyncdefmain(player_instance):awaitplayer_instance.start_protocol()if__name__=="__main__":# Parse arguments and acquire configuration parametersargs=parse_args()player=args.playerparties={"Alice":{"address":"127.0.0.1","port":8080},"Bob":{"address":"127.0.0.1","port":8081},}test_data=pd.DataFrame({"time":[3,5,6,8,10,14,14,18,20,22,30,30],"event":[1,1,1,0,0,1,1,0,1,0,1,1],"Group A":[1,1,0,1,0,0,0,0,1,0,1,0],"Group B":[0,0,1,0,1,1,1,1,0,1,0,1],})ifplayerinparties.keys():port=parties[player]["port"]delparties[player]pool=Pool()pool.add_http_server(port=port)forname,partyinparties.items():assert"address"inpartypool.add_http_client(name,party["address"],port=party["port"]if"port"inpartyelse80)# default port=80ifplayer=="Alice":event_times=test_data[["time","event"]]player_instance=Alice(identifier=player,data=event_times,pool=pool,)elifplayer=="Bob":groups=test_data[["Group A","Group B"]]player_instance=Bob(identifier=player,data=groups,pool=pool,)elifplayer=="Helper":player_instance=Helper(player)else:raiseValueError(f"Unknown player was provided: '{player}'")loop=asyncio.get_event_loop()loop.run_until_complete(main(player_instance))print("-"*32)print(player_instance.statistic)print("-"*32)# Validate resultsevent_times=test_data[["time","event"]]groups=test_data[["Group A","Group B"]]print(lifelines.statistics.multivariate_logrank_test(event_times["time"],groups["Group B"],event_times["event"]))print("-"*32)