Package: medpalm
Med-PaLMA responsible path to generative AI in healthcare: Unleash the power of Med-PaLM 2 to revolutionize medical knowledge, answer complex questions, and enhance healthcare experiences with accuracy, safety, and equitable practices.Getting Startedpip install MedPalmUsageimporttorchfrommedpalm.modelimportMedPalm#usageimg=torch.randn(1,3,256,256)text=torch.randint(0,20000,(1,4096))model=MedPalm()output=model(img,text)print(output.shape)📝 Note: Modify the examples to suit your data and project needs.📚 DatasetsHere is a comprehensive markdown table containing metadata and details for all the datasets mentioned in the MED PALM paperDatasetModalityDescription# Training examples# Test examplesTasksMultiMedBenchMultimodalBenchmark for biomedical AI14 biomedical tasksMedQATextUS licensing exam questions10,1781,273Question answeringMedMCQATextIndian medical exam questions182,8224,183Question answeringPubMedQATextBiomedical literature questions0500Question answeringMIMIC-IIIRadiology reportsRadiology reports for ICU patients58,405 reports13,057 reportsReport summarizationVQA-RADRadiology imagesQA pairs on radiology images1,797 QA pairs451 QA pairsVisual question answeringSlake-VQARadiology imagesEnglish-Chinese QA pairs9,849 samples2,070 samplesVisual question answeringPath-VQAPathology imagesQA pairs on pathology images19,755 QA pairs6,761 QA pairsVisual question answeringMIMIC-CXRChest X-rayImages and reports353,5424,834Report generation, classificationPAD-UFES-20Dermatology imagesSkin lesion smartphone images1,838 images460 imagesImage classificationCBIS-DDSM (mass)MammographyMammogram mass patches1,318 images378 imagesImage classificationCBIS-DDSM (calcification)MammographyMammogram calcification patches1,544 images326 imagesImage classificationVinDr-MammoMammographyMammogram studies16,000 images4,000 imagesImage classificationPrecisionFDA (training)GenomicsGenomic variant images197,038 imagesImage classificationPrecisionFDA (evaluation)GenomicsGenomic variant images13,030 imagesImage classificationMontgomery CountyChest X-rayChest X-rays0138 imagesTB detection evaluationMIMIC-CXR (human evaluation)Chest X-rayChest X-ray images and reports246 casesHuman evaluation💼 Commercial Use-CasesMed Palm has thousands of potential use cases the 3 below are simple, for more detailed applications check out my new blog article on MedPalm's use in the real world.Click here to learn moreClinical Diagnostics: Combining medical imaging, patient tales 📖, and genes, we're aiming for top-notch diagnostic solutions.Healthcare Research: Dive deep into diverse datasets and discover something new with Med-PaLM by your side! 🤿Telemedicine: Quick, reliable, and remote! 🌍 Med-PaLM's here to revolutionize telehealth.Contributing to Med Palm 🤖🌟Help with the todo list!LicenseMed-PaLM's is under the MIT license. Check out the detailshere.Citation@misc{2307.14334,Author={Tao Tu and Shekoofeh Azizi and Danny Driess and Mike Schaekermann and Mohamed Amin and Pi-Chuan Chang and Andrew Carroll and Chuck Lau and Ryutaro Tanno and Ira Ktena and Basil Mustafa and Aakanksha Chowdhery and Yun Liu and Simon Kornblith and David Fleet and Philip Mansfield and Sushant Prakash and Renee Wong and Sunny Virmani and Christopher Semturs and S Sara Mahdavi and Bradley Green and Ewa Dominowska and Blaise Aguera y Arcas and Joelle Barral and Dale Webster and Greg S. Corrado and Yossi Matias and Karan Singhal and Pete Florence and Alan Karthikesalingam and Vivek Natarajan},Title={Towards Generalist Biomedical AI},Year={2023},Eprint={arXiv:2307.14334},}TodoImplement a training script using Huggingface's accelerate and deepspeed