"Med-AI: Transforming Healthcare with AI Innovations"
Tags: twiliochallenge, ai, twilio, devchallenge
Published: 2024-06-23 20:02:38

*This is a submission for [Twilio Challenge v24.06.12](https://dev.to/challenges/twilio)*

## What I Built

Med-AI is an innovative AI-driven healthcare application that harnesses artificial intelligence to enhance medical diagnostics, treatment planning, and healthcare delivery. It focuses on improving patient care and operational efficiency through advanced AI technologies.

## Key Features:

### 📅 Appointment Booking:

- Streamlined appointment scheduling system for patients to book and manage appointments with healthcare providers efficiently.
- After booking, patients receive a confirmation call. [Demo of call received](https://youtu.be/6s9T8U6Je-E?si=t8UF8E6Fm0hYZpvN)

### 📝 Prescription Summary:

- AI-powered summarization of medical prescriptions to provide patients with clear and concise information about their medications.

### 💊 Medicine Reminders:

- Personalized medication reminders based on patient-specific schedules and dosage requirements, ensuring adherence to treatment plans through timely messages.

### 📈 Report Generation:

- Automated generation of medical reports and summaries, facilitating comprehensive documentation and analysis for healthcare professionals. By using `puppeteer` and `handlebars`, we generate the report that are being saved to MongoDB database when patients set reminders.

### 🌐 Multi-Language Support:

- Ensures accessibility and inclusivity by providing support for multiple languages, allowing users worldwide to interact with the application in their preferred language.

## Technologies Used:

- *Frontend:* Vite + React
- *Backend:* Node.js, Express
- *Testing:* Postman

### Dependencies:

- @google/generative-ai
- axios
- express
- handlebars
- mongoose
- nodemon
- puppeteer
- twilio

### Gemini Models:

- gemini-1.5-flash
- @google/generative-ai

### Twilio APIs:

- *SMS*
- *Call*


## Demo
<!-- Share a link to your app and include some screenshots here. -->
[Website link](https://med-ai-alpha.vercel.app/)
[Frontend repository](https://github.com/jyotika6221/med-ai-fe.git)
[Backend repository](https://github.com/pooranjoyb/med-ai-be.git)


![sign up](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/ic2vn1usizenhsv86sqf.jpg)
![sign-in](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/1np2o4ztc4ion12kzmsp.jpg)

![home page](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/ctz5vkpfv35zwc1yp0tw.jpg)

![medicine reminder](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/a29ak4w51jgv4l8dvmtr.jpg)

![schedule logs](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/y9b97w6qb62u2wt3zn3e.jpg)

![received message screenshot](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/8u38tzz03818zab8i52c.jpg)

![book appointment](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/zmm8ntw6qq675n31hh12.jpg)

![call received screenshot](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/3v69gs83miymaf1fjydk.jpg)

![personalized medical report](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/bl36w2x3zdmvjzayu3pg.jpg)

![prescription summary](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/84d1wwe1ujtte73psnch.jpg)

## Twilio and AI
<!-- Tell us how you leveraged Twilio’s capabilities with AI -->
## AI Capabilities Integration:


To leverage AI capabilities in our Med-AI application, we integrated Twilio's APIs for both SMS and voice calls, alongside AI models such as Gemini. Here’s how we utilized these capabilities:

### 1. SMS Integration:

Twilio's SMS API is used to send personalized medication reminders to patients. These reminders are tailored based on AI-generated insights from patient-specific schedules and dosage requirements, ensuring adherence to treatment plans.

### 2. Voice Call Integration:

Twilio's voice call API automates confirmation calls for appointment bookings. After patients schedule an appointment through our application, Twilio initiates a voice call to confirm the details, enhancing user engagement with real-time communication.

### 3. AI-Powered Prescription Summaries:

Leveraging Gemini-1.5-Flash model, our application provides real-time AI-powered summarization of medical prescriptions. This feature ensures that patients receive clear and concise information about their medications, reducing errors and improving patient understanding.



## Additional Prize Categories

<!-- Does your submission qualify for any additional prize categories (Twilio Times Two, Impactful Innovators, Entertaining Endeavors)? Please list all that apply.  -->


### Twilio Times Two:

We integrated two Twilio APIs: SMS and call functionalities. These APIs are utilized for sending medication reminders via SMS and confirming appointments through automated calls, enhancing patient engagement and operational efficiency.

### Impactful Innovators:

Med-AI drives significant social impact by leveraging AI to improve healthcare accessibility and efficiency. It enhances patient outcomes through accurate medication reminders, simplifies appointment bookings, and provides clear prescription summaries. This initiative aims to reduce medication errors, improve patient understanding, and support healthcare professionals with automated report generation, ultimately advancing healthcare delivery and patient care.

<!-- Team Submissions: Please pick one member to publish the submission and credit teammates by listing their DEV usernames directly in the body of the post. -->

{% embed https://dev.to/pooranjoyb %}