Post
217
Here are my complete project notebooks hosted to my project titled "Multimodal Custom Finetuned LLM for Virtual Healthcare Consultations" at OSF - https://osf.io/ne2zh/
Pranav Upadhyaya
pranavupadhyaya52
AI & ML interests
None yet
Recent Activity
updated a model 6 days ago
pranavupadhyaya52/RockyEmbed_Marco published a model 7 days ago
pranavupadhyaya52/RockyEmbed_Marco updated a Space 7 days ago
fermacsys/READMEOrganizations
Posts 2
Post
2264
Hello everyone. I've built a medical AI assistant application.
pranavupadhyaya52/MediWiki_Medical_Assistant
It is a multimodal chatbot and can accept text, radiology images, prescription and lab reports (currently it only accepts one image per chat.) and audio files (wav and MP3 extension files).
It is built on top of a finetuned Llama 3.2 11B vision instruct. It also uses a 41000 medically related question answer pair stored in the form of chromadb embedding for Retrieval Augmented Generation (RAG).
Please let me know your thoughts on my project and how I can improve it further. Thank you.
pranavupadhyaya52/MediWiki_Medical_Assistant
It is a multimodal chatbot and can accept text, radiology images, prescription and lab reports (currently it only accepts one image per chat.) and audio files (wav and MP3 extension files).
It is built on top of a finetuned Llama 3.2 11B vision instruct. It also uses a 41000 medically related question answer pair stored in the form of chromadb embedding for Retrieval Augmented Generation (RAG).
Please let me know your thoughts on my project and how I can improve it further. Thank you.