Hugging Face model: adricohen/mistral-7B-medqa-lora-8bit-v1
Author: adricohen
Created: 2025-02-13 21:31:40
Last modified: 2025-02-13 21:55:46
Likes: 0 | Downloads: 0
Tags: safetensors, medical-QA, LoRA, 8bit, mistral, en, license:apache-2.0, region:us
Card metadata:
title: Mistral-7B Fine-Tuned on Synthetic Medical QA with LoRA (8-bit Quantization)
description: This repository contains a fine-tuned version of the Mistral-7B model for medical question answering tasks, trained on the SyntheticMedicalQA-4336 dataset. The fine-tuning process leverages Low-Rank Adaptation (LoRA) with 8-bit quantization for memory efficiency and uses the PEFT (Parameter Efficient Fine-Tuning) library for optimization.
base_model: alecocc/mistral-7B-SFT-medqa-graph-cot
dataset: SyntheticMedicalQA-4336
fine_tuning: LoRA (8-bit Quantization)
task: Medical Question Answering
license: apache-2.0
language: en
tags: medical-QA, LoRA, 8bit, mistral