FlowerTune LLM Leaderboard
Collection
My submissions for FlowerTune Medical LLM Leaderboard
•
3 items
•
Updated
Model Card for FlowerTune-Mistral-7B-Instruct-v0.3-Medical-PEFT
This PEFT adapter has been trained by using Flower, a friendly federated AI framework.
The adapter and benchmark results have been submitted to the FlowerTune LLM Medical Leaderboard.
Model Details
Please check the following GitHub project for model details and evaluation results:
https://github.com/mrs83/FlowerTune-Mistral-7B-Instruct-v0.3-Medical
Training procedure
The following bitsandbytes quantization config was used during training:
- quant_method: bitsandbytes
- _load_in_8bit: False
- _load_in_4bit: True
- llm_int8_threshold: 6.0
- llm_int8_skip_modules: None
- llm_int8_enable_fp32_cpu_offload: False
- llm_int8_has_fp16_weight: False
- bnb_4bit_quant_type: fp4
- bnb_4bit_use_double_quant: False
- bnb_4bit_compute_dtype: float32
- bnb_4bit_quant_storage: uint8
- load_in_4bit: True
- load_in_8bit: False
Framework versions
- PEFT 0.6.2
- Flower 1.12.0
- Downloads last month
- 11
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.
Model tree for mrs83/FlowerTune-Mistral-7B-Instruct-v0.3-Medical-PEFT
Base model
mistralai/Mistral-7B-v0.3
Finetuned
mistralai/Mistral-7B-Instruct-v0.3