Update README.md
Browse files
README.md
CHANGED
|
@@ -185,8 +185,9 @@ The model was trained on a comprehensive dataset of Python code review examples
|
|
| 185 |
- Error Handling and Logging
|
| 186 |
|
| 187 |
## Training Procedure
|
|
|
|
| 188 |
### Training Hyperparameters
|
| 189 |
-
- Training regime: bf16 mixed precision with QLoRA
|
| 190 |
- Base Model: Qwen2.5-7B-Instruct
|
| 191 |
- LoRA Rank: 32
|
| 192 |
- LoRA Alpha: 64
|
|
@@ -209,9 +210,9 @@ Testing Data
|
|
| 209 |
Evaluation performed on held-out Python code examples from the same dataset distribution.
|
| 210 |
|
| 211 |
### Metrics
|
| 212 |
-
ROUGE-L: 0.754
|
| 213 |
-
BLEU: 61.99
|
| 214 |
-
Validation Loss: 0.595
|
| 215 |
|
| 216 |
## Results
|
| 217 |
The model achieved strong performance on code review tasks, particularly excelling at:
|
|
@@ -253,12 +254,12 @@ Carbon emissions can be estimated using the [Machine Learning Impact calculator]
|
|
| 253 |
publisher = {Hugging Face}
|
| 254 |
}
|
| 255 |
## Model Card Authors
|
| 256 |
-
|
| 257 |
|
| 258 |
## Model Card Contact
|
| 259 |
-
Hugging Face: alenphilip
|
| 260 |
LinkedIn: [alenphilipgeorge](linkedin.com/in/alen-philip-george-130226254)
|
| 261 |
-
Email: alenphilipgeorge@gmail.com
|
| 262 |
|
| 263 |
|
| 264 |
For questions about this model, please use the Hugging Face model repository discussions or contact via the above channels.
|
|
|
|
| 185 |
- Error Handling and Logging
|
| 186 |
|
| 187 |
## Training Procedure
|
| 188 |
+
[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/alenphilip2071-google/huggingface/runs/d27nrifd)
|
| 189 |
### Training Hyperparameters
|
| 190 |
+
- Training regime: bf16 mixed precision with SFT & QLoRA
|
| 191 |
- Base Model: Qwen2.5-7B-Instruct
|
| 192 |
- LoRA Rank: 32
|
| 193 |
- LoRA Alpha: 64
|
|
|
|
| 210 |
Evaluation performed on held-out Python code examples from the same dataset distribution.
|
| 211 |
|
| 212 |
### Metrics
|
| 213 |
+
ROUGE-L: 0.754
|
| 214 |
+
BLEU: 61.99
|
| 215 |
+
Validation Loss: 0.595
|
| 216 |
|
| 217 |
## Results
|
| 218 |
The model achieved strong performance on code review tasks, particularly excelling at:
|
|
|
|
| 254 |
publisher = {Hugging Face}
|
| 255 |
}
|
| 256 |
## Model Card Authors
|
| 257 |
+
Alen Philip George
|
| 258 |
|
| 259 |
## Model Card Contact
|
| 260 |
+
Hugging Face: [alenphilip](https://huggingface.co/alenphilip)
|
| 261 |
LinkedIn: [alenphilipgeorge](linkedin.com/in/alen-philip-george-130226254)
|
| 262 |
+
Email: [alenphilipgeorge@gmail.com](mailto:alenphilipgeorge@gmail.com)
|
| 263 |
|
| 264 |
|
| 265 |
For questions about this model, please use the Hugging Face model repository discussions or contact via the above channels.
|