fasterinnerlooper commited on
Commit
0f31b7e
1 Parent(s): d0dba9d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -9
README.md CHANGED
@@ -1,34 +1,37 @@
1
  ---
2
  license: other
3
  base_model: stabilityai/stable-code-3b
4
- tags:
5
- - generated_from_trainer
6
  model-index:
7
  - name: stable-code-3b
8
  results: []
 
 
 
 
 
9
  ---
10
 
11
- <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
- should probably proofread and complete it, then remove this comment. -->
13
 
14
  # stable-code-3b
15
 
16
- This model is a fine-tuned version of [stabilityai/stable-code-3b](https://huggingface.co/stabilityai/stable-code-3b) on an unknown dataset.
17
 
18
  ## Model description
19
 
20
- More information needed
21
 
22
  ## Intended uses & limitations
23
 
24
- More information needed
25
 
26
  ## Training and evaluation data
27
 
28
- More information needed
29
 
30
  ## Training procedure
31
 
 
 
32
  ### Training hyperparameters
33
 
34
  The following hyperparameters were used during training:
@@ -48,4 +51,4 @@ The following hyperparameters were used during training:
48
  - Transformers 4.36.2
49
  - Pytorch 2.1.2+cu121
50
  - Datasets 2.16.1
51
- - Tokenizers 0.15.1
 
1
  ---
2
  license: other
3
  base_model: stabilityai/stable-code-3b
 
 
4
  model-index:
5
  - name: stable-code-3b
6
  results: []
7
+ datasets:
8
+ - fasterinnerlooper/lcc_csharp
9
+ library_name: peft
10
+ language:
11
+ - code
12
  ---
13
 
 
 
14
 
15
  # stable-code-3b
16
 
17
+ This model is a fine-tuned (LoRA) version of [stabilityai/stable-code-3b](https://huggingface.co/stabilityai/stable-code-3b) trained on the Microsoft/lcc_csharp dataset.
18
 
19
  ## Model description
20
 
21
+ Stable Code 3B fine-tuned on microsoft/lcc_csharp modified for in-filling
22
 
23
  ## Intended uses & limitations
24
 
25
+ Meant to be used to in-fill C# code
26
 
27
  ## Training and evaluation data
28
 
29
+ [microsoft/lcc_csharp](https://huggingface.co/microsoft/lcc_csharp) modified for in-filling. The dataset is sliced randomly across the entire dataset. One entry in the original dataset maps to one entry in the modified dataset.
30
 
31
  ## Training procedure
32
 
33
+ Trained in a single GPU environment (either A4000 or P5000) with 16GB of RAM.
34
+
35
  ### Training hyperparameters
36
 
37
  The following hyperparameters were used during training:
 
51
  - Transformers 4.36.2
52
  - Pytorch 2.1.2+cu121
53
  - Datasets 2.16.1
54
+ - Tokenizers 0.15.1