Vipitis commited on
Commit
c3c4126
1 Parent(s): 14ac43e

adding model card

Browse files
Files changed (1) hide show
  1. README.md +11 -0
README.md CHANGED
@@ -1,3 +1,14 @@
1
  ---
2
  license: bigcode-openrail-m
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
1
  ---
2
  license: bigcode-openrail-m
3
+ datasets:
4
+ - bigcode/the-stack-dedup
5
+ - Vipitis/Shadertoys-fine
6
+ pipeline_tag: text-generation
7
  ---
8
+
9
+ [Santacoder](https://huggingface.co/bigcode/santacoder) finetuned on [Shadertoys-fine](https://huggingface.co/datasets/Vipitis/Shadertoys-fine) for 1000 steps with a batch size of 2 and full sequence length of 2048.
10
+ Origianl finetuning script from found [here](https://github.com/loubnabnl/santacoder-finetuning), adapted version to follow (soon^^).
11
+
12
+ Main purpose of this model is to explore if finetuning models improves performance on [ShaderEval](https://huggingface.co/spaces/Vipitis/ShaderEval), results to follow (sooner).
13
+
14
+ License carried over from model, however training data has an undefied license. Check details in [Shadertoys](https://huggingface.co/datasets/Vipitis/Shadertoys).