bart1259 commited on
Commit
30dd15a
·
verified ·
1 Parent(s): 5c530e1

Upload folder using huggingface_hub

Browse files
Files changed (2) hide show
  1. README.md +4 -6
  2. model.safetensors +1 -1
README.md CHANGED
@@ -5,12 +5,12 @@ license: mit
5
  Chain of Thought (CoT) transformer model trained to do multi-step integer arithmetic.
6
 
7
  Model details:
8
- - **Vocabulary Size**: 40 (Character Tokenization)
9
  - **Layer Count**: 8
10
  - **Attention Head Count**: 4
11
  - **Residual Stream Size**: 256
12
  - **Context Length**: 256
13
- - **Tokens Trained on**: 419,716,608
14
 
15
 
16
  ```py
@@ -19,8 +19,7 @@ from transformers import pipeline
19
  pipe = pipeline(
20
  "text-generation", model="bart1259/MiniCOTMath"
21
  )
22
- print(pipe("Input: (5 + 5)
23
- ", max_new_tokens=100)[0]["generated_text"])
24
  ```
25
 
26
  Outputs:
@@ -60,8 +59,7 @@ class StopCriteria(StoppingCriteria):
60
  def __iter__(self):
61
  yield self
62
 
63
- prompt = "Input: (5 + 5)
64
- "
65
 
66
  tokenizer = AutoTokenizer.from_pretrained("bart1259/MiniCOTMath")
67
  model = AutoModelForCausalLM.from_pretrained("bart1259/MiniCOTMath").cuda()
 
5
  Chain of Thought (CoT) transformer model trained to do multi-step integer arithmetic.
6
 
7
  Model details:
8
+ - **Vocabulary Size**: 35 (Character Tokenization)
9
  - **Layer Count**: 8
10
  - **Attention Head Count**: 4
11
  - **Residual Stream Size**: 256
12
  - **Context Length**: 256
13
+ - **Tokens Trained on**: 419,706,880
14
 
15
 
16
  ```py
 
19
  pipe = pipeline(
20
  "text-generation", model="bart1259/MiniCOTMath"
21
  )
22
+ print(pipe("Input: (5 + 5)\n", max_new_tokens=100)[0]["generated_text"])
 
23
  ```
24
 
25
  Outputs:
 
59
  def __iter__(self):
60
  yield self
61
 
62
+ prompt = "Input: (5 + 5)\n"
 
63
 
64
  tokenizer = AutoTokenizer.from_pretrained("bart1259/MiniCOTMath")
65
  model = AutoModelForCausalLM.from_pretrained("bart1259/MiniCOTMath").cuda()
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4fa529a29bee7d337ad783dc4ba51fbc70891014f441c7fd6921b535fd63295e
3
  size 25352072
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b0e7b2d91eb4e7ea8bdc4b94640382a0af079b8e8e9974b801c9c48fdf4af330
3
  size 25352072