Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -101,7 +101,7 @@ print(out)
101
 
102
  | Parameters | Hidden Size | Layers | Heads | Sequence Length |
103
  |------------|-------------|--------|-------|-----------------|
104
- | 7B | 4096 | 32 | 32 | 1024 |
105
 
106
  ### Training Dataset
107
 
 
101
 
102
  | Parameters | Hidden Size | Layers | Heads | Sequence Length |
103
  |------------|-------------|--------|-------|-----------------|
104
+ | 7B | 4096 | 32 | 32 | 2048 |
105
 
106
  ### Training Dataset
107