2 contributors

History: 22 commits

beomi

Fix typo on tokenize example

b5ef04e 11 months ago

.gitattributes

1.52 kB

initial commit 12 months ago
README.md

17.6 kB

Fix typo on tokenize example 11 months ago
added_tokens.json

309 kB

Upload tokenizer 12 months ago
config.json

606 Bytes

Update model with >10B trained ckpt, change model type to bfloat16(match pretrain) 11 months ago
generation_config.json

159 Bytes

Add 5B korean trained model, test version. 12 months ago
model-00001-of-00015.safetensors

919 MB
LFS

Add >20B trained ckpt 11 months ago
model-00002-of-00015.safetensors

990 MB
LFS

Add >20B trained ckpt 11 months ago
model-00003-of-00015.safetensors

967 MB
LFS

Add >20B trained ckpt 11 months ago
model-00004-of-00015.safetensors

967 MB
LFS

Add >20B trained ckpt 11 months ago
model-00005-of-00015.safetensors

990 MB
LFS

Add >20B trained ckpt 11 months ago
model-00006-of-00015.safetensors

944 MB
LFS

Add >20B trained ckpt 11 months ago
model-00007-of-00015.safetensors

990 MB
LFS

Add >20B trained ckpt 11 months ago
model-00008-of-00015.safetensors

967 MB
LFS

Add >20B trained ckpt 11 months ago
model-00009-of-00015.safetensors

967 MB
LFS

Add >20B trained ckpt 11 months ago
model-00010-of-00015.safetensors

990 MB
LFS

Add >20B trained ckpt 11 months ago
model-00011-of-00015.safetensors

944 MB
LFS

Add >20B trained ckpt 11 months ago
model-00012-of-00015.safetensors

990 MB
LFS

Add >20B trained ckpt 11 months ago
model-00013-of-00015.safetensors

967 MB
LFS

Add >20B trained ckpt 11 months ago
model-00014-of-00015.safetensors

742 MB
LFS

Add >20B trained ckpt 11 months ago
model-00015-of-00015.safetensors

380 MB
LFS

Add >20B trained ckpt 11 months ago
model.safetensors.index.json

26.8 kB

Add 5B korean trained model, test version. 12 months ago
pytorch_model-00001-of-00015.bin
Detected Pickle imports (4)
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch.BFloat16Storage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
919 MB
LFS

Add >20B trained ckpt 11 months ago
pytorch_model-00002-of-00015.bin
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.BFloat16Storage",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
990 MB
LFS

Add >20B trained ckpt 11 months ago
pytorch_model-00003-of-00015.bin
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.BFloat16Storage",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
967 MB
LFS

Add >20B trained ckpt 11 months ago
pytorch_model-00004-of-00015.bin
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.BFloat16Storage",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
967 MB
LFS

Add >20B trained ckpt 11 months ago
pytorch_model-00005-of-00015.bin
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.BFloat16Storage",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
990 MB
LFS

Add >20B trained ckpt 11 months ago
pytorch_model-00006-of-00015.bin
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.BFloat16Storage",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
944 MB
LFS

Add >20B trained ckpt 11 months ago
pytorch_model-00007-of-00015.bin
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.BFloat16Storage",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
990 MB
LFS

Add >20B trained ckpt 11 months ago
pytorch_model-00008-of-00015.bin
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.BFloat16Storage",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
967 MB
LFS

Add >20B trained ckpt 11 months ago
pytorch_model-00009-of-00015.bin
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch.BFloat16Storage",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
967 MB
LFS

Add >20B trained ckpt 11 months ago
pytorch_model-00010-of-00015.bin
Detected Pickle imports (4)
- "torch.BFloat16Storage",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
990 MB
LFS

Add >20B trained ckpt 11 months ago
pytorch_model-00011-of-00015.bin
Detected Pickle imports (4)
- "torch.BFloat16Storage",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
944 MB
LFS

Add >20B trained ckpt 11 months ago
pytorch_model-00012-of-00015.bin
Detected Pickle imports (4)
- "torch.BFloat16Storage",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
990 MB
LFS

Add >20B trained ckpt 11 months ago
pytorch_model-00013-of-00015.bin
Detected Pickle imports (4)
- "torch.BFloat16Storage",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
967 MB
LFS

Add >20B trained ckpt 11 months ago
pytorch_model-00014-of-00015.bin
Detected Pickle imports (4)
- "torch.BFloat16Storage",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
742 MB
LFS

Add >20B trained ckpt 11 months ago
pytorch_model-00015-of-00015.bin
Detected Pickle imports (3)
- "torch.BFloat16Storage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
380 MB
LFS

Add >20B trained ckpt 11 months ago
pytorch_model.bin.index.json

26.8 kB

Add 5B korean trained model, test version. 12 months ago
special_tokens_map.json

414 Bytes

Upload tokenizer 12 months ago
tokenizer.json

5.21 MB

Upload tokenizer 12 months ago
tokenizer_config.json

698 Bytes

Upload tokenizer 12 months ago

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (4)

Detected Pickle imports (3)