7 contributors

History: 20 commits

x54-729

Add special tokens for chat

b286911 7 months ago

.gitattributes

3.09 kB

use bin instead of safetensors with max shard of 2GB 8 months ago
README.md

10.9 kB

Update license in README.md 8 months ago
config.json

858 Bytes

fast tokenizer and stream_chat fix (#7) 8 months ago
configuration_internlm2.py

7.02 kB

fast tokenizer and stream_chat fix (#7) 8 months ago
generation_config.json

132 Bytes

use bin instead of safetensors with max shard of 2GB 8 months ago
modeling_internlm2.py

60 kB

small 8 months ago
pytorch_model-00001-of-00021.bin
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
1.92 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00002-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
1.94 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00003-of-00021.bin
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
1.96 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00004-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.94 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00005-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.96 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00006-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
1.94 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00007-of-00021.bin
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
1.96 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00008-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
1.94 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00009-of-00021.bin
Detected Pickle imports (3)
- "torch.HalfStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.96 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00010-of-00021.bin
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
1.94 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00011-of-00021.bin
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
1.96 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00012-of-00021.bin
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
1.94 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00013-of-00021.bin
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
1.96 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00014-of-00021.bin
Detected Pickle imports (3)
- "torch.HalfStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.94 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00015-of-00021.bin
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
1.96 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00016-of-00021.bin
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
1.94 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00017-of-00021.bin
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
1.96 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00018-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
1.94 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00019-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.96 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00020-of-00021.bin
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
1.56 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00021-of-00021.bin
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
1.14 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model.bin.index.json

27.2 kB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
special_tokens_map.json

257 Bytes

Add special tokens for chat 7 months ago
tokenization_internlm2.py

8.81 kB

fast tokenizer and stream_chat fix (#7) 8 months ago
tokenization_internlm2_fast.py

7.72 kB

fast tokenizer and stream_chat fix (#7) 8 months ago
tokenizer.model

1.48 MB
LFS

initial commit internlm2-chat-20b model 8 months ago
tokenizer_config.json

2.4 kB

Add special tokens for chat 7 months ago

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)