8 contributors

History: 18 commits

x54-729

fast tokenizer and stream_chat fix

b81b872 verified 6 months ago

.gitattributes

3.02 kB

update .gitattributes 6 months ago
README.md

11.5 kB

Update license in Readme.md 6 months ago
config.json

855 Bytes

update rope_scaling 6 months ago
configuration_internlm.py

7.49 kB

support flash attn 2 6 months ago
configuration_internlm2.py

7.02 kB

fast tokenizer and stream_chat fix 6 months ago
generation_config.json

132 Bytes

initial commit internlm2-chat-20b-sft model 6 months ago
modeling_internlm2.py

60 kB

fast tokenizer and stream_chat fix 6 months ago
pytorch_model-00001-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.92 GB
LFS

initial commit internlm2-chat-20b-sft model 6 months ago
pytorch_model-00002-of-00021.bin
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
1.94 GB
LFS

initial commit internlm2-chat-20b-sft model 6 months ago
pytorch_model-00003-of-00021.bin
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
1.96 GB
LFS

initial commit internlm2-chat-20b-sft model 6 months ago
pytorch_model-00004-of-00021.bin
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
1.94 GB
LFS

initial commit internlm2-chat-20b-sft model 6 months ago
pytorch_model-00005-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
1.96 GB
LFS

initial commit internlm2-chat-20b-sft model 6 months ago
pytorch_model-00006-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.94 GB
LFS

initial commit internlm2-chat-20b-sft model 6 months ago
pytorch_model-00007-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
1.96 GB
LFS

initial commit internlm2-chat-20b-sft model 6 months ago
pytorch_model-00008-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
1.94 GB
LFS

initial commit internlm2-chat-20b-sft model 6 months ago
pytorch_model-00009-of-00021.bin
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
1.96 GB
LFS

initial commit internlm2-chat-20b-sft model 6 months ago
pytorch_model-00010-of-00021.bin
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
1.94 GB
LFS

initial commit internlm2-chat-20b-sft model 6 months ago
pytorch_model-00011-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
1.96 GB
LFS

initial commit internlm2-chat-20b-sft model 6 months ago
pytorch_model-00012-of-00021.bin
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
1.94 GB
LFS

initial commit internlm2-chat-20b-sft model 6 months ago
pytorch_model-00013-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.96 GB
LFS

initial commit internlm2-chat-20b-sft model 6 months ago
pytorch_model-00014-of-00021.bin
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
1.94 GB
LFS

initial commit internlm2-chat-20b-sft model 6 months ago
pytorch_model-00015-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.96 GB
LFS

initial commit internlm2-chat-20b-sft model 6 months ago
pytorch_model-00016-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.94 GB
LFS

initial commit internlm2-chat-20b-sft model 6 months ago
pytorch_model-00017-of-00021.bin
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
1.96 GB
LFS

initial commit internlm2-chat-20b-sft model 6 months ago
pytorch_model-00018-of-00021.bin
Detected Pickle imports (3)
- "torch.HalfStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.94 GB
LFS

initial commit internlm2-chat-20b-sft model 6 months ago
pytorch_model-00019-of-00021.bin
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
1.96 GB
LFS

initial commit internlm2-chat-20b-sft model 6 months ago
pytorch_model-00020-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.56 GB
LFS

initial commit internlm2-chat-20b-sft model 6 months ago
pytorch_model-00021-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
1.14 GB
LFS

initial commit internlm2-chat-20b-sft model 6 months ago
pytorch_model.bin.index.json

27.2 kB

initial commit internlm2-chat-20b-sft model 6 months ago
special_tokens_map.json

95 Bytes

initial commit internlm2-chat-20b-sft model 6 months ago
tokenization_internlm.py

8.92 kB

initial commit internlm2-chat-20b-sft model 6 months ago
tokenization_internlm2.py

8.81 kB

fast tokenizer and stream_chat fix 6 months ago
tokenization_internlm2_fast.py

7.72 kB

fast tokenizer and stream_chat fix 6 months ago
tokenizer.model

1.48 MB
LFS

initial commit internlm2-chat-20b-sft model 6 months ago
tokenizer_config.json

2.18 kB

Update special tokens (#2) 6 months ago

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)