rwkv-x-playground / experiment /rwkv-x-exp /multi-size-train

1 contributor

History: 37 commits

picocreator

[GHA] experiment/rwkv-x-exp/multi-size-train/v5-L6-D2048-split-baseline.ipynb result notebook & reports (#201)

21657c7 9 months ago

v5-L12-D2048-E0_01-baseline-p2.pth
Detected Pickle imports (3)
- "torch.BFloat16Storage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
1.72 GB
LFS

[GHA] experiment/rwkv-x-exp/multi-size-train/v5-L12-D2048-baseline.ipynb result model (#186) 9 months ago
v5-L12-D2048-E0_01-baseline-p3.pth
Detected Pickle imports (3)
- "torch.BFloat16Storage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
1.72 GB
LFS

[GHA] experiment/rwkv-x-exp/multi-size-train/v5-L12-D2048-baseline.ipynb result model (#186) 9 months ago
v5-L12-D2048-E0_01-enwiki-4k-p1.pth
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage"
What is a pickle import?
1.72 GB
LFS

[GHA] experiment/rwkv-x-exp/multi-size-train/v5-L12-D2048-part1.ipynb result model (#182) 9 months ago
v5-L12-D2048-E0_01-neox-v5base-init.pth
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.BFloat16Storage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.72 GB
LFS

[GHA] experiment/rwkv-x-exp/multi-size-train/v5-L12-D2048-part1.ipynb result model (#182) 9 months ago
v5-L12-D2048-baseline.ipynb

16.6 MB
LFS

[GHA] experiment/rwkv-x-exp/multi-size-train/v5-L12-D2048-baseline.ipynb result notebook & reports (#187) 9 months ago
v5-L12-D2048-part1.ipynb

15.9 MB
LFS

[GHA] experiment/rwkv-x-exp/multi-size-train/v5-L12-D2048-part1.ipynb result notebook & reports (#183) 9 months ago
v5-L6+6-D2048-E0_01-baseline-p3.pth
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage"
What is a pickle import?
1.72 GB
LFS

[GHA] experiment/rwkv-x-exp/multi-size-train/v5-L6+6-D2048-layer-expansion.ipynb result model (#194) 9 months ago
v5-L6+6-D2048-E0_01-layer-expansion-p1.pth
Detected Pickle imports (3)
- "torch.BFloat16Storage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.72 GB
LFS

[GHA] experiment/rwkv-x-exp/multi-size-train/v5-L6+6-D2048-layer-expansion.ipynb result model (#194) 9 months ago
v5-L6+6-D2048-E0_01-layer-expansion-p2.pth
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage"
What is a pickle import?
1.72 GB
LFS

[GHA] experiment/rwkv-x-exp/multi-size-train/v5-L6+6-D2048-layer-expansion.ipynb result model (#194) 9 months ago
v5-L6+6-D2048-E0_01-overwrite-naive-p1.pth
Detected Pickle imports (3)
- "torch.BFloat16Storage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
1.72 GB
LFS

[GHA] experiment/rwkv-x-exp/multi-size-train/v5-L6+6-D2048-overwrite-naive.ipynb result model (#184) 9 months ago
v5-L6+6-D2048-E0_01-overwrite-naive-p2.pth
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.BFloat16Storage"
What is a pickle import?
1.72 GB
LFS

[GHA] experiment/rwkv-x-exp/multi-size-train/v5-L6+6-D2048-overwrite-naive.ipynb result model (#184) 9 months ago
v5-L6+6-D2048-layer-baseline.ipynb

79.6 kB

[GHA] experiment/rwkv-x-exp/multi-size-train/v5-L6+6-D2048-layer-baseline.ipynb result notebook & reports (#199) 9 months ago
v5-L6+6-D2048-layer-expansion.ipynb

15.7 MB
LFS

[GHA] experiment/rwkv-x-exp/multi-size-train/v5-L6+6-D2048-layer-expansion.ipynb result notebook & reports (#195) 9 months ago
v5-L6+6-D2048-overwrite-naive.ipynb

15.7 MB
LFS

[GHA] experiment/rwkv-x-exp/multi-size-train/v5-L6+6-D2048-overwrite-naive.ipynb result notebook & reports (#189) 9 months ago
v5-L6-D2048-E0_01-baseline-p2.pth
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage"
What is a pickle import?
1.07 GB
LFS

[GHA] experiment/rwkv-x-exp/multi-size-train/v5-L6-D2048-baseline.ipynb result model (#180) 9 months ago
v5-L6-D2048-E0_01-baseline-p3.pth
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage"
What is a pickle import?
1.07 GB
LFS

[GHA] experiment/rwkv-x-exp/multi-size-train/v5-L6-D2048-baseline.ipynb result model (#180) 9 months ago
v5-L6-D2048-E0_01-enwiki-4k-p1.pth
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "collections.OrderedDict"
What is a pickle import?
1.07 GB
LFS

[GHA] experiment/rwkv-x-exp/multi-size-train/v5-L6-D2048-part1.ipynb result model (#178) 9 months ago
v5-L6-D2048-E0_01-layer-expansion-a3.pth
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage"
What is a pickle import?
1.07 GB
LFS

[GHA] experiment/rwkv-x-exp/multi-size-train/v5-L6-D2048-split-baseline.ipynb result model (#200) 9 months ago
v5-L6-D2048-E0_01-layer-expansion-b3.pth
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage"
What is a pickle import?
1.07 GB
LFS

[GHA] experiment/rwkv-x-exp/multi-size-train/v5-L6-D2048-split-baseline.ipynb result model (#200) 9 months ago
v5-L6-D2048-E0_01-neox-v5base-init.pth
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "collections.OrderedDict"
What is a pickle import?
1.07 GB
LFS

[GHA] experiment/rwkv-x-exp/multi-size-train/v5-L6-D2048-part1.ipynb result model (#178) 9 months ago
v5-L6-D2048-E0_01-split-2a.pth
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.BFloat16Storage"
What is a pickle import?
1.07 GB
LFS

[GHA] experiment/rwkv-x-exp/multi-size-train/v5-L6+6-D2048-layer-baseline.ipynb result model (#198) 9 months ago
v5-L6-D2048-E0_01-split-2b.pth
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.BFloat16Storage"
What is a pickle import?
1.07 GB
LFS

[GHA] experiment/rwkv-x-exp/multi-size-train/v5-L6+6-D2048-layer-baseline.ipynb result model (#198) 9 months ago
v5-L6-D2048-E0_01-split-merge-2m.pth
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.BFloat16Storage"
What is a pickle import?
1.07 GB
LFS

[GHA] experiment/rwkv-x-exp/multi-size-train/v5-L6-D2048-split-train.ipynb result model (#192) 9 months ago
v5-L6-D2048-E0_01-split-merge-p3.pth
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.BFloat16Storage"
What is a pickle import?
1.07 GB
LFS

[GHA] experiment/rwkv-x-exp/multi-size-train/v5-L6-D2048-split-train.ipynb result model (#192) 9 months ago
v5-L6-D2048-baseline.ipynb

16.5 MB
LFS

[GHA] experiment/rwkv-x-exp/multi-size-train/v5-L6-D2048-baseline.ipynb result notebook & reports (#181) 9 months ago
v5-L6-D2048-part1.ipynb

15.7 MB
LFS

[GHA] experiment/rwkv-x-exp/multi-size-train/v5-L6-D2048-part1.ipynb result notebook & reports (#179) 9 months ago
v5-L6-D2048-split-baseline.ipynb

15.9 MB
LFS

[GHA] experiment/rwkv-x-exp/multi-size-train/v5-L6-D2048-split-baseline.ipynb result notebook & reports (#201) 9 months ago
v5-L6-D2048-split-train.ipynb

16.6 MB
LFS

[GHA] experiment/rwkv-x-exp/multi-size-train/v5-L6-D2048-split-train.ipynb result notebook & reports (#193) 9 months ago

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)