Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
formll
/
resolving-scaling-law-discrepancies
like
1
RefinedWeb
EleutherAI/OpenWebText2
open_lm
arxiv:
2406.19146
License:
mit
Model card
Files
Files and versions
Community
fee67f2
resolving-scaling-law-discrepancies
/
dataset=owt2
/
hparams=base_warmup=long_decay=kaplan
/
params=28M_maxstep=53680
1 contributor
History:
3 commits
TomerPorian
Add files using large-upload tool
af6e2cf
verified
about 2 months ago
flop_1.00e+17_step_1109.pt
pickle
Detected Pickle imports (3)
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
What is a pickle import?
179 MB
LFS
Add files using large-upload tool
about 2 months ago
flop_1.25e+16_step_139.pt
pickle
Detected Pickle imports (3)
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
What is a pickle import?
179 MB
LFS
Add files using large-upload tool
about 2 months ago
flop_1.60e+18_step_17740.pt
pickle
Detected Pickle imports (3)
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
What is a pickle import?
179 MB
LFS
Add files using large-upload tool
about 2 months ago
flop_2.00e+17_step_2218.pt
179 MB
LFS
Add files using large-upload tool
about 2 months ago
flop_2.51e+16_step_278.pt
pickle
Detected Pickle imports (3)
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
What is a pickle import?
179 MB
LFS
Add files using large-upload tool
about 2 months ago
flop_3.20e+18_step_35479.pt
pickle
Detected Pickle imports (3)
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
What is a pickle import?
179 MB
LFS
Add files using large-upload tool
about 2 months ago
flop_4.00e+17_step_4435.pt
pickle
Detected Pickle imports (3)
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
What is a pickle import?
179 MB
LFS
Add files using large-upload tool
about 2 months ago
flop_5.01e+16_step_555.pt
pickle
Detected Pickle imports (3)
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
What is a pickle import?
179 MB
LFS
Add files using large-upload tool
about 2 months ago
flop_8.00e+17_step_8870.pt
pickle
Detected Pickle imports (3)
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
What is a pickle import?
179 MB
LFS
Add files using large-upload tool
about 2 months ago