Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
formll
/
resolving-scaling-law-discrepancies
like
4
Follow
Foundations of Robust Machine Learning Lab
3
RefinedWeb
EleutherAI/OpenWebText2
open_lm
arxiv:
2406.19146
License:
mit
Model card
Files
Files and versions
Community
6e42be7
resolving-scaling-law-discrepancies
/
dataset=rw
/
hparams=tuned_warmup=long_decay=const
/
params=37M_maxstep=45220
1 contributor
History:
2 commits
TomerPorian
Add files using large-upload tool
45804fd
verified
8 months ago
flop_1.00e+17_step_2745.pt
Safe
pickle
Detected Pickle imports (3)
"torch._utils._rebuild_tensor_v2"
,
"collections.OrderedDict"
,
"torch.FloatStorage"
What is a pickle import?
226 MB
LFS
Add files using large-upload tool
8 months ago
flop_1.25e+16_step_344.pt
Safe
pickle
Detected Pickle imports (3)
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
What is a pickle import?
226 MB
LFS
Add files using large-upload tool
8 months ago
flop_1.60e+18_step_43918.pt
Safe
pickle
Detected Pickle imports (3)
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
What is a pickle import?
226 MB
LFS
Add files using large-upload tool
8 months ago
flop_2.00e+17_step_5490.pt
Safe
pickle
Detected Pickle imports (3)
"torch._utils._rebuild_tensor_v2"
,
"collections.OrderedDict"
,
"torch.FloatStorage"
What is a pickle import?
226 MB
LFS
Add files using large-upload tool
8 months ago
flop_2.50e+16_step_687.pt
Safe
pickle
Detected Pickle imports (3)
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
What is a pickle import?
226 MB
LFS
Add files using large-upload tool
8 months ago
flop_4.00e+17_step_10980.pt
Safe
pickle
Detected Pickle imports (3)
"torch._utils._rebuild_tensor_v2"
,
"collections.OrderedDict"
,
"torch.FloatStorage"
What is a pickle import?
226 MB
LFS
Add files using large-upload tool
8 months ago
flop_5.00e+16_step_1373.pt
Safe
pickle
Detected Pickle imports (3)
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
What is a pickle import?
226 MB
LFS
Add files using large-upload tool
8 months ago
flop_6.27e+15_step_172.pt
Safe
pickle
Detected Pickle imports (3)
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
What is a pickle import?
226 MB
LFS
Add files using large-upload tool
8 months ago
flop_8.00e+17_step_21959.pt
Safe
226 MB
LFS
Add files using large-upload tool
8 months ago
