GPT2XL_RLLMv10-wd-001,003,010
Collection
Spin-off experiments eg. what will happen if the v10/layer10's weight decay got increased or decreased....so yeah all these attempts failed..
•
6 items
•
Updated
A failed experiment. Increased v10's weight decay from .005 to .010.
Interested? see RLLM Virtual map for more context.
- Downloads last month
- 1