A failed experiment. Lowered v10's weight decay from .005 to .003.

Interested? see RLLM Virtual map for more context.

Downloads last month: 9

Inference Examples

This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Space using migueldeguzmandev/GPT2XL_RLLMv10-wd-003 1

Collection including migueldeguzmandev/GPT2XL_RLLMv10-wd-003

GPT2XL_RLLMv10-wd-001,003,010

Collection

Spin-off experiments eg. what will happen if the v10/layer10's weight decay got increased or decreased....so yeah all these attempts failed.. • 6 items • Updated May 8