Spaces:

Ashmal
/

MobiLlama

Runtime error

MobiLlama / playground /deepspeed_config_s2.json

Upload folder using huggingface_hub

5472531 verified 4 months ago

No virus

291 Bytes

	{
	"zero_optimization": {
	"stage": 2,
	"offload_optimizer": {
	"device": "cpu"
	},
	"contiguous_gradients": true,
	"overlap_comm": true
	},
	"fp16": {
	"enabled": "auto"
	},
	"train_micro_batch_size_per_gpu": "auto",
	"gradient_accumulation_steps": "auto"
	}