Etherll
/

Hermes-3-Llama-3.1-8B-adapter

Inference Endpoints

Model card Files Files and versions Community

Etherll commited on Aug 24

Commit

dd66f3d

•

1 Parent(s): dc13c70

Update adapter_config.json

Files changed (1) hide show

adapter_config.json +1 -1

adapter_config.json CHANGED Viewed

@@ -9,7 +9,7 @@
   "layers_pattern": null,
   "layers_to_transform": null,
   "loftq_config": {},
-  "lora_alpha": 16,
   "lora_dropout": 0,
   "megatron_config": null,
   "megatron_core": "megatron.core",

   "layers_pattern": null,
   "layers_to_transform": null,
   "loftq_config": {},
+  "lora_alpha": 32,
   "lora_dropout": 0,
   "megatron_config": null,
   "megatron_core": "megatron.core",