QwQ-32B-Dynamic-F8 / args-lambda-quant.json
clowman's picture
Upload folder using huggingface_hub
a24fe61 verified
raw
history blame contribute delete
239 Bytes
{"quantization": "Dynamic-F8", "model": "Qwen/QwQ-32B", "dataset": "HuggingFaceH4/ultrachat_200k", "dataset_split": "train_sft", "dataset_name": null, "num_samples": 512, "seq_length": 2048, "batch_size": 32, "update_metadata_only": false}