koichi12
/

llm-scripts

Model card Files Files and versions

llm-scripts / scripts /yans /eval /lm-evaluation-harness /models /cyberagent /cyberagent-open-calm-medium /harness.jsquad-1.2.sh

koichi12's picture

Add files using upload-large-folder tool

42bd089 verified 11 months ago

history blame contribute delete

301 Bytes

	MODEL_ARGS="pretrained=cyberagent/open-calm-medium,use_fast=True,device_map=auto,torch_dtype=auto"
	TASK="jsquad-1.2-0.2"
	python main.py --model hf-causal --model_args $MODEL_ARGS --tasks $TASK --num_fewshot "3" --device "cuda" --output_path "models/cyberagent-open-calm-medium/result.jsquad-1.2.json"