koichi12
/

llm-scripts

Model card Files Files and versions

llm-scripts / scripts /yans /eval /lm-evaluation-harness /models /cyberagent /cyberagent-open-calm-1b /harness.sh

koichi12's picture

Add files using upload-large-folder tool

42bd089 verified 11 months ago

history blame contribute delete

304 Bytes

	MODEL_ARGS="pretrained=cyberagent/open-calm-1b"
	TASK="jcommonsenseqa-1.1-0.2,jnli-1.1-0.2,marc_ja-1.1-0.2,jsquad-1.1-0.2,xlsum_ja"
	python main.py --model hf-causal --model_args $MODEL_ARGS --tasks $TASK --num_fewshot "2,3,3,3,1" --device "cuda" --output_path "models/cyberagent-open-calm-1b/result.json"