koichi12
/

llm-scripts

Model card Files Files and versions

llm-scripts / scripts /yans /eval /lm-evaluation-harness /models /cyberagent /cyberagent-open-calm-3b /harness.sh

koichi12's picture

Add files using upload-large-folder tool

42bd089 verified 10 months ago

history blame contribute delete

357 Bytes

	MODEL_ARGS="pretrained=cyberagent/open-calm-3b"
	TASK="jcommonsenseqa-1.1-0.2,jnli-1.1-0.2,marc_ja-1.1-0.2,jsquad-1.1-0.2,jaqket_v2-0.1-0.2,xlsum_ja,xwinograd_ja,mgsm"
	python main.py --model hf-causal --model_args $MODEL_ARGS --tasks $TASK --num_fewshot "3,3,3,2,1,1,0,5" --device "cuda" --output_path "models/cyberagent/cyberagent-open-calm-3b/result.json"