Instructions to use mlfoundations-dev/c1_science_nod_1s_1k with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use mlfoundations-dev/c1_science_nod_1s_1k with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="mlfoundations-dev/c1_science_nod_1s_1k")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("mlfoundations-dev/c1_science_nod_1s_1k")
model = AutoModelForCausalLM.from_pretrained("mlfoundations-dev/c1_science_nod_1s_1k")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps

vLLM

How to use mlfoundations-dev/c1_science_nod_1s_1k with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "mlfoundations-dev/c1_science_nod_1s_1k"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "mlfoundations-dev/c1_science_nod_1s_1k",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/mlfoundations-dev/c1_science_nod_1s_1k

SGLang

How to use mlfoundations-dev/c1_science_nod_1s_1k with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "mlfoundations-dev/c1_science_nod_1s_1k" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "mlfoundations-dev/c1_science_nod_1s_1k",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "mlfoundations-dev/c1_science_nod_1s_1k" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "mlfoundations-dev/c1_science_nod_1s_1k",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use mlfoundations-dev/c1_science_nod_1s_1k with Docker Model Runner:
```
docker model run hf.co/mlfoundations-dev/c1_science_nod_1s_1k
```

c1_science_nod_1s_1k / trainer_log.jsonl

ryanmarten

Upload model

98e4b2f verified about 1 year ago

raw

history blame contribute delete

13.5 kB

	{"current_steps": 1, "total_steps": 70, "loss": 0.9545, "lr": 2.8571428571428573e-06, "epoch": 0.09523809523809523, "percentage": 1.43, "elapsed_time": "0:00:33", "remaining_time": "0:38:48"}
	{"current_steps": 2, "total_steps": 70, "loss": 0.9963, "lr": 5.7142857142857145e-06, "epoch": 0.19047619047619047, "percentage": 2.86, "elapsed_time": "0:01:02", "remaining_time": "0:35:15"}
	{"current_steps": 3, "total_steps": 70, "loss": 0.9956, "lr": 8.571428571428571e-06, "epoch": 0.2857142857142857, "percentage": 4.29, "elapsed_time": "0:01:27", "remaining_time": "0:32:42"}
	{"current_steps": 4, "total_steps": 70, "loss": 0.9425, "lr": 1.1428571428571429e-05, "epoch": 0.38095238095238093, "percentage": 5.71, "elapsed_time": "0:01:55", "remaining_time": "0:31:41"}
	{"current_steps": 5, "total_steps": 70, "loss": 0.9215, "lr": 1.4285714285714287e-05, "epoch": 0.47619047619047616, "percentage": 7.14, "elapsed_time": "0:02:26", "remaining_time": "0:31:44"}
	{"current_steps": 6, "total_steps": 70, "loss": 0.8968, "lr": 1.7142857142857142e-05, "epoch": 0.5714285714285714, "percentage": 8.57, "elapsed_time": "0:03:00", "remaining_time": "0:32:07"}
	{"current_steps": 7, "total_steps": 70, "loss": 0.8699, "lr": 2e-05, "epoch": 0.6666666666666666, "percentage": 10.0, "elapsed_time": "0:03:31", "remaining_time": "0:31:44"}
	{"current_steps": 8, "total_steps": 70, "loss": 0.8294, "lr": 1.9987569212189224e-05, "epoch": 0.7619047619047619, "percentage": 11.43, "elapsed_time": "0:03:58", "remaining_time": "0:30:47"}
	{"current_steps": 9, "total_steps": 70, "loss": 0.8498, "lr": 1.9950307753654016e-05, "epoch": 0.8571428571428571, "percentage": 12.86, "elapsed_time": "0:04:25", "remaining_time": "0:29:56"}
	{"current_steps": 10, "total_steps": 70, "loss": 0.7961, "lr": 1.9888308262251286e-05, "epoch": 0.9523809523809523, "percentage": 14.29, "elapsed_time": "0:04:55", "remaining_time": "0:29:33"}
	{"current_steps": 11, "total_steps": 70, "loss": 1.143, "lr": 1.9801724878485438e-05, "epoch": 1.0476190476190477, "percentage": 15.71, "elapsed_time": "0:06:00", "remaining_time": "0:32:14"}
	{"current_steps": 12, "total_steps": 70, "loss": 0.7095, "lr": 1.969077286229078e-05, "epoch": 1.1428571428571428, "percentage": 17.14, "elapsed_time": "0:06:28", "remaining_time": "0:31:16"}
	{"current_steps": 13, "total_steps": 70, "loss": 0.7578, "lr": 1.955572805786141e-05, "epoch": 1.2380952380952381, "percentage": 18.57, "elapsed_time": "0:06:59", "remaining_time": "0:30:38"}
	{"current_steps": 14, "total_steps": 70, "loss": 0.6678, "lr": 1.9396926207859085e-05, "epoch": 1.3333333333333333, "percentage": 20.0, "elapsed_time": "0:07:30", "remaining_time": "0:30:00"}
	{"current_steps": 15, "total_steps": 70, "loss": 0.7232, "lr": 1.921476211870408e-05, "epoch": 1.4285714285714286, "percentage": 21.43, "elapsed_time": "0:07:59", "remaining_time": "0:29:19"}
	{"current_steps": 16, "total_steps": 70, "loss": 0.7196, "lr": 1.900968867902419e-05, "epoch": 1.5238095238095237, "percentage": 22.86, "elapsed_time": "0:08:29", "remaining_time": "0:28:39"}
	{"current_steps": 17, "total_steps": 70, "loss": 0.7044, "lr": 1.8782215733702286e-05, "epoch": 1.619047619047619, "percentage": 24.29, "elapsed_time": "0:08:56", "remaining_time": "0:27:52"}
	{"current_steps": 18, "total_steps": 70, "loss": 0.6598, "lr": 1.8532908816321557e-05, "epoch": 1.7142857142857144, "percentage": 25.71, "elapsed_time": "0:09:20", "remaining_time": "0:26:59"}
	{"current_steps": 19, "total_steps": 70, "loss": 0.6985, "lr": 1.826238774315995e-05, "epoch": 1.8095238095238095, "percentage": 27.14, "elapsed_time": "0:09:44", "remaining_time": "0:26:07"}
	{"current_steps": 20, "total_steps": 70, "loss": 0.6762, "lr": 1.7971325072229227e-05, "epoch": 1.9047619047619047, "percentage": 28.57, "elapsed_time": "0:10:12", "remaining_time": "0:25:32"}
	{"current_steps": 21, "total_steps": 70, "loss": 0.944, "lr": 1.766044443118978e-05, "epoch": 2.0, "percentage": 30.0, "elapsed_time": "0:10:42", "remaining_time": "0:24:59"}
	{"current_steps": 22, "total_steps": 70, "loss": 0.5937, "lr": 1.7330518718298263e-05, "epoch": 2.0952380952380953, "percentage": 31.43, "elapsed_time": "0:11:24", "remaining_time": "0:24:54"}
	{"current_steps": 23, "total_steps": 70, "loss": 0.5627, "lr": 1.698236818086073e-05, "epoch": 2.1904761904761907, "percentage": 32.86, "elapsed_time": "0:11:54", "remaining_time": "0:24:20"}
	{"current_steps": 24, "total_steps": 70, "loss": 0.5685, "lr": 1.6616858375968596e-05, "epoch": 2.2857142857142856, "percentage": 34.29, "elapsed_time": "0:12:20", "remaining_time": "0:23:39"}
	{"current_steps": 25, "total_steps": 70, "loss": 0.5741, "lr": 1.6234898018587336e-05, "epoch": 2.380952380952381, "percentage": 35.71, "elapsed_time": "0:12:51", "remaining_time": "0:23:08"}
	{"current_steps": 26, "total_steps": 70, "loss": 0.5585, "lr": 1.5837436722347902e-05, "epoch": 2.4761904761904763, "percentage": 37.14, "elapsed_time": "0:13:15", "remaining_time": "0:22:26"}
	{"current_steps": 27, "total_steps": 70, "loss": 0.578, "lr": 1.5425462638657597e-05, "epoch": 2.571428571428571, "percentage": 38.57, "elapsed_time": "0:13:38", "remaining_time": "0:21:43"}
	{"current_steps": 28, "total_steps": 70, "loss": 0.5398, "lr": 1.5000000000000002e-05, "epoch": 2.6666666666666665, "percentage": 40.0, "elapsed_time": "0:14:11", "remaining_time": "0:21:16"}
	{"current_steps": 29, "total_steps": 70, "loss": 0.5607, "lr": 1.4562106573531632e-05, "epoch": 2.761904761904762, "percentage": 41.43, "elapsed_time": "0:14:40", "remaining_time": "0:20:44"}
	{"current_steps": 30, "total_steps": 70, "loss": 0.5327, "lr": 1.4112871031306118e-05, "epoch": 2.857142857142857, "percentage": 42.86, "elapsed_time": "0:15:11", "remaining_time": "0:20:15"}
	{"current_steps": 31, "total_steps": 70, "loss": 0.5451, "lr": 1.3653410243663953e-05, "epoch": 2.9523809523809526, "percentage": 44.29, "elapsed_time": "0:15:41", "remaining_time": "0:19:44"}
	{"current_steps": 32, "total_steps": 70, "loss": 0.7337, "lr": 1.3184866502516846e-05, "epoch": 3.0476190476190474, "percentage": 45.71, "elapsed_time": "0:16:21", "remaining_time": "0:19:25"}
	{"current_steps": 33, "total_steps": 70, "loss": 0.4906, "lr": 1.2708404681430054e-05, "epoch": 3.142857142857143, "percentage": 47.14, "elapsed_time": "0:16:50", "remaining_time": "0:18:52"}
	{"current_steps": 34, "total_steps": 70, "loss": 0.4505, "lr": 1.2225209339563144e-05, "epoch": 3.238095238095238, "percentage": 48.57, "elapsed_time": "0:17:13", "remaining_time": "0:18:14"}
	{"current_steps": 35, "total_steps": 70, "loss": 0.4561, "lr": 1.1736481776669307e-05, "epoch": 3.3333333333333335, "percentage": 50.0, "elapsed_time": "0:17:45", "remaining_time": "0:17:45"}
	{"current_steps": 36, "total_steps": 70, "loss": 0.4272, "lr": 1.1243437046474854e-05, "epoch": 3.4285714285714284, "percentage": 51.43, "elapsed_time": "0:18:11", "remaining_time": "0:17:10"}
	{"current_steps": 37, "total_steps": 70, "loss": 0.4469, "lr": 1.0747300935864245e-05, "epoch": 3.5238095238095237, "percentage": 52.86, "elapsed_time": "0:18:42", "remaining_time": "0:16:41"}
	{"current_steps": 38, "total_steps": 70, "loss": 0.4163, "lr": 1.0249306917380731e-05, "epoch": 3.619047619047619, "percentage": 54.29, "elapsed_time": "0:19:09", "remaining_time": "0:16:07"}
	{"current_steps": 39, "total_steps": 70, "loss": 0.4217, "lr": 9.750693082619274e-06, "epoch": 3.7142857142857144, "percentage": 55.71, "elapsed_time": "0:19:36", "remaining_time": "0:15:35"}
	{"current_steps": 40, "total_steps": 70, "loss": 0.4681, "lr": 9.252699064135759e-06, "epoch": 3.8095238095238093, "percentage": 57.14, "elapsed_time": "0:20:07", "remaining_time": "0:15:05"}
	{"current_steps": 41, "total_steps": 70, "loss": 0.4479, "lr": 8.756562953525151e-06, "epoch": 3.9047619047619047, "percentage": 58.57, "elapsed_time": "0:20:33", "remaining_time": "0:14:32"}
	{"current_steps": 42, "total_steps": 70, "loss": 0.6286, "lr": 8.263518223330698e-06, "epoch": 4.0, "percentage": 60.0, "elapsed_time": "0:20:59", "remaining_time": "0:13:59"}
	{"current_steps": 43, "total_steps": 70, "loss": 0.3714, "lr": 7.774790660436857e-06, "epoch": 4.095238095238095, "percentage": 61.43, "elapsed_time": "0:21:40", "remaining_time": "0:13:36"}
	{"current_steps": 44, "total_steps": 70, "loss": 0.3794, "lr": 7.291595318569951e-06, "epoch": 4.190476190476191, "percentage": 62.86, "elapsed_time": "0:22:07", "remaining_time": "0:13:04"}
	{"current_steps": 45, "total_steps": 70, "loss": 0.3869, "lr": 6.815133497483157e-06, "epoch": 4.285714285714286, "percentage": 64.29, "elapsed_time": "0:22:33", "remaining_time": "0:12:31"}
	{"current_steps": 46, "total_steps": 70, "loss": 0.3488, "lr": 6.34658975633605e-06, "epoch": 4.380952380952381, "percentage": 65.71, "elapsed_time": "0:23:04", "remaining_time": "0:12:02"}
	{"current_steps": 47, "total_steps": 70, "loss": 0.3458, "lr": 5.887128968693887e-06, "epoch": 4.476190476190476, "percentage": 67.14, "elapsed_time": "0:23:33", "remaining_time": "0:11:31"}
	{"current_steps": 48, "total_steps": 70, "loss": 0.3633, "lr": 5.43789342646837e-06, "epoch": 4.571428571428571, "percentage": 68.57, "elapsed_time": "0:23:59", "remaining_time": "0:10:59"}
	{"current_steps": 49, "total_steps": 70, "loss": 0.368, "lr": 5.000000000000003e-06, "epoch": 4.666666666666667, "percentage": 70.0, "elapsed_time": "0:24:29", "remaining_time": "0:10:29"}
	{"current_steps": 50, "total_steps": 70, "loss": 0.3478, "lr": 4.5745373613424075e-06, "epoch": 4.761904761904762, "percentage": 71.43, "elapsed_time": "0:24:54", "remaining_time": "0:09:57"}
	{"current_steps": 51, "total_steps": 70, "loss": 0.3541, "lr": 4.162563277652104e-06, "epoch": 4.857142857142857, "percentage": 72.86, "elapsed_time": "0:25:22", "remaining_time": "0:09:27"}
	{"current_steps": 52, "total_steps": 70, "loss": 0.3483, "lr": 3.7651019814126656e-06, "epoch": 4.9523809523809526, "percentage": 74.29, "elapsed_time": "0:25:48", "remaining_time": "0:08:56"}
	{"current_steps": 53, "total_steps": 70, "loss": 0.5051, "lr": 3.3831416240314085e-06, "epoch": 5.0476190476190474, "percentage": 75.71, "elapsed_time": "0:26:34", "remaining_time": "0:08:31"}
	{"current_steps": 54, "total_steps": 70, "loss": 0.3073, "lr": 3.017631819139273e-06, "epoch": 5.142857142857143, "percentage": 77.14, "elapsed_time": "0:27:04", "remaining_time": "0:08:01"}
	{"current_steps": 55, "total_steps": 70, "loss": 0.3209, "lr": 2.669481281701739e-06, "epoch": 5.238095238095238, "percentage": 78.57, "elapsed_time": "0:27:35", "remaining_time": "0:07:31"}
	{"current_steps": 56, "total_steps": 70, "loss": 0.3349, "lr": 2.339555568810221e-06, "epoch": 5.333333333333333, "percentage": 80.0, "elapsed_time": "0:28:00", "remaining_time": "0:07:00"}
	{"current_steps": 57, "total_steps": 70, "loss": 0.3231, "lr": 2.0286749277707783e-06, "epoch": 5.428571428571429, "percentage": 81.43, "elapsed_time": "0:28:26", "remaining_time": "0:06:29"}
	{"current_steps": 58, "total_steps": 70, "loss": 0.3176, "lr": 1.7376122568400533e-06, "epoch": 5.523809523809524, "percentage": 82.86, "elapsed_time": "0:28:55", "remaining_time": "0:05:58"}
	{"current_steps": 59, "total_steps": 70, "loss": 0.318, "lr": 1.467091183678444e-06, "epoch": 5.619047619047619, "percentage": 84.29, "elapsed_time": "0:29:21", "remaining_time": "0:05:28"}
	{"current_steps": 60, "total_steps": 70, "loss": 0.289, "lr": 1.2177842662977136e-06, "epoch": 5.714285714285714, "percentage": 85.71, "elapsed_time": "0:29:52", "remaining_time": "0:04:58"}
	{"current_steps": 61, "total_steps": 70, "loss": 0.3285, "lr": 9.903113209758098e-07, "epoch": 5.809523809523809, "percentage": 87.14, "elapsed_time": "0:30:23", "remaining_time": "0:04:29"}
	{"current_steps": 62, "total_steps": 70, "loss": 0.2843, "lr": 7.852378812959227e-07, "epoch": 5.904761904761905, "percentage": 88.57, "elapsed_time": "0:30:50", "remaining_time": "0:03:58"}
	{"current_steps": 63, "total_steps": 70, "loss": 0.4462, "lr": 6.030737921409169e-07, "epoch": 6.0, "percentage": 90.0, "elapsed_time": "0:31:15", "remaining_time": "0:03:28"}
	{"current_steps": 64, "total_steps": 70, "loss": 0.309, "lr": 4.4427194213859216e-07, "epoch": 6.095238095238095, "percentage": 91.43, "elapsed_time": "0:32:04", "remaining_time": "0:03:00"}
	{"current_steps": 65, "total_steps": 70, "loss": 0.302, "lr": 3.0922713770922155e-07, "epoch": 6.190476190476191, "percentage": 92.86, "elapsed_time": "0:32:35", "remaining_time": "0:02:30"}
	{"current_steps": 66, "total_steps": 70, "loss": 0.2962, "lr": 1.9827512151456175e-07, "epoch": 6.285714285714286, "percentage": 94.29, "elapsed_time": "0:33:06", "remaining_time": "0:02:00"}
	{"current_steps": 67, "total_steps": 70, "loss": 0.2891, "lr": 1.1169173774871478e-07, "epoch": 6.380952380952381, "percentage": 95.71, "elapsed_time": "0:33:33", "remaining_time": "0:01:30"}
	{"current_steps": 68, "total_steps": 70, "loss": 0.3033, "lr": 4.9692246345985905e-08, "epoch": 6.476190476190476, "percentage": 97.14, "elapsed_time": "0:34:01", "remaining_time": "0:01:00"}
	{"current_steps": 69, "total_steps": 70, "loss": 0.2833, "lr": 1.2430787810776556e-08, "epoch": 6.571428571428571, "percentage": 98.57, "elapsed_time": "0:34:30", "remaining_time": "0:00:30"}
	{"current_steps": 70, "total_steps": 70, "loss": 0.3071, "lr": 0.0, "epoch": 6.666666666666667, "percentage": 100.0, "elapsed_time": "0:34:59", "remaining_time": "0:00:00"}
	{"current_steps": 70, "total_steps": 70, "epoch": 6.666666666666667, "percentage": 100.0, "elapsed_time": "0:35:28", "remaining_time": "0:00:00"}