introvoyz041/FactoryBench_Generation huggingface dataset:
Question type: predictive
Question template: Given the baseline sensor stream below and the counterfactual scenario where {event}, rank the signal segments listed in the 'options' field in the order you would expect them to appear as the event manifests. Answer only with a four letter string indicating your ranking (ie. DCAB), nothing else.
Answer format: ranking
Notes: Model must output a permutation of [A, B, C, D]. Chunks should be kept short to limit token cost. The correct ordering reflects causal propagation delay across signals.
Question type: intervention_outcome
Question template: Given the counterfactual scenario where {event}, what would most likely happen next? Answer only with a 4 letter string using F and T to indicate your answers (ie. TFFT to indicate True, False, False, True). Do not output anything else.
Answer format: multiple_choice_multi_select
Notes: One correct consequence, one plausible-but-wrong distractor, one unrelated distractor, and one 'nothing extraordinary happens' option. Target ~30% of generated instances where the correct answer IS 'nothing extraordinary happens'.
Question type: trajectory_outcome_multiselect
Question template: Given the counterfactual scenario where {event}, select all statements that would apply. Answer only with a 4 letter string using F and T to indicate your answers (ie. TFFT to indicate True, False, False, True). Do not output anything else.
Answer format: multiple_choice_multi_select
Notes: Always include both fixed statements (one or both may be correct depending on the scenario). Add 2 random additional statements with a 50/50 correct/incorrect split. mc_003 tests sharp speed drop, mc_004 tests stable speeds â€” they are natural opposites.
Question type: predictive
Question template: In the counterfactual scenario where {event}, what would be the expected values of {joint_signal} at T+{n}ms? Answer only with a list of 6 numbers (integer or decimal) formatted as a JSON array, ie. [10.2,9,2.1,1,7,0.21]. Do not return anything else.
Answer format: tensor
Notes: A 6-element vector of floats, one per joint axis (0-indexed). Format as a JSON array.