introvoyz041/FactoryBench_Generation huggingface dataset:
Question type: predictive
Question template: The sensor stream below is from a robot exhibiting {anomaly}. Rank the signal segments listed in the 'options' field in the order you would expect them to appear as the anomaly manifests. Answer only with a four letter string indicating your ranking (ie. DCAB), nothing else.
Answer format: ranking
Number of items: 4
Notes: Model must output a permutation of [A, B, C, D]. Chunks should be kept short to limit token cost. The correct ordering reflects causal propagation delay across signals.
Question type: predictive
Question template: The sensor stream below is from a robot exhibiting {anomaly}. What would most likely happen next? Answer only with a 4 letter string using F and T to indicate your answers (ie. TFFT to indicate True, False, False, True). Do not output anything else.
Answer format: multiple_choice_multi_select
Number of choices: 4
Notes: One correct consequence, one plausible-but-wrong distractor, one unrelated distractor, and one 'nothing extraordinary happens' option. Target ~30% of generated instances where the correct answer IS 'nothing extraordinary happens'.
Question type: anomaly detection
Question template: The sensor stream below is from a robot exhibiting {anomaly}. Select all statements that apply in the options provided. Answer only with a 4 letter string using F and T to indicate your answers (ie. TFFT to indicate True, False, False, True). Do not output anything else.
Answer format: multiple_choice_multi_select
Notes: Always include both fixed statements (one or both may be correct depending on the scenario). Add 2 random additional statements with a 50/50 correct/incorrect split. mc_003 tests sharp speed drop, mc_004 tests stable speeds â€” they are natural opposites.
Question type: predictive
Question template: The sensor stream below is from a robot exhibiting {anomaly}. What are the expected values of {joint_signal} at T+{n}ms? Answer only with a list of 6 numbers (integer or decimal) formatted as a JSON array, ie. [10.2,9,2.1,1,7,0.21]. Do not return anything else.
Answer format: tensor
Notes: A 6-element vector of floats, one per joint axis (0-indexed). Format as a JSON array.
Question type: predictive
Question template: Knowing that the robot suffers from {anomaly} in the given context time series, we want to isolate the {phase} phase. Assuming a fixed window length of {window_length} timesteps, at which timestamp should the window begin? Answer only with an integer or decimal number, nothing else.
Answer format: numerical
Notes: Same as L1 template 1 but on anomalous data. Ground truth from phase segmentation. Accept answers within a tolerance band.
Question type: comparative
Question template: You are provided with two sensor streams originating from robots accomplishing tasks. What differences between the two given instances of robotic time series data (if any) do you notice? Answer only with a 4 letter string using F and T to indicate your answers (ie. TFFT to indicate True, False, False, True). Do not output anything else.
Answer format: multiple_choice_single_select
Number of choices: 4
Notes: Same as L1 template 3 but on anomalous data. Ground truth from instance metadata.
Question type: identification
Question template: Knowing that the robot suffers from {anomaly} in the given context time series, what robot does this sensor data originate from? Answer only with the letter of the correct option (ie. A), nothing else.
Hidden metadata: robot, gripper
Answer format: multiple_choice_single_select
Number of choices: 3
Notes: Same as L1 template 6 but on anomalous data. The model must infer the robot despite the anomaly affecting signal characteristics.