p-doom/crowd-code-dataset-0.2 huggingface dataset:
[tab] slurm/jobs/franz/berlin/atari/atari_data_gen.sh (shellscript)
#!/usr/bin/env bash

#SBATCH --nodes=1
#SBATCH --ntasks-per-node=1
#SBATCH --time=24:00:00
#SBATCH --cpus-per-task=8
#SBATCH --gres=gpu:1
#SBATCH --output=/fast/project/HFMI_SynergyUnit/jafar_ws/logs/franz/atari/%x_%j.log
#SBATCH --error=/fast/project/HFMI_SynergyUnit/jafar_ws/logs/franz/atari/%x_%j.log
#SBATCH --job-name=generate_atari_data

cd data/
uv run python jasmine_data/atari/generate_atari_dataset.py --output_dir=/fast/project/HFMI_SynergyUnit/jafar_ws/data/breakout
[content] data/jasmine_data/atari/visualize_array_record.py (python)
            # Single-channel (or legacy multi-channel where last channel is the view)
            img_np = frames_cf[t, 0, :, :] if channels == 1 else frames_cf[t, channels - 1, :, :]
            img = Image.fromarray(img_np, mode="L")
[content] data/jasmine_data/atari/visualize_array_record.py (python)
        # When channels represent RGB, render as color unless composite is requested
        if channels == 3 and not use_composite:
            # frames_cl is (T, H, W, C) so we can use it directly for RGB
            img_np_rgb = frames_cl[t]
            img = Image.fromarray(img_np_rgb, mode="RGB")
        elif use_composite and channels > 1:
            # Tile individual channels horizontally as grayscale for debugging
[tab] slurm/README.md (markdown)
# slurm

This repository contains Slurm job scripts and tools for ML workflows on the HPC cluster.

## Structure

- `common/` — Shared setup code (env, sbatch headers)
- `dev/` — Individual folders for development or experimental jobs
- `jobs/` — Stable, production-ready sbatch scripts
- `templates/` — Optional Jinja2 or shell templates for job generation
- `utils/` — Helper scripts

Team: Franz, Mihir, Alfred