p-doom/crowd-code-dataset-0.2 huggingface dataset:
[terminal_command] TERMINAL ()
tensorboard --logdir test_output//fast/home/franz.srambical/crowd-pilot/.nemo_venv/lib/python3.10/site-packages/tensorboard/default.py:30: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.  import pkg_resourcesTensorFlow installation not found - running with reduced feature set.NOTE: Using experimental fast data loading logic. To disable, pass    "--load_fast=false" and report issues on GitHub. More details:    https://github.com/tensorflow/tensorboard/issues/4784Serving TensorBoard on localhost; to expose to the network, use a proxy or pass --bind_allTensorBoard 2.20.0 at http://localhost:6006/ (Press CTRL+C to quit)source /home/franz.srambical/crowd-pilot/.nemo_venv/bin/activate^C^C
[content] slurm/dev/franz/berlin/crowd-pilot/nemo/test_full_finetune.py (python)
recipe.data = run.Config(
    llm.ChatDataModule,
    dataset_root=DATASET_DIR,
    seq_length=2048,
    global_batch_size=8,    # Adjust based on your memory/convergence needs
    micro_batch_size=1,
)