TIC-FM

TIC-FM is a time series classification foundation model that replaces the conventional frozen-encoder-plus-task-specific-classifier pipeline with in-context inference. At deployment, TIC-FM treats the labeled training split as context and predicts labels for the query/test split without fitting a new classifier or updating model parameters.

Paper · Code · ICML FMSD 2026 workshop paper

Model description

TIC-FM contains three main components:

1. A ViT-based time series encoder that converts each series into an instance embedding using raw values, first-order differences, and patch-level statistics.
2. A lightweight projection adapter that maps time series embeddings into the token space of the in-context classifier.
3. A latent-memory, split-masked Transformer that conditions each query on labeled context examples while preventing information flow among query examples.

The released checkpoint supports parallel context–query inference and cyclic label-permutation ensembling. Its main configuration is summarized below.

Component	Configuration
Input length	512
Time series embedding dimension	512
Time series encoder	6 Transformer layers
Projection adapter	512 → 1024 → 512
In-context Transformer	12 blocks, 4 attention heads
Latent memory	32 latent tokens; 2 write and 2 read layers
Direct class capacity	Up to 10 classes

Tasks with more than 10 classes are handled by the hierarchical class-extension procedure implemented in the evaluation pipeline.

Repository files

File	Description
TSEncoder_orion_icl_full.pt	TIC-FM model checkpoint
TSEncoder_orion_icl_model_hparams.json	Architecture and checkpoint configuration

This repository contains model weights and configuration only. Model definitions, data loading, preprocessing, and evaluation scripts are provided in the official code repository.

Quick start

1. Set up the code

git clone https://github.com/fangjuntao/TIC-FM.git
cd TIC-FM

conda env create -f environment.yml
conda activate TICFS

pip install -U huggingface_hub

2. Download the checkpoint

hf download Jwpqkh/TIC-FM \
  TSEncoder_orion_icl_full.pt \
  TSEncoder_orion_icl_model_hparams.json \
  --local-dir checkpoints

The same files can be downloaded in Python:

from huggingface_hub import hf_hub_download

checkpoint_path = hf_hub_download(
    repo_id="Jwpqkh/TIC-FM",
    filename="TSEncoder_orion_icl_full.pt",
)
hparams_path = hf_hub_download(
    repo_id="Jwpqkh/TIC-FM",
    filename="TSEncoder_orion_icl_model_hparams.json",
)

print(checkpoint_path)
print(hparams_path)

3. Evaluate on UCR

Download the UCR archive and run the evaluation script from the project root:

python scripts/eval_TSEncoder_orion_icl_classifier_ucr_full.py \
  --suite ucr \
  --mode classifier_v2 \
  --ucr_path /path/to/UCRdata/ \
  --full_ckpt checkpoints/TSEncoder_orion_icl_full.pt \
  --model_hparams_json checkpoints/TSEncoder_orion_icl_model_hparams.json

To evaluate a single dataset:

python scripts/eval_TSEncoder_orion_icl_classifier_ucr_full.py \
  --suite ucr \
  --dataset ECG200 \
  --mode classifier_v2 \
  --ucr_path /path/to/UCRdata/ \
  --full_ckpt checkpoints/TSEncoder_orion_icl_full.pt \
  --model_hparams_json checkpoints/TSEncoder_orion_icl_model_hparams.json

Useful arguments include --support_size, --query_batch_size, and --softmax_temperature. See the code repository for the complete evaluation interface.

Training data and procedure

TIC-FM is trained in three stages:

1. The time series encoder is pretrained for 100 epochs with a contrastive objective on 100,000 synthetic time series generated by CauKer.
2. The in-context classifier is pretrained on synthetic classification tasks sampled from a structural causal model prior.
3. The encoder and in-context classifier are frozen, and only the projection adapter is trained for five epochs on the training splits of the UCR archive.

No UCR test split is used for checkpoint training. Therefore, this released checkpoint corresponds to the main TIC-FM model rather than the fully synthetic TIC-FM (Syn.) variant.

Evaluation

The model is evaluated on all 128 datasets in the UCR archive using the official train/test splits. The official training split is supplied as labeled context, and the test split is treated as unlabeled queries. TIC-FM performs inference without fitting a dataset-specific classifier.

Model	Target-specific classifier fitting	Average accuracy	Mean rank
TIC-FM	No	80.01%	3.59

These results are taken from version 2 of the accompanying arXiv paper. Refer to the paper for baselines, per-dataset results, low-label protocols, statistical analysis, and complete experimental settings.

Intended use

TIC-FM is intended for:

• Research on training-free and in-context time series classification.
• Evaluation on univariate classification datasets with labeled context examples.
• Reproduction and extension of the experiments reported in the accompanying papers.

Limitations

• The released checkpoint is primarily evaluated on the univariate UCR archive; performance on other domains, multichannel datasets, irregularly sampled data, or distribution shifts is not guaranteed.
• Predictions depend on the quality and class coverage of the labeled context set. Query classes absent from the context cannot be inferred reliably.
• Inputs are processed at a fixed length of 512 by the provided evaluation pipeline; alternative preprocessing may change performance.
• The checkpoint uses custom PyTorch modules and is not directly compatible with transformers.pipeline.
• The model is a research artifact and should be independently validated before use in high-stakes applications.

Citation

If you use this checkpoint, please cite the following papers.

@article{fang2026rethinking,
  title   = {Rethinking Zero-Shot Time Series Classification:
             From Task-specific Classifiers to In-Context Inference},
  author  = {Fang, Juntao and Xie, Shifeng and Nie, Shengbin and
             Ling, Yuhui and Liu, Yuming and Li, Zijian and Zhang, Keli and
             Pan, Lujia and Palpanas, Themis and Cai, Ruichu},
  journal = {arXiv preprint arXiv:2602.00620},
  year    = {2026}
}

@inproceedings{fang2026beyond,
  title     = {Beyond Task-Specific Classifiers:
               In-Context Inference for Time Series Classification
               Foundation Models},
  author    = {Fang, Juntao and Xie, Shifeng and Nie, Shengbin and
               Ling, Yuhui and Liu, Yuming and Li, Zijian and Zhang, Keli and
               Pan, Lujia and Palpanas, Themis and Cai, Ruichu},
  booktitle = {2nd ICML Workshop on Foundation Models for Structured Data},
  year      = {2026},
  url       = {https://openreview.net/forum?id=HVvARHEA9M}
}

License

The TIC-FM model checkpoint is released under the MIT License. Third-party components remain subject to their respective licenses.

Contact

For questions or issues, please open an issue in the official code repository.