--- license: other license_name: polyform-strict-1-0-0 license_link: https://polyformproject.org/licenses/strict/1.0.0 library_name: transformers base_model: - tri-fair-lab/Snowdon1.1-Small --- # Thomson-1.0-Small > [!Note] > This repository contains model weights and configuration files in the Hugging Face Transformers format. > > For more details, please refer to our technical report, [**Thomson: Continual Learning of Frontier Models for SovereignAI**](https://huggingface.co/spaces/tri-fair-lab/publications/blob/main/Thomson_1_0_Technical_Report.pdf). Thomson-1.0-Small is a frontier Foundation Model of high proficiency across a wide range of specialised and general-purpose domains as well as practical deployment settings. It is the open-weight member of the Thomson-1.0 family, developed within a Continual Learning paradigm with a deliberate focus on economically impactful, high-stakes professional work across legal, tax, and journalism domains. It is obtained by repurposing the open-weight Qwen3.6-35B-A3B model and substantially improving it on a wide range of performance domains. ## Thomson-1.0 Highlights The development of frontier models is commonly perceived to be in the exclusive remit of a small number of heavily funded players. Thomson demonstrates that frontier performance can instead be achieved by a wide range of institutions through Continual Learning on readily available open-weight models: - **Continual Learning:** as opposed to limited approaches such as small-scale fine-tuning, prompt engineering, or tool-augmentation on a frozen model, the pipeline delivers distinct improvements across a wide range of capabilities, including those not explicitly targeted, while almost eliminating the forgetting problem common to narrow domain adaptation. - **High-stakes professional work:** an enhanced focus on legal, tax, and journalism — domains commonly predicted to undergo large productivity improvements through AI, combining the formality and rigorous reasoning of technical fields with the nuance and tolerance for uncertainty of the humanities. - **Value sovereignty:** alignment determines which values a model expresses and how it handles questions on which credible narratives diverge. Here it targets the [Public AI Constitution](https://huggingface.co/spaces/tri-fair-lab/publications/blob/main/Public_AI_Constitution.pdf), an openly developed document that permits free use and modification, rather than a proprietary value system, and is applied at two points: Constitutional DPO during value re-alignment, and a constitutional conformance reward during reinforcement learning. The normative foundations of a model should themselves be a shared public resource, open to scrutiny and debate. - **Data-centricity:** proprietary content is not merely absorbed as knowledge but converted into supervision, with mid-training data curated from a corpus of over 19T tokens and preference data derived from expert-authored material that no annotation budget could reproduce at scale. - **Agentic Deep Research:** a full research harness with reward structures designed to incentivise faithful tool use and accurate citation patterns, vital to reducing hallucinations in high-stakes settings. - **Efficiency:** the full pipeline consumed approximately 1.63 × 10²³ FLOP over 35,207 B200 GPU-hours, showing that these results are achievable with compute and personnel budgets substantially lower than commonly thought. ## Model Overview - Type: Causal Language Model (Mixture-of-Experts) - Training Stage: Value re-alignment, Continual pre-training, Post-training - Base Checkpoint: [Snowdon1.1-Small](https://huggingface.co/tri-fair-lab/Snowdon1.1-Small) - Number of Parameters: 35B in total and 3B activated - Architecture: [Qwen3.6-35B-A3B](https://huggingface.co/Qwen/Qwen3.6-35B-A3B); see `config.json` for the full specification - Context Length: 262,144 natively - Training Compute: 1.63 × 10²³ FLOP / 35,207 B200 GPU-hours - Precision: BF16 weights ## Model Training and Data ![Thomson model development pipeline](https://huggingface.co/thomsonreuters/Thomson-1.0-Small/resolve/main/thomson_model_development_pipeline.svg) *The pipeline is organised into three sequential modules with distinct development foci, allowing computational investment to be adjusted to match sovereignty requirements.* **Value focus.** Starting from an open-weight, instruction-tuned Foundation Model, values are re-aligned through Constitutional DPO, potentially augmented with activation steering, bringing the model's expressed values into line with the Public AI Constitution. **Knowledge focus.** Data-centric continual pre-training (CPT) ingests Thomson Reuters' proprietary data — decades of news, contracts, regulatory filings, case law, statutes and practitioner guidance — with model merging protecting general capabilities while the model absorbs domain knowledge. The mid-training corpus comprises 200B tokens curated from a pool of over 19T tokens of permissively public and proprietary data, split roughly equally between curated proprietary documents, synthetic rephrasings of those documents, and general-capability replay data. **Behaviour, skill & agentic focus.** Post-training combines Direct Preference Optimisation with reinforcement learning. The underlying data draws on rehearsal data that reinforces knowledge weakened during earlier stages, document-driven preference data derived from Thomson Reuters' own expert-authored content, ontology-driven preference data built from domain schemas such as IRAC for case law, expert-authored diverse queries data capturing how practitioners actually use AI day to day, and agentic data from the Deep Research harness. ## Benchmark Results ### Cross-Domain Overview
Thomson-1.0-SmallSnowdon-1.1-SmallQwen3.6-35B-A3BGemma 4-31BHaiku 4.5
Overall Avg.
74.671.771.771.268.2
Legal
Stanford LegalBench
79.980.980.383.180.7
Info. Retrieval
49.648.649.451.949.2
Reasoning
68.267.364.771.965.5
Classification
70.070.170.469.468.1
Doc. Processing & RAG
78.871.274.776.643.8
Summarisation
89.488.189.089.484.3
Contract Under.
67.364.863.773.270.1
Human Queries
90.282.282.681.274.9
Deep Research
85.080.082.074.080.0
Harvey Legal Agent Bench.
73.471.569.534.260.5
Domain Avg.
75.272.472.770.567.7
Tax
Deep Research
78.668.068.075.062.0
Tax Q&A
86.685.286.284.579.4
Domain Avg.
82.676.577.379.670.7
Journalism
Deep Research
74.267.573.074.781.0
General
Factuality
61.159.358.857.656.8
Long Context
74.173.873.869.467.4
Multilingualism
71.972.873.179.485.8
Instruction Following
86.185.585.689.378.2
Writing
81.079.379.575.577.9
Reasoning
61.561.361.566.149.3
General Agent
85.881.480.372.959.7
Coding
37.435.639.834.632.9
Maths
86.788.087.591.166.5
Domain Avg.
71.770.871.170.763.8
Safety / Values
Political Neutrality
98.591.578.591.592.0
Robustness
56.347.348.741.770.2
Adversarial Testing
89.187.789.288.5--
Domain Avg.
81.375.572.173.981.1
  1. The best score in each row is shown in bold. Dashes (--) mark benchmarks that were not run for a given model.
  2. All models were run with medium reasoning effort.
  3. Overall Avg. is the unweighted mean over all individual benchmarks, excluding Adversarial Testing.
  4. The Deep Research rows report a weighted aggregate of completeness (~40%), factuality (~35%), relevance (~20%) and coherence (~5%), scored on reports produced inside a planner-worker-reporter harness with tool access.
  5. Snowdon-1.1-Small is the value-realigned checkpoint immediately preceding mid-training.
### Legal Results for common open legal benchmarks.
Thomson-1.0-SmallSnowdon-1.1-SmallQwen3.6-35B-A3BGemma 4-31BHaiku 4.5
PRBench Hard
31.425.926.925.219.3
Stanford LegalBench
79.980.980.383.180.7
Lexam MCQ4 (en)
72.275.675.887.472.2
MBE Bar Exam
83.483.180.188.877.3
Contract Scrub
44.638.539.654.836.5
Query Sufficiency
59.454.855.751.747.4
Harvey Legal Agent Bench.
73.471.569.530.260.5
  1. Every model is evaluated through the same harness, on identical prompts, with comparable inference parameters and grading pipelines designed to faithfully measure performance rather than incidental artefacts.
  2. No model is granted retrieval or tool access unless the benchmark itself defines it, in which case all models receive the same tools.
  3. Scores are percentages. The best result in each row is shown in bold.
### General Capability Preservation Benchmark results for popular general capability benchmarks.
Thomson-1.0-SmallSnowdon-1.1-SmallQwen3.6-35B-A3B
AIME 2026
90.093.386.7
FaithEval-Inconsistent
97.796.796.9
GDPval
71.675.873.7
GPQA-Diamond
85.485.485.2
Humanity's Last Exam
13.413.314.1
IFEval
91.090.091.1
MGSM
90.287.488.9
MMLU-Pro
85.785.285.2
SimpleQA-Verified
22.522.121.2
SWE-bench Pro
34.432.934.3
Tau2: Telecom
100.098.3100.0
Terminal-Bench 2.1
40.538.445.2
WritingBench
81.079.379.5
  1. These benchmarks were not targeted during training. They measure whether Continual Learning preserves the broad capabilities inherited from the starting checkpoint.
  2. Benchmarks are evaluated using the UK AI Security Institute's Inspect AI framework and its accompanying inspect_evals task implementations.
  3. Scores are percentages. The best result in each row is shown in bold; ties are all shown in bold.
## Quickstart > [!Note] > The model weights are compatible with Hugging Face Transformers, vLLM, SGLang, TokenSpeed, etc. ```python from transformers import AutoModelForCausalLM, AutoTokenizer model_id = "thomsonreuters/Thomson-1.0-Small" tokenizer = AutoTokenizer.from_pretrained(model_id) model = AutoModelForCausalLM.from_pretrained( model_id, dtype="auto", device_map="auto", ) messages = [{"role": "user", "content": ""}] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, return_tensors="pt" ).to(model.device) outputs = model.generate(inputs, max_new_tokens=2048) print(tokenizer.decode(outputs[0][inputs.shape[-1]:], skip_special_tokens=True)) ``` ## Citation ```bibtex @misc{chen2026thomsoncontinuallearningfrontier, title={Thomson: Continual Learning of Frontier Models for SovereignAI}, author={Shengzhuang Chen and Jerrod Parker and Yejin Bang and Andrew M. Bean and Nabeel Seedat and Stefan Winzeck and Daniil Glazko and Jannik Zgraggen and Fangyi Yu and Scott Arnott and Dietrich Trautmann and Luca Ciuffreda and Guglielmo Bonifazi and Davide Romano and Bradley Bell and Kirsty Fielding and Daniele Giofrè and Tom Zielund and Ipshita Chatterjee and Sneha Murthy Ghantasala and Manpreet Nanreh and John Scoville and Maciej Sakowicz and Wassim Seifeddine and Lukas Thede and Jonathan Richard Schwarz}, year={2026}, eprint={2608.27147}, archivePrefix={arXiv}, primaryClass={cs.AI}, url={https://arxiv.org/abs/2608.27147}, } ``` ## Correspondence `{first.last}@thomsonreuters.com` ## Acknowledgements Developed by Thomson Reuters, in partnership with Imperial College London, DatologyAI, and Lambda. Value re-alignment was co-authored by Imperial College London; continual pre-training data was curated in partnership with DatologyAI.