Text Classification
Transformers
decision-model
latent-reasoning
recurrent-depth
adaptive-compute
multilingual
Instructions to use d2v1shx/dazo with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use d2v1shx/dazo with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="d2v1shx/dazo")# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("d2v1shx/dazo", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Dazo
Dazo is an experimental recurrent latent decision model. It is designed to spend variable test-time compute on structured decisions without generating a natural-language chain of thought.
Dazo is not a pretrained general-purpose checkpoint yet. The initial release is a research architecture and training harness.
Architecture
- A bidirectional encoder reads the evidence/context.
- Candidate actions/labels are encoded separately rather than packed into the context sequence.
- A Perceiver-style cross-attention compressor maps the evidence into a fixed latent workspace.
- A weight-tied recurrent Transformer repeatedly refines that workspace.
- Candidate options query the workspace in parallel to produce a calibrated probability distribution.
- A separate critic predicts correctness/abstention, while recurrent convergence and a learned halt probability provide stopping signals.
The v0 workspace uses evidence, hypothesis, critic, and control slots. The option decoder is permutation-equivariant for categorical decisions; ordinal options carry explicit semantic rank IDs.
Intended research questions
- Does accuracy increase when Dazo receives more recurrent inference steps on problems requiring deeper composition?
- Can Dazo generalize from shallow training chains to deeper unseen chains by increasing recurrence at test time?
- Can adaptive stopping avoid the known recurrent-depth failure mode of overthinking?
- Does separate option encoding eliminate the high-cardinality and option-order bottlenecks seen in prompt-packed decision models?
Status
Research prototype. Do not treat probabilities as production-calibrated until the model is trained and calibrated on the deployment domain.
Model tree for d2v1shx/dazo
Base model
jhu-clsp/mmBERT-small