hayulalab/collective-voting-paper

Collective Voting: Multi-Model Ensemble Inference on Unified Memory — Hayula Research

Hayula AI Lab

Abstract

Ensemble methods improve prediction quality by combining multiple independent models. While effective, ensembles are rarely deployed in production AI inference due to the memory cost of loading multiple models simultaneously. The Apple M2 Ultra with 192GB unified memory changes this calculus: we can load 2-3 70B-parameter models at 4-bit quantization (~40GB each) alongside a routing ensemble layer, with memory remaining for KV cache. We propose Collective Voting, an inference framework that runs

Files

File	Description
paper.md	Full paper (Markdown)
README.md	This model card

Citation

@techreport{hayulalab2026collectivevoting,
    title={Collective Voting: Multi-Model Ensemble Inference on Unified Memory — Hayula Research},
    author={Hayula AI Lab},
    year={2026},
    url={https://huggingface.co/hayulalab/collective-voting-paper}
}

---

hayulalab — Open Source AI Research