Infrastructure for scalable monitoring