Remove cluster from handles struct

Cluster should not be in the handles struct because it becomes part of
the detection object and gets serialized when we do spmd.