Sibling caption classifier refinement to avoid double parsing