Remove training elements in ROCs