changes for separating duplicate and missing events