logging improvement related to skipping due to duplicates