add the circular buffer for de-duplication process