Add a filter to prevent duplication of data

Add a filter to prevent duplication of data