add the de-dup function while upload contents