Ensure that when building filter fields that filter doesn't already exist

This prevents duplicates from being created/inserted.