Only configure filters for client tests

Signed-off-by: Alin Dreghiciu <adreghiciu@gmail.com>