Only pop source_address from kwargs after saving it

This test is no longer accurate