Remove fields that aren't actually being given in the JSON from the server