Only set data if we have data to set.

Dont set an empty dict