Remove some casts
Since we made set_payload take a void pointer, we don't need these casts anymore.