Do you think we should make this something more along the lines of:

```py
retry_options = default_retry_options.copy()  # Maybe even deep copy, or a function that returns a new dict?
retry_options.update(task_args.pop('retry_options', {}))
task_args['retry_options'] = TaskRetryOptions(**retry_options)
```