Just for clarification: this is so you can decide what should be injected by Dagger and what should be injected by Jersey correct?

I would guess that you could also add all of the providers that are contributed to Jersey into a module of its own and use that for injection.  I'm guessing that would limit you from using method level injection, however.