Split extra_kwargs into source- and kernel-related ones