perf(element binder): Do not create tasklists when not needed

This code was originally authored by @mhevery in the
DirectiveInjector change.