Eagerly load libs if needed for tasks

Fixes #1125