Load deps once

See #182 and #184 for the background. This PR is for `1.4-wip` not `master` as #184 was setup. (#200 reverted the change in `master`)