Add option for dynamic modules

Especially handy in a multi-tenancy setup where each tenant might not want the same modules and keys.