Fixes #3870 - add a directory for module's configs