Fix running shipped bins by using a config file

This should get everything working again.

MSP-10817