Only load client and config if needed

Also, hard exit if config file is missing so errors aren't thrown.