Clean up settings management for kronos tests

Test Plan: Existing tests all work.

Reviewers: marcua, jblum

Reviewed By: marcua

Differential Revision: https://phabricator.locu.com/D6736