Revert "Add config knobs for sphinx server."

This reverts commit 6bb4a3cba27dddfc51e99fffe4097f156c1d9d9f.