Make stop actually stop background servers