Don't call listen daemon again if should quit.