Modify response to indicate to clients that the host is shutting down

#2501