Add monitor retry for UDP servers and clean timeouts and intervals when we are closing