Move task_done to finally: section for katcp_server