[minor] Clean up eventlisteners after the timeout