Make shutdown clean, need to have received all requested encoded and decoded frames.