only accumulate empty frames until an object has been classified again