direct-to-evt: keep state even when not selected

We now save the state within the event in order to prevent dropping
portion of the computation done on an incomplete input from the port.

Signed-off-by: Jan Dvořák <mordae@anilinux.org>