Make signal batching to behave more intuitively when not executing ops

Other parts of the system rely on signals outside of operation execution.
By only batching the signals when an operation is being executed, these
other subsystems continue to operate correctly.

Fixes #825.