Make signal batching to behave more intuitively when not executing ops

Other parts of the system rely on signals outside of operation execution. By only batching the signals when an operation is being executed, these other subsystems continue to operate correctly.

Fixes #825.