Support for gesture tracking in hardware manager