server: keep track of pressed buttons