Actually keep track of pin timeouts