Block click actions even if next click is later

So we don't end up having the click event go through the button.