After you've saved the changed you made to the button it can take up to 10 minutes for those changes to be reflected in the button. The reason for this is that your changes have to be applied to the database server and our cache has to be updated with your latest version.
It's also smart to check if the toggle next to your button in the overview is set to active and that you've saved your changes.