You can challenge the banker at any time and if you beat their hand, you can take over the banker role for the remainder of the shoe.