As Saudi Arabia is considered by some to be an alternative destination for terror suspects who would otherwise go to Yemen , the options may continue to narrow for where to send detainees the administration does not want to keep in U.S. custody .