Venezuelan President Hugo Chavez says a U.S. Navy attache accused of spying has been ordered out of the country .