President Bush will visit the U.S. Gulf Coast Sunday as the region continues to clean-up from Hurricane Katrina .