The building served for a short period of time as the U.S. Customs House .
For a short time , it served as the U.S. Customs House .