Asylum seekers can and should start to build their U.S. credit history as soon as possible after arriving in the United States. A good U.S. credit history can be built by making regular credit card payments or purchasing a large ticket item with credit.