It matters how long ago you used payday loans. Applying for a mortgage is easy if your last payday loan was more than six years ago. This is true even if your credit score is good.