With a 580 credit score, the amount you can borrow will depend on other factors such as your income, debt-to-income ratio, and the type of loan you're applying for. For an FHA loan, you could potentially borrow up to 96.5% of the home's value, but this will also depend on the lender's policies and your financial situation.