Yes, you can afford a house with $20K a year. Your income is vital in getting a mortgage lender's final decision. However, there are other things that a lender looks into, like your debt to income ratio, credit score, down payment, and various other things while sanctioning a home loan.