The higher the average interest rate, the slower the housing market becomes. The cost of owning, selling or buying a home becomes more expensive the higher the interest rate.