The answer is yes. We know Google is a user experience company, and high bounce rates mean that your site is not focusing on UX. Hence, your rankings can tank.