The majority of website browsing is now done on mobile devices that are both constrained by bandwidth and processing power, in comparison to a home computer. Google also now indexes mobile-friendly websites first. Speed influences user-engagement, and user-engagement influences Google, so if mobile users go back to Google after clicking your website, this is a negative signal.