No, inactive plugins do not slow down your website. Only the activated plugins are loaded when the website loads and the inactive plugins are ignored.