Yes, adding audio to your GIF file makes it slower to upload online. The thing is that audio adds information to your GIF file. And you should know that more information means a more significant file size. In fact, this is one of the reasons why most GIF files are mute.