Yes, any piece of terminal tackle, such as a swivel, will add a weak point to your fishing line. Any time you tie a knot or join two lines together, you’re introducing a point of weakness to the line. So while a swivel will create a weak point, there’s no way to avoid it since a line-to-line knot would create the same weak point as a swivel.