The simple answer to this question would be: no. The majority of users who enable port forwarding do so because the gaming servers will not allow them to communicate in any other way. The speed of the internet connection will not be affected, and other users on the same network should not notice any change as a result of this.