Yes! To fix this, make sure that the Bluetooth receiver is the only device in a particular USB bus. For example, you should not plug the headphones receiver into a USB hub, as it will share the same data line with other USB devices.
This is partly due to how Linux manages data through USB, as well as how PulseAudio interprets that same data. Some USB peripherals such as mice and keyboards tend to crowd the USB bus, leaving the audio receiver waiting for those peripherals to finish which, in turn, stutters the audio.