Yes, a slow internet connection can adversely affect your Xbox's download speeds. Ensure that you have a stable and high-speed internet connection for optimal performance.