A method for adaptively downloading digital video content, including a sequence of portions, wherein each portion is a group of pictures comprising multiple frames of video data, the method comprising: receiving a scene complexity map associated with the digital video content and specifying a complexity level associated with each portion, in the sequence of portions, of the digital video content; identifying a plurality of encoded video streams associated with the digital video content, wherein each encoded video stream is associated with a different bit rate and includes an encoded portion encoded to the different bit rate for each portion of the digital video content; receiving a sequence header index for each of the plurality of encoded video streams, each sequence header index specifying a switch point for each portion in the sequence of portions, each switch point specifying a playback offset associated with each portion, the playback offset associated with each portion being determined based on a location of the portion in the sequence of portions for each of the plurality of encoded video streams; determining, based on the scene complexity map, the complexity level associated with a first portion of the digital video content; determining during playback of a different portion of the digital video content, based on the complexity level, prevailing bandwidth conditions, and the switch point associated with the first portion of the digital video content, a first encoded video stream included in the plurality of encoded video streams from which to download a first encoded portion corresponding to the first portion of the digital video content; and downloading for playback the first encoded portion from the first encoded video stream to a content buffer residing within a content player device; wherein a highest bit rate encoded video stream only includes encoded portions having a highest complexity level, and a lesser bit rate encoded video stream includes encoded portions having a lower complexity level and the encoded portions having the highest complexity level. receiving a scene complexity map associated with the digital video content and specifying a complexity level associated with each portion, in the sequence of portions, of the digital video content; identifying a plurality of encoded video streams associated with the digital video content, wherein each encoded video stream is associated with a different bit rate and includes an encoded portion encoded to the different bit rate for each portion of the digital video content; receiving a sequence header index for each of the plurality of encoded video streams, each sequence header index specifying a switch point for each portion in the sequence of portions, each switch point specifying a playback offset associated with each portion, the playback offset associated with each portion being determined based on a location of the portion in the sequence of portions for each of the plurality of encoded video streams; determining, based on the scene complexity map, the complexity level associated with a first portion of the digital video content; determining during playback of a different portion of the digital video content, based on the complexity level, prevailing bandwidth conditions, and the switch point associated with the first portion of the digital video content, a first encoded video stream included in the plurality of encoded video streams from which to download a first encoded portion corresponding to the first portion of the digital video content; and downloading for playback the first encoded portion from the first encoded video stream to a content buffer residing within a content player device; wherein a highest bit rate encoded video stream only includes encoded portions having a highest complexity level, and a lesser bit rate encoded video stream includes encoded portions having a lower complexity level and the encoded portions having the highest complexity level.