A computer-implemented method comprising: encoding video to produce encoded data, including: buffering, for each of a plurality of previously coded blocks (631 - 633) that have been encoded before a current block of a current picture that is to be encoded, an actual motion vector, MV, value used during encoding of the previously coded block and related to a used reference picture from multiple reference pictures (660, 670), and a candidate MV value for each of the other reference pictures of the multiple reference pictures (660, 670) evaluated during motion estimation for the previously coded block but not used during encoding of the previously coded block; performing motion estimation for the current block of the current picture to select a MV value for the current block, including evaluating one or more candidate MV values for the current block in each of the multiple reference pictures (660, 670), the one or more candidate MV values obtained using a search process starting in each of the multiple reference pictures (660, 670) from a starting point in each of the multiple reference pictures that is likely to yield a MV value with good prediction, wherein, for each of the multiple reference pictures (660, 670), the starting point for the motion estimation is determined using one or more MV values (641 - 643) buffered for the plurality of previously coded blocks (631 - 633) that use that reference picture; and encoding the current block using a MV value for the current block selected among the candidate MV values for the current block in the multiple reference pictures (660, 670); and outputting the encoded data in a bitstream. encoding video to produce encoded data, including: buffering, for each of a plurality of previously coded blocks (631 - 633) that have been encoded before a current block of a current picture that is to be encoded, an actual motion vector, MV, value used during encoding of the previously coded block and related to a used reference picture from multiple reference pictures (660, 670), and a candidate MV value for each of the other reference pictures of the multiple reference pictures (660, 670) evaluated during motion estimation for the previously coded block but not used during encoding of the previously coded block; performing motion estimation for the current block of the current picture to select a MV value for the current block, including evaluating one or more candidate MV values for the current block in each of the multiple reference pictures (660, 670), the one or more candidate MV values obtained using a search process starting in each of the multiple reference pictures (660, 670) from a starting point in each of the multiple reference pictures that is likely to yield a MV value with good prediction, wherein, for each of the multiple reference pictures (660, 670), the starting point for the motion estimation is determined using one or more MV values (641 - 643) buffered for the plurality of previously coded blocks (631 - 633) that use that reference picture; and encoding the current block using a MV value for the current block selected among the candidate MV values for the current block in the multiple reference pictures (660, 670); and buffering, for each of a plurality of previously coded blocks (631 - 633) that have been encoded before a current block of a current picture that is to be encoded, an actual motion vector, MV, value used during encoding of the previously coded block and related to a used reference picture from multiple reference pictures (660, 670), and a candidate MV value for each of the other reference pictures of the multiple reference pictures (660, 670) evaluated during motion estimation for the previously coded block but not used during encoding of the previously coded block; performing motion estimation for the current block of the current picture to select a MV value for the current block, including evaluating one or more candidate MV values for the current block in each of the multiple reference pictures (660, 670), the one or more candidate MV values obtained using a search process starting in each of the multiple reference pictures (660, 670) from a starting point in each of the multiple reference pictures that is likely to yield a MV value with good prediction, wherein, for each of the multiple reference pictures (660, 670), the starting point for the motion estimation is determined using one or more MV values (641 - 643) buffered for the plurality of previously coded blocks (631 - 633) that use that reference picture; and encoding the current block using a MV value for the current block selected among the candidate MV values for the current block in the multiple reference pictures (660, 670); and outputting the encoded data in a bitstream.