A video image encoding device comprising: a group configuration determination unit configured to determine a group to which each of a plurality of blocks belongs, the plurality of blocks being obtained by dividing each picture included in video image data; a group information addition unit configured to add, to an output stream, group information expressing the group to which each of the plurality of blocks belongs; a decode time determination unit configured to calculate a decode time and determine decode delay for each of the groups and add delay information including the decode time and the decode delay to the output stream, wherein decode delay indicates a delay imposed on the initiation of a decoding process of each of the groups; an output time determination unit configured to calculate a display time and determine output delay for each of the groups and add group output delay information including the display time and the output delay to the output stream, wherein output delay indicates a delay imposed on the initiation of an output process of each of the groups; an encode amount control unit configured to control an encode amount so that data used for decoding all of the blocks included in one of the groups arrives at a receiving buffer of a decoding device by a time expressed by the display time and the output delay of the one of the groups in the group output delay information from the output time determination unit, when the data is transmitted to the decoding device at a predetermined transmission rate; an encoding process unit configured to perform encoding based on the controlled encode amount from the encode amount control unit; and an information amount control unit configured to control an information amount of the output stream when the data used for decoding all of the blocks in one of the groups of a picture does not arrive at the receiving buffer of the decoding device by the display time of the one of the groups in the group output delay information so that first data in a next picture immediately after the picture to which the one of the groups belongs does not arrive at the receiving buffer of the decoding device by a next display time of a leading one of the groups of the next picture. a group configuration determination unit configured to determine a group to which each of a plurality of blocks belongs, the plurality of blocks being obtained by dividing each picture included in video image data; a group information addition unit configured to add, to an output stream, group information expressing the group to which each of the plurality of blocks belongs; a decode time determination unit configured to calculate a decode time and determine decode delay for each of the groups and add delay information including the decode time and the decode delay to the output stream, wherein decode delay indicates a delay imposed on the initiation of a decoding process of each of the groups; an output time determination unit configured to calculate a display time and determine output delay for each of the groups and add group output delay information including the display time and the output delay to the output stream, wherein output delay indicates a delay imposed on the initiation of an output process of each of the groups; an encode amount control unit configured to control an encode amount so that data used for decoding all of the blocks included in one of the groups arrives at a receiving buffer of a decoding device by a time expressed by the display time and the output delay of the one of the groups in the group output delay information from the output time determination unit, when the data is transmitted to the decoding device at a predetermined transmission rate; an encoding process unit configured to perform encoding based on the controlled encode amount from the encode amount control unit; and an information amount control unit configured to control an information amount of the output stream when the data used for decoding all of the blocks in one of the groups of a picture does not arrive at the receiving buffer of the decoding device by the display time of the one of the groups in the group output delay information so that first data in a next picture immediately after the picture to which the one of the groups belongs does not arrive at the receiving buffer of the decoding device by a next display time of a leading one of the groups of the next picture.