A transmission device, comprising: an image encoding unit adapted to classify image data of pictures configuring moving image data into a plurality of layers, to encode the image data of the pictures of each of the plurality of layers, to divide the plurality of layers into a predetermined number of layer sets, and to generate the predetermined number of video streams including the encoded image data of the pictures of each of the layer sets, respectively, the image encoding unit being adapted to perform the encoding so that at least decoding timings of the encoded image data of the pictures of the lowest layer set are predetermined intervals and decoding timings of the encoded image data of the pictures of a layer set positioned to be higher than the lowest layer set are intermediate timings of decoding timings of the encoded image data of the pictures of all layer sets positioned to be lower than the layer set; a transmitting unit adapted to transmit a container of a predetermined format including at least a video stream having the encoded image data of the pictures of the lowest layer set among the predetermined number of generated video streams; and an information inserting unit adapted to, when a switching portion at which a sequence of the video streams to be transmitted is switched from a first sequence to a second sequence having a different frame rate from the first sequence is provided, insert display control information into at least encoded image data of a picture corresponding to the switching portion or a packet containing the encoded image data; wherein the display control information is information for performing control such that a display of a last picture of the first sequence is repeated by a predetermined number or for controlling a display period of time of the last picture of the first sequence such that a display of pictures of the second sequence is skipped. an image encoding unit adapted to classify image data of pictures configuring moving image data into a plurality of layers, to encode the image data of the pictures of each of the plurality of layers, to divide the plurality of layers into a predetermined number of layer sets, and to generate the predetermined number of video streams including the encoded image data of the pictures of each of the layer sets, respectively, the image encoding unit being adapted to perform the encoding so that at least decoding timings of the encoded image data of the pictures of the lowest layer set are predetermined intervals and decoding timings of the encoded image data of the pictures of a layer set positioned to be higher than the lowest layer set are intermediate timings of decoding timings of the encoded image data of the pictures of all layer sets positioned to be lower than the layer set; a transmitting unit adapted to transmit a container of a predetermined format including at least a video stream having the encoded image data of the pictures of the lowest layer set among the predetermined number of generated video streams; and an information inserting unit adapted to, when a switching portion at which a sequence of the video streams to be transmitted is switched from a first sequence to a second sequence having a different frame rate from the first sequence is provided, insert display control information into at least encoded image data of a picture corresponding to the switching portion or a packet containing the encoded image data; wherein the display control information is information for performing control such that a display of a last picture of the first sequence is repeated by a predetermined number or for controlling a display period of time of the last picture of the first sequence such that a display of pictures of the second sequence is skipped.