Patent ID: 7974281

Claim:
A multiplexer configured to multiplex audio data as TS (Transport Stream) packets, comprising: first encoding means configured to encode said audio data using a first encoding method serving as a predetermined encoding method; second encoding means configured to encode said audio data using a second encoding method, which is a variable-length encoding method, and also differs from said first encoding method, arranged to add a timing value representing timing employed for a case of being decoded to each predetermined audio data unit; PES packetizing means configured to packetize said audio data encoded by said first encoding means, and said audio data encoded by said second encoding means to a PES packet, and also add point-in-time information employed for a case of being decoded to a plurality of said packetized PES packets; TS packetizing means configured to packetize said PES packet PES-packetized by said PES packetizing means to a TS packet, and also add the same ID to a plurality of said packetized TS packets; determining means configured to determine TS packets to be multiplexed from a plurality of said TS packets packetized by said TS packetizing means; and multiplexing means configured to multiplex said TS packets determined by said determining means; wherein said PES packetizing means packetize said audio data encoded by said first encoding means, and said audio data encoded by said second encoding means to a PES packet such that said audio data unit satisfying a predetermined cycle appears at the head of a PES payload; wherein said determining means is configured to assume a first virtual decoder configured to decode said audio data encoded by said first encoding means, and a second virtual decoder configured to decode said audio data encoded by said second encoding means based on said timing value added to said audio data encoded by said second encoding means, and also determine TS packets to be multiplexed based on multiplexing constraints arranged to randomly access said multiplexed TS packets; and wherein said determining means determine TS packets to be multiplexed from a plurality of said TS packets packetized by said TS packetizing means based on a first elementary buffer included in said first virtual decoder and a data transfer rate as to said first elementary buffer, and a second elementary buffer included in said second virtual decoder and a data transfer rate as to said second elementary buffer.