Abstract: In a multiplexer, a channel selection controller determines which channel code is to be selected for a control data generator, each of multiplex buffers, and null packet generator, a PTS/DTS controller replaces PTS with DTS in a program being multiplexed, an output controller reads and deliver TS at a time synchronous with a system clock, and a virtual decoder buffer simulates each of T-STD buffers as in MPEG2.

Abstract: A data structure suited to efficiently representing a plurality of image streams including common and non-common portions. Specifically, a plurality of similar group of picture (GOP) data structures representing the corresponding plurality of image streams including common and non-common portions is adapted to provide a first encoded stream comprising only P-picture and B-picture access units of one of the similar GOP data structures, and a corresponding plurality of encoded streams comprising only respective I-picture access units of the similar GOP data structures. In this manner, the redundant P-picture and B-picture access units within the encoded streams are eliminated, thereby greatly reducing the bandwidth or memory resources needed to transmit or store the plurality of image streams.

Abstract: A transmitting system which comprises a transmission line, a transmitting apparatus connected to the transmission line, and a receiving apparatus connected to the transmission line, and transmits data between the transmitting apparatus and the receiving apparatus, wherein the transmitting apparatus comprises packet compressing means which receives input data comprising plural packets having identifiers as an input, identifies packets to be discarded and effective packets according to the identifiers, and outputs compression information indicating the number of continuously discarded packets and the effective packets to the transmission line, and the receiving apparatus comprises packet restoring means which receives the compression information and the effective packets which have been output from the transmitting apparatus, generates ineffective, packets which are as many as the discarded packets, and outputs the ineffective packets and the effective packets.

Abstract: An MPEG2 decoded video signal is accompanied by a representation of the coding decisions to aid downstream re-encoding. The representation is MPEG compliant bit modified to reduce the number of bits.

Abstract: The present invention relates in general to producing of digital information and digital broadcasting and more specifically to system and method for combining video stream with digital information. The presented solution for combining video stream with digital information can be utilized in different future networks, such as digital television networks, third generation mobile networks and IP networks (IP, Internet Protocol).

Abstract: A multimedia data decoding apparatus to decode multimedia data and method thereof includes a data information extracting unit extracting detail information from the multimedia data. An input buffering unit stores the multimedia data for a predetermined time. A decoding unit decodes the multimedia data from the input buffering unit into original signals of respective types. An output buffering unit stores the decoded multimedia data for a predetermined time. A control unit determines buffering capacities of the input buffering unit and the output buffering unit based on the detail information extracted by the data information extracting unit.

Abstract: An image processing method and apparatus for encoding and decoding image and sound data in which sound or other data is imprinted into key frame images. In encoding, an image input unit receives a first image and a second image (key frames). A matching processor performs a pixel-by-pixel matching between the images and transmits a corresponding point file to an imprinting unit. Sound data acquired by a sound input unit are also transmitted to the imprinting unit. The corresponding point file and the sound data are imprinted into the first image and an altered first image is generated. In decoding, the corresponding point file and sound data are extracted, the corresponding point file is used to generate intermediate images between the key frames to provide a motion picture, and the sound data is reproduced in synchronization with the motion picture.

Abstract: Each of the data amount of a video stream multiplexed in one video frame period and the data amount of an audio stream multiplexed in a predetermined period is almost constant in any video frame period. The data amount of a transport stream generated in one video frame period is almost constant in any video frame period. In addition, corresponding to a target video encoding rate and a target audio encoding rate, schedule data for multiplexing a video stream and an audio stream is generated. Corresponding to the schedule data, a video stream and an audio stream are multiplexed and output as a transport stream to a decoding unit so that an SDT buffer of the decoding unit does not overflow.

Abstract: According to one embodiment, a system is disclosed. The system includes a transmission device that converts a transport stream in to a transport stream file (TSF), a transmission medium coupled to the transmission device and a set top appliance, coupled to the transmission medium that receives the TSF.

Abstract: The present invention provides a data stream processing apparatus which records a data stream supplied via a network. An MPEG2 partial TS and channel bandwidth information are read from a recording medium, and a bandwidth of an IEEE 1394 serial data bus is secured on the basis of the read channel bandwidth information. MPEG2-TS packets read out are buffered and time stamps are generated based on PCR decoded for a period of the buffering. Subsequently, a head having stored therein a time stamp is appended to each of the MPEG2-TS packets to generate a source packet and the source packet is sent to the other electronic device by the use of the secured channel bandwidth of the IEEE 1394 serial data bus.

Abstract: A technique to provide low branch-mispredict for MPEG run length encoding. Packed data instructions are used to reorder data when loading into registers. A bitmask is then created to identify zero and non-zero values. An index is generated from the bitmask and locations of the non-zero values are determined. Subsequently, the run-length of the zeros are calculated to encode the data for output based on one of the MPEG standards.

Abstract: A method and a system is provided for embedding and detecting additional information, such as copyright information, in audio data, so that a modification in the sonic quality due to the embedding is imperceptible to human beings, and does not drastically deteriorate the sonic quality.

Abstract: A video signal, an audio signal, and a control signal to be used for control at the receiving end are time-division-multiplexed and transmitted.

Abstract: A digital signal processing apparatus including a time stamp generator generating a reference time having a same format as a first time stamp added to each packet of an inputted digital signal, a comparator comparing the first time stamp added to each packet of the inputted digital signal with the reference time, a time stamp converter converting the first time stamp added to each packet of the inputted digital signal into a second time stamp having a different format than the first time stamp, and an output circuit outputting an outputted digital signal in the form of a plurality of packets having the second time stamp converted by the time stamp converter added to each packet when the first time stamp of each packet of the inputted digital signal coincides with the reference time.

Abstract: According to a data display method, data having a program unit and instruction data for the program unit multiplexed on bit stream data is received. The program unit is extracted from the received data and is stored in a memory. The instruction data is extracted from the received data, and the program unit or part thereof specified by the instruction data is read from the memory and is executed. Then, the bit stream data and the execution result are displayed. This ensures smooth synchronization of reproduction of a bit stream with execution of an associated program and efficient use of resources.

Abstract: The object of this invention is to realize the correct and prompt synchronization of data in decoding and reproducing multiplexed coded data multiplexed with a plurality of media coded data in the unit of packet without regard to the configuration or characteristics of the apparatus. To achieve a data decoder that can synchronize the video and audio data correctly, the timing controller obtains a buffering time indicated by the time difference between the decoding end time and the specified presentation time contained in the data, and data buffering is performed by buffer memory. The video decoding end time is latched from the system time counter according to a timing pulse generated by the video decoder when the first decoded data is output from video decoder after the data decoder is activated.

Abstract: A method and an apparatus for synchronized play back of audio-video signals, even when plural digitally compressed audio data are separated and played back, avoid time lag or lead of reference time after the audio data are changed over and can improve the performance of play back of audio data synchronizing with video data, is provided. An apparatus for synchronized play back of audio-video signals decodes and plays back and displays plural digitally compressed audio data and digitally compressed video data. When the audio data to be decoded are changed over, a reference time generator calculates reference time base on the amount of played back data of the changed over decoded audio data. With this reference time, a synchronizing controller controls a video decoder and makes the decoded video data and the changed over audio data synchronize and plays back and displays the audio data and the video data.

Abstract: A method of operating a digital video processor to continuously demultiplex, store and decode audio and video data streams and play back corresponding frames of audio and video. The processor further continuously demultiplexes, stores and decodes a first subpicture data stream and plays back first subpicture data in synchronization with the playback of frames of video data. PTS values associated with SPU's in the first subpicture data stream are continuously stored. The processor then detects a command instructing a transition from a first subpicture data stream to a second subpicture data stream and stores a PTS value associated with a first complete SPU of the second subpicture data stream so that it follows a PTS value associated with a last complete SPU in the first subpicture data stream. The processor then continuously stores PTS values associated with the SPU's in the second subpicture data stream.

Abstract: An apparatus in a digital network receives at least one input transport stream having a plurality of PID streams and outputs at least one transport streams. The apparatus demultiplexes the at least one input transport streams and determines whether to: decrypt packets included in the at least one input transport stream; statistically multiplex a group of PID streams included in the at least one input transport stream; and encrypt packets included in the at least one input transport stream.

Abstract: The image decoding apparatus includes first clock reproducing means 20 for reproducing the first clock signal 21 from a time stamp signal 19 extracted from a digital transport stream 5, decoding means 8 for decoding a digital video stream 7 and outputting the first digital video signal 9 synchronizing with the first clock signal 21 and having the first frame frequency, graphic generating means 10, overlaying means 12 for overlaying the first digital video signal 9 and the graphic signal 11 and outputting the first overlaid digital video signal 15 synchronizing with the first clock signal 21, and digital-to-analog converting means 16 for converting the first overlaid digital video signal 15 into an analog signal 17, and an image without any missing frames or display disturbances can be provided even when the digital video signal and the graphic signal are displayed being overlaid.

Abstract: The multiplexer device comprises a multiplexing means for multiplexing a plurality types of media information and outputting a multiplexed bit stream, a priority deciding means for deciding priority corresponding to each of the media information, and a multiplexing controller for controlling multiplexing of each of the media information according to the multiplexing means based on the priority decided by the priority deciding means. In addition the priority in each information is multiplexed.

Abstract: The inventive system mainly includes a synchronization marker at a transmitting site and a synchronization forcer at a receiving site connecting to each other via computer networks. The synchronization marker performs the sequential mark marking of frames per every marking interval. The synchronization forcer regulates the play time of the audio signals and their corresponding video signals according to their sequential marks. The inventive system can determine precisely about the minimum marking interval yielding a bounded skew requirement. Consequently, the invention satisfies any given skew requirement under various buffer size and traffic arrivals while imposing minimal overhead.

Abstract: A system for adding monitoring capability to equipment located within a video, audio and/or data production facility. A sampling device is connected to a data communications network and transmits a continuous representation of the video, audio or data being sampled over a data communications network in response to commands from an operator station. To accommodate monitoring of large numbers of sampling devices on a single network, the sampling device may encode and/or compress the video, audio or data being monitored prior to transmitting the sample over the network. The sampling device may also further reduce its contribution to network loading by providing an instant sample of the stream being sampled, such as a single video frame, either a single time, or repeatedly at regular predetermined time intervals.

Abstract: A demultiplexing and decoding apparatus for coded audio and video data realized with a simple circuit construction and reduced processing load, which processes a packet with higher priority over other packets, prior to the other packets. A plurality of TS packet buffers 73 and 74, for storing input TS packets until they are interpreted, are set in a RAM 7, and processing priority orders are respectively set in the buffers. A PID filter 31 demultiplexes a TS packet, with a PID designated in PID table 36, from a supplied transport stream. A TS packet with higher priority is stored into the TS packet buffer 73, while a TS packet with lower priority is stored into the TS packet buffer 74. Regardless of the input order, the TS packet stored in the TS packet buffer 73 is processed by the CPU 6 prior to the TS packet stored in the TS packet buffer 74.

Abstract: A wireless moving image and audio transmitting system capable of enhancing the display quality of moving image and output quality of audio without expanding the bandwidth of radio communication is disclosed. The wireless moving image and audio transmitting system comprises a moving image and audio transmitter and a portable display terminal. When the portable display terminal is near the moving image and audio transmitter, the sound input from the audio input unit of the moving image and audio transmitter is directly output from the speaker of the audio output unit. At this time, the moving image and audio transmitter transmits the input moving image at a low compression rate to the portable display terminal. Thus, the display quality of moving image and output quality of audio can be enhanced without expanding the bandwidth of radio communication.

Abstract: Normally, in an MPEG recorder, during recording, a time stamp counter is locked to the program clock reference of the incoming stream by pulling the clock frequency of a controllable oscillator. During playback, the oscillator is left free running. Playback and recording situations lead to conflicting requirements. By using an adder that adds an increment value to a count value in order to obtain the next count value, these conflicts can be resolved. The time stamp values are derived from the count values. During recording, the value of the increment value is controllable, and during playback, the value of the increment value is fixed.

Abstract: A relay server obtains web data including a motion picture from a WWW server, and embeds control code composed of a script or bytecode in the obtained web data to generate web data for synchronization. The control code is sent to each of clients, and becomes a controller to control the browser in the same client. When one of the clients sends manipulating information indicating manipulation of the motion picture such as playback, stop, etc. to the relay server, the same relay server receive the manipulating information, and broadcast it to all of the clients including the sender. The controller of each client receives the manipulating information, and executes playback, stop, etc. in synchronization.

Abstract: In order to control the coding quantity depending on the processing situation at the terminal when decoding or synthesizing plural pictures or sounds simultaneously, the decoding apparatus of the invention comprises a reception control unit 11 for receiving the information, a separation unit 12 for analyzing and separating the received information, a priority decision unit 14 for determining the priority of processing of the pictures separated in the separation unit 12, a picture expanding unit 18 for expanding the pictures according to the determined priority, s picture synthesizing unit 19 for synthesizing the pictures on the basis of the expanded pictures, a synthesis result accumulating unit 22 for accumulating the synthesized pictures, a reproduction time control unit 23 for controlling the time for starting reproduction, and an output unit 24 for delivering the result of synthesis according to the information of the reproduction time control unit 23.

Abstract: A method and apparatus for recording digital data streams. When a digital broadcast data stream received by a set top box is transmitted through a communication interface such as an IEEE-1394 bus to a streamer, program clock references contained in the data stream become different from the actual arrival time of the digital data stream because of different clock frequencies of the digital data stream and communication interface. The difference is compensated before the digital data stream is recorded on the streamer. The method in accordance with the present invention comprises detecting program clock references contained in received digital transport stream packets, creating the transport time reference of each transport stream packet based upon the detected program clock references and arrival times of the transport stream packets, and creating transport stream units by adding each of the created transport time reference to the associated transport stream packet.

Abstract: Primary programs (P1, P2, . . . ) and commercials (=secondary programs C1, C2, . . . ) are transmitted alternately and, in the “normal mode” of a display system according to the invention, they are applied directly to a display (3). Tertiary programs (C1*, C2*, . . . ) with commercials are transmitted in parallel and expanded in time, i.e. with a small-bandwidth, and are continuously stored in a memory (4). When the user presses “pause” during the “normal mode”, the tertiary programs (commercials C1*, . . . ) that have been recorded until then will be shown, and the program (P3, . . . ) itself will be delayed, i.e. stored in a buffer (5). When the user resumes watching, he can start with the primary program (P3) where he left off and (some of the) the commercials (C3, C4, . . . ) broadcast at the end of the program will not be shown.

Abstract: A digital data transmission apparatus and a transmission method thereof in accordance with the present invention includes a reproduction section for reproducing digital data of n (n is an integer of 2 or more) channels from a recording medium, a multiplexing section for dividing one frame in a television signal into n transmission areas on a line-by-line basis, and multiplexing digital data of the n channels reproduced by the reproduction section on the n corresponding transmission areas on the line-by-line basis, and a transmitting section for transmitting data multiplexed by the multiplexing section.

Abstract: A digital data transmission apparatus and a transmission method thereof in accordance with the present invention includes a reproduction section for reproducing digital data of n (n is an integer of 2 or more) channels from a recording medium, a multiplexing section for dividing one frame in a television signal into n transmission areas on a line-by-line basis, and multiplexing digital data of the n channels reproduced by the reproduction section on the n corresponding transmission areas on the line-by-line basis, and a transmitting section for transmitting data multiplexed by the multiplexing section.

Abstract: A digital information processing system ensures illegal-copy protection of video and audio signals without changing the structure or format of a stream of multiplexed video, audio and data packets. A packet demultiplexer selects packets from a packet stream according to the packet identifiers (PID) of the packets. The packet demultiplexer has a first output port electrically connected to video and audio signal decoders, and a second output port for digital processing such as storage. When a selected packet is a video or audio packet, the packet demultiplexer outputs the selected packet through the first output port. When the selected packet is a data packet, and packet demultiplexer outputs the selected packet through the second output port.

Abstract: The production of an interleaved multimedia stream for servers and client computers coupled to each other by a diverse computer network which includes local area networks (LANs) and/or wide area networks (WANs) such as the internet. Interleaved multimedia streams can include compressed video frames for display in a video window, accompanying compressed audio frames and annotation frames. In one embodiment, a producer captures separate video/audio frames and generates an interleaved multimedia file. In another embodiment, the interleaved file include annotation frames which provide either pointer(s) to the event(s) of interest or include displayable data embedded within the annotation stream. The interleaved file is then stored in the web server for subsequent retrieval by client computer(s) in a coordinated manner, so that the client computer(s) is able to synchronously display the video frames and displayable event(s) in a video window and event window(s), respectively.

Abstract: A text data extraction system analyzes one or more interleaved video data streams and parses the stream(s) to extract text data from text data packets. In addition, presentation time data is extracted to facilitate independent use of the text data from corresponding video data. Extracted time coded text data is stored so that the presentation time data can be used to link the extracted text data back to the corresponding video data to facilitate for example: annotation of a movie, text searching of closed caption text, printing transcripts of closed caption text, controlling video playback, such as the order in which scenes are played back, and any other suitable navigation or manipulation of video images or text data.

Abstract: A recording medium having content stream data recorded thereon and a recording and reproducing apparatus provided thereof. On the recording medium, content stream data is recorded as a Stream OBject (SOB) formed with at least one Stream OBject Unit (SOBU), each of which has a predetermined size and one or more stream packs. Each of the stream packs has an Application Time Stamp (ATS) indicating reproducing time information and an application packet in which content stream data is packed therein. Each of the SOBUs, excluding a last one of the SOBUs and SOBUs having stuffing packets, includes at least two entire ATSs. Thus, an incremental application packet arrival time (IAPAT) of each of the SOBUs can be correctly obtained, and program searching referring to a mapping list is smoothly performed without error.

Abstract: A system for playing a selected one of multiple audio tracks recorded in synchronized fashion with a motion picture on an optical disk. The optical disk has encoded on it a mixing master music and effects (“M&E”) track, or a switching master M&E track. Individual audio tracks are provided for language-specific versions of the same motion picture, but these tracks have data recorded in them only where there is dialog. In this way, for many a motion picture, all tracks but masters will have data recorded for well less than half of the running time of the motion picture. When a mixing master is used, it is mixed with a language-specific track when the latter has dialog; the mixing master contains no dialog. If a switching master is used, it may contain dialog recorded with the M&E; when a language-specific track has dialog recorded in it, it also contains M&E and the track is played to the exclusion of the switching master.

Abstract: A decoding buffer capacity necessary for decoding N pieces of digital data, including a picture, audio, a character and another form of data, is found beforehand. Then the found capacity is compared with a predetermined value. M pieces of digital data are selected out of the N pieces of digital data so that a total buffer capacity necessary for decoding the M pieces of digital data is not more than the predetermined value. Then the M pieces of digital data are multiplexed and supplied as one multiplexed data. This data multiplexing method enables systems having different buffer capacities in their own decoders to exactly decode digital data by changing decoding buffer capacities that are predetermined. As a result, a transmission free from missing an important data is realized.

Abstract: The present invention relates to a method and apparatus for detecting a high definition television signal (e.g., a high definition MPEG2 data stream) and re-encoding the high definition signal to create a standard definition television signal. In particular, the invention involves re-encoding a copy of the high definition (HD) signal into a standard definition (SD) signal and combining both the original signal and the re-encoded standard definition signal into a multiplexed signal. The provision of both an SD signal and an HD signal in the multiplexed signal enables both SD television receivers and HD television receivers to receive content initially provided as an HD signal. The re-encoding may be performed, for example, at a cable television system headend. The HD television signal may contain one or more television services (channels). The invention enables backward compatibility between an HD data stream and SD receivers.

Abstract: A transport packet generation apparatus and method used in a system which delivers content such as movies and music is disclosed. This invention provides a mechanism for providing and retrieving content on a medium such as a DVD optical disc. One aspect of the present invention provides content by processing and packing data packets onto the medium. A further aspect of the present invention retrieves content by reading data off the medium and processing the data to functionally reconstruct the original data packets for use in the system for delivering content.

Abstract: In an image transmission method of the first embodiment, as shown in FIG. 1, when compressed image data Dv obtained by compressively coding digital image data corresponding to a moving picture is transmitted, an identification flag Hfd indicating whether or not the compressed image data is suitable for use in random and independent reproduction, is transmitted subsequently to a synchronous signal Hsd positioned at the beginning of a header Hv. At a reproducing end for reproducing the compressed image data transmitted according to the image transmission method, when analyzing the header Hv added to the compressed image data Dv corresponding to one moving picture, it is decided whether or not the compressed image data Dv is suitable for use in the random reproduction in a short time, by analysis of the identification flag Hfd.

Abstract: A demultiplexer is provided with a PID extractor for extracting a PID of each TS packet from an inputted transport stream; a PID comparator for detecting whether or not the extracted PID matches any of PIDs which are set on a PID table, and outputting an entry number of the PID table where the corresponding PID is set, as a matching PID entry number, when a match is detected; a packet selector for selecting TS packets whose PIDs are detected by the PID comparator; and a data storage controller for determining an area in a memory where each TS packet is to be stored, according to the matching PID entry number; wherein TS packets having different PIDs are multiplexed and stored into a video data storage area in the memory. Therefore, when plural kinds of video data are included in the same program on digital broadcasting, these plural kinds of video data can be reproduced simultaneously.

Abstract: The present invention concerns a method for cascading detachable conditional access modules as well as a circuit for inserting a predetermined sequence and a circuit for detecting the sequence. Each module receives a data stream formed of packets of fixed length separated by an interpacket space of fixed length. The interpacket spaces contain a constant predetermined sequence which does not interfere with the packets. The predetermined sequence may be used to regenerate a packet clock signal.

Abstract: A digital television transmitting system is presented having a recovery circuit for recovering non-return to zero (NRZ) data pulses and transport clock pulses from a biphase-mark serial data pulse stream and wherein the recovered NRZ data pulses and the recovered transport clock pulses are applied to modulation and amplifying circuits for broadcasting by an antenna. The recovery circuit includes a first circuit for receiving the biphase-mark serial pulse stream and providing therefrom a train of first clock pulses wherein the rising edge of each the biphase-mark pulse corresponds with a rising edge of one of the first clock pulses. A second circuit receives the biphase-mark serial data pulses and the first clock pulses for providing therefrom a train of de-serialized data pulses each having a rising edge corresponding with a rising edge of one of the first clock pulses.

Abstract: A device for simultaneously transmitting a plurality of television signals comprises an adjusting circuit (5) for adjusting the bitrate for each television signal in dependence upon the complexity of this signal with respect to the joint complexity of the plurality of television signals. The device provides improvement of quality in Digital Video Broadcast systems. It has also been found to be possible to transmit extra signals through a given channel while maintaining the picture quality. Use of the device in optical recording provides the possibility of a longer playing time.

Abstract: An improved audio-visual circuit is provided that includes a transport packet parsing circuit for receiving a transport data packet stream, a CPU circuit for initializing said integrated circuit and for processing portions of said data packet stream, a ROM circuit for storing data, a RAM circuit for storing data, an audio decoder circuit for decoding audio portions of said data packet stream, a video decoder circuit for decoding video portions of said data packet stream, an NTSC/PAL encoding circuit for encoding video portions of said data packet stream, an OSD coprocessor circuit for processing OSD portions of said data packets, a traffic controller circuit moving portions of said data packet stream between portions of said integrated circuit, an extension bus interface circuit, a P1394 interface circuit, a communication coprocessors circuit, an address bus connected to said circuits, and a data bus connected to said circuits.

Abstract: A digital video processor and operating method for a receiving raw audio and video data representing images and sound to be played. The processor includes a demultiplexer for receiving the raw audio and video data and providing demultiplexed audio and video data to a memory. A first system time clock provides first time values in response to being continuously clocked by the demultiplexer. A CPU decodes and plays back the audio and video data as a function of the audio and video PTS values. The processor further includes a second system time clock providing second time values in response to being periodically incremented by the CPU. The CPU periodically sets the second system time clock to a second time value equal to a current first time value of the first system time clock in response to a standard play mode, and the CPU periodically sets the first system time clock to a first time value equal to a current second time value of the second system time clock in response to a trick play mode.

Abstract: A multiplexed data producing apparatus which multiplexes N (integer) pieces of object data in which one of video data, audio data, and digital data is multiplexed to produce one piece of multiplexed data comprises a temporal storage means for temporarily storing the N pieces of object data; a control means for controlling synchronization of time information of each object data for each temporarily stored object data; and a multiplexing means for multiplexing the processed object data to produce multiplexed data.

Abstract: Video assist control systems and methods for use in film/video production environments are presented which provide a link between production and post-production by storing and managing both recorded media and production information. Multiple video signals (including audio) may be selectively received and simultaneously digitally recorded and stored, along with time code information, with near instantaneous playback capability for multiple current and past recordings. Database functionality is incorporated to provide for entry and storage of information associated with each recording. The database provides searching capabilities to locate and retrieve past recordings, based on stored information, for playback review, editing and assembly of recordings or portions thereof.

Abstract: When MPEG streams are connected, audio data is connected without losing continuity, so that playback data which is not unnatural is obtained. In a case where data of videos of a stream is connected to immediately after another video of another stream and these are edited to create still another stream, if a soundless portion occurs, or if an audio is directly connected to another audio and the audio data leads the video data, unnatural playback data results. Therefore, by inserting still another audio, as audio data at the connection point of the still another stream, corresponding to the video to be erased between the still another audio and still another audio, playback data which is not unnatural can be obtained.