Information recording medium, information recording device and method, imormation reproduction device and method, information recording/reproduction device and method, computer program for controlling recording or reproduction, and data structure including control signal
Video information indicating a main video, sub-video information indicating a sub-video at least part of which can be displayed superimposedly over the main video, predetermined part coordinate information specifying the coordinates of a predetermined part included in the sub-video in the coordinate system defined with respect to the sub-video, and sub-video control information are recorded on an information recording medium. The sub-video control information includes (i) coordinates-before-movement information specifying the coordinates of a sub-frame before a movement wherein at least a part of the sub-video is the sub-frame and (ii) coordinates-after-movement information specifying the coordinates of the sub-frame after the n-th movement (n is a natural number equal to or greater than 1).
The present invention relates to: an information record medium, such as a high density optical disc, capable of recording thereon various information such as main picture information or video information, audio information, sub-picture information, reproduction control information, and so on, at high density; an apparatus for and a method of recording the information onto the information record medium; an apparatus for and a method of reproducing the information from the information record medium; an apparatus and a method capable of both recording and reproducing the information; a computer program for controlling the recording or reproduction; and a data structure including a control signal.
BACKGROUND ARTDVDs become common as optical discs onto which various information such as main picture information, audio information, sub-picture information, reproduction control information and so on is recorded. According to a DVD standard, the main picture information (video data), the audio information (audio data) and the sub-picture information (sub-picture data) are packetized each with the reproduction control information (navigation data) and are multi-recorded onto a disc in a program stream format of MPEG 2 (Moving Picture Experts Group phase 2), which is a high performance encoding technology. Among them, the main picture information has data, which is compressed in a MPEG video format (ISO 13818-2), for one stream in one program stream. On the other hand, the audio information is recorded in a plurality of formats (i.e. linear PCM, AC-3, MPEG audio and so on) and has data for up to 8 streams in one program stream. The sub-picture information is defined by a bitmap, and is compressed and recorded in a run length method, and has data for up to 32 streams in one program stream.
On the other hand, a transport stream format of MPEG2 standard is coming to be standardized, which is suitable for data transfer. According to the transport stream format, a plurality of elementary streams are transferred at the same time. For example, a plurality of programs, such as a plurality of satellite digital broadcasting channels in one satellite radio wave, are transmitted at the same time in a TDM (Time Division Multiplex) scheme.
According to DVDs of this type, sub-picture information may be recorded as sub-video information such as a caption or subtitle of a movie, in association with the video information as the main video information. Furthermore, for example, it is possible to display various button images such as a menu selection button or an operation execution button on the main picture, with the aid of the sub-picture information. In this case, it is also possible to highlight the button image with different brightness, with different colors or the like, depending on the operation status, so that the button operation status is indicated, for example whether or not the button is selected, clicked or depressed with the aid of a remote controller or the like. That is, in DVD players, on the basis of the sub-picture information and the high light information, it is possible to display a menu screen including a plurality of buttons or selectable item frames.
On the other hand, in DVD players, it is also possible to scroll up-and-down character lines displayed by means of the sub-picture information, in a display area of the sub-picture occupying a predetermined area on the displayed main picture.
DISCLOSURE OF INVENTIONHowever, according to the high light display control of the button using the sub-picture on the basis of the aforementioned DVD video standard, a position allowing the high light control by means of the high light information is fixed relative to the display screen or the main picture. That is, the high light is defined relative to the button image. For this, only simple display controls can be achieved, such as a high light display with the improved brightness of the operation button. In other words, according to the conventional DVD, there is employed a control scheme in which a highlightened image based on the high light information is overlapped on the button image as a back ground image based on the button information. For this, there is a problem that an area in which the button is highlightened is deviated from the button image, if the button image is moved by the scrolling of the sub-picture within the display area of the sub-picture displayed in a predetermined area on the main picture.
In this manner, according to the conventional DVD, there is a problem that it is technically difficult to perform a complicated and sophisticated display control using the sub-picture, for example, scrolling the sub-picture including the highlightened button.
The present invention has been accomplished in view of the above problems for example. It is therefore an object of the present invention to provide an information record medium, an information record apparatus and method, an information reproduction apparatus and method, an information record reproduction apparatus and method, a computer program for a record or reproduction control, and a data structure including a control signal for a reproduction control, which enable the complicated and sophisticated display control using the sub-video information, such as a control of scrolling the sub-picture appropriately including the highlightened button.
The information record medium according to the present invention includes: video information to indicate a main video; sub-video information to indicate a sub-video, the sub-video at least partially displayable over the main video; predetermined part coordinate information to designate coordinates of a predetermined part included in the sub-video, in a coordinate system defined with respect to the sub-video; and sub-video control information including (i) coordinates-before-movement information to indicate coordinates of a sub-frame before a movement in the coordinate system, the sub-frame being at least an area of the sub-video, and (ii) coordinates-after-movement information to indicate coordinates of the sub frame after n-th movement (n is natural number equal to or more than 1) in the coordinate system.
According to the information record medium of the invention, at the reproduction of the information record medium such as a DVD, it is possible to display, as a sub-frame, at least a part of the sub-video information, which may be made the sub-video information, as it is or after subjected to some treatment or processing, superimposed on the main video such as the main video or the video display image. Such sub-video information may be image data such as bit map data or JPEG data. Incidentally, the sub-video information may be superimposed and displayed as a whole over the main video. Alternatively, a part of the sub-video information may be cut out as a sub-frame and displayed. Alternatively, one or more sub-frames may be cut out from the same sub-video information. In the case that a plurality of sub-frames are cut out, they may be cut out in such a manner that individual pieces have any common part, or may be cut out in such a manner that individual pieces have no common part.
Then, for the reproduction of the information record medium, the coordinates of the predetermined part, which is included in the sub-video and may be the button video part including a plan view, a design, an icon, a picture and so on to indicate a button or may be an item frame having a special shape, is designated by the predetermined part coordinate information in the coordinate system defined for the sub-video. For example, if the predetermined part has a rectangular shape, such coordinates may be coordinates of opposing two or four corners. Furthermore, if the predetermined part has any arbitrary shape, the coordinates may be coordinates sufficient to identify the arbitrary shape.
Such predetermined part coordinate information may be streamed into a SPD (Sub-Picture Data) stream with the sub-video information and recorded. However, it may be streamed into a SCP (Sub-Picture Control Packet) stream with the sub-video control information and recorded, or may be recorded in other schemes, or recorded into other record areas.
Under the condition of such a data structure, a discussion is made on the case of scrolling the displayed contents of the sub-frame in the display area of the sub-frame displayed in the predetermined area on the main video. Incidentally, the display area of the sub-frame on the main video is fixed relative to the main video, if it is a simple area. That is, in the coordinate system defined for the main video, the coordinates or a range of an outline of the sub-frame is fixed. It is possible, however, to move a display position of the outline of the sub-frame itself, or change a size of the outline of the sub-frame. In any case, it is possible to change the displayed contents within the sub-frame displayed on the main video by moving the sub-frame, which is cut out from the sub-video, relative to the sub-video. Then, typically due to the movement of the sub-frame from side to side or up and down relative to the sub-video, a scroll display is achieve in the sub-frame to be finally displayed on the main video.
Before the movement of the sub-frame (i.e. before the scrolling), firstly, the coordinates of the sub-frame on the sub-video are determined with the aid of the coordinates-before-movement information, so that the sub-frame is cut out and displayed over the main video. In this case, a display position of the predetermine part such as the button video part is identified relative to the main video in a relationship with the sub-frame, on the basis of the predetermined part coordinate information and the coordinates-before-movement information. Incidentally, if there are a plurality of predetermined parts, display positions of individual predetermined parts are also identified relative to the main video, on the basis of a plurality of predetermined part coordinate information. It is possible to identify display positions of such individual predetermined parts, even if the sub-frame (or the outline thereof) is displayed in any area of the main video.
Then, after the movement of the sub-frame (i.e. after the scroll is begun), the coordinates of the sub-frame on the sub-video is identified with the aid of the coordinates-after-movement information, so that the sub-frame is cut out and displayed over the main video. In this case, the display position of the predetermined part which may be the button video part is identified relative to the main video in the relationship with the sub-frame, on the basis of the predetermined part coordinate information and the coordinates-after-movement information. Incidentally, if there are a plurality of predetermined parts, display positions of individual predetermined parts are also identified relative to the main video, on the basis of a plurality of predetermined part coordinate information. It is possible to identify display positions of such individual predetermined parts, even if the sub-frame (the outline thereof) is displayed in any area of the main video.
Therefore, in the case that a predetermined processing such as highlighting is performed relative to the predetermined part, such as the button video part, defined in the coordinate system of the sub-video, it is possible to perform the predetermined processing relative to the predetermined part even before or after the movement of the sub-frame. That is, by moving the sub-frame on the sub-video including the button video part to be highlighted, the position to be highlighted cannot be deviated from the position of the button video part defined in the coordinate system of the sub-video, even if the position of the button video part is moved within the sub-frame. Furthermore, if the sub-frame is moved continuously in accordance with a frame rate of the main video, the smooth scroll display can be achieved due to the continuous movement of the sub-frame.
Consequently, it is possible to achieve the complex and sophisticated display control using the sub-video, such as scrolling the sub-video including highlightened button.
In an aspect of the information record medium of the invention, the predetermined part is a button video part, and the predetermined part coordinate information is button position information to indicate coordinates of the button video part.
According to this aspect, in the case that the predetermined processing such as highlighting is performed relative to the button video part defined in the coordinate system of the sub-video, it is possible to perform the predetermined processing relative to the button video part even before or after the movement of the sub-frame. Therefore, it is possible to scroll appropriately the sub-frame including, for example, the highlighted button video part.
The “button position information” herein is coordinate information or area information to define the button video part, for example, as a rectangular area. Furthermore, the “button” herein may be a push button (i.e. a simple pressable button), a toggle button (i.e. a button to switch statuses every time when the button is operated), an exclusive button (i.e. a plurality of buttons allowing only one thereamong being pressed down) and the like. These buttons are operated with the aid of a remote controller, an audio input, a touch operation on a screen, a key board operation and the like. Additionally, an area of the button video part capable of acting as a button may be an entire area of the button video part, or may be an opaque part of the button video part indicated by alpha value to indicate transparency for example.
In an aspect relating to the button video part, the sub-video control information may further include first button status information to indicate an operational status of a button, which is indicated by the button video part before the movement of the sub-frame.
In such an arrangement, at the reproduction of the information record medium, it is possible to firstly display the button video part within the sub-frame, in an appropriate operating status such as a status in which each button is selectable by default or a status in which each button is not selectable by default, on the basis of the first button status information included in the reproduced sub-video control information before the movement of the sub-frame (i.e. before a scrolling). Incidentally, the “predetermined kinds of button status” includes a status allowing an operation of a button while the button is selected, not selected or executed, or a status not allowing any operation of a button.
In an aspect relating to the button video part, the sub-video control information may further include second button status information to indicate in which status a button, which is indicated by the button video part after the n-th movement of the sub-frame, is among the predetermined kinds of preset button status.
In such an arrangement, at the reproduction of the information record medium, it is possible to display the button video part within the sub-frame in an appropriate operating status such as a status in which each button is selectable after the scrolling or a status in which each button is not selectable after the scrolling, on the basis of the second button status information included in the reproduced sub-video control information after the movement of the sub-frame (i.e. after the scrolling).
In an aspect relating to the button video part, the sub-video control information further includes button command information to define a button command to be executed in a case that the button is operated.
In such an arrangement, at the reproduction of the information record medium, it is possible to issue the button command further defined by the button information in the information reproduction apparatus presently reproducing the media, in the case that the predetermined button operation is performed relative to the button defined by the button information. Therefore, in the information reproduction apparatus, the button command can be executed quickly.
In an aspect relating to the button video part, the record medium may further include: high light information to define how to control a high light display for the button video part.
In such an arrangement, how to control the high light display is defined relative to the button video part, on the basis of the reproduced high light information. The “how to control the high light display” herein means which high light display is to be performed depending on the “button status”, such as pressed, selected, impressed, unselected, pressable or selectable, impressable or unselectable and so on. The high light display control may be performed specifically by displaying a button to be highlightened in such a manner that the button is distinguished from other buttons or other parts, by changing the brightness, changing the contrast, giving a reverse shading, depending on the button status.
Therefore, by performing the display control based on the button position information and the high light information, the button video made of at least a part of the sub-video can be displayed over the main video, and functioned as an operating button to operate the information reproduction apparatus or the reproduction operation.
This high light information may be included in the sub-video control information such as the belowmentioned SCP (Sub-Picture Control Packet) with the coordinates-before-movement information and the coordinates-after-movement information, or may be included in the sub-video information set such as the belowmentioned SPD (Sub-Picture Data) with the sub-video information and the predetermined coordinate information. In the former case, the belowmentioned SCP button can be displayed for example. In the latter case, the belowmentioned SPD button can be displayed.
In an aspect of this button video part, the high light information to define how to control the high light display may define which display mode is used to perform the high light display among predetermined kinds of preset display mode, depending on the button status among predetermined kinds of preset button status of a button displayed on the main video.
In such an arrangement, if the predetermined button operation is performed at the reproduction of the information record medium, it is possible to highlight the corresponding button in a display mode defined by the high light information in the information reproduction apparatus. Incidentally, the “predetermined kinds of display mode” includes various modes such as a brightness change of the button, a contrast change of the button, a hue (color phase) change of the button, a color saturation change of the button, a change to the complementary color, an existence or nonexistence of the reverse shading, a vibration display and so on, in addition to a simple local brightening.
In another aspect of the information record medium of the invention, a sub-video information set comprises the sub-video information and the predetermined part coordinate information, and the main video information, the sub-video information set and the sub-video control information are divided into predetermined packets and multiplexed, and further streamed into a video stream comprising the divided main video, a sub-video stream comprising the divided sub-video information set and a control information stream comprising the divided sub-video control information.
According to this aspect, similarly to the PS of the MPEG2 for example, in the case that each information is packetized, streamed and recorded, the sub-video information set such as the SPD made of the sub-video information and the predetermined part coordinate information is recorded as a special SPD stream, while the sub-video control information for the display control of the sub-video information is recorded as a special SCP stream, that is another stream different from the SPD. Furthermore, the main video is also recorded as a special video stream for example. therefore, a display based on the sub-video information set recorded as one stream in the PS for example can be controlled for the display efficiently by the sub-video control information recorded as another stream. Additionally, by using a plurality of sub-video control information streams relative to the same sub-video information set stream, various buttons can be highlightened. For example, by using the same sub-video information set, they can be functioned as different operating buttons.
The information record apparatus according to the present invention includes: a first record device for recording video information to indicate a main video; a second record device for recording sub-video information to indicate a sub-video, the sub-video at least partially displayable over the main video, and predetermined part coordinate information to designate coordinates of a predetermined part included in the sub-video, in a coordinate system defined with respect to the sub-video; and a third record device for recording sub-video control information including (i) coordinates-before-movement information to indicate coordinates of a sub-frame before a movement in the coordinate system, the sub-frame being at least an area of the sub-video, and (ii) coordinates-after-movement information to indicate coordinates of the sub frame after n-th movement (n is natural number equal to or more than 1) in the coordinate system.
According to the information record medium of the invention, the first record device such as a controller, an encoder, a TS object generator mentioned below, an optical pickup, a cutting device or the like, records the video information to indicate the main video onto the information record medium such as a DVD. The second record device such as a controller, an encoder, an optical pickup, a cutting device or the like, records the predetermined part coordinate information to designate the coordinates of the predetermined part such as the button video part onto the information record medium such as a DVD. The third record device such as a controller, an encoder, an optical pickup, a cutting device or the like, records the sub-video control information including the coordinates-before-movement information and the coordinates-after-movement information relating to the sub-frame.
Therefore, the information record medium of the invention mentioned above (including various aspects thereof) can be recorded relatively efficiently.
Incidentally, the information record apparatus according to the present invention may also take various aspects, correspondingly to various aspects of the information record medium according to the present invention as mentioned above.
The information record method according to the present invention includes: a first record process of recording video information to indicate a main video; a second record process of recording sub-video information to indicate a sub-video, the sub-video at least partially displayable over the main video, and predetermined part coordinate information to designate coordinates of a predetermined part included in the sub-video, in a coordinate system defined with respect to the sub-video; and a third record process of recording sub-video control information including (i) coordinates-before-movement information to indicate coordinates of a sub-frame before a movement in the coordinate system, the sub-frame being at least an area of the sub-video, and (ii) coordinates-after-movement information to indicate coordinates of the sub frame after n-th movement (n is natural number equal to or more than 1) in the coordinate system.
According to the information record method of the invention, the first record process is for recording the video information to indicate the main video, the second record process is for recording the predetermined part coordinate information included in the sub-video and the sub-video information, and the third record process is for recording the sub-video control information including the coordinates-before-movement information and the coordinates-after-movement information relating to the sub-frame, onto the information record medium such as a DVD, with the aid of a controller, an encoder, a TS object generator mentioned below, an optical pickup, a cutting device or the like.
Therefore, the information record medium according to the present invention as mentioned above (including various aspects thereof) can be recorded relatively efficiently.
Incidentally, the information record method according to the present invention may also take various aspects, correspondingly to various aspects of the information record medium according to the present invention.
The information reproduction apparatus according to the present invention is for reproducing the information record medium according to the present invention mentioned above (including various aspects thereof), and comprises: a reproduction device for reproducing the video information, the sub-video information, the predetermined part coordinate information and the sub-video control information; a display output device capable of displaying the reproduced sub-video information over the reproduced video information; and a control device for controlling the reproduction device and the display output device to display, before the movement of the sub-frame, the predetermined part within the sub-frame before the movement after the predetermined part is subjected to a predetermined kind of processing on the basis of the reproduced predetermined part coordinate information, while displaying the sub-frame before the movement over the main video on the basis of the coordinates-before-movement information included in the reproduced sub video control information, and to display, after the movement of the sub-frame, the predetermined part within the sub-frame after the movement after the predetermined part is subjected to a predetermined kind of processing on the basis of the reproduced predetermined part coordinate information, while displaying the sub-frame after the movement over the main video on the basis of the coordinates-after-movement information included in the reproduced sub-video control information.
According to the information reproduction apparatus of the invention, the reproduction device such as a controller, a decoder, a demultiplexer, an optical pickup and the like reproduces the video information, the sub-video information, the predetermined part coordinate information and the sub-video control information. For example, the display output device such as a CRT (Cathode Ray Tube) device, a PDP (Plasma Display Panel) device, an LCD (Liquid Crystal Display) device, a projector device and so on is capable of displaying and outputting the sub-video information over the reproduced video information. Before the movement of the sub-frame (e.g. before a scroll), the control device such as a controller or the like controls the reproduction device and the display output device so that the sub-frame-before-movement is displayed over the main video, on the basis of the coordinates-before-movement information, while the predetermined part such as the button video part is displayed within the sub-frame-before-movement after subjected to the predetermined processing such as highlighting, on the basis of the predetermined part coordinate information. Then, after the movement of the sub-frame, the control device controls the reproduction device and the display output device so that the sub-frame-after-movement is displayed over the main video, on the basis of the coordinates-after-movement information, while the predetermined part such as the button video part is displayed within the sub-frame-after-movement after subjected to the predetermined processing such as highlighting.
Therefore, the information record medium according to the present invention as mentioned above (including various aspects thereof) can be reproduced relatively efficiently.
Incidentally, the first information reproduction apparatus according to the present invention may also take various aspects, correspondingly to various aspects of the information record medium according to the present invention.
In an aspect of the information reproduction apparatus of the invention, the predetermined part is a button video part, the predetermined part coordinate information is button position information to indicate coordinates of the button video part, the information record medium further comprises high light information to define how to control a high light display for the button video part, the reproduction device further reproduces the high light information, and the control device controls the reproduction device and the display output device to perform the high light display as the predetermined kind of processing for the button video part, on the basis of the reproduced high light information.
According to this aspect, for example, it is possible to scroll the sub-frame including highlightened button video part within the predetermined area on the main video.
The information reproduction method according to the present invention is a method of reproducing the information record medium according to the present invention mentioned above (including various aspects thereof), and implemented with an information reproduction apparatus comprising (i) a reproduction device for reproducing the video information, the sub-video information, the predetermined part coordinate information and the sub-video control information and (ii) a display output device capable of displaying the reproduced sub-video information over the reproduced video information, the method comprising: a first control process of controlling the reproduction device and the display output device to display, before the movement of the sub-frame, the predetermined part within the sub-frame before the movement after the predetermined part is subjected to a predetermined kind of processing on the basis of the reproduced predetermined part coordinate information, while displaying the sub-frame before the movement over the main video on the basis of the coordinates-before-movement information included in the reproduced sub video control information; and a second control process of controlling the reproduction device and the display output device to display, after the movement of the sub-frame, the predetermined part within the sub-frame after the movement after the predetermined part is subjected to a predetermined kind of processing on the basis of the reproduced predetermined part coordinate information, while displaying the sub-frame after the movement over the main video on the basis of the coordinates-after-movement information included in the reproduced sub-video control information.
According to the information reproduction method of the invention, the first control process is for controlling, before the movement of the sub-frame (e.g. before a scroll), the reproduction device and the display output device so that the sub-frame-before-movement is displayed over the main video, on the basis of the coordinates-before-movement information, while the predetermined part such as the button video part is displayed within the sub-frame-before-movement after subjected to the predetermined processing such as highlighting, on the basis of the predetermined part coordinate information, with the aid of the controller, the decoder, the demultiplexer, the optical pickup and so on. Then, a second control process is for controlling, after the movement of the sub-frame, the reproduction device and the display output device so that the sub-frame-after-movement is displayed over the main video, on the basis of the coordinates-after-movement information, while the predetermined part such as the button video part is displayed within the sub-frame-after-movement after subjected to the predetermined processing such as highlighting.
Therefore, the information record medium of the invention mentioned above (including various aspects thereof) can be recorded relatively efficiently.
Incidentally, the information reproduction method according to the present invention may also take various aspects, correspondingly to various aspects of the information record medium according to the present invention as mentioned above.
The information record reproduction apparatus according to the present invention includes: a first record device for recording video information to indicate a main video; a second record device for recording sub-video information to indicate a sub-video, the sub-video at least partially displayable over the main video, and predetermined part coordinate information to designate coordinates of a predetermined part included in the sub-video, in a coordinate system defined with respect to the sub-video; a third record device for recording sub-video control information including (i) coordinates-before-movement information to indicate coordinates of a sub-frame before a movement in the coordinate system, the sub-frame being at least an area of the sub-video, and (ii) coordinates-after-movement information to indicate coordinates of the sub frame after n-th movement (n is natural number equal to or more than 1) in the coordinate system; a reproduction device for reproducing the video information, the sub-video information, the predetermined part coordinate information and the sub-video control information; a display output device capable of displaying the reproduced sub-video information over the reproduced video information; and a control device for controlling the reproduction device and the display output device to display, before the movement of the sub-frame, the predetermined part within the sub-frame before the movement after the predetermined part is subjected to a predetermined kind of processing on the basis of the reproduced predetermined part coordinate information, while displaying the sub-frame before the movement over the main video on the basis of the coordinates-before-movement information included in the reproduced sub video control information, and to display, after the movement of the sub-frame, the predetermined part within the sub-frame after the movement after the predetermined part is subjected to a predetermined kind of processing on the basis of the reproduced predetermined part coordinate information, while displaying the sub-frame after the movement over the main video on the basis of the coordinates-after-movement information included in the reproduced sub-video control information.
According to the information record reproduction apparatus of the invention, since there are provided both functions of the information record apparatus and the information reproduction apparatus according to the present invention, the information record medium of the invention mentioned above (including various aspects thereof) can be recorded relatively efficiently.
Incidentally, the information record reproduction apparatus according to the present invention may also take various aspects, correspondingly to various aspects of the information record medium according to the present invention as mentioned above.
The information record reproduction method according to the present invention is a method implemented with an information reproduction apparatus comprising (i) a reproduction device for reproducing the video information, the sub-video information, the predetermined part coordinate information and the sub-video control information and (ii) a display output device capable of displaying the reproduced sub-video information over the reproduced video information, said method comprising: a first record process of recording video information to indicate a main video; a second record process of recording sub-video information to indicate a sub-video, the sub-video at least partially displayable over the main video, and predetermined part coordinate information to designate coordinates of a predetermined part included in the sub-video, in a coordinate system defined with respect to the sub-video; a third record process of recording sub-video control information including (i) coordinates-before-movement information to indicate coordinates of a sub-frame before a movement in the coordinate system, the sub-frame being at least an area of the sub-video, and (ii) coordinates-after-movement information to indicate coordinates of the sub frame after n-th movement (n is natural number equal to or more than 1) in the coordinate system; a first control process of controlling the reproduction device and the display output device to display, before the movement of the sub-frame, the predetermined part within the sub-frame before the movement after the predetermined part is subjected to a predetermined kind of processing on the basis of the reproduced predetermined part coordinate information, while displaying the sub-frame before the movement over the main video on the basis of the coordinates-before-movement information included in the reproduced sub video control information; and a second control process of controlling the reproduction device and the display output device to display, after the movement of the sub-frame, the predetermined part within the sub-frame after the movement after the predetermined part is subjected to a predetermined kind of processing on the basis of the reproduced predetermined part coordinate information, while displaying the sub-frame after the movement over the main video on the basis of the coordinates-after-movement information included in the reproduced sub-video control information.
According to the information record reproduction method of the invention, since it has both function of the information record method and the information reproduction method of the invention mentioned above, the information record medium of the invention (including various aspects thereof) can be recorded and reproduced relatively efficiently.
Incidentally, the information record reproduction method according to the present invention may also take various aspects, correspondingly to various aspects of the information record medium according to the present invention.
The computer program according to the present invention is a computer program for a record control to control a computer disposed at the information record apparatus according to the present invention mentioned above (including various aspects thereof), the program making the computer function as at least a part of the first record device, the second record device and the third record device.
According to the computer program for a record control of the invention, the information record apparatus according to the present invention mentioned above may be embodied relatively easily, by reading and running the computer program from a record medium, such as a ROM, a CD-ROM, a DVD-ROM, a hard disk and so on, storing the computer program therein/thereon, or by downloading the computer program to the computer via the communication device and running it.
Incidentally, the computer program for a record control according to the present invention may also take various aspects, correspondingly to various aspects of the information record medium according to the present invention as mentioned above.
The computer program for a reproduction control according to the present invention is to control a computer disposed at the information reproduction apparatuses according to the present invention mentioned above (including various aspects thereof), the program making the computer function as at least a part of the reproduction device, the display output device and the control device.
According to the computer program for a reproduction control of the invention, the information reproduction apparatus according to the present invention mentioned above may be embodied relatively easily, by reading and running the computer program from a record medium, such as a ROM, a CD-ROM, a DVD-ROM, a hard disk and so on, storing the computer program therein/thereon, or by downloading the computer program to the computer via the communication device and running it.
Incidentally, the computer program for the reproduction control according to the present invention may also take various aspects, correspondingly to various aspects of the information record medium according to the present invention as mentioned above.
The computer program for a record reproduction control according to the present invention is to control a computer disposed at the information record reproduction apparatus according to the present invention mentioned above (including various aspects thereof), the program making the computer function as at least a part of the first record device, the second record device, the third record device, the reproduction device, the display output device and the control device.
According to the computer program for a record reproduction control of the invention, the information record reproduction apparatus according to the present invention mentioned above may be embodied relatively easily, by reading and running the computer program from a record medium, such as a ROM, a CD-ROM, a DVD-ROM, a hard disk and so on, storing the computer program therein/thereon, or by downloading the computer program to the computer via the communication device and running it.
Incidentally, the computer program for the record reproduction control according to the present invention may also take various aspects, correspondingly to various aspects of the information record medium according to the present invention as mentioned above.
The data structure including a control signal according to the present invention includes: video information to indicate a main video; sub-video information to indicate a sub-video, the sub-video at least partially displayable over the main video; predetermined part coordinate information to designate coordinates of a predetermined part included in the sub-video, in a coordinate system defined with respect to the sub-video; and sub-video control information including (i) coordinates-before-movement information to indicate coordinates of a sub-frame before a movement in the coordinate system, the sub-frame being at least an area of the sub-video, and (ii) coordinates-after-movement information to indicate coordinates of the sub frame after n-th movement (n is natural number equal to or more than 1) in the coordinate system.
According to the data structure including the control signal of the invention, similarly to the information record medium according to the present invention mentioned above, it is possible to achieve the complex and sophisticated display control using the sub-video, such as a control by scrolling the sub-picture including the highlightened button.
Incidentally, the data structure including the control signal according to the present invention may also take various aspects, correspondingly to various aspects of the information record medium according to the present invention as mentioned above.
The above object of the present invention is achieved by a computer program product for a record control in a computer-readable medium for tangibly embodying a program of instructions executable by a computer disposed at the aforementioned information record apparatus according to the present invention (including various aspects), the program making the computer function as at least a part of the first record device, the second record device and the third record device.
The above object of the present invention is achieved by a computer program product for a reproduction control in a computer-readable medium for tangibly embodying a program of instructions executable by a computer disposed at the information reproduction apparatus according to the present invention (including various aspects), the program making the computer function as at least a part of the reproduction device, the display output device and the control device.
The above object of the present invention is achieved by a computer program product for a record reproduction control in a computer-readable medium for tangibly embodying a program of instructions executable by a computer disposed at the information record reproduction apparatus according to the present invention (including various aspects), the program making the computer function as at least a part of the first record device, the second record device, the third record device, the reproduction device, the display output device and the control device.
According to the computer program product for the record control, the reproduction control, or the record reproduction control of the invention, at least a part of the first record device, the second record device, the reproduction device, the display output device and the control device according to the present invention mentioned above may be embodied relatively easily, by reading and running the computer program product from a record medium, such as a ROM, a CD-ROM, a DVD-ROM, a hard disk and so on, storing the computer program therein/thereon, or by downloading the computer program product to the computer via the communication device and running it. More specifically, the computer program product may be made of computer readable codes (or computer readable commands) to make the computer function as at least a part of the first record device, the second record device, the third record device, the reproduction device and the control device.
These effects and other advantages of the present invention become more apparent from the following embodiments and examples.
BRIEF DESCRIPTION OF DRAWINGS
FIGS. 22 are schematic diagrams showing three types of sub-picture structures, constructed from the sub-picture structures shown in
(Information Record Medium)
The information record medium of the present invention is discussed, with reference to its embodiments, as well as
Firstly, with reference to
As shown in
Next, with reference to
In
In
In
Incidentally, for convenience of explanation, the video stream, the audio stream and the sub-picture stream are arranged in this order from the top in
The optical disc 100 in the aforementioned embodiment is adapted to multi-record the transport stream (TS) as shown in
Next, with reference to
In the following explanation, the “title” means a reproduction unit, on the basis of which a plurality of “play lists” are executed continuously or sequentially, and which is a logically large grouped unit, such as one movie or one TV program. The “play list set” means a bundle of “play lists”. For example, it may be a bundle of play lists to reproduce a plurality of content information having a special relationship switchable to each other in an angle reproduction or a parental reproduction, or may be a bundle of play lists to reproduce content information relating to a plurality of programs broadcasted in the same time zone and collectively recorded. Alternatively, it may be a bundle of play lists to reproduce various content information, in one title, prepared on the basis of required function, for example on the basis of video performance or audio performance required for the information reproduction system, such as a high vision compatibility, a display resolution, a surround speaker compatibility, a speaker layout and so on. The “play list” is information for storing the information required to reproduce the “object” and consists of a plurality of “items” each storing the information about a reproduction range of the object to access the object. The “object” is the entity information of contents constructing the aforementioned MPEG2 transport stream.
In
The disc information file 110 is a file for storing general information about the entire optical disc 100, and stores the disc general information 112, the title information table 114 and other information 118. The disc general information 112 may store the total numbers of titles or the like in the optical disc 100. The title information table 114 includes a title pointer 114-1 and a plurality of titles 200 (title #1-#m) whose ID (identification) number or record address is indicated by the title pointer. In each title 200, each title type (e.g. sequential reproduction type, branch type and so on), or the play list (P list) number constructing each title is recorded for each title, as the logical information.
More specifically, for example, as shown in
The pointer 200PT as an example of the first pointer information according to the present invention indicates an ID number of the play list set 126S stored in the play list information file 120 corresponding to content information to be reproduced on the basis of the title element 200-2 including the pointer 200PT. Incidentally, the pointer 200PT may be information to indicate a record position of the play list set 126S corresponding to the content information to be reproduced on the basis of the title element 200-2. The pre-command 200PR as an example of the first pre-command according to the present invention indicates a command to be executed before reproducing the content information whose reproduction sequence is defined by one play list set 126S designated by the pointer 200PT. The post command 200PS as an example of the first post command according to the present invention is a command to be executed after reproducing the content information whose reproduction sequence is defined by said one play list set. Other information 200-5 included in the title element 200-2 may include next information to designate a title element for a next reproduction after the present reproduction of the present title element, for example.
Therefore, when the information reproduction apparatus reproduces the information record medium, the desired content information can be reproduced as a title element 200-2, by making access to the play list set 126S in accordance with the pointer 200PT and performing a control to select play list corresponding to the desired program or the like from among a plurality of play lists 126 in the play list set 126S. Furthermore, reproducing such a title element 200-2 solely or sequentially makes it possible to reproduce one title 200. Furthermore, it is possible to execute commands to be executed before reproduction, in the content information whose reproduction sequence is defined by one play list set 126S designated by the pointer 200PT, according to the pre-command 200PR. Furthermore, it is possible to execute commands to be executed after the reproduction, in the content information whose reproduction sequence is defined by one play list set 126S designated by the pointer 200PT, according to the post command 200PS. The post command 200PS may be a command to branch the content information, a command to select a next title and so on. Additionally, it is possible to reproduce a next title element 200-2 to be reproduced after the presently reproduced title element 200-2, according to the “next information” included in other information 200-5.
Again in
As shown in
The pointer 126PT as an example of the second pointer information according to the present invention indicates an item identification number defined by the item definition table 126-3 corresponding to the content information to be reproduced on the basis of the play list element 126-2 including the pointer 126PT. Incidentally, the pointer 126PT may be an item record position defined by the item definition table 126-3.
As shown in
Again in
As shown in
As shown in
As shown in
Again in
The object data file 140 stores a plurality of TS objects 142 for each transport stream (TS #1 object-TS #s object), i.e. entity data of contents to be actually reproduced.
Incidentally, four kinds of file discussed with reference to
As shown in
Next, with reference to
As shown in
As shown in
Furthermore, in
In the case that the transport stream as shown in
In this embodiment, these PAT and PMT are included as the TS packets 146 to be stored in the TS object 142 shown in
Furthermore in this embodiment, these PAT and PMT recorded as such are not referred to when the optical disc 100 is reproduced. Instead, referring to the AU table 131 and the ES map table 134, shown in
Next, with reference to
In
Incidentally, in the case of a simple logical structure, one title element 200-2 consists of one play list set 126S. Furthermore, one play list set 126S consists of one play list 126. On the other hand, it is possible to refer to one play list set 126S by a plurality of title elements 200-2 or a plurality of titles 200.
Each play list 126 is logically made of a plurality of items (play items) 204. In each play list 126, a plurality of items 204 may have the sequential structure or may have the branch structure. On the other hand, it is possible to refer to one item 204 by a plurality of play lists 126. The aforementioned in-point information and out-point information recorded on/in the item 204 logically designates the reproduction range of the TS object 142. Then, the object information 130d of the logically designated reproduction range is referred to and thereby the reproduction range of the TS object 142 is physically designated, via the file system finally. Here, the object information 130d includes various information to reproduce the TS object 142, such as the attribute information of the TS object 142, the ES address information 134d and the like required for the data search in the TS object 142 (Incidentally, the ES map table 134 shown in
Then, when the information record and reproduce apparatus reproduces the TS object 142 as mentioned below, a physical address to be reproduced in the TS object 142 is obtained from the item 204 and the object information 130d so that a desired elementary stream is reproduced.
Incidentally, the EP (Entry Pass) map including a plurality of ES address information 134d, shown within the object information of
Thus, in this embodiment, the in-point information and out-point information recorded on/in the item 204, as well as the ES address information 134d recorded in the ES map table 134 (see
As discussed above, in this embodiment, units of the TS packet 146 are multiplexed and recorded on the optical disc 100. Thereby, the transport stream including a plurality of elementary streams as shown in
(Information Record Reproduction Apparatus)
Next, with reference to
In
The information record reproduction apparatus 500 is provided with: an optical pickup 502; a servo unit 503; a spindle motor 504; a decoder 506; a demultiplexer 508; a video decoder 511; an audio decoder 512; a sub-picture decoder 513; an adder 514; a still picture decoder 515; a system controller 520; a memory 530; a memory 540; a memory 550; a modulator 606; a formatter 608; a TS object generator 610; a video encoder 611; an audio encoder 612; and a sub-picture encoder 613. The system controller 520 includes a file system/logical structure data generator 521 and a file system/logical structure data reader 522. Furthermore, the memory 530 and a user interface 720 to give a user input such as title information are connected to the system controller 520.
Among these constitutional elements, the decoder 506, the demultiplexer 508, the video decoder 511, the audio decoder 512, the sub-picture decoder 513, the adder 514, the still picture decoder 514, the memory 540 and the memory 550 mainly constructs the reproduction system. On the other hand, among these constitutional elements, the modulator 606, the formatter 608, the TS object generator 610, the video encoder 611, the audio encoder 612 and the sub-picture encoder 613 mainly constructs the record system. The optical pickup 502, the servo unit 503, the spindle motor 504, the system controller 520, the memory 530 and the user interface 720 to give the user input such as title information are generally shared for both the reproduction system and the record system. Furthermore, for the record system, a TS object data source 700 (or a PS object data source 700, or a still picture data source 700 such as bit map data, JPEG data and the like); a video data source 711; an audio data source 712; and a sub-picture data source 713 are prepared. Furthermore, the file system/logical structure data generator 521 disposed in the system controller 520 is used mainly in the record system, and the file system/logical structure reader 522 is used mainly in the reproduction system.
The optical pickup 502 irradiates the optical disc 100 with a light beam LB such as a laser beam, at the first power as reading light for the reproduction, and at the second power with the light beam LB being modified as writing light for recording. The servo unit 503 performs the focus servo, the tracking servo and the like for the optical pickup 502, as well as the spindle servo for the spindle motor 504, under control of the control signal Sc1 outputted from the system controller 520, during the reproduction and recording. The spindle motor 504 is controlled under the spindle servo by the servo unit 503, for rotating the optical disc 100 at a predetermined speed.
(i) Structure and Operation of Record System
Next, with reference to
(i-1) In the Case that the Already Generated Object is Used
This case is discussed, with reference to
In
Firstly in
Next, the TS object data source 700 outputs the TS object data D1, under control of the control signal Sc8 to indicate the data reading from the system controller 520. Then, the system controller 520 imports the TS object data D1 from the TS object data source 700 (step S23), and performs the data array analysis (e.g. a record data length and the like) of the TS object data D1, the analysis of each elementary stream structure (e.g. understanding of ES_PID (elementary stream/packet identification number)), on the basis of the PAT, the PMT and the like packetized with the video data as mentioned above, due to the TS analysis feature in the file system/logical structure data generator 521 (step S24).
Next, the system controller 520 makes the file system/logical structure data generator 521 generate the disc information file 110, the play list information file 120, the object information file 130 and the file system 105 (see
Incidentally, variations in which the data about each elementary stream structure information and the TS object data D1 data array may be prepared in advance are naturally understood or suggested, all of which are encompassed within a scope of the embodiment.
In
At step S26 in
The selection output from the formatter 608 is transmitted to the modulator 606 as disc image data D5, and modulated by the modulator 606, and recorded onto the optical disc 100 through the optical pickup 502 (step S27). The system controller 520 also executes the disc record control in this case.
Then, if both the logical information file data D4 generated at the step S25 and the corresponding object data D1 have not been completely recorded yet, the operational flow returns to the step S26 to continue the recording (step S28: No). Incidentally, there is no preference in the record sequence of the logical information file data D4 and the corresponding object data D1.
On the other hand, if the both have been already recorded, it is judged whether or not the recording onto the optical disc 100 is to be ended, on the basis of the presence or absence of an end command (step S29). If it is not to be ended (step S29: No), the operational flow returns to the step S21 to continue the recording. On the other hand, if it is to be ended (step S29: Yes), a series of record processing ends.
As described above, the information record reproduction apparatus 500 performs the record processing in the case of using the already prepared TS object.
Incidentally, the example in
Additionally, a PS object data-source or a still picture data source may be used instead of the TS object data source 700. In this case, the recording processing the same as in the case of the TS object data D1 as mentioned above is performed for the PS object data, or the sill picture data such as bit map data, JPEG data and the like, instead of the TS object data D1. Furthermore, instead of the TS object 142, the PS object data or the still picture data is stored in the object data file 140. Then, various logic information about the PS object data or the still picture data is generated under control of the system controller 520, and stored in the disc information file 110, the play list information file 120, the object information file 130 and the like.
(i-2) The Case of Receiving and Recording the Transport Stream on Air
This case is explained with reference to
Again, in this case, the similar processing is performed, as is “the case of using the already prepared object” described above. Therefore, the following explanation is focused on the differences from this case.
In the case of receiving and recording the transport stream on air, the TS object data source 700 is provided with a receiver (set top box) for receiving the digital broadcast on air, for example, receives the TS object data D1, and transmits it to the formatter 608 in real time (step S41). At the same time, reception information D3 (i.e. information corresponding to the data transmitted through the receiver and the interface of the system controller 520) including the program construction information and the belowmentioned ES_PID information, which are deciphered upon receiving, is imported into the system controller 520 and is stored into the memory 530 (step S44).
In the meantime, the TS object data D1 outputted to the formatter 608 is outputted to the modulator 606 under the switching-control by the formatter 608 (step S42), and is recorded onto the optical disc 100 (step S43).
Along with these operations, using the program construction information and the ES_PID information included in the reception information D3 imported upon receiving and stored in the memory 530, the file system/logical structure data generator 521 prepares the logical information file data D4 (step S24 and step S25). Then, after the completion of recording a series of the TS object data D1, this logical information file data D4 is additionally recorded onto the optical disc 100 (step S46 and step S47). Incidentally, these steps S24 and S25 may be performed after the step S43.
Moreover, as the occasion demands (e.g. in the case of editing one portion of the title, or the like), by adding the user input 12 of the title information and the like from the user interface 720 to the program construction information and the ES_PID information stored in the memory 530, it is possible to prepare the logical information file data D4 by the system controller 520 and additionally record this onto the optical disc 100.
As described above, the information record reproduction apparatus 500 performs the record processing in the case of receiving the transport stream on air and recording it in real time.
Incidentally, if all the reception data obtained when broadcasting is once stored into an archive apparatus, and then, if this is used as the object source 700, the same processing as that in “the case of using the already prepared object” will do.
(i-3) The Case of Recording the Video data, the Audio Data and the Sub-Picture Data
This case is explained with reference to
In the case of recording the video data, the audio data, and the sub-picture data, which are individually prepared in advance, the video data source 711, the audio data source 712, and the sub-picture data source 713 are individually provided with the memory storage, such as a video tape and a memory, and store a video data DV, an audio data DA, and a sub-picture data DS, respectively.
These data sources are controlled by the control signal Sc8 giving an instruction for reading out the data from the system controller 520, and they transmit the video data DV, the audio data DA, and the sub-picture data DS, to the video encoder 611, the audio encoder 612, and the sub-picture encoder 613, respectively (step S61). Then, the video encoder 611, the audio encoder 612, and the sub-picture encoder 613 execute a predetermined type of encode processing (step S62).
The TS object generator 610 is controlled by a control signal Sc6 from the system controller 520 and converts the data encoded in this manner to the TS object data constituting the transport stream (step S63). In this case, the data array information of each TS object data (e.g. a record data length and the like) and the construction information of each elementary stream (e.g. the ES_PID, as described later, and the like) are transmitted as information I6 from the TS object generator 610 to the system controller 520 and are stored into the memory 530 (step S66).
On the other hand, the TS object data generated by the TS object generator 610 is transmitted to the {circle around (2)} side of the switch Sw1 of the formatter 608. Namely, when formatting the TS object data from the TS object generator 610, the formatter 608 is switching-controlled by the switch control signal Sc5 from the system controller 520 to shift the switch Sw1 to the {circle around (2)} side and the switch Sw2 to the {circle around (1)} side, thereby outputting the TS object data (step S64). Then, this TS object data is recorded onto the optical disc 100 through the modulator 606 (step S65).
Along with these operations, using the data array information of each TS object data and the construction information of each elementary stream imported as the information I6 into the memory 530, the file system/logical structure data generator 521 prepares the logical information file data D4 (step S24 and step S25). Then, after the completion of recording a series of the TS object data D2, the logical information file data D4 is additionally recorded onto the optical disc 100 (step S67 and step S68). Incidentally, the step S24 and the step S25 may be processed after the step S65.
Moreover, as the occasion demands (e.g. in the case of editing one portion of the title), by adding the user input 12 such as the title information and the like from the user interface 720 to these information stored in the memory 530, it is possible to prepare the logical information file data D4 by the file system/logical structure generator 521 and additionally record this onto the optical disc 100.
As described above, the information record reproduction apparatus 500 performs the record processing in the case of recording the video data, the audio data, and the sub-picture data, which are individually prepared in advance.
Incidentally, this record processing is applicable even when recording an arbitrary content the user has.
(i-4) The Case of Recording the Data by Authoring
This case is explained with reference to
In this case, by combining the above described three types of record processing in the three cases, an authoring system generates the TS object, the logical information file data, and the like in advance (step S81), and then completes the processing until switching-control performed at the formatter 608 (step S82). Then, the information obtained by this operation is transmitted, as the disc image data D5, to the modulator 606 equipped in front of and/or behind an original disc cutting machine (step S83), and this cutting machine prepares the original disc (step S84).
(ii) Structure and Operation in Reproduction System
Next, the specific structure and operation of each constitutional element constituting the reproduction system of the information record reproduction apparatus 500 is explained with reference to
In
Responding to this, the system controller 520 controls the disc reproduction with respect to the optical disc 100, and the optical pickup 502 transmits a reading signal S7 to the demodulator 506.
The demodulator 506 demodulates a recorded signal recorded onto the optical disc 100 from this reading signal S7, and outputs it as demodulated data D8. The logical information file data (i.e. the file system 105, the disc information file 110, the P list information file 120, and the object information file 130, shown in
On the other hand, depending on whether the TS object data is included as the multiplexed information part in the demodulated data D8, or whether the still picture data is included, or whether both data are included, the shift switch Sw3 is shifted to {circle around (1)} side (demultiplexer 508 side) or shifted to {circle around (2)} side (still decoder 515 side), under control of the control signal Sc10 from the system controller 520. Thereby, the TS object data is selectively supplied to the demultiplexer 508, and the still picture data is selectively supplied to the still picture decoder 515.
Then, as for the TS object data included as the multiplexed information part in the demodulated data D8, the demultiplexer 508 demultiplexes the TS object data, under control of the control signal Sc2 from the system controller 520. Here, when the access to the reproduction position address is terminated under the reproduction control by the system controller 520, the control signal Sc2 is transmitted to start the demultiplexing.
The video packet, the audio packet and the sub-picture packet are transmitted respectively from the demultiplexer 508 and supplied respectively to the video decoder 511, the audio decoder 512 and the sub-picture decoder 513. Then, the video data DV, the audio data DA and the sub-picture data DS are decoded, respectively. In this case, the sub-picture data DS is supplied to the adder 514 via the memory 540. The sub-picture data DS is outputted from the memory 540, selectively or at a predetermined timing, under control of the control signal Sc5 from the system controller 520, so as to be super-imposed on the video data DV, if needed. That is, in comparison with a case that the sub-picture data outputted from the sub-picture decoder 513 is directly super-imposed, it is easy to control the timing of the super-imposing, or to judge the need for the super-imposing. For example, under output control of the control signal Sc5, it is possible to select whether or not a caption using the sub-picture is displayed over the main picture, or whether or not a menu screen using the sub-picture is displayed.
Incidentally, although the packets obtained by packetizing the PAT or the PMT, included in the transport stream shown in
The adder 514 is controlled by a control signal Sc3 giving an instruction of the mixing from the system controller 520, and mixes or superimposes in a predetermined timing the video data DV and the sub-picture data DS, which are respectively decoded at the video decoder 511 and the sub-picture decoder 513. The result is outputted as a video output from the information record reproduction apparatus 500 to a TV monitor, for example.
On the other hand, the audio data DA decoded at the audio decoder 512 is outputted as an audio output from the information record reproduction apparatus 500 to an external speaker, for example.
In the case that the still picture data is included in the decoded data D8, the still picture data is supplied to the still picture decoder 515, via the shift switch Sw3 controlled by the control signal Sc10 from the system controller 520, instead of or in addition to such a reproduction operation or processing of the video data DV or the sub-picture data DS. Then, the still picture data such as the decoded bit map data, JPEG data and the like is added to the adder 514 via the shift switch Sw4, without subjected to any processing, under control of the control signal Sc11 from the system controller 520. Alternatively, it may be temporarily stored in the memory 550 via the shift switch Sw4. The still picture data is outputted from the memory 550, selectively or at a predetermined timing, under control of the control signal Sc12 from the system controller 520, and then supplied to the adder 514 via the shift switch Sw5. Thereby, if needed, the video data DV or the sub-picture data DS is super-imposed over the still picture data or vice versa. That is, in comparison with a case that the still picture data outputted from the still picture decoder 515 is directly super-imposed, it is easy to control the timing of the super-imposing, or to judge the need for the super-imposing. For example, under output control of the control signal Sc12, it is possible to select whether or not a still picture such as a menu screen or a window screen using the still picture data or a still picture as a background image using the still picture data is displayed on the main picture of the sub-picture.
Additionally, under control of the control signal Sc13 from the system controller 520, the still picture data may be outputted via another route (not shown), with the aid of the shift switch Sw5 shifted to {circle around (2)} side. Alternatively, no still picture data may be outputted from the shift switch Sw5 shifted to {circle around (2)} side.
Here, the specific example of a reproduction processing routine by the system controller 520 is explained with reference to a flow chart of
In
Firstly, the choice or selection of the title is performed via the user interface 720 (step S211). Responding to this, the system controller 520 obtains the information about the reproduction sequence from a reading result of the file system/logical structure data reader 522. Incidentally, in the selection of the title 200, the desired title element(s) 200-2 (see
Then, contents of a plurality of play lists 126 composing a play list set 126S corresponding to the selected title 200 (title element 200-2) are obtained. Here, as a processing at a logic hierarchy, the information about the each play list 126 structure and each item composing each play list (see
Then, contents of the play list 126 to be reproduced is obtained from among a plurality of play lists 126 obtained at step S212. For example, herein, the reproduction is started from a play list #1, and the contents of the corresponding play list 126 is obtained (step S213). The contents of the play list 126 may be one or more play list elements 126-2 (see
Then, the pre-command 126PR (see
Then, the TS object 142 (see
Incidentally, in this embodiment, also the belowmentioned AU (Association Unit) information 132I and PU (Presentation Unit) information 302I are obtained as the information stored in the object information file 130. On the basis of these informations, the aforementioned logic hierarchy is associated with the object hierarchy (see
Then, the reproduction of the TS object 142 determined at step S215 is actually started. That is, on the basis of the processing at the logic hierarchy, the processing at the object hierarchy is started (step S216).
During the reproduction of the TS object 142, it is judged whether or not the next item 204 composing the play list 126 to be reproduced exists (step S217). Then, insofar as the next item 204 exists (step S217: Yes), the process goes back to the step S215 to repeat the aforementioned determination and the reproduction of the TS object 142.
On the other hand, at the judgement at step S217, if it is judged that the next item 204 does not exist (step S217: No), the post command 126PS (see
Then, it is judged whether or not the next play list 126 composing the selected title 200 exists (step S219). If exists (step S219: Yes), the process goes back to the step S213 to repeat the processings following obtaining the play list 126 to be reproduced.
On the other hand, at the judgement at step S219, if it is judged that the next play list 126 does not exist (step S219: No), i.e. if the all play lists 126 to be reproduced corresponding to the title 200 selected at step S211 are completely reproduced, a series of reproduction operations or processings is terminated.
As discussed above, the information record reproduction apparatus 500 in this embodiment reproduces the optical disc 100.
Particularly in this embodiment, (i) with regard to the structure and operation of the record system mentioned above, the object data file 140 is recorded so that the control information stream or the sub-picture stream that is an elementary stream relating to the sub-picture includes the SP data (still picture data) and the SP control information to scroll the highlighted button.
Particularly in this embodiment, (ii) with regard to the structure and operation of the reproduction system, when the object is determined and reproduced at the steps S215 and S216, the SP data and the SP control information recorded in the sub-picture stream or the control information stream are reproduced. On the basis of these SP data and the SP control information, the highlight button control with the sub-frame can be performed, especially a scroll display control of one or more buttons highlighted or highlightable. Various display controls of such a sub-picture will be described later in detail.
(Selection Scheme of Play List in Play List Set)
In the embodiment, the play list 126 corresponding to the desired content information is selected, as occasion demands, from the play list set 126S which is included in the reproduced play list information file 120.
With respect to such selection of the play list, the pre command 200PR included in the title element 200-2 (see
(Scroll Display Control of Highlight Button)
Next, with reference to
Firstly, with reference to
In this embodiment, in
As shown in
The “structure information”, which acts as a header of the sub-picture structure, includes a SP data identifier such as an identification number for identifying the sub-picture, a data length of the SP control information included in the sub-picture structure, a data length of the SP data included in the sub-picture structure, and other information. The data lengths of the SP control information and the SP data may be variable or constant, respectively.
The “SP control information” comprises various parameters to control the SP data, by the unit of a sub-frame (SF), which is an image part cut out at least partially from an image defined by the SP data. More specifically, the “SP control information” includes a “SP data display start time point” and a “SP data display time” (or “display time end time point”), which are indicated by the PTS (presentation time stamp) or the like, and “sub-frame information” for defining each sub-frame range or the like which is an object to be controlled in the SP data.
Furthermore, the “SP control information” includes “active button initial information”, “sub-frame movement information #1 to #L”, “button command #1 to #L” and “other information”.
From among them, the “active button initial information” is information for designating a selectable (i.e. active) button or a button to be highlighted, when the sub-frame including the button is firstly displayed (initial state).
Each of the “sub-frame movement information #1 to #L” includes (i) “coordinate information” for designating coordinates to which the sub-frame moves by scrolling, (ii) “active button information” for identifying the selectable (i.e. active) button or the button to be highlighted after the movement in accordance with this coordinate information, and (iii) other information, respectively (for each movements).
Each of the “button command #1 to #L” designates a button command to be executed in response to a button operation, for each button. For example, in the case that the sub-frame is scrolled, the command designates how long it will take to execute the movement corresponding to the sub-frame movement information #i.
The “other information” in the SP control information may be various parameters indicating a condition of a sub-frame scaling, a rotational movement, a parallel translation, a shadowing and so on.
On the other hand, the “SP data” may have “image data” in a JPEG format or a bit map data format through a run length encoding for example. Furthermore, the “SP data” has button position information #1 to #n for designating a button position (range) within the sub-frame, for each button, and other information.
The “button position information #1 to #n” may designate each display area of buttons whose total number is “n”, with two corners diagonally opposing to each other of a rectangular area, in the case that the rectangular area is defined as a button for example. These coordinates are indicated in a SP data coordinate system. Furthermore, each button position information includes route information for indicating a route along which a highlight moves (e.g. from top to down) with a user's operation using cursor keys or the like, and highlight pattern information for indicating a highlight display pattern (e.g. brightness, color density, hatching pattern and so on).
Particularly in this embodiment as mentioned above, the “highlight” information“to highlight the button depending on the operational status includes (i) the button position information #1 to #n added to the SP data, (ii) the sub-frame movement information #1 to #L added to the SP control information, and (iii) the button commands #1 to #m added to the SP control information. Incidentally, the reason why the button position information #1 to #n is added to the SP data is to avoid defining redundantly the coordinates of the same button in each SP control information, in the case that the SP control information and the SP data are divided into different streams.
According to this embodiment, since there are provided with the SP control information and the SP data constructed as mentioned above, any area within one SP data can be designated as a sub-frame on the basis of the sub-frame information in the SP control information. Furthermore, any area or areas within this sub-frame can be designated as an area or areas acting as one or more (n) buttons. Then, on the basis of the active button initial information, the sub-frame movement information #i (#1 to #L), the button command #i (#1 to #m) in the SP control information, any button or buttons can be highlighted depending on the operational status, and furthermore the sub-frame can be scrolled with the button or buttons highlighted.
Incidentally, in
That is, in
By employing the separate structure shown in
As shown in
As shown in
In the embodiment, for example, with respect to the SP data in the SP data structure 722 recorded on a SPD stream, the SP control information recorded on a SCP stream different from this SPD stream is operated, to thereby perform the reproduction control of the still picture. In this case, there may be only one or a plurality of SCP streams which operates with respect to one SPD stream. Recording the two types of streams onto mutually different elementary streams allows efficient reproduction control. Moreover, operating a plurality of SP control information on a plurality of SCP streams, with respect to the SP data on one SPD stream, allows more efficient reproduction control.
More specifically, as shown in
In
However, in addition to such reproduction control of the still picture, it is possible that with respect to the SP data in the sub picture data structure recorded on the sub picture stream, the SP control information in the sub picture structure recorded on the same stream is operated, to thereby perform the reproduction control of the still picture. Namely, both the SP control information 721 and the SP data structure 722 may be recorded into only one sub picture stream, to thereby operate the SP control information 721 to the SP data structure 722.
In any case, by sharing or using many times the SP data provided as the bit map data and JPEG data which have a large data amount, it is possible to save a limited recording capacity on the disc, which allows more efficient reproduction and display processing. In addition, in any case, it is possible to superimpose such a sub picture onto a moving picture or video which is based on the video data recorded in another video stream.
Now, with reference to
In
Specifically, for example, coordinates (X1, Y1) and (X2, Y2) of two corners of the rectangular sub-frame #1, are designated by the sub-frame information ((X1, Y1), (X2, Y2)) in the SP control information shown in
In the case that such a sub-frame #1 is cut out from the SP data, and is then displayed in a predetermined area on the main video screen, the buttons #1, #2 and #3 firstly become selectable on the basis of the active initial button information (=#1, #2 and #3) in the SP control information, while the button #1 is highlighted in the initial state (hatched portion in
Then, as shown in
In accordance with the sub-frame information (i.e. the coordinate information, the active button information and so on) in the SP control information, the sub-frame #1 is moved. As a result, buttons #4, #5 and #6 defined by the button position information (#4 to #6) added to the SP data are displayed as the sub-picture. Particularly, during the movement of the sub-frame #1, i.e. while the sub-picture including the highlighted button is scrolled, the position information of buttons on the SP data is identified by the button position information in the SP data, and how to scroll the sub-picture is identified by the sub-frame movement information and the like (see
For example, in the specific example of
The scrolling display of the highlighted button discussed above is achieved generally as follows in the information record reproduction apparatus 500 shown in
Now, with reference to
Firstly in
Then, the system controller 520 determines the number (n) of outputting the sub-picture, for example, on the basis of a frame rate of the video signal decoded by the video decoder 511 and the scroll time obtained at the step S221 (step S222).
Then, the system controller 520 determines an amount (Δ Y) for moving the sub-frame by one frame, from a mathematical formula, Δ Y=Y3−Y1 (step S223).
Then, the system controller 520 calculates the sub-frame coordinates of each frame of the video signal, from a definition ((X1, Y1+Δ Y*n), (X2, Y2+Δ Y*n)). Furthermore, the system controller 520 performs a control with the control signal Sc5 to output the sub-picture from the memory 540, so that the sub-picture is outputted on the basis of the highlight number as the highlight number at the scroll start (step S224).
Then, it is judged whether or not the sub-picture is outputted by (n-1) times (step S225). If it is not outputted by (n-1) times (step S225: No), the process flow goes back to the step S224 to repeat the subsequent processings. Thereby, as the number of outputting the sub-picture increases, the sub-frame coordinates gradually moves from ((X1, Y1), (X2, Y2)) to ((X3, Y3), (X4, Y4)).
At the judgement at the step S225, if it is judged that the sub-picture is outputted by (n-1) times (step S225: Yes), the system controller 520 performs a control with the control signal Sc5 to output the sub-picture from the memory 540, so that the sub-picture is outputted on the basis of the highlight number as the highlight number at the scroll end (step S226).
Consequently, the scroll display can be achieved with a displacement amount (Δ Y) of the sub-frame for one frame of the video signal. Furthermore, in this case, the scrolling is performed while the button to be highlighted remains highlighted.
Firstly in
Then, the system controller 520 determines a size in the Y axis direction, “y—2−y—1+1”. Then, the coordinates of the button to be highlighted, ((st, t1), (s2, t2)), is identified from the highlight number designated at the step S231 (step S232).
Then, a variable “I” to control the highlight when each frame is displayed during the scrolling is set to “0” (step S233).
Then, the system controller 520 judges whether or not a following inequality is satisfied (step S234).
t1≦y—1+I≦t2
At the judgement of the step S234, if the aforementioned inequality is not satisfied (step S234: No), the image data is outputted into an area from X axis coordinate “x—1” to “x—2” at a Y axis coordinate “y—1+I” of the sub-picture data (step S235). Then, the process flow goes to a step S236.
On the other hand, at the judgement of step S234, if the aforementioned inequality is satisfied (step S234: Yes), a control is performed to output from the memory 540 the image data in an area from X axis coordinate “x—1” to “s1” at Y axis coordinate “y—1+I” of the sub-picture data (step S238).
Then, a control is performed to apply color conversion for the highlight relative to the image data in an area from X axis coordinate “s1” to “s2” at Y axis coordinate “y—1+I” of the sub-picture data and output it from the memory 540 (step S239).
Furthermore, a control is performed to output from the memory 540 the image data in an area from X axis coordinate “s2” to “x2” at Y axis coordinate “y—1+I” of the sub-picture data (step S240). Then, the process flow goes to the step S236.
Then, at the step S236, the system controller 520 judges whether or not it is repeated for a size of the sub-frame in the Y axis direction (step S236). If it is repeated for a size of the sub-frame in the Y axis direction (S236: Yes), a series of processings ends.
On the other hand, at the judgement of the step S236, if it is judged that it is not repeated for a size of the sub-frame in the Y axis direction (S236: No), the variable “I” is incremented by “1”. After then, the process flow goes back to the step S234 to repeat the subsequent processings.
As shown from
(Access Flow on Reproduction)
Next, with reference to
In
Among them, the logic hierarchy 401 is a hierarchy for logically specifying various logical information to reproduce the desired title during the reproduction, as well as the play list (P list) to be reproduced and its constitutional contents. In the logic hierarchy 401, disc information 110d indicating the entire titles 200 and the like on the optical disc 100 is written within the disc information file 110 (see
Next, the logic-object association hierarchy 402 is a hierarchy for specifying the attribute and the physical storage address of the TS object data 140d to be reproduced, so as to specify the combination and/or the construction of the TS object data 140d as the entity data and perform an address conversion to the object hierarchy 403 from the logic hierarchy 401, on the basis of the information specified in the logic hierarchy 401 as described above. More specifically, in the logic-object association hierarchy 402, the object information data 130d, which separates a group of the contents composing each item 204 into units of the AU 132 and which finely separates each AU 132 into units of the PU 302, is written in the object information file 130 (see
Here, the “PU (Presentation Unit) 302” is a unit associating and uniting a plurality of elementary streams by the reproduction switchable unit. If there are three audio streams in the PU 302, the user can freely switch these three audio (e.g. audio for each language), during the reproduction of this vision.
On the other hand, the “AU (Associate Unit) 132” is a unit uniting a plurality of elementary streams such as video streams in the TS object used in one title, and made of one or more PUs 302. More specifically, it is a unit uniting the elementary stream packet IDs (ES_PID) for each TS object, indirectly via the PU 302. This AU 132 corresponds to an assembly made of a plurality of programs having a specific inter-relationship in view of the contents, such as a plurality of programs switchable to each other in the multi-source broadcasting. The PUs 302 belonged to the same AU 132 corresponds to one or more elementary stream assemblies each constructing a plurality of programs switchable to each other by the user operation during the reproduction.
Therefore, if the AU 132 to be reproduced is identified, and the PUs belonged to the AU are identified, the elementary stream to be reproduced is identified. That is, a desired elementary stream can be reproduced from the multi-recorded optical disc 100, without using the PAT or the PMT shown in
Incidentally, a further specific data structure of the AU information 132I and the PU information 302I, each defining the AU 132 and the PU 302, is discussed later in detail.
The elementary stream to be actually reproduced herein is identified or designated by the ES_PID that is a packet ID (see
Thus, in the logic-object association hierarchy 402, an address conversion is performed from a logical address relating to each item 204 to a physical address relating to each PU 302.
Next, the object hierarchy 403 is a physical hierarchy to reproduce the actual TS object data 140d. In the object hierarchy 403, the TS object data 140d is written within the object data file 140 (see
Thus, in the object hierarchy 403, the object data is actually reproduced, using the physical address obtained from the conversion in the logic-object association hierarchy 402.
As described above, the three hierarchies shown in
(Structure of Object Information File)
Next, with reference to
In this specific example, as shown in
In the upper part of
In the AU table 131, there are stored “AU table general information” in which the number of AUs and the pointer to each AU, and the like are written, and “the other information.”
The AU table 131 describes therein the Index number (Index number=. . .) of the corresponding ES map table 134, as the AU information 132I which indicates an ES table Index #m in each PU #m corresponding to each AU #n. Here, the “AU” is a unit corresponding to a “show” in TV broadcast, for example, as mentioned above (especially, in the case of “multi-vision” broadcasting, it is a unit of a group of a plurality of “visions” which is changeable or selectable), and it includes one or more PUs, each of which is a reproduction unit. Moreover, the “PU” is a group of mutually changeable elementary streams which are included in each AU, as described above, and the ES table Index #m corresponding to each PU is specified by the PU information 302I. For example, if multi-view contents are provided with the AU, the AU stores therein a plurality of PUs, and each PU stores therein the pointers to a plurality of elementary stream packet IDs which indicate the packets constituting the contents of each view. This indicates the Index number in the ES map table 134, as described later.
In the lower part of
The “ES map table general information” describes therein the size of the ES map table, the total number of Indexes, and the like.
The “Index #m” includes the elementary stream packet ID (ES_PID) of the entire elementary stream to be used for the reproduction, the corresponding Index number, and the address information of the elementary stream.
In the embodiment, for example, if the elementary stream is the video stream of the MPEG 2 as described above, only the TS packet number of the TS packet at the head of the I picture, and the corresponding display time length are written, as the address information, i.e. the ES address information 134d, on the ES map table 134, by which the data amount is tried to be reduced.
Because of the construction as described above, it is possible to obtain the elementary stream packet ID (ES_PID) of the actual elementary stream, from the Index number of the ES map 134 specified from the AU table 131. Moreover, since the address information of the elementary stream corresponding to the elementary stream packet ID can be obtained at the same time, it is possible to reproduce the object data on the basis of these information.
According to the data structure of the optical disc 100 explained above, even in adding a new title to the optical disc 100, necessary information can be easily added, which is useful. On the other hand, even if some information becomes unnecessary as a result of editing or the like, for example, what is to be done is simply not to refer to the information, and it is not necessary to actually delete the information from the table, which is useful, as well.
As explained in detail with reference to
Incidentally, in the aforementioned embodiment, the explanation is made on the optical disc 100 as an example of the information record medium and the recorder or player of the optical disc 100 as an example of the information record reproduction apparatus. Nevertheless, the present invention is not limited to the optical disc and the player or recorder thereof, but is applicable to various record media and the recorders or players thereof, supporting other high density recording or high transfer rate.
The present invention is not limited to the above-described embodiments, and various changes may be made, if desired, without departing from the essence or spirit of the invention which can be read from the claims and the entire specification. An information record medium, an apparatus for and a method of recording the information, an apparatus for and a method of reproducing the information, an apparatus for and a method of recording and reproducing the information, a computer program for controlling the record or the reproduction, and a data structure including a control signal, all of which involves such changes, are also intended to be within the technical scope of the present invention.
INDUSTRIAL APPLICABILITYAn information record medium, a apparatus for and a method of recording the information, an apparatus for and a method of reproducing the information, an apparatus for and a method of recording and reproducing the information, a computer program for controlling the record or the reproduction, and a data structure including a control signal, all of which are according to the present invention, can be applied to a high-density optical disc for consumer or industrial use, such as a DVD, on which various information, such as the video information, the audio information and the sub-video information, can be recorded at high density and further can be applied to a DVD player, a DVD recorder, and the like. Moreover, they can be applied to an information record medium, an information record reproduction apparatus, or the like, which are mounted on or can be connected to various computer equipment for consumer or industrial use, for example.
Claims
1. An information record medium comprising:
- video information to indicate a main video;
- sub-video information to indicate a sub-video, the sub-video at least partially displayable over the main video;
- predetermined part coordinate information to designate coordinates of a predetermined part included in the sub-video, in a coordinate system defined with respect to the sub-video; and
- sub-video control information including (i) coordinates-before-movement information to indicate coordinates of a sub-frame before a movement in the coordinate system, the sub-frame being at least an area of the sub-video, and (ii) coordinates-after-movement information to indicate coordinates of the sub frame after n-th movement (n is natural number equal to or more than 1) in the coordinate system.
2. The information record medium according to claim 1, wherein
- the predetermined part is a button video part, and
- the predetermined part coordinate information is button position information to indicate coordinates of the button video part.
3. The information record medium according to claim 2, wherein
- the sub-video control information further includes first button status information to indicate in which status a button, which is indicated by the button video part before the movement of the sub-frame, is among predetermined kinds of preset button status.
4. The information record medium according to claim 3, wherein
- the sub-video control information further includes second button status information to indicate in which status a button, which is indicated by the button video part after the n-th movement of the sub-frame, is among the predetermined kinds of preset button status.
5. The information record medium according to claim 2, wherein
- the sub-video control information further includes button command information to define a button command to be executed in a case that the button is operated.
6. The information record medium according to claim 2, further comprising:
- high light information to define how to control a high light display for the button video part.
7. The information record medium according to claim 6, wherein
- the high light information to define how to control the high light display defines which display mode is used to perform the high light display among predetermined kinds of preset display mode, depending on the button status among predetermined kinds of preset button status of a button displayed on the main video.
8. The information record medium according to claim 1, wherein
- a sub-video information set comprises the sub-video information and the predetermined part coordinate information, and
- the main video information, the sub-video information set and the sub-video control information are divided into predetermined packets and multiplexed, and further streamed into a video stream comprising the divided main video, a sub-video stream comprising the divided sub-video information set and a control information stream comprising the divided sub-video control information.
9. An information record apparatus comprising:
- a first record device for recording video information to indicate a main video;
- a second record device for recording sub-video information to indicate a sub-video, the sub-video at least partially displayable over the main video, and predetermined part coordinate information to designate coordinates of a predetermined part included in the sub-video, in a coordinate system defined with respect to the sub-video; and
- a third record device for recording sub-video control information including (i) coordinates-before-movement information to indicate coordinates of a sub-frame before a movement in the coordinate system, the sub-frame being at least an area of the sub-video, and (ii) coordinates-after-movement information to indicate coordinates of the sub frame after n-th movement (n is natural number equal to or more than 1) in the coordinate system.
10. An information record method comprising:
- a first record process of recording video information to indicate a main video;
- a second record process of recording sub-video information to indicate a sub-video, the sub-video at least partially displayable over the main video, and predetermined part coordinate information to designate coordinates of a predetermined part included in the sub-video, in a coordinate system defined with respect to the sub-video; and
- a third record process of recording sub-video control information including (i) coordinates-before-movement information to indicate coordinates of a sub-frame before a movement in the coordinate system, the sub-frame being at least an area of the sub-video, and (ii) coordinates-after-movement information to indicate coordinates of the sub frame after n-th movement (n is natural number equal to or more than 1) in the coordinate system.
11. An information reproduction apparatus for reproducing the information record medium according to claim 1, said apparatus comprising:
- a reproduction device for reproducing the video information, the sub-video information, the predetermined part coordinate information and the sub-video control information;
- a display output device capable of displaying the reproduced sub-video information over the reproduced video information;
- a control device for controlling the reproduction device and the display output device to display, before the movement of the sub-frame, the predetermined part within the sub-frame before the movement after the predetermined part is subjected to a predetermined kind of processing on the basis of the reproduced predetermined part coordinate information, while displaying the sub-frame before the movement over the main video on the basis of the coordinates-before-movement information included in the reproduced sub video control information, and to display, after the movement of the sub-frame, the predetermined part within the sub-frame after the movement after the predetermined part is subjected to a predetermined kind of processing on the basis of the reproduced predetermined part coordinate information, while displaying the sub-frame after the movement over the main video on the basis of the coordinates-after-movement information included in the reproduced sub-video control information.
12. The information reproduction apparatus according to claim 11, wherein
- the predetermined part is a button video part,
- the predetermined part coordinate information is button position information to indicate coordinates of the button video part,
- the information record medium further comprises high light information to define how to control a high light display for the button video part,
- the reproduction device further reproduces the high light information, and
- the control device controls the reproduction device and the display output device to perform the high light display as the predetermined kind of processing for the button video part, on the basis of the reproduced high light information.
13. An information reproduction method of reproducing the information record medium according to claim 1, implemented with an information reproduction apparatus comprising (i) a reproduction device for reproducing the video information, the sub-video information, the predetermined part coordinate information and the sub-video control information and (ii) a display output device capable of displaying the reproduced sub-video information over the reproduced video information, said method comprising:
- a first control process of controlling the reproduction device and the display output device to display, before the movement of the sub-frame, the predetermined part within the sub-frame before the movement after the predetermined part is subjected to a predetermined kind of processing on the basis of the reproduced predetermined part coordinate information, while displaying the sub-frame before the movement over the main video on the basis of the coordinates-before-movement information included in the reproduced sub video control information; and
- a second control process of controlling the reproduction device and the display output device to display, after the movement of the sub-frame, the predetermined part within the sub-frame after the movement after the predetermined part is subjected to a predetermined kind of processing on the basis of the reproduced predetermined part coordinate information, while displaying the sub-frame after the movement over the main video on the basis of the coordinates-after-movement information included in the reproduced sub-video control information.
14. An information record reproduction apparatus comprising:
- a first record device for recording video information to indicate a main video;
- a second record device for recording sub-video information to indicate a sub-video, the sub-video at least partially displayable over the main video, and predetermined part coordinate information to designate coordinates of a predetermined part included in the sub-video, in a coordinate system defined with respect to the sub-video;
- a third record device for recording sub-video control information including (i) coordinates-before-movement information to indicate coordinates of a sub-frame before a movement in the coordinate system, the sub-frame being at least an area of the sub-video, and (ii) coordinates-after-movement information to indicate coordinates of the sub frame after n-th movement (n is natural number equal to or more than 1) in the coordinate system;
- a reproduction device for reproducing the video information, the sub-video information, the predetermined part coordinate information and the sub-video control information;
- a display output device capable of displaying the reproduced sub-video information over the reproduced video information; and
- a control device for controlling the reproduction device and the display output device to display, before the movement of the sub-frame, the predetermined part within the sub-frame before the movement after the predetermined part is subjected to a predetermined kind of processing on the basis of the reproduced predetermined part coordinate information, while displaying the sub-frame before the movement over the main video on the basis of the coordinates-before-movement information included in the reproduced sub video control information, and to display, after the movement of the sub-frame, the predetermined part within the sub-frame after the movement after the predetermined part is subjected to a predetermined kind of processing on the basis of the reproduced predetermined part coordinate information, while displaying the sub-frame after the movement over the main video on the basis of the coordinates-after-movement information included in the reproduced sub-video control information.
15. An information record reproduction method implemented with an information record reproduction apparatus comprising (i) a reproduction device for reproducing the video information, the sub-video information, the predetermined part coordinate information and the sub-video control information and (ii) a display output device capable of displaying the reproduced sub-video information over the reproduced video information, said method comprising:
- a first record process of recording video information to indicate a main video;
- a second record process of recording sub-video information to indicate a sub-video, the sub-video at least partially displayable over the main video, and predetermined part coordinate information to designate coordinates of a predetermined part included in the sub-video, in a coordinate system defined with respect to the sub-video;
- a third record process of recording sub-video control information including (i) coordinates-before-movement information to indicate coordinates of a sub-frame before a movement in the coordinate system, the sub-frame being at least an area of the sub-video, and (ii) coordinates-after-movement information to indicate coordinates of the sub frame after n-th movement (n is natural number equal to or more than 1) in the coordinate system;
- a first control process of controlling the reproduction device and the display output device to display, before the movement of the sub-frame, the predetermined part within the sub-frame before the movement after the predetermined part is subjected to a predetermined kind of processing on the basis of the reproduced predetermined part coordinate information, while displaying the sub-frame before the movement over the main video on the basis of the coordinates-before-movement information included in the reproduced sub video control information; and
- a second control process of controlling the reproduction device and the display output device to display, after the movement of the sub-frame, the predetermined part within the sub-frame after the movement after the predetermined part is subjected to a predetermined kind of processing on the basis of the reproduced predetermined part coordinate information, while displaying the sub-frame after the movement over the main video on the basis of the coordinates-after-movement information included in the reproduced sub-video control information.
16. A computer program for a record control to control a computer disposed at the information record apparatus according to claim 9, said program making the computer function as at least a part of the first record device, the second record device and the third record device.
17. A computer program for a reproduction control to control a computer disposed at the information reproduction apparatus according to claim 11, said program making the computer function as at least a part of the reproduction device, the display output device and the control device.
18. A computer program for a record reproduction control to control a computer disposed at the information record reproduction apparatus according to claim 14, said program making the computer function as at least a part of the first record device, the second record device, the third record device, the reproduction device, the display output device and the control device.
19. A data structure including a control signal, said structure comprising:
- video information to indicate a main video;
- sub-video information to indicate a sub-video, the sub-video at least partially displayable over the main video;
- predetermined part coordinate information to designate coordinates of a predetermined part included in the sub-video, in a coordinate system defined with respect to the sub-video; and
- sub-video control information including (i) coordinates-before-movement information to indicate coordinates of a sub-frame before a movement in the coordinate system, the sub-frame being at least an area of the sub-video, and (ii) coordinates-after-movement information to indicate coordinates of the sub frame after n-th movement (n is natural number equal to or more than 1) in the coordinate system.
Type: Application
Filed: Oct 1, 2003
Publication Date: Jun 15, 2006
Inventors: Nobuyuki Takakuwa (Saitama), Yasuko Fukuda (Saitama), Takao Sawabe (Saitama), Tohru Kanegae (Saitama), Masanori Nakahara (Saitama), Takeshi Koda (Saitama)
Application Number: 10/530,033
International Classification: H04N 5/91 (20060101);
