Abstract: A method and apparatus for reproducing metadata provides a data structure in which metadata whose preferential reproduction is desired can be selected and reproduced. The metadata relevant to a moving image includes a stream data structure including one or more access units each being a data unit which can be independently processed, and each of the access units includes first data to specify an effective period defined with respect to a time axis of the moving image, object area data describing a spatio-temporal region in the moving image, second data including one of or both of data to specify a display method relevant to the spatio-temporal region and data to specify a processing to be performed when the spatio-temporal region is specified, and third data to specify, in a case where one or more access units exist on a same screen in the moving image at a time of reproduction of the metadata, reproduction priority of each of the access units.

Abstract: In the case where metadata refers to relevant content on a network, since the relevant content on the network can not be necessarily permanently held, it is desirable that a time limit for making reference can be set. Besides, in order to provide relevant content which can be referred to only in a limited period for promoting sales, or in order to provide relevant content which can be referred to only in a limited period such as, for example, Christmas Day every year for raising the entertainingness of the metadata, it is desirable that a reference time limit of the relevant content can be set. Then, in order to set an effective time limit of an access unit, a flag to specify the effective time limit and the effective time limit are described in each access unit.

Abstract: There is provided a structure of metadata which can express an object of a complicated shape. There are added vcr_shape_num indicating the number of sub-planar areas constituting an object area, vcr_rule_code indicating that an integration system to integrate the sub-planar areas and to determine a final object area is written, vcr_rule_length to indicate the length of data of the integration system, and data vcr_rule to indicate the integration system, and thereafter, vcr_subregion_data of data of each sub-planar area appearing in vcr_rule is described continuously by the number indicated by vcr_shape_num.

Abstract: A moving-picture processing apparatus includes an acquisition unit configured to acquire metadata including information about each temporal region in an input moving picture with a plurality of temporal regions, a decision unit configured to determine a cutout region corresponding to at least any one of the plurality of temporal regions on the basis of the metadata, and a cutting-out unit configured to cut out the cutout region from an image in each frame of the input moving picture.

Abstract: A structure of metadata relevant to a moving image, in which metadata editing is easily performed, comprising a stream data structure including one or more access units each capable of being independently processed; each of said access units has: first data for a reference time point within an access unit time for describing the metadata so as to cause the access unit time to correspond to a moving image time; an object area data describing a spatio-temporal region in the moving image; and second data for specifying a display method relevant to the spatio-temporal region and/or a processing when the spatio-temporal region is designated. The moving image time is to be made to correspond to the access unit time on basis of the reference time point in the first data, so that a period during which at least said second data may be called is specified.

Abstract: An object region data describing method of describing information about the object region in an image over a plurality of frames determines the region of a target object in an image using an approximate function that approximates the trajectory obtained by arranging, in the direction of frame advance, one representative point of an approximate figure for the object region and the difference values for determining the other representative points and describes information about the object region using a parameter for the function.

Abstract: A computer system with a monitor display, comprises a decoder unit configured to decode video data containing digital watermark information to derive decoded data, and configured to determine, based on information included in the video data, whether or not first certification for certifying that the video data is legitimately reproduced data succeeds, and a graphics controller which determines, using the digital watermark information, whether or not second certification for certifying that the video data is to be protected from being copied succeeds, the graphics controller converting the decoded data into a protected decoded data from being copied and outputting the protected decoded data to the monitor display if the first certification and the second certification succeed, and the graphics controller inhibiting the decoded data from being output to the monitor display if the first certification fails and the second certification succeeds.

Abstract: A method to detect a given pattern in an image, as for obtaining, by a computer, transformation parameters that facilitate transformation of a template as to be overlapped with the object, comprising: inputting the template having contour points and region distinguishing information for each points; inputting contour candidate points and region distinguishing information for each points; transforming a position or a shape of the template by using each of transformation parameter set candidates; obtaining an evaluation value, or similarity of a distribution of the object and background regions, on each overlapping pair between one of the contour candidate points in the image and one of the contour points of the template; obtaining sum of the evaluation values only for those not smaller than a threshold evaluation value, for the each of the transformation parameter set candidates; and outputting a transformation parameter set having largest sum of the evaluation values.

Abstract: A spatiotemporal locator processing method of correcting a spatiotemporal locator capable of specifying a trajectory of a representative point of an approximate figure representing an arbitrary region in order to represent a transition of the region over a plurality of frames in video data, obtains the trajectory of the representative point based on the spatiotemporal locator, displays the obtained trajectory of the representative point on a screen, receives input of a correction instruction for the trajectory displayed on the screen, and corrects the spatiotemporal locator based on the correction instruction.

Abstract: An object region data describing method of describing information about the object region in an image over a plurality of frames determines the region of a target object in an image using an approximate function that approximates the trajectory obtained by arranging, in the direction of frame advance, one representative point of an approximate figure for the object region and the difference values for determining the other representative points and describes information about the object region using a parameter for the function.

Abstract: A data processing method processes image data including spatiotemporal locator information which is added. The spatiotemporal locator information represents a spatiotemporal area which is a temporal transition of an object region over a plurality of frames. The method sets a curved surface defined by a periphery of the spatiotemporal area based on the spatiotemporal locator information, calculates time when a reference trajectory crosses the curved surface, determines whether coordinate values of the reference trajectory are inside or outside of the object region in at least one of frames in which the object region exists, and outputs information relating to whether or not the reference trajectory passes the spatiotemporal area.

Abstract: There is provided a structure of metadata in which an operation at a time of object designation can be changed according to the kind of an input interface used for input or a method of an input operation. The metadata relevant to a moving image has a stream data structure including one or more access units each being a data unit which can be independently processed, and each of the access units includes first data to specify an effective period defined with respect to a time axis of the moving image, object area data describing a spatio-temporal region in the moving image, plural second data each specifying processing to be performed when the spatio-temporal region is designated, and third data to cause the respective second data to correspond to kinds of input interfaces or operation methods by which a user designates the object.

Abstract: In order to assist a viewer in understanding the contents of a moving image, it is desired to plainly represent the contents of metadata to the viewer. The metadata relevant to the moving image has a stream data structure including one or more access units each being a data unit which can be independently processed. Each of the access units includes first data to specify an effective period defined with respect to a time axis of the moving image, object area data describing a spatio-temporal region in the moving image, and balloon data to display relevant data of the object by a balloon. The balloon data includes text data to be displayed in the inside of the balloon and to express the contents of the object and position specifying data to specify a display position of the balloon.

Abstract: There is provided an invention in which in a moving image hypermedia including moving image data and its metadata, when a viewer specifies an object, it is easy to confirm that the specification has been successfully made, and the specified object can be easily confirmed. Metadata relevant to a moving image has a stream data structure including one or more access units each being a data unit which can be independently processed, and each of the access units includes first data to specify an effective period defined with respect to a time axis of the moving image, object area data describing a spatio-temporal region in the moving image, second data to specify a processing to be performed when the spatio-temporal region is specified, third data including a display method for causing the spatio-temporal region to be recognized, and fourth data to specify, in a case where an event relevant to the spatio-temporal region is generated by a cursor operated by a user, calling the third data.

Abstract: For a reproduction device in which a usable memory size has an upper limit, this invention discloses a novel structure of metadata, which can suppress the number of seeks of a CD or a DVD occurring at a time of reproduction of metadata of a moving image including a large number of scripts and hyper texts (HTML) each having a small data size, and the number of times of file request transmission/reception through a large number of networks. In the metadata of the moving image, in the case where access units AU#2 and AU#3 require EF#1, and access units AU#2 to AU#4 require EF#2, the EF#1 and the EF#2 are embedded in front of the AU#2, and a script in the AU uses a file name, a file identifier, or a virtual buffer offset in order to specify the EF to which reference is made. Embedding of a file and identification of the file are realized by causing the EF and the AU to have file identification information respectively and by specifying the file identification information from the script.

Abstract: Although it is necessary to display a mouse cursor in order to specify an object area in a moving image, there is a fear that a standard cursor spoils the atmosphere of the moving image or the intention of a producer. Then, a data structure is desired in which the shape of the cursor can be freely specified according to the contents of the moving image or the object. In metadata of the moving image, the object area appearing in the moving image is divided into plural data (access units), and the access unit is made to be capable of specifying the cursor shape, and the cursor shape in the object area is made freely changeable.

Abstract: In preparation for a case where a user indicates an area where an object does not exist, it is desired that an action for that case is also described in metadata. Then, layer value data indicating order of overlap of object area data on a screen or discrimination data intrinsic to an object area is described in each of access units. The access unit in which the layer value data or the discrimination data is a specific value, corresponds to “area where an object does not exist” at that time.

Abstract: There is provided a structure of metadata which can express an object of a complicated shape. There are added vcr_shape_num indicating the number of sub-planar areas constituting an object area, vcr_rule_code indicating that an integration system to integrate the sub-planar areas and to determine a final object area is written, vcr_rule_length to indicate the length of data of the integration system, and data vcr_rule to indicate the integration system, and thereafter, vcr_subregion_data of data of each sub-planar area appearing in vcr_rule is described continuously by the number indicated by vcr_shape_num.

Abstract: Since there is a case where reproduction of metadata is limited according to the processing power of a reproduction apparatus or the designation from a user, the invention provides a data structure in which metadata whose preferential reproduction is desired can be selected and reproduced.

Abstract: In the case where metadata refers to relevant content on a network, since the relevant content on the network can not be necessarily permanently held, it is desirable that a time limit for making reference can be set. Besides, in order to provide relevant content which can be referred to only in a limited period for promoting sales, or in order to provide relevant content which can be referred to only in a limited period such as, for example, Christmas Day every year for raising the entertainingness of the metadata, it is desirable that a reference time limit of the relevant content can be set. Then, in order to set an effective time limit of an access unit, a flag to specify the effective time limit and the effective time limit are described in each access unit.