Abstract: A variance between sequential video pictures is extracted, and then, a GOP boundary position is decided based on inter-frame variance information. Furthermore, simple motion estimation is carried out with respect to video pictures inside one GOP. If a motion variation between the video pictures is large, a small predictive frame interval is taken; to the contrary, if the motion variation is small, a large predictive frame interval is taken. The simple motion estimation is carried out between two downscaled feature planes at a timewise fixed interval with respect to a video picture which is discriminated to be an interlaced video picture, wherein a motion compensatory prediction error at that time is output as image variance information. If the image variance is small, coding is conducted by a frame structure; to the contrary, if the image variance is large, the coding is conducted by a field structure.

Abstract: The present invention intends to provide a classification apparatus for broadcasted sport videos for classifying various scenes constituting a sport video, depending on the importance level without being limited to any particular sport video by using visual and audio features. A sport video classification processing portion determines and classifies a play scene, a close-up shot and the like using an audio and a color feature extracted from motion picture data. Because the determination of the most frequent color can be changed adaptively for each inputted sport video, it is not necessary to determine any particular color to the most frequent color previously.

Abstract: The present invention provides a scene classification apparatus for classifying uncompressed or compressed video into various types of scenes at low cost and with high accuracy using characteristics of a video and audio characteristics accompanied by the video. When video are compressed data, their motion intensity, spatial distribution of motion and histogram of motion direction are detected by using values of motion vectors of predictive coding images existing in respective shots, and the respective shots of the video are classified into a dynamic scene, a static scene, a slow scene, a highlight scene, a zooming scene, a panning scene, a commercial scene and the like based on the motion intensity, the spatial distribution of motion, the histogram of motion direction and shot density.

Abstract: The picture input section 12 fetches image data from the storage device 11, and then, inputs image data on sequential n images into the section 13 for measuring correlation between sequential images and the section 14 for measuring correlation between sampled images. The section 13 for measuring correlation between sequential images measures the correlation between sequential images based on video data. The section 14 for measuring correlation between sampled images measures the correlation between sub-sampled images. The short shot determining section 15 determines short cut points by using the correlation between the sequential images and the correlation between the sub-sampled images. Otherwise, short cut points may be determined in consideration of motion amount between the sequential images or the sub-sampled images.

Abstract: A coding parameter extracting unit extracts predictive-coded mode information, motion vectors, and coded transformed coefficients from video-signal-demultiplexed information. An abrupt scene change judging unit uses a characteristic that scenes change greatly before and after an abrupt scene change, to classify blocks on the basis of the predictive-coded mode information among the compressed moving picture data, so that an abrupt scene change is detected. A special effect judging unit detects dissolve from motion characteristic values calculated from the values of motion vectors, predictive-coded picture characteristic values derived from coefficients on frequency domains in blocks, and the number of blocks each having a motion vector that is larger than a threshold; and detects wipe by motion characteristic values calculated from the values of motion vectors, and predictive-coded picture characteristic values derived from coefficients on frequency domains in blocks.

Abstract: A variance between sequential video pictures is extracted, and then, a GOP boundary position is decided based on inter-frame variance information. Furthermore, simple motion estimation is carried out with respect to video pictures inside one GOP. If a motion variation between the video pictures is large, a small predictive frame interval is taken; to the contrary, if the motion variation is small, a large predictive frame interval is taken. The simple motion estimation is carried out between two downscaled feature planes at a timewise fixed interval with respect to a video picture which is discriminated to be an interlaced video picture, wherein a motion compensatory prediction error at that time is output as image variance information. If the image variance is small, coding is conducted by a frame structure; to the contrary, if the image variance is large, the coding is conducted by a field structure.

Abstract: A thumbnail data having a time necessary for browsing display is extracted from a video file stored in a storage device in real time using query (cut point query, query by telop such as news, audio classification data, etc.), and then, high-precise thumbnail retrieval and browsing is carried out at frame unit and second unit. Further, high-precise segment playback by designating the thumbnail retrieval and browsing time as playback start/end points can be achieved without preparing a thumbnail data saving storage device. Therefore, it is possible to achieve high-precise thumbnail retrieval and browsing at frame unit and second unit without previously preparing and saving the thumbnail data. Further, it is possible to provide a retrieval, browsing and editing apparatus, which can effectively and accurately realize frame unit edit processing using the thumbnail retrieval and browsing, and to provide a recording medium recording the processing program.

Abstract: The present invention relates to the video playback unit of one or a plurality of videos, the delivery unit and the recording medium for recording the program of the processing of these units. The video playback unit of one video reads in order the video data of the video file from the storage unit. The display displays the video data, the time information sequence data and the still image sequence data positioned before and after the playback time of the video data. In this way, the video scene contained in the video file stored in the storage unit and the video file within the server network-connected can be effectively read or the target scene can be effectively retrieved. On the other hand, the playback unit of a plurality of videos divides a plurality of videos read from the storage unit into the main videos and the proxy videos so that these videos can be simultaneously displayed. In this way, a plurality of videos can be played back even in a limited transmission bandwidth and decoding capacity.

Abstract: A next input image selector 8 specifies a time at which an input image to be processed next is to be input immediately after finishing an encoding of one image. An input video capture 1 obtains an image of which input time has been specified and sends this image to an input image information detector 2. The input image information detector 2 makes a decision as to whether or not the input image is an image to be processed based on an image variance between this input image and an input image processed immediately before stored in a frame memory 3. If this decision is negative, an input image re-selector 4 re-selects an image to be processed, and if the decision is affirmative, this input image is sent as an image to be processed to a target output bits setter 5 and a motion predictor 11. An output bits controller 6 determines a quantizing level of a quantizer 14 from target output bits and actual output bits obtained from an encoder 15.

Abstract: It is an objective of the invention to provide a description scheme of summary audio/video data, which is capable of presenting fast and advanced browsing.

Abstract: The present invention provides an information search and display apparatus capable of dealing with information provided in various data formats from a plurality of different media in an integrated manner.

Abstract: A feature description method capable of high-speed, efficiently searching audio data or grasping a summary of the audio data by giving considerations to elements and characteristics peculiar to the audio data, is provided. Also, an audio video data feature description collection construction method for collecting feature descriptions from multiple pieces of audio video data based on a specific feature type makes it possible to efficiently, clearly describe a feature description collection.