Abstract: An apparatus may include a memory to store a recorded video. The apparatus may further include an interface to receive at least one set of sensor information based on sensor data that is recorded concurrently with the recorded video and a video clip creation module to identify a sensor event from the at least one set of sensor information and to generate a video clip based upon the sensor event, the video clip comprising video content from the recorded video that is synchronized to the sensor event.

Abstract: Various embodiments may obtain an image representation of an object for use in image matching and content retrieval. For example, an image matching system processes video content items to determine one or more scenes for one or more video content items. The image matching system can extract, from at least one video frame for a scene, feature descriptors relating to one or more objects represented in the at least one video frame. The image matching system indexes the feature descriptors into a feature index storing information for each of the feature descriptors and respective corresponding video frame. The image matching system correlates the feature descriptors of the feature index to determine one or more groups having similar feature descriptors. The image matching system indexes the one or more groups into a correlation index storing information for each of the one or more groups and respective corresponding feature descriptors.

Abstract: Techniques related to video codec architecture for next generation video are described.

Abstract: The present disclosure provides an image capture, curation, and editing system that includes a resource-efficient mobile image capture device that continuously captures images. In particular, the present disclosure provides low power frameworks for processing, compressing, and transmitting images at a mobile image capture device. One example low power framework includes a scene analyzer that analyzes a scene depicted by a first image and determines whether to store the first image in a non-volatile memory or to discard the first image from a temporary image buffer without storing the first image in the non-volatile memory.

Abstract: A video codec including a memory and a processor operably coupled to the memory. The processor is configured to compute a reconstructed pixel based on a residual pixel and a first prediction pixel and compute a second prediction pixel in a directional intra prediction mode based on the reconstructed pixel, where the first and second prediction pixels are located in a same block of a video frame. A method for intra prediction including computing a prediction pixel adaptively based on a plurality of reconstructed neighboring pixels, where a distance between the prediction pixel and each of the plurality of reconstructed neighboring pixels is one.

Abstract: A video segmentation system can be utilized to automate segmentation of digital video content. Features corresponding to visual, audio, and/or textual content of the video can be extracted from frames of the video. The extracted features of adjacent frames are compared according to a similarity measure to determine boundaries of a first set of shots or video segments distinguished by abrupt transitions. The first set of shots is analyzed according to certain heuristics to recognize a second set of shots distinguished by gradual transitions. Key frames can be extracted from the first and second set of shots, and the key frames can be used by the video segmentation system to group the first and second set of shots by scene. Additional processing can be performed to associate metadata, such as names of actors or titles of songs, with the detected scenes.

Abstract: Embodiments provide a video camera that can be configured to compress video data in a manner that achieves a targeted output size in a computationally efficient manner. The video compression systems and methods can be used with DCT-based compression standards to include a rate control aspect. The rate controlled video compression methods can be configured to compress video data in, real time and/or using a single pass. During compression of video data, the video compression systems and methods can modify compression parameters to achieve a targeted file size while maintaining relatively high visual quality of the compressed images.

Abstract: A method for video browsing includes comparing a current image frame with a previous image frame prior to the current image frame in a video to obtain target block information, identifying the current image frame as a keyframe if the target block information satisfies a predetermined condition, and playing the keyframe.

Abstract: An aspect of the disclosure is directed to transmitting a reduced stream of encoded video frames. An original stream of encoded video frames is analyzed, a plurality of frames are removed without re-encoding encoded video frames to generate the reduced stream of encoded video frames, and the reduced stream and metadata describing the plurality of removed frames are transmitted. An aspect of the disclosure is directed to creating a new version of an original stream of encoded video frames from a reduced stream of encoded video frames. The reduced stream of encoded video frames is received, the plurality of removed frames is identified based on metadata related to the reduced stream, a plurality of replacement frames are generated, and the plurality of replacement frames are added to the reduced stream of encoded video frames to recreate the new version of the original stream of encoded video frames.

Abstract: A system and process for video characterization that facilitates video classification and retrieval, as well as motion detection, applications. This involves characterizing a video sequence with a gray scale image having pixel levels that reflect the intensity of motion associated with a corresponding region in the sequence of video frames. The intensity of motion is defined using any of three characterizing processes. Namely, a perceived motion energy spectrum (PMES) characterizing process that represents object-based motion intensity over the sequence of frames, a spatio-temporal entropy (STE) characterizing process that represents the intensity of motion based on color variation at each pixel location, a motion vector angle entropy (MVAE) characterizing process which represents the intensity of motion based on the variation of motion vector angles.

Abstract: An image display apparatus includes: a light-emitting unit having a plurality of light sources capable of controlling emission brightness individually; a display unit that displays an image on a screen; and a control unit that controls the respective emission brightnesses of the respective light sources according to images of regions on the screen corresponding to the respective light sources. When a difference between an image of a subject frame and an image of a past frame earlier than the subject frame is caused from movement of a predetermined object, the control unit suppresses the emission brightness of a light source corresponding to an image region of the subject frame brighter than that of the past frame from changing from the emission brightness of a light source corresponding to this image region of the past frame.

Abstract: Methods and system for providing content are disclosed. One method can comprise receiving a request for data at a first time, wherein the data comprises a first time duration, determining a buffer size based upon the first time duration, and determining a playback window based upon the determined buffer size and the first time. The method can also comprise synchronizing presentation of content on a plurality of devices.

Abstract: A method and apparatus for generating a thumbnail of a video content in an electronic device is provided. The method for generating the thumbnail of the video content in the electronic device includes dividing a video content into a plurality of pieces, extracting a characteristic point of each of the plurality of pieces, comparing the characteristic point of each of the plurality of pieces and a characteristic point of each of a plurality of pieces of at least one other video content, and determining a thumbnail of the video content from a piece of the video content that is not the same as a piece of the at least one other video content, based on a result of the comparing.

Abstract: An image sequence acquisition section acquires an image sequence including a plurality of images. A processing section performs an image summarization process that acquires a summary image sequence based on first and second deletion determination processes that delete some of the images included in the acquired image sequence. The processing section sets an attention image sequence including one at least one attention image included in the plurality of images, selects a first reference image from the attention image sequence, selects a first determination target image from the plurality of images, and performs the first deletion determination process that determines whether the first determination target image can be deleted based on first deformation information that represents deformation between the first reference image and the first determination target image.

Abstract: A method of removing unwanted camera motion from a video sequence is provided. The method matches a group of feature points between each pair of consecutive video frames in the video sequence. The method calculates the motion of each matched feature point between the corresponding pair of consecutive video frames. The method calculates a set of historical metrics for each feature point. The method, for each pair of consecutive video frames, identifies a homography that defines a dominant motion between the pair of consecutive frames. The homography is identified by performing a geometrically biased historically weighted RANSAC on the calculated motion of the feature points. The geometrically biased historically weighted RANSAC gives a weight to the calculated motion of each feature point based on the historical metrics calculated for the feature point. The method removes the unwanted camera motion from the video sequence by using the identified homographies.

Abstract: Methods and apparatus provide for a Scene Detector to optimize the location of scene breaks in a set of video frames. Specifically, the Scene Detector receives a set of video frames and a corresponding content model for each video frame. As the Scene Detector identifies a scene in the set of video frames, the Scene Detector updates statistical predictors with respect to characteristics of that scene's characteristics. The Scene Detector thereby utilizes the updated statistical predictors to identify a video frame that may be the next scene break. The Scene Detector analyzes video frames with respect to the possible next scene break in order to identify the actual second scene break that occurs after the previously identified scene break.

Abstract: A system for tagging an object comprises and interface and a processor. The interface is configured to receive an image. The processor is configured to determine a key frame. Determining a key frame comprises determining that the image is stable. The processor is configured to determine a tag for an item in the key frame.

Abstract: Mechanisms are provided for retrieving and presenting related content using text stream data feeds. Text stream data feeds such as caption information associated with media content or conversations associated with social networking applications are aggregated and used to retrieve related media content, text documents, and advertisements. Text stream data feeds that a user is exposed to may indicate that the user is interested or at least primed for particular types of related content. In particular examples, an inverse vector space search engine is used to determine particular pieces of related content and categories of interest. Post filtering may also be applied to the results.

Abstract: A contrast calculating unit calculates a contrast of a high frequency component and a contrast of a low frequency component of a transformed radiographic image at an analysis point set by an analysis point setting unit. A ratio calculating unit calculates a ratio of the contrast of the high frequency component to the contrast of the low frequency component. A determining unit determines whether or not there is a body motion during an imaging operation to take the radiographic image based on the ratio. A display control unit displays a result of the determination on a display unit.

Abstract: Systems and methods of motion detection on encrypted or scrambled video data streams are provided. Some methods can include identifying macroblock size information for an encrypted/scrambled video data stream and using the identified macroblock size information to determine a presence of motion in the encrypted/scrambled video data stream without decrypting and descrambling the encrypted/scrambled video data stream.

Abstract: A solution is provided for temporally segmenting a video based on analysis of entities identified in the video frames of the video. The video is decoded into multiple video frames and multiple video frames are selected for annotation. The annotation process identifies entities present in a sample video frame and each identified entity has a timestamp and confidence score indicating the likelihood that the entity is accurately identified. For each identified entity, a time series comprising of timestamps and corresponding confidence scores is generated and smoothed to reduce annotation noise. One or more segments containing an entity over the length of the video are obtained by detecting boundaries of the segments in the time series of the entity. From the individual temporal segmentation for each identified entity in the video, an overall temporal segmentation for the video is generated, where the overall temporal segmentation reflects the semantics of the video.

Abstract: There are provided a method and apparatus for adaptive Group of Pictures structure selection. The apparatus includes an encoder for encoding a video sequence using a Group of Pictures structure by performing, for each Group of Pictures for the video sequence, picture coding order selection, picture type selection, and reference picture selection. The selections are based upon a Group of Pictures length.

Abstract: An image processing method includes steps of: providing a source face image and a target face image; extracting facial features from the source face image and the target face image respectively; detecting feature dimensions of the facial features from the source face image and the target face image respectively; pairing the facial features from the source face image with the facial features from the target face image; and, forming an output face image by adjusting the facial features from the source face image in at least one of the feature dimensions according to the paired features from the target face image in the corresponding feature dimensions.

Abstract: Object detection techniques are described. In one or more implementations, a plurality of images are received by a computing device. The plurality of images are analyzed by the computing device to detect whether the images include, respectively, a depiction of an object. If an object is found in a first image, the locations, angles and scales for object detection can be further restricted in a second one. If an object is not found in a first one of the image, different portions of a second one of the images are analyzed for object detection.

Abstract: Frames of a video data stream can be encoded using statistically-based spatially differentiated partitioning. Statistically-based spatially differentiated partitioning involves forming a difference frame between a current video frame and a temporally nearby video frame and then calculating the variance of the difference frame on a block-by-block basis. A histogram can be formed from the calculated variances and a threshold determined on the histogram. The determined threshold can be used to select parameters for the encoding process that will more efficiently encode static or slow-motion areas without a significant loss in resulting quality.

Abstract: An aspect of the disclosure is directed to transmitting a reduced stream of encoded video frames. An original stream of encoded video frames is analyzed, a plurality of frames are removed without re-encoding encoded video frames to generate the reduced stream of encoded video frames, and the reduced stream and metadata describing the plurality of removed frames are transmitted. An aspect of the disclosure is directed to creating a new version of an original stream of encoded video frames from a reduced stream of encoded video frames. The reduced stream of encoded video frames is received, the plurality of removed frames is identified based on metadata related to the reduced stream, a plurality of replacement frames are generated, and the plurality of replacement frames are added to the reduced stream of encoded video frames to recreate the new version of the original stream of encoded video frames.

Abstract: To provide an image evaluation apparatus and camera which are capable of evaluating an image which is comprehensively good. An image evaluation apparatus comprising: a storage portion which stores a plurality of images when an imaging portion of a camera has continuously imaged in a predetermined time interval a plurality of frames of a subject in a photographing area of the camera, and an image evaluation portion which evaluates a plurality of the images stored in the storage portion, based on a characteristic amount showing a state in which the subject in the photographing area changing in chronological sequence, when the plurality of the images is imaged.

Abstract: Methods, apparatus and systems are employed to generate a dynamic content, for example, a looping video using an application operating on a device including a graphical user interface presented in a display. In some embodiments, a video stream including audio is acquired by employing the graphical user interface to operate an application displayed in the graphical user interface and a continuous loop is generated from the acquired video stream, the application automatically limiting a length of the continuous loop to a maximum amount of time pre-determined by the application.

Abstract: A method of optical sensing comprising generating optical data associated with an object of interest, generating non-optical data associated with the object of interest, and analyzing the optical and non-optical data.

Abstract: Various aspects of a method and system to process video content are disclosed herein. The method includes determination of a first frame identification value associated with a video content. The first frame identification value corresponds to an average color value of a frame of the video content. The method further includes determination of a second frame identification value associated with the video content. The second frame identification value corresponds to a global motion vector (GMV) value of the frame of the video content. The method further includes determination of a first intermediate frame based on one or both of the first frame identification value and the second frame identification value.

Abstract: A method for providing audio messages includes receiving a first image set and a second image set. The first image set includes visually encoded audio data for rendering audio on an electronic computing device. The method also includes displaying images from the first and second image sets interspersed in an image sequence. In the image sequence, a time interval between each image from the first image set and at least one image from the second image set is less than a critical flicker interval (CFI) for a human eye.

Abstract: An image processing device includes an evaluation unit which acquires a search pattern which is an appearance pattern of a person in a scene of a video content containing the scene, where a similar scene is to be searched, and a search target pattern which is an appearance pattern of a person in a video content which is to be a search target of the similar scene, calculates a degree of similarity between the search pattern and the search target pattern, and determines the similar scene on a basis of the calculated degree of similarity.

Abstract: An apparatus for generating an image signal for a display (103) comprises a receiver (105) which receives a video signal comprising three-dimensional data for a sequence of images. An image generator (107) generates display images for the sequence of images based on the three dimensional data and a rendering viewpoint. A shot transition detector (111) detects shot transitions in the sequence of images and a viewpoint controller (113) changes the rendering viewpoint in synchronization with the shot transition. A signal generator (109) generates the image signal to comprise the display images. The apparatus may further track viewer movements and adapt the rendering accordingly. In addition the system may bias the viewpoint towards a nominal viewpoint. The viewpoint changes due to tracking may be non-synchronous whereas the viewpoint changes due to bias may be synchronous with shot transitions.

Abstract: Methods and systems for coding applications are described, where multiple coding passes are performed for purposes of rate control. Prediction structures are generated and used by the multiple coding passes to update coding statistics generated prior to the coding passes. The updated coding statistics are used for a subsequent coding operation.

Abstract: Described herein are techniques related to frame-level quantization parameter (QP) adjustment in video encoding. In particular, a method of implementing a bit rate control (BRC) algorithm is described to dynamically control the QP during the video encoding.

Abstract: Systems, methods and computer readable media for determination of monochromatic images are described. Some implementations can include a method. The method can include converting an image in a first colorspace to a first converted image in a second colorspace. The method can also include generating a hue histogram based on hue values in the converted image and determining a hue dispersion measure based on the hue histogram and a number of pixels in the image. The method can further include determining a hue clustering value based on the hue histogram and converting the image in the first colorspace into a second converted image in a third colorspace. The method can also include determining a variance measure based on the second converted image, and comparing the hue dispersion measure, the hue clustering value and the variance measure to a first threshold value, a second threshold value and a third threshold value, respectively.

Abstract: A content providing system based on a media playback apparatus capable of reading a content reception information stored in a storage media to provide a multimedia content to a user is disclosed. In accordance with the system, an advertisement or a promotion of a product is possible by distributing a storage media that holds a link to a content providing apparatus to consumers.

Abstract: An auto-contrast enhancement system includes a human visual system (HVS)-based local difference (LD) histogram unit configured to build a LD histogram with respect to intensity values; a histogram classifier configured to categorize histograms of input images based on distribution properties; and a histogram equalization (HE) unit configured to process the input image according to a result of the HVS-based LD histogram unit and the enhancement level determined in the histogram classifier.

Abstract: Content-based analysis is performed on multimedia content prior to encoding the multimedia content in the rendering chain of processing. A content-based index stream is generated based on the content-based analysis and the content-based index stream is embedded in the multimedia file during rendering. The content-based index stream can be used to generate a content-based searchable index when necessary.

Abstract: In one embodiment, a method includes analyzing characteristics of a media program to label parts of the media program with a plurality of labels where parts of the media program that are determined to be substantially similar are labeled with a same label. The method then analyzes different partitionings of a sequence of the labels to determine partitions for the media program based on a weighting function that is configured to weight the different partitionings based on portions created from the partitions in the different partitionings. Then, a partitioning for the media program is outputted based on comparing the different partitionings of the sequence of labels using the weighting function. The outputted partitioning partitions the media program into a set of portions and provides points for insertion of information for a service in the media program.

Abstract: A system and method is provided for editing and parsing compressed digital information. The compressed digital information may include visual information which is edited and parsed in the compressed domain. In a preferred embodiment, the present invention provides a method for detecting moving objects in a compressed digital bitstream which represents a sequence of fields or frames of video information for one or more captured scenes of video.

Abstract: According to a method in the present invention, first whether an inter-frame difference for each pixel in predetermined first region and second region in the dynamic image exceeds a predetermined threshold is judged to determine whether the pixel is a static information point, and when, in the second region, pixels in regions not overlapping with the first region are determined as non-static information points, judgment on the inter-frame difference and the predetermined threshold is stopped; and then static characteristic information in the dynamic image is determined based on the static information points in the first region. Preferably, the inter-frame difference for each pixel in the first region may be re-judged based on an adjusted predetermined threshold, to further determine the static characteristic information in the dynamic image, so that static opaque static characteristic information or static characteristic information with arbitrary degrees of transparency in the dynamic image can be detected.

Abstract: There is provided a fingerprint (340) for a video stream (110) comprising a sequence of scenes (200a, 200b, 200c), wherein the fingerprint (340) includes information indicative of durations of the scenes (200a, 200b, 200c). The information indicative of the durations of the scenes (200a, 200b, 200c) is included in the fingerprint (340) in an order in which the scenes (200a, 200b, 200c) are included in the video stream (110). Moreover, each duration is optionally defined as a count of a number of video frames (260, 270) therein. The method is capable of generating a fingerprint which is susceptible to more simply and more efficiently synchronizing first and second data signals together.

Abstract: An apparatus, method, and computer-readable medium for motion sensor-based video stabilization. A motion sensor may capture motion data of a video sequence. A controller may compute instantaneous motion of the camera for a current frame of the video sequence and accumulated motion of the camera corresponding to motion of a plurality of frames of the video sequence. The controller may compare the instantaneous motion to a first threshold value, compare the accumulated motion to a second threshold value, and set a video stabilization strength parameter for the current frame based on the results of the comparison. A video stabilization unit may perform video stabilization on the current frame according to the frame's strength parameter.

Abstract: In a video processing system, a method and system for using motion estimation to equalize video quality across intra frames are provided. Inter-prediction processing may be enabled for macroblocks in an “I” frame to generate temporal statistics. The inter-prediction processing may comprise motion estimation and motion compensation. Spatial statistics may be generated from the macroblocks in the “I” frame. A rate control may be determined based on the inter-prediction processing and spatial statistics.

Abstract: The method facilitates efficient motion estimation for video sequences captured with a stationary camera with respect to an object. For video captured with this type of camera, a main cause of changes between adjacent frames corresponds to object motion. In this setting the output from the motion compensation stage is the block matching algorithm describing the way pixel blocks move between adjacent frames. For video captured with cameras mounted on moving vehicles (e.g. school buses, public transportation vehicles and police cars), the motion of the vehicle itself is the largest source of apparent motion in the captured video. In both cases, the encoded set of motion vectors is a good descriptor of apparent motion of objects within the field of view of the camera.

Abstract: An image processing device, including an analyzer calculating cutting data and difference data from image data, a selector receiving data from a working node, the data including cutting data, cost data, and position data, an assembler receiving data from working nodes and from a predecessor node and calculating updated node data as a function of the cost data, a driver configured to call the analyzer with image data of an input image, call the selector with an input node and with the cutting data calculated by the analyzer, call the assembler with the successor nodes determined by the selector as working nodes and with the input node as a predecessor node, and repeatedly call the selector and the assembler using one of the updated nodes as a working node for the selector, until a condition relating to the cutting data and the position data of an updated node is satisfied.

Abstract: Embodiments of generating in-slide and between slide transitions in a slideshow based on image content analysis are provided.

Abstract: The system provides for the automatic editing of a video comprised of a plurality of content segments. When two or more content clips are available at a particular moment in time, the system will automatically choose at least a portion of one of the clips pursuant to preference metrics determined by a user. The system contemplates the ability of the user to define specific metrics to control the editing, including frequency of edits, content of content clip, level of activity, and the like. In another embodiment, the system has a plurality of pre-defined editing modes that define various metrics for use in the automatic editing system, including guaranteed participation, speaker-centric, quality of clip, and the like.

Abstract: According to one embodiment, a method comprises conducting an analysis for anomalous behavior on application software and generating a video of a display output produced by the application software. The video is to be displayed on an electronic device contemporaneously with display of one or more events detected by the analysis being performed on the application software.