Abstract: An automatic face annotation method is provided. The method includes dividing an input video into different sets of frames, extracting temporal and spatial information by employing camera take and shot boundary detection algorithms on the different sets of frames, and collecting weakly labeled data by crawling weakly labeled face images from social networks. The method also includes applying face detection together with an iterative refinement clustering algorithm to remove noise of the collected weakly labeled data, generating a labeled database containing refined labeled images, finding and labeling exact frames containing one or more face images in the input video matching any of the refined labeled images based on the labeled database, labeling remaining unlabeled face tracks in the input video by a semi-supervised learning algorithm to annotate the face images in the input video, and outputting the input video containing the annotated face images.

Abstract: An object identification method is provided. The method includes dividing an input video into a number of video shots, each containing one or more video frames. The method also includes detecting target-class object occurrences and related-class object occurrences in each video shot. Further, the method includes generating hint information including a small subset of frames representing the input video and performing object tracking and recognition based on the hint information. The method also includes fusing tracking and recognition results and outputting labeled objects based on the combined tracking and recognition results.

Abstract: A method is provided for enhanced video services to at least one user. The method includes receiving a first input video, and processing the received input video to obtain multi-dimensional information associated with the input video. The method also includes obtaining user recommendation information based on user behavior, and creating enhanced video information based on the multi-dimensional information associated with the input video and the user recommendation information. Further, the method includes associating the enhanced video information with the first input video to create an enhanced video of the first input video, and playing back the enhanced video to the user.

Abstract: A method for video sequential alignment is provided. The method includes inputting a first video sequence and a second video sequence, and extracting features of the first video sequence and the second video sequence. The method also includes generating an expanded path using a hierarchical sequential alignment algorithm and generating masks containing search space using keyframe matching. Further, the method includes calculating the lowest path cost within search space to find a minimal alignment path using a block A* algorithm and outputting a final alignment result after applying the block A* algorithm to search space.

Abstract: A method is provided for content alignment. The method includes obtaining a first content sequence and a second content sequence different from the first content sequence. The method also includes representing each of the first content sequence and the second content sequence in a hierarchical structure containing an ordered root element sequence and a sub-tree structure. The ordered root element sequence includes a plurality of root elements and each root element is associated with a sub-tree of elements. The method also includes determining a desired alignment between the first content sequence and the second content sequence using dynamic programming, and outputting results of the desired alignment between the first content sequence and the second content sequence.

Abstract: A method for a mobile platform containing a mobile terminal having an operating system includes initializing a plurality of user environments (UEs) on the mobile terminal over the operating system, including a current UE running on the mobile terminal. The plurality of UEs are capable of being switched among one another based on one or more of predetermined conditions without changing the operating system. The method also includes collecting sensing data on certain parameters associated with operation of the mobile terminal, and processing the sensing data to indicate at least one of the predetermined conditions. Further, the method includes determining whether the current UE suits the at least one of the predetermined conditions indicated by processing the sensing data and, when the current UE does not suit the condition of the mobile terminal, switching the current UE to a desired UE from the plurality of UEs.

Abstract: A video object retrieval method is provided. The method includes dividing an input video into a number of video shots and detecting target-class object occurrences and related-class object occurrences in each video shot. The method also includes pre-processing object bounding box images and performing automatic object extraction. Further, the method includes performing object-level feature extraction and integration and generating visual search results based on similarity scores.

Abstract: An object identification method is provided. The method includes dividing an input video into a number of video shots, each containing one or more video frames. The method also includes detecting target-class object occurrences and related-class object occurrences in each video shot. Further, the method includes generating hint information including a small subset of frames representing the input video and performing object tracking and recognition based on the hint information. The method also includes fusing tracking and recognition results and outputting labeled objects based on the combined tracking and recognition results.

Abstract: A method is provided for a user-sensing remote control system including a TV and a remote control. The method includes obtaining sensing data from a plurality of sensors in the remote control related to a user of the remote control, pre-processing the sensing data, and determining a user identity space containing a plurality of possible user identities of the user using a predetermined statistical algorithm. The method also includes determining whether there is a dominant possible user identity; when it is determined that there is no dominant possible user identity, selecting one or more possible user identities from the user identity space and updating the user identity space until there is a dominant possible user identity; and when it is determined that there is a dominant possible user identity, presenting the dominant possible user identity as the identity of the user to other applications.

Abstract: A method is provided for a content recommendation module. The method includes receiving a user input related to viewing contents from a user and determining whether a recommendation pool containing a plurality of selected recommendation candidates has been changed corresponding to the input. The method also includes, when the recommendation pool has been changed, mapping the plurality of selected recommendation candidates in the changed recommendation pool into a hierarchical data structure with a plurality of levels such that each of the plurality of levels acts as a stage of a zoom operation on the selected recommendation candidates. Further, the method includes rendering mapped recommendation candidates from the plurality of levels to be displayed to the user.

Abstract: A method is provided for a personalized content delivery system. The method includes detecting a viewing activity of at least one user of a content-presentation device capable of presenting multiple programs in one or more channels, and determining a plurality of user identities of the at least one user. The method also includes discovering available video contents for the at least one user based on the plurality of user identities, and determining personalized video contents for the at least one user by merging the plurality of user identities. Further, the method includes recommending the determined personalized video contents to the at least one user, and delivering the recommended personalized video contents to the at least one user such that the personalized video contents are presented on the content-presentation device.

Abstract: A method is provided for an intelligent user-interaction system based on object detection. The method includes receiving an input video sequence corresponding to a video program, and dividing the input video sequence into a plurality of video shots, each containing one or more video frames. The method also includes detecting possible object occurrences in each of the plurality of video shots, and analyzing possible paths of an object in a video shot using a multimodal-cue approach. Further, the method includes aggregating the path-based selected object occurrences across the plurality of video shots to detect objects, and generating a complete list of the object occurrences across the plurality of video shots.

Abstract: A method for a mobile platform containing a mobile terminal having an operating system includes initializing a plurality of user environments (UEs) on the mobile terminal over the operating system, including a current UE running on the mobile terminal. The plurality of UEs are capable of being switched among one another based on one or more of predetermined conditions without changing the operating system. The method also includes collecting sensing data on certain parameters associated with operation of the mobile terminal, and processing the sensing data to indicate at least one of the predetermined conditions. Further, the method includes determining whether the current UE suits the at least one of the predetermined conditions indicated by processing the sensing data and, when the current UE does not suit the condition of the mobile terminal, switching the current UE to a desired UE from the plurality of UEs.

Abstract: A method is provided for a user-sensing remote control system including a TV and a remote control. The method includes obtaining sensing data from a plurality of sensors in the remote control related to a user of the remote control, pre-processing the sensing data, and determining a user identity space containing a plurality of possible user identities of the user using a predetermined statistical algorithm. The method also includes determining whether there is a dominant possible user identity; when it is determined that there is no dominant possible user identity, selecting one or more possible user identities from the user identity space and updating the user identity space until there is a dominant possible user identity; and when it is determined that there is a dominant possible user identity, presenting the dominant possible user identity as the identity of the user to other applications.

Abstract: A method for an intelligent user-interaction control system includes generating a plurality of summary video frames for a certain time of incoming bit-stream of a video program to be shown on a display, and detecting a hold command from a user to stop the video program. The method also includes presenting the plurality of summary video frames to the user on the display after stopping the video program, obtaining a user selection on a selected summary frame from the plurality of the summary video frames, presenting a plurality of objects of interest from the selected summary frame to the user on the display, and determining a user-selected object of interest from the plurality of objects of interest. The method also includes searching the selected object in an online database to obtain searching results corresponding to the selected object, and prompting the user about the searching results.