Abstract: In accordance with some embodiments of the disclosed subject matter, a method and a system for recommending and sharing customized multimedia route planning are provided. The method includes: receiving a query image from a user, the query image containing an object-of-interest of the user, performing an integrative segmentation process to determine one or more contours of the object-of-interest in the query image; determining a route having a maximum area overlap with the one or more contours of object-of-interest on a map image; generating an output image including the object-of-interest and the route; and recommending the output image to the user, and sharing the output image on a social network platform.

Abstract: A system and a method for enhancing target tracking via detector and tracker fusion for unmanned aerial vehicles (UAVs) are provided. The method comprises receiving at least one raw input image of objects to be detected; based on the at least one raw input image of objects, generating the objects' candidate information; based on the objects' candidate information, calculating location and velocity estimation of an object at a current timestamp based on a detector and tracker fusion; and based on the location and velocity estimation of the object at the current timestamp, predicting the location and velocity estimation of the object at a future timestamp.

Abstract: The present disclosure provides a method and device for visual appearance based person identity inference. The method may include obtaining a plurality of input images. The input images include a gallery set of images containing, persons-of-interest and a probe set of images containing person detections, and one input image corresponds to one person. The method may further include extracting N feature maps from the input images using a Deep Neural Network, N being a natural number; constructing N structure samples of the N feature maps using conditional random field (CRF) graphical models; learning the N structure samples from an implicit common latent feature space embedded in the N structure samples; and according to the learned structures, identifying one or more images from the probe set containing a same person-of-interest as an image in the gallery set.

Abstract: A face detection and tracking method of a robotic device. The method includes obtaining a video frame from a camera of the robotic device; performing a face detection process on the video frame to detect one or more faces in the video frame and, after the face detection process, identifying the detected one or more faces in the video frame. The method also includes performing a vision-based tracking process to track the identified one or more faces using a combination of a feature points tracker and a correlation tracker and, after the vision-based tracking process, performing a detection and tracking fusion process and providing desired target prediction of the identified one or more faces.

Abstract: The present invention discloses a method for recommending an image-based route. The method includes: obtaining a query image from a user; performing an interactive segmentation process to determine one or more contours of an object-of-interest in the query image; determining a route having the maximum area overlap with the one or more contours of the object-of-interest on a map image; generating an output image including the object-of-interest and the route having the maximum area overlap with the contours of the object-of-interest; and recommending the output image to the user, and sharing the output image on a social network platform.

Abstract: A context-aware chatbot method and system are provided. The context-aware chatbot method comprises receiving a user's voice; converting the user's voice to a question to be answered; determining a question type of the question to be answered; generating at least one answer to the question based on a context-aware neural conversation model; validating the answer generated by the context-aware neural conversation model; and delivering the answer validated to the user. The context-aware neural conversation model takes contextual information of the question into consideration, and decomposes the contextual information of the question into a plurality of high dimension vectors.

Abstract: A method for scalable user intent mining is provided. The method includes detecting named entities from a plurality of query logs in a public query log dataset and generating features of the plurality of query logs based on the detected named entities. The method also includes applying a multimodal restricted boltzmann machine (RBM) on the generated features of the plurality of query logs to train a public multimodal RBM and generating a plurality of public query representations. Further, the method includes receiving a search query from a user, determining whether there are a plurality of history queries of the user. When there is no history query, user intent is predicted using the public multimodal RBM. When there are the history queries, the public multimodal RBM is applied on the plurality of history queries to train a personalized multimodal RBM, and the user intent is predicted using the personalized multimodal RBM.

Abstract: A method for a scalable storage-loss optimized (SSLO) system for color gamut mapping is provided. The SSLO system method comprises generating a pre-computed color gamut mapping between an input color gamut and an output color gamut, receiving an input signal including a plurality of input pixels from the input signal domain, wherein the input pixels correspond to a set of first color values represented in a first color space; converting the set of the first color values to be a set of second color values represented in a second color space; generating a set of third color values through a mapping modeling and a color reproduction; converting the set of the third color values to be a set of fourth color values represented in the first color space; and outputting an output signal including a plurality of output pixels corresponding to the fourth color values to the output signal domain.

Abstract: A method for optimized wake-up strategy via sleeping stage prediction with recurrent neural networks is provided. The method comprises receiving a set of raw sensory data of a user's sleeping status; translating the set of raw sensory data into a plurality of sleeping stages; saving the plurality of sleeping stages as a history of sleeping stages; determining a current sleeping stage; predicting a plurality of future sleeping stages of the user in an upcoming interval; calculating a wakeup score of the current sleeping stage and a wakeup score of each future sleeping stage; determining an optimized sleeping stage for wake up based on the wakeup score through comparing the wakeup score of the current sleeping stage and the wakeup scores of the future sleeping stages; and triggering an alarm impulse to wake up the user at the optimized sleeping stage for wake up.

Abstract: A method for personalized intelligent wake-up system based on multimodal deep neural network comprises monitoring a sleeping status of a user; obtaining a current sleeping-stage of the user within a current time frame and a prediction of a next sleeping-stage of the user for a next time frame; correcting the current sleeping-stage of the user through combining the current sleeping-stage and the prediction of the next sleeping-stage; determining a wake up strategy for the current time frame; determining a relationship between each of a plurality of alarm impulses adopted to wake up the user and a corresponding reaction of the user; identifying a change in the current sleeping-stage for the current time frame; determining an alarm impulse to be triggered for waking up the user; and triggering the determined alarm impulse.

Abstract: An experience-aware anomaly processing system and a method for an experience-aware anomaly processing system are provided. The experience-aware anomaly processing system comprises an anomaly detection module configured to receive geographic location data with corresponding time information of a target object, and analyze target object behavior based on the geographic location data with corresponding time information of the target object; a user feedback module configured to receive user feedback from a user and model user feedback behavior when the user receives an alarm message indicating the target object is abnormal; and a decision module configured to receive user setting from the user, and make a detection decision through fusing target object behavior information corresponding to the target object behavior, user feedback behavior information corresponding to the user feedback behavior, and the user setting.

Abstract: A unified attractiveness prediction method is provided. The method includes receiving a plurality of videos and extracting at least one of metadata and view data from each of the plurality of received videos, wherein the metadata is information for describing video contents, and the view data is a total number of users who watch the video. The method also includes obtaining potential view amounts of the plurality of received videos and calculating impact factor scores of the plurality of received videos based on the potential view amounts, each impact factor score including a numerical score for indicating a degree of effectiveness of a corresponding video. Further, the method includes providing a video with a highest impact factor score based on the calculated impact factor scores.

Abstract: A binary TV system and a method for a binary TV system are provided. The binary TV system comprises a TV program managing module configured to acquire a user preference for TV programs, and generate messages of recommended actions to be performed by a TV; a content recommender module configured to analyze the user preference and generate a recommendation of TV programs matching the user preference; a channel monitoring module configured to monitor and recognize a current TV program a user is watching; an advertisements (Ads) detecting module configured to detect advertisements in a specific TV channel; and a TV controlling module configured to send the messages generated by the TV controlling module to the TV. The user and the TV is communicated with each other through a binary interaction.

Abstract: A method for multimodal clue based personalized app function recommendation is provided. The method includes receiving an app search query from a user, obtaining a plurality of real-time clues collected from the user and extracting a plurality of features to represent the collected clues, wherein the plurality of features include structured features and text features. The method also includes generating a joint representation of the multimodal clues based on the plurality of extracted features and creating a logistic regression model based on the joint representation of the multimodal clues. Further, the method includes ranking a list of app functions using the logistic regression model and displaying the ranked app function list for the user.

Abstract: A method for sharing information among multiple devices is provided. The method includes a sensing device sensing signals of at least one object associated with a targeting device and extracting at least one feature of the object from the sensed signals. The method also includes the sensing device broadcasting the extracted feature of the object on a determined network containing a plurality of targeting devices and receiving feedbacks from the plurality of targeting devices on the network in response to the broadcasting. Further, the method includes the sensing device automatically identifying one of the plurality of targeting devices based on the received feedbacks, synchronizing information with the identified targeting device and displaying the information to a user of the sensing device.

Abstract: A binary TV system and a method for a binary TV system are provided. The binary TV system comprises a TV program managing module configured to acquire a user preference for TV programs, and generate messages of recommended actions to be performed by a TV; a content recommender module configured to analyze the user preference and generate a recommendation of TV programs matching the user preference; a channel monitoring module configured to monitor and recognize a current TV program a user is watching; an advertisements (Ads) detecting module configured to detect advertisements in a specific TV channel; and a TV controlling module configured to send the messages generated by the TV controlling module to the TV. The user and the TV is communicated with each other through a binary interaction.

Abstract: The present disclosure provides a method for a privacy-aware indoor drone exploration and communication framework, including: receiving a communication request for a target person from an outside caller; locating the target person in response to the communication request; establishing a video call between the target person and the outside caller to transmit images of the target person to the outside caller; and avoiding showing privacy areas and privacy objects in the indoor environment in the images of the target person to the outside caller during the video call.

Abstract: A content retrieval method including: extracting a plurality of fingerprints including a plurality of video fingerprints and audio fingerprints from contents stored in a content database; determining representative video fingerprints of the video frames and representative audio fingerprints of the audio sequences; determining a data rate indicating a storage limitation and a coverage indicating a number of searching results to be returned; storing selected representative video fingerprints and representative audio fingerprints based on the storage limitation indicated by the data rate in a fingerprint database; receiving a query containing at least one of video data and audio data submitted by a user; extracting at least one query fingerprint representing the query; determining a number of fingerprints most matching the query fingerprint based on the coverage to generate search results indicating matching contents represented by the number of most matching fingerprints; and returning the search results to the

Abstract: The present invention provides an information presentation system, comprising: a video module configured to obtain video content to be presented to a user; a network module configured to obtain certain information related to the video content including at least a first type of related information, a second type of related information, and a third type of related information; a first display configured to display the video content at a primary location in front of the user; one or more second displays configured to display the first type related information at the primary location outside the first display and to display the second type related information on a secondary location along the side of the primary location; an interactive display configured to interact with the user and display the third type related information; and a system controller configured to perform content assignments to the displays according to requirements from the user.

Abstract: A method for a scalable storage-loss optimized (SSLO) system for color gamut mapping is provided. The SSLO system method comprises generating a pre-computed color gamut mapping between an input color gamut and an output color gamut, receiving an input signal including a plurality of input pixels from the input signal domain, wherein the input pixels correspond to a set of first color values represented in a first color space; converting the set of the first color values to be a set of second color values represented in a second color space; generating a set of third color values through a mapping modeling and a color reproduction; converting the set of the third color values to be a set of fourth color values represented in the first color space; and outputting an output signal including a plurality of output pixels corresponding to the fourth color values to the output signal domain.