Abstract: A UAV comprises a camera and an image processor. The camera is operable to output captured image data corresponding to a first representation of a scene within a field of view of the camera. The scene includes an item. The image processor is configured to receive the captured image data. The image processor is configured, in response to recognising a predetermined object indicative of the presence of the item in the first representation, to generate image data corresponding to a second, different representation of the scene. A part of the scene that is associated with the item in the first representation is represented differently in the first and second representations. The image processor is configured to output the generated image data.

Abstract: An unmanned aerial vehicle, UAV, comprises (i) a camera having a field of vision including, in use, a portion of a vehicle to be cleaned, (ii) a liquid container comprising waterless carwash liquid, (iii) a liquid dispenser operable to cause the waterless carwash liquid comprised in the liquid container to be dispensed from the liquid container, (iv) a cleaning implement, and (v) a controller communicatively coupled to the camera, the liquid dispenser and the cleaning implement. The controller is operable (a) to cause the liquid dispenser to dispense the waterless carwash liquid from the liquid container onto the portion of the vehicle to be cleaned and (b) to control the cleaning implement to clean the portion of the vehicle to be cleaned.

Abstract: A system and method generates a broadcast image. The method includes receiving a first image captured by a first camera having a first configuration incorporating a first center of projection. The method includes determining a first mapping from a first image plane of the first camera onto a sphere. The method includes determining a second mapping from the sphere to a second image plane of a second virtual camera having a second configuration incorporating the first center of projection of the first configuration. The method includes generating a second image based upon the first image and a concatenation of the first and second mappings.

Abstract: Provided are methods, systems, and computer-readable medium for synthetically generating training data to be used to train a learning algorithm that is capable of generating computer-generated images of a subject from real images that include the subject. The training data can be generated using a facial rig by changing expressions, camera viewpoints, and illumination in the training data. The training data can then be used for tracking faces in a real-time video stream. In such examples, the training data can be tuned to expected environmental conditions and camera properties of the real-time video stream. Provided herein are also strategies to improve training set construction by analyzing which attributes of a computer-generated image (e.g., expression, viewpoint, and illumination) require denser sampling.

Abstract: Approaches are described for formation retrieval. Embodiments receive positional data, across an interval window, including a respective agent trajectory for each agent and an object trajectory for one or more objects. The interval window is partitioned into frames and, at each frame, embodiments calculate a cost of assigning a role to each agent based on one or more exemplar formations. A formation is determined by assigning a role to each agent based on the calculated cost. Each frame of the formation is compared to a corresponding frame of a stored formation, by calculating a distance between a position of each assigned role in the frame and a position of a corresponding role in the stored formation and by comparing the object trajectory for the one or more objects with a corresponding object trajectory in the stored formation. Based on the comparisons, a list of stored formations is generated.

Abstract: An unmanned aerial vehicle, UAV, is operable in an autonomous mode. The UAV comprises an upwards-configurable sensor an actuator and a controller. The upwards-configurable sensor is configurable in an upwards-facing configuration during an autonomous procedure such that a field of view of the upwards-configurable sensor includes airspace directly above the UAV during the autonomous procedure. The controller is operable to control the actuator during the autonomous procedure based on data captured by the upwards-configurable sensor to cause the UAV to make physical contact with an object in the airspace directly above the UAV during the autonomous procedure.

Abstract: Approaches are described for discovering a formation associated with an agent group engaging in an activity over a window of time. A formation analysis system computes first and second results for an objective function based on first and second sets of role assignments for each agent in the agent group at first and second moments in time, respectively. The formation analysis system iterates by: replacing the first set of role assignments with the second set of role assignments, and determining whether completion criteria have been met based at least in part on comparing the first result with the second result. If the completion criteria have not been met, then the formation analysis system replaces the second set of role assignments with a third set of role assignments that associate each agent in the first agent group with a different role assignment in the third set of role assignments at a third moment in time.

Abstract: There are provided systems and methods for generating a visually consistent alternative audio for redubbing visual speech using a processor configured to sample a dynamic viseme sequence corresponding to a given utterance by a speaker in a video, identify a plurality of phonemes corresponding to the dynamic viseme sequence, construct a graph of the plurality of phonemes that synchronize with a sequence of lip movements of a mouth of the speaker in the dynamic viseme sequence, use the graph to generate an alternative phrase that substantially matches the sequence of lip movements of the mouth of the speaker in the video.

Abstract: Speech animation may be performed using visemes with phonetic boundary context. A viseme unit may comprise an animation that simulates lip movement of an animated entity. Individual ones of the viseme units may correspond to one or more complete phonemes and phoneme context of the one or more complete phonemes. Phoneme context may include a phoneme that is adjacent to the one or more complete phonemes that correspond to a given viseme unit. Potential sets of viseme units that correspond with individual phoneme string portions may be determined. One of the potential sets of viseme units may be selected for individual ones of the phoneme string portions based on a fit metric that conveys a match between individual ones of the potential sets and the corresponding phoneme string portion.

Abstract: Embodiments disclosed herein relate to a method and apparatus for generating a three-dimensional surface. In one embodiment, there is a method for generating a three-dimensional surface. The method includes capturing a plurality of images of a target object with at least two cameras, the target object illuminated by at least two sets of red-green-blue (RGB) lights positioned in an array about the target object and generating a three-dimensional surface of the target object by iteratively reconstructing a surface estimate of the target object and aligning images of the target object using motion estimation until the images converge, wherein the images are processed in n-frame intervals.

Abstract: A system and method improves a camera calibration. The method includes receiving a camera image, a planar template pattern, a 3D geometry of a surface on which the planar template pattern is embedded, and a set of parameter values. The method includes rendering the planar template pattern into a camera perspective based on the parameter values to generate a warped template image. The method includes generating an error image including at least one non-zero difference between the camera image and the warped template image. The method includes adjusting the parameter values to reduce an error between the camera image and the warped template image.

Abstract: Methods and systems for estimating HDR sky light probes for outdoor images are disclosed. A precaptured sky light probe database is leveraged. The database includes a plurality of HDR sky light probes captured under a plurality of different illumination conditions. A HDR sky light probe is estimated from an outdoor image by fitting a three dimensional model to an object of interest in the image and solving an inverse optimization lighting problem for the 3D model where the space of possible HDR sky light probes is constrained by the HDR sky light probes of the database.

Abstract: There is provided a method for use by a system including a hardware processor and a memory storing a three-dimensional (3D) character data having a topology mesh describing a character. The method includes stabilizing the 3D character data by removing a translational motion and a rotational motion from the 3D character data, determining a range of motion of a plurality of points of the topology mesh describing the character, identifying a plurality of poses for generating an animation, where each of the plurality of poses includes a unique configuration of the plurality of points of the topology mesh, and creating an animatronic including a plurality of actuators configured to instantiate the plurality of poses for generating the animation.

Abstract: Techniques are described to characterize motion patterns of a group of agents engaging in an activity. An analysis system receives input data associated with spatial and temporal information of at least one element of interest associated with the activity, where the object of interest may be a ball, person, animal or any other object in motion. The analysis system partitions the input data into a plurality of spatiotemporal segments and generates one or more representations of one or more sets of segments of the plurality of spatiotemporal segments based on one or more criteria. The analysis system computes a metric, such as an entropy value, for each of the one or more representations. Partial tracing data, such as ball movements in a sporting event, may be created using an inexpensive input device, such as a tablet computer, making the disclosed techniques available for a wide range of events and activities.

Abstract: Techniques are disclosed for creating digital assets that can be used to personalize themed products. For example, a workflow and pipeline used to generate a 3D model from digital images of a person's face and to manufacture a personalized, physical figurine customized with the 3D model are disclosed. The 3D model of the person's face may be simplified to match a topology of a desired figurine. While the topology is deformed to match that of the figurine, the 3D model retains the geometry of the child's face. Simplifying the topology of the 3D model in this manner allows the mesh to be integrated with or attached to a mesh representing desired figurine.

Abstract: To generate a media presentation of a live event, a user interface is coupled to at least three cameras that share substantially the same vantage point. One of the cameras (e.g., a context camera) provides a context view of the event that is displayed on a screen of the user interface. The views of the other two cameras are superimposed onto the context view to define sub-portions that are visually demarcated within the context view. Based on user interaction, the user interface can switch between the cameras views and control the cameras to capture different portions of the context view. Based the image data captured by the views of the cameras within the context view, the user interface generates a media presentation that may be broadcast to multiple viewers.

Abstract: Speech animation may be performed using visemes with phonetic boundary context. A viseme unit may comprise an animation that simulates lip movement of an animated entity. Individual ones of the viseme units may correspond to one or more complete phonemes and phoneme context of the one or more complete phonemes. Phoneme context may include a phoneme that is adjacent to the one or more complete phonemes that correspond to a given viseme unit. Potential sets of viseme units that correspond with individual phoneme string portions may be determined. One of the potential sets of viseme units may be selected for individual ones of the phoneme string portions based on a fit metric that conveys a match between individual ones of the potential sets and the corresponding phoneme string portion.

Abstract: Methods and systems for predicting light probes for outdoor images are disclosed. A light probe database is created to learn a mapping from the outdoor image's features to predicted outdoor light probe illumination parameters. The database includes a plurality of images, image features for each of the plurality of images, and a captured light probe for each of the plurality of images. A light probe illumination model based on a sun model and sky model is fitted to the captured light probes. The light probe for the outdoor image may be predicted based on the database dataset and fitted light probe models.

Abstract: Embodiments disclosed herein relate to a method and apparatus for generating a three-dimensional surface. In one embodiment, there is a method for generating a three-dimensional surface. The method includes capturing a plurality of images of a target object with at least two cameras, the target object illuminated by at least two sets of red-green-blue (RGB) lights positioned in an array about the target object and generating a three-dimensional surface of the target object by iteratively reconstructing a surface estimate of the target object and aligning images of the target object using motion estimation until the images converge, wherein the images are processed in n-frame intervals.

Abstract: There are provided systems and methods for generating a visually consistent alternative audio for redubbing visual speech using a processor configured to sample a dynamic viseme sequence corresponding to a given utterance by a speaker in a video, identify a plurality of phonemes corresponding to the dynamic viseme sequence, construct a graph of the plurality of phonemes that synchronize with a sequence of lip movements of a mouth of the speaker in the dynamic viseme sequence, use the graph to generate an alternative phrase that substantially matches the sequence of lip movements of the mouth of the speaker in the video.