Abstract: Embodiments of the invention relate to systems, apparatuses and methods to provide image data, augmented with related data, to be displayed on a mobile computing device. Embodiments of the invention display a live view augmented with information identifying an object amongst other objects. Embodiments of the invention may utilize other related data, such as 3D point cloud data, image data and location data related to the object, to obtain a specific location of an object within the live view. Embodiments of the invention may further display a live view with augmented data three-dimensionally consistent with the position and orientation of the image sensor of the mobile computing device.

Abstract: A plurality of frames of a video recorded by a video camera and depth maps of the plurality of frames are stored in a data storage. One or more target video camera positions are determined. Each frame of the plurality of frames is associated with one or more of the target video camera positions. For each frame, one or more synthesized frames from the viewpoint of the one or more target camera positions associated with that frame are generated by applying a view interpolation algorithm to that frame using the color pixels of that frame and the depth map of that frame. Users can provide their input about the new camera positions and other camera parameters through multiple input modalities. The synthesized frames are concatenated to create a modified video. Other embodiments are also described and claimed.

Abstract: Systems, devices and methods are described including receiving a source image having a foreground portion and a background portion, where the background portion includes image content of a three-dimensional (3D) environment. A camera pose of the source image may be determined by comparing features of the source image to image features of target images of the 3D environment and using the camera pose to segment the foreground portion from the background portion may generate a segmented source image. The resulting segmented source image and the associated camera pose may be stored in a networked database. The camera pose and segmented source image may be used to provide a simulation of the foreground portion in a virtual 3D environment.

Abstract: Systems, devices and methods are described including receiving a source image having a foreground portion and a background portion, where the background portion includes image content of a three-dimensional (3D) environment. A camera pose of the source image may be determined by comparing features of the source image to image features of target images of the 3D environment and using the camera pose to segment the foreground portion from the background portion may generate a segmented source image. The resulting segmented source image and the associated camera pose may be stored in a networked database. The camera pose and segmented source image may be used to provide a simulation of the foreground portion in a virtual 3D environment.

Abstract: Techniques related to filling hole regions in a disparity map are discussed. Such techniques may include generating approximated disparity values for grid nodes of an approximation grid having a lower resolution than the disparity map based on disparity values within outer hole contour regions circumscribing the hole regions. The hole regions may be filled with upsampled disparity values based on the approximated disparity values to provide a final disparity map.

Abstract: This application is directed to dynamic control for data capture. A device may comprise a capture logic module to receive at least one of biometric data from a biometric sensing module, context data from a context sensing module or content data from a content sensing module. The capture logic module may determine if a capture scenario exists based on at least one of the biometric data and context data. The determination may be weighted based on an operational mode. If a capture scenario is determined to exist, the capture logic module may then determine whether to capture data based on at least the content data. Captured data may be stored in a capture database in the device (e.g., along with enhanced metadata based on at least one of the biometric data, the context data or the content data). The device may also comprise a feedback database including feedback data.

Abstract: Methods and systems may provide for creating a non-uniform mesh for a first image, the non-uniform mesh including a plurality of vertices that align with one or more boundaries in the first image. Additionally, sample data associated with at least the first image may be obtained, wherein the sample data corresponds to the plurality of vertices. In one example, a second image is synthesized based at least in part on the sample data, wherein synthesizing the second image includes rendering one or more areas that are un-occluded in the second image and are occluded in the first image.

Abstract: An image processing apparatus, system, and method to automatically determine a plurality of image acquisition settings for an scene; acquire a set of images of the scene, the set of images including multiple images acquired with a distinct plurality of the determined image acquisition settings; and generate a single image by combining the acquired set of images.

Abstract: Embodiments of the invention describe processing a first image data and 3D point cloud data to extract a first planar segment from the 3D point cloud data. This first planar segment is associated with an object included in the first image data. A second image data is received, the second image data including the object captured in the first image data. A second planar segment related to the object is generated, where the second planar segment is geometrically consistent with the object as captured in the second image data. This planar segment is generated based, at least in part, on the second image data, the first image data and the first planar segment. Embodiments of the invention may further augment the second image data with content associated with the object. This augmented image may be displayed such that the content is displayed geometrically consistent with the second planar segment.

Abstract: Examples are disclosed for determining a suggested camera pose or suggested camera settings for a user to capture one or more images. In some examples, the suggested camera pose or suggested camera settings may be based on an indication of the user's interest and gathered information associated with the user's interests. The user may be guided to adjust an actual camera pose or actual camera settings to match the suggested camera pose or suggested camera settings.

Abstract: Systems, devices and methods are described including receiving a source image having a foreground portion and a background portion, where the background portion includes image content of a three-dimensional (3D) environment. A camera pose of the source image may be determined by comparing features of the source image to image features of target images of the 3D environment and using the camera pose to segment the foreground portion from the background portion may generate a segmented source image. The resulting segmented source image and the associated camera pose may be stored in a networked database. The camera pose and segmented source image may be used to provide a simulation of the foreground portion in a virtual 3D environment.

Abstract: An image processing apparatus, system, and method to automatically determine a plurality of image acquisition settings for an scene; acquire a set of images of the scene, the set of images including multiple images acquired with a distinct plurality of the determined image acquisition settings; and generate a single image by combining the acquired set of images.

Abstract: Systems, devices and methods are described including determining a goal for collaborative media gathering, automatically generating a plurality of tasks specifying the capture of media associated with the goal, storing the tasks, and providing the tasks to a plurality of users. The goal may be automatically determined in response to real-time social media analysis.

Abstract: Embodiments of the invention relate to systems, apparatuses and methods to provide image data, augmented with related data, to be displayed on a mobile computing device. Embodiments of the invention display a live view augmented with information identifying an object amongst other objects. Embodiments of the invention may utilize other related data, such as 3D point cloud data, image data and location data related to the object, to obtain a specific location of an object within the live view. Embodiments of the invention may further display a live view with augmented data three-dimensionally consistent with the position and orientation of the image sensor of the mobile computing device.

Abstract: Embodiments of the invention describe processing a first image data and 3D point cloud data to extract a first planar segment from the 3D point cloud data. This first planar segment is associated with an object included in the first image data. A second image data is received, the second image data including the object captured in the first image data. A second planar segment related to the object is generated, where the second planar segment is geometrically consistent with the object as captured in the second image data. This planar segment is generated based, at least in part, on the second image data, the first image data and the first planar segment. Embodiments of the invention may further augment the second image data with content associated with the object. This augmented image may be displayed such that the content is displayed geometrically consistent with the second planar segment.

Abstract: Embodiments of a system and method for mobile augmented reality are provided. In certain embodiments, a first image is acquired at a device. Information corresponding to at least one second image matched with the first image is obtained from a server. A displayed image on the device is augmented with the obtained information.