Abstract: An augmented reality system having a light source and a camera. The light source projects a pattern of light onto a scene, the pattern being periodic. The camera captures an image of the scene including the projected pattern. A projector pixel of the projected pattern corresponding to an image pixel of the captured image is determined. A disparity of each correspondence is determined, the disparity being an amount that corresponding pixels are displaced between the projected pattern and the captured image. A three-dimensional computer model of the scene is generated based on the disparity. A virtual object in the scene is rendered based on the three-dimensional computer model.

Abstract: Systems and methods are provided for selectively controlling a carry mode for holograms presented in mixed-reality environments and for providing leashing buffers for the holograms. The carry mode enables holograms to be functionally moved within a single mixed-reality environment, and out into one or more different mixed-reality environments. The carry mode can be automatically applied to holograms created within the mixed-reality environment. The carry mode can also be applied responsive to user input applied to world-locked holograms, which triggers a switch from the world-locked mode to the carry mode from. Holograms can also be leashed for persistently displaying holograms associated with or linked to a user in the mixed-reality environment to provide the user increased accessibility to the hologram while navigating within and without a particular mixed-reality environment. Selectable options are presented with a hologram in carry mode for switching from the carry mode to the world-locked mode.

Abstract: A video management system may identify moving objects in a scene, and may obscure the moving object. Additionally, the video management system may identify parts of the scene that are not moving, and may identify pixels having a color falling within a range which may be associated with human skin, and may obscure such pixels. The video management system may present an image to a monitor including the obscured moving object and the obscured pixels having the color falling within the range associated with human skin.

Abstract: A method for generating an augmented reality application comprises: transmitting, to a corresponding first network device, an application creating request regarding the augmented reality application submitted by a registered user, wherein the augmented reality application includes an augmented reality processing module provided by the first network device; transmitting, to the first network device, a target image and a corresponding augmented reality instance submitted by the registered user; receiving feedback information that the target image has been associated with the augmented reality application, which is transmitted by the first network device; and releasing the augmented reality application.

Abstract: The present disclosure is directed toward systems and methods for generating and providing an augmented reality overlay for display in connection with an augmented reality display device. For example, systems and methods described herein identify a user being viewed through an augmented reality display device, and builds an augmented reality overlay for the user that is displayed on a view of the user through the augmented reality display device. Systems and methods described herein build the augmented reality overlay based on the location of the augmented reality display device, and on other networking system information including a networking system relationship between the user wearing the augmented reality display device and the user who is being looked at through the augmented reality display device.

Abstract: A method for representing virtual information in a view of a real environment is provided that includes: providing a system setup including at least one display device, wherein the system setup is adapted for blending in virtual information on the display device in at least part of the view, determining a position and orientation of a viewing point relative to at least one component of the real environment, providing a geometry model of the real environment, providing at least one item of virtual information and a position of the at least one item of virtual information, determining whether the position of the item of virtual information is inside a 2D or 3D geometrical shape, determining a criterion which is indicative of whether the built-in real object is at least partially visible or non-visible in the view of the real environment, and blending in the at least one item of virtual information on the display device in at least part of the view of the real environment.

Abstract: Techniques are disclosed for deforming an image using Bezier transformation. The image is divided in a plurality of sections. Each section represents a corresponding Bezier patch. Each section comprises a multiple control points for Bezier transformation, with corner control points of the sections forming anchor points. The deformation of the image is performed by selecting multiple anchor points, and interacting with the selected anchor points. A bounding box that includes the selected anchor points is displayed. Translating, rotating, and/or scaling the selected anchor points based on user input relative to the bounding box results in corresponding Bezier transformation of portion of the image within the bounding box. Thus, instead of having to interact with one control point at a time to deform the image, the desired deformation is achieved by selecting multiple anchor points, and applying the Bezier deformation to the whole bounding box defined by the selected anchor points.

Abstract: A method of retrieving data comprises receiving a user input in the form of a command, determining that the user input is a gesture, sending a request to a cloud server based on the determined gesture, receiving data from a knowledge base connected to the cloud server based on the request, and displaying virtual content at the user device based on the received data.

Abstract: Provided are mechanisms and processes for automatically removing an individual from an image or group of images. One example method includes receiving a request to remove an individual from an image. Specifically, this request includes a selection of the individual's face in the image. Next, preferences relating to removal of the individual are received, such as preferred selections about whether to remove the individual completely from the image, whether to replace the individual with a substitute, and whether to retain selected individuals in the image. Facial features associated with the individual and body features associated with the individual are then identified and the individual is removed from the image based on the preferences provided relating to removal of the individual and surrounding elements.

Abstract: A computer device may include a memory storing instructions and processor configured to execute the instructions to provide a presentation image to a user device, wherein the presentation image is associated with a first model. The processor may be further configured to receive an image captured by a camera of the user device and a recorded alignment of the presentation image on a display of the user device; generate a second model based on the received image captured by the camera of the user device; determine an alignment of the first model with the second model based on the recorded alignment of the presentation image on the display of the user device; and generate an authentication determination verifying whether a user of the user device is human, based on the determined alignment of the first model with the second model.

Abstract: A projecting apparatus includes an image generating section configured to generate a masking-processed image by combining an input image and a mask drawing image including a mask region and a non-mask region and a projecting section configured to project the masking-processed image. The image generating section is at least capable of executing, on a first masking-processed image including a non-mask image corresponding to the non-mask region in a first projecting position, moving masking processing for generating a second masking-processed image obtained by moving the non-mask image from the first projecting position to a second projecting position or capable of executing, on a first masking-processed image including the non-mask image having a first dimension, enlarging or reducing masking processing for generating a second masking-processed image obtained by enlarging or reducing the non-mask image from the first dimension to a second dimension.

Abstract: The present disclosure relates to methods, devices, and systems for presentation of multimedia content. In an aspect of the present disclosure, a method includes receiving, at a processor of a mobile device, a plurality of images from a camera, at least one image of the plurality of images including an object. The method also includes displaying a camera video stream based on the plurality of images, displaying three dimensional (3D) augmented reality content in the camera video content, and displaying video content based on the 3D augmented reality content. The video content is associated with the object.

Abstract: Systems and methods for generating a 360 degree mixed virtual reality environment that provides a 360 degree view of an environment in accordance with embodiments of the invention are described. In a number of embodiments, the 360 degree mixed virtual reality environment is obtained by (1) combining one or more real world videos that capture images of an environment with (2) a virtual world environment that includes various synthetic objects that may be placed within the real world clips. Furthermore, the virtual objects embedded within the 360 degree mixed reality environment interact with the real world objects depicted in the real world environment to provide a realistic mixed reality experience.

Abstract: A method comprising receiving sensor data from a sensor, obtaining image data from a graphical effects shader based on the sensor data, blending the image data with a plurality of application surfaces to create a blended image, and transmitting the blended image to a display. The method may further comprise blending a color image with the blended image in response to a reduction in ambient light. Also disclosed is a mobile node (MN) comprising a sensor configured to generate sensor data, a display device, and a processor coupled to the sensor and the device display, wherein the processor is configured to receive the sensor data, obtain image data generated by a graphical effects shader based on the sensor data, blend the image data with an application surface associated with a plurality of applications to create a blended image, and transmit the blended image to the display.

Abstract: A method for processing an augmented reality (AR) image includes: obtaining an AR workspace image of an AR workspace that includes a document in a first region of the AR workspace and an AR output projection in a second region of the AR workspace; obtaining an internal representation of the AR output projection; masking the AR workspace image of the AR workspace with the internal representation to eliminate the AR output projection in the AR workspace image; and generating, in response to masking the AR workspace image of the AR workspace, a clean version of the AR workspace image in which the AR output projection is eliminated.

Abstract: Techniques for fast generating a banner image are described herein. The disclosed techniques include selecting a size and a layout of the banner image and selecting a stock photo; generating a background canvas according to the size of the banner image; determining an initial size of the stock photo on the background canvas based at least in part on the size and the layout of the banner image; determining an adjusted size of the stock photo on the background canvas on a basis of the initial size using interpolation calculation; determining a position of the stock photo on the background canvas based at least in part on a drag operation; and generating the banner image that includes the background canvas and the stock photo.

Abstract: An exemplary extended reality presentation system presents, to a user, a field of view into an extended reality world, and identifies an augmentable object from a set of objects presented in the field of view. The system determines that the augmentable object is located at a first apparent proximity to the user, and presents, within the field of view, a first form of an overlay object graphically associated with the augmentable object. The first form is tailored to the first apparent proximity. Subsequent to determining that the augmentable object is located at the first apparent proximity, the system determines that the augmentable object has come to be located at a second apparent proximity to the user and replaces, within the field of view, the first form of the overlay object with a second form of the overlay object distinct from the first form and tailored to the second apparent proximity.

Abstract: Apparatuses, systems and computer-implemented methods are disclosed for augmented reality stimulus removal. A field definition module determines a permitted field of view for a user. A field recognition module identifies a portion of an image stream outside the permitted field of view. The image stream is obtained by an augmented reality device of the user. An overlay module modifies the image stream for display to the user via the augmented reality device. The overlay module modifies the image stream by obscuring the portion of the image stream outside the permitted field of view in response to a restrictive mode being set for the user.

Abstract: The present invention relates to a system and method of placing augmented reality renderings, within the context of physical space imagery, creating an immersive augmented reality experience. The method comprising the steps of imaging physical space, by way of a camera enabled mobile device, to create a physical space imagery, initiating data communication with a remote agent, selecting, by way of the remote agent, at least one of an augmented reality rendering, and data communicating the augmented reality rendering, for inclusion within the physical space imagery, forming an immersive augmented reality experience, viewable and useable, by a consumer, on the camera enabled mobile device.

Abstract: A waveguide apparatus includes a planar waveguide and at least one optical diffraction element (DOE) that provides a plurality of optical paths between an exterior and interior of the planar waveguide. A phase profile of the DOE may combine a linear diffraction grating with a circular lens, to shape a wave front and produce beams with desired focus. Waveguide apparati may be assembled to create multiple focal planes. The DOE may have a low diffraction efficiency, and planar waveguides may be transparent when viewed normally, allowing passage of light from an ambient environment (e.g., real world) useful in AR systems. Light may be returned for temporally sequentially passes through the planar waveguide. The DOE(s) may be fixed or may have dynamically adjustable characteristics. An optical coupler system may couple images to the waveguide apparatus from a projector, for instance a biaxially scanning cantilevered optical fiber tip.