Abstract: Embodiments of the invention are directed to systems, methods, and computer program products for verifying, storing, and transferring data within an entity. The system is configured for receiving data from one or more source systems, generating a metadata, exposure, and control statement for the data, transferring the data and the metadata, exposure, and control statement to a system of origination, logically classifying the data in the system of record into one or more domains, transferring the data into one or more authorized data sources associated with the one or more domains, receiving a request from a user associated with a target system to retrieve a set of data from the one or more authorized data sources, and transferring the set of data from the one or more authorized data sources to the target system.

Abstract: A method to identify positions of fingers of a hand is described. The method includes capturing images of a first hand using a plurality of cameras that are part of a wearable device. The wearable device is attached to a wrist of a second hand and the plurality of cameras of the wearable device is disposed around the wearable device. The method includes repeating capturing of additional images of the first hand, the images and the additional images captured to produce a stream of captured image data during a session of presenting the virtual environment in a head mounted display (HMD). The method includes sending the stream of captured image data to a computing device that is interfaced with the HMD. The computing device is configured to process the captured image data to identify changes in positions of the fingers of the first hand.

Abstract: In a system and method of recognizing a barcode from a stream of video frames, a processor-implemented camera module receives a stream of video frames, with at least one video frame including a barcode. A processor-implemented barcode blur estimate module estimates an amount of defocus blur in a video frame. The processor-implemented barcode blur estimate module further estimates an identity of the barcode. A processor-implemented barcode localization module identifies a region of the video frame containing the barcode. A processor-implemented barcode geometric modeler module generates a geometric model of the barcode that includes an identified barcode deformity. A processor-implemented barcode decoder module decodes the barcode from the video frame using the estimated amount of defocus blur, the estimated identity of the barcode, and the geometric model of the barcode.

Abstract: In one example, a device includes a first platform having a first side and a second platform having a second side that overlaps the first side. The device also includes an actuator that rotates the first platform relative to the second platform. The device also includes a plurality of light sources mounted to the first platform in a substantially circular arrangement around the axis of rotation of the first platform. The plurality of light sources emit a plurality of light beams such that respective adjacent light beams intersect at least at a predetermined distance to the first side. The first side remains at least at the predetermined distance to the second side in response to the actuator rotating the first platform. The device also includes a light detector mounted to the second platform and positioned to at least partially overlap at least one of the plurality of light beams.

Abstract: A method is provided, including the following method operations: receiving captured images of an interactive environment in which a head-mounted display (HMD) is disposed; receiving inertial data processed from at least one inertial sensor of the HMD; analyzing the captured images and the inertial data to determine a current and predicted future location of the HMD; using the predicted future location of the HMD to adjust a beamforming direction of an RF transceiver towards the predicted future location of the HMD; tracking a gaze of a user of the HMD; generating image data depicting a view of a virtual environment for the HMD, wherein regions of the view are differentially rendered; generating audio data depicting sounds from the virtual environment, the audio data being configured to enable localization of the sounds by the user; transmitting the image data and the audio data via the RF transceiver to the HMD.

Abstract: A virtual environment or mixed reality environment system including a headset device and controller. Both the headset device and the controller are configured to access and update a shared scene map. In some cases, the headset device may implement pose tracking with respect to the headset device and the controller and the controller may also implement pose tracking with respect to the headset device and the controller.

Abstract: A system configured to improve the operations associated with generating virtual representations of physical environments to recognize the physical environments and/or relocalize within the virtual representations in a substantially real time system. In some cases, the system may use a first pre-training phase of descriptors and/or split nodes of regression forests using features common across various scenes to learn general image appearance, and a second training phase of descriptors and/or leaf nodes of regression forests to learn scene specific features. The system may align the features using an orientation vector, correct for camera perspective and lens distortion of the features as well as learn robust illumination invariant features from real and synthetic data.

Abstract: There exists a number of youth development programs centered on sports programming. Some of these programs operate on a platform of revitalizing neighborhood spaces to improve community engagement by creating a space for youth to enjoy sports. Oftentimes these neighborhood spaces include restrictions or the surrounding community has needs (like lighting and seating) which are unmet or under-met. Envisioned is a system approach to addressing these needs wherein a wide variety of custom solutions can be produced from prefabricated, modular, and portable components that interface with existing amenities (if any) so to enrich the youth experience and better achieve program objectives. This modular approach provides a common infrastructure for different spaces, different sports, and different levels of play.

Abstract: Methods, systems, and computer programs are presented for rendering images on a head mounted display (HMD). One method includes operations for tracking, with one or more first cameras inside the HMD, the gaze of a user and for tracking motion of the HMD. The motion of the HMD is tracked by analyzing images of the HMD taken with a second camera that is not in the HMD. Further, the method includes an operation for predicting the motion of the gaze of the user based on the gaze and the motion of the HMD. Rendering policies for a plurality of regions, defined on a view rendered by the HMD, are determined based on the predicted motion of the gaze. The images are rendered on the view based on the rendering policies.

Abstract: A system configured to determine one or more boundaries of the space, for example, in 3D applications. In some cases, the system may generate point data including a set of safe points in a space and a set of unsafe points in the space, the space surrounding a user device of the system, generate a triangulation over a union of the set of safe points and the set of unsafe points, determine triangles of the triangulation that include at least one safe point and determine edges of determined triangles which are part of a single triangle that include at least one safe point. The system may then determine one or more boundaries of the space using the determined edges.

Abstract: Methods and systems for warning a user of a head mounted display (HMD) during game play of a video game. A game is executed causing interactive scenes of the game to be transmitted for rendering on a display portion of the HMD. Coordinates of the HMD are determined in a three-dimensional space of a real-world environment in which the user wearing the HMD is present, to identify a current position of the user. A movement of the HMD is determined during execution of the game by identifying a change in one or more coordinates of the HMD in the three-dimensional space. When it is determined that the user is approaching a boundary of an interaction space in a real-world environment, a warning signal is conveyed to the HMD to indicate proximity of the user to the boundary of the interaction space.

Abstract: A method for automatic registration of 3D image data, captured by a 3D image capture system having an RGB camera and a depth camera, includes capturing 2D image data with the RGB camera at a first pose; capturing depth data with the depth camera at the first pose; performing an initial registration of the RGB camera to the depth camera; capturing 2D image data with the RGB camera at a second pose; capturing depth data at the second pose; and calculating an updated registration of the RGB camera to the depth camera.

Abstract: A method for implementing a graphics pipeline. The method includes determining a plurality of light sources affecting a virtual scene. Geometries of objects of an image of the scene is projected onto a plurality of pixels of a display from a first point-of-view. The pixels are partitioned into a plurality of tiles. A foveal region of highest resolution is defined for the image as displayed, wherein a first subset of pixels is assigned to the foveal region, and wherein a second subset of pixels is assigned to a peripheral region that is outside of the foveal region. A first set of light sources is determined from the plurality of light sources that affect one or more objects displayed in a first tile that is in the peripheral region. At least two light sources from the first set is clustered into a first aggregated light source affecting the first tile when rendering the image in pixels of the first tile.

Abstract: Gaze tracking data representing a viewer's gaze with respect to one or more images presented to the viewer is used to generate foveated image data representing one or more foveated images characterized by a higher level of detail within one or more regions of interest and a lower level of detail outside the regions of interest. The image data for portions outside the one or more regions of interest is selectively filtered to reduce visual artifacts due to contrast resulting from the lower level of detail before compositing foveated images for presentation.

Abstract: In one example, a device includes a first platform having a first side and a second platform having a second side that overlaps the first side. The device also includes an actuator that rotates the first platform relative to the second platform. The device also includes a plurality of light sources mounted to the first platform in a substantially circular arrangement around the axis of rotation of the first platform. The plurality of light sources emit a plurality of light beams such that respective adjacent light beams intersect at least at a predetermined distance to the first side. The first side remains at least at the predetermined distance to the second side in response to the actuator rotating the first platform. The device also includes a light detector mounted to the second platform and positioned to at least partially overlap at least one of the plurality of light beams.

Abstract: A system for performing a pinch and hold gesture is described. The system includes a head-mounted display (HMD) and a glove, which is worn by a hand of the user. Each finger segment of the glove includes a sensor for detecting positions of the finger segment when moved by the hand. The system includes a computing device interfaced with the HMD and the glove. The computing device analyzes data from the sensors of the finger segments to determine that a pinch and hold gesture is performed by at least two of the finger segments. Moreover, the computing device generates image data that is communicated to the HMD, such that a scene rendered on the HMD is modified to render a visual cue indicative of a location in the scene at which the pinch and hold gesture is associated.

Abstract: A head mounted display is provided that includes a main body, a sensor, and a door. The door of the head mounted display includes a computing device or, in some cases, an embedded screen. The computing device includes a camera and a display interface. The sensor and the camera of the mobile computing device are rigidly positioned with fixed displacements.

Abstract: Systems and methods include receiving an image for presenting on a display screen of a head mounted display (HMD). The image is provided by an application. The received image is pre-distorted to enable optics provided in a HMD to render the image. An alignment offset is identified for an eye of a user wearing the HMD by determining a position of the eye relative to an optical axis of at least one lens of the optics of the HMD. The pre-distorted image provided by the application is adjusted to define a corrected pre-distorted image that accounts for the alignment offset. The corrected pre-distorted image is forwarded to the display screen of the HMD for rendering, such that the image presented through the optics of the HMD removes aberrations caused by the alignment offset.

Abstract: Methods and systems for presenting an object on a screen of a head mounted display (HMD) include receiving an image of a real-world environment in proximity of a user wearing the HMD. The image is received from one or more forward facing cameras of the HMD and processed for rendering on a screen of the HMD by a processor within the HMD. A gaze direction of the user wearing the HMD, is detected using one or more gaze detecting cameras of the HMD that are directed toward one or each eye of the user. Images captured by the forward facing cameras are analyzed to identify an object captured in the real-world environment that is in line with the gaze direction of the user, wherein the image of the object is rendered at a first virtual distance that causes the object to appear out-of-focus when presented to the user. A signal is generated to adjust a zoom factor for lens of the one or more forward facing cameras so as to cause the object to be brought into focus.

Abstract: Gaze tracking data may representing a user's gaze with respect to one or more images transmitted to a user are analyzed to determine one or more regions of interest. The one or more transmitted images are selectively compressed so that fewer bits are needed to transmit data for portions of an image outside the one or more regions interest than for portions of the image within the one or more regions of interest.