Abstract: Moving images of a space, which includes objects 34 and 35 of a display target, as viewed from reference points are created in advance as reference images, and they are combined in response to actual positions of the points of view to draw a moving image. When the object 35 is displaced as indicated by an arrow mark in the space, reference points of view 30a to 30e are fixed as depicted in (a). Alternatively, the reference points of view are displaced in response to the displacement like reference points of view 36a to 36e in (b). Then, the moving images from the reference points of view are generated as the reference images.

Abstract: Embodiments of the present disclosure relates to a method and device for processing an image, and a nonvolatile storage medium. The method includes: acquiring a first image and a first virtual object having a corresponding relationship with a preset standard model, the first image includes a target object; determining control information based on the target object and the standard model; obtaining a second virtual object matched with the target object by processing the first virtual object based on the control information; and generating a second image; the second image includes the target object fitted with the second virtual object.

Abstract: Systems can identify visible surfaces for pixels in an image (portion) to be rendered. A sampling pattern of ray directions is applied to the pixels, so that the sampling pattern of ray directions repeats, and with respect to any pixel, the same ray direction can be found in the same relative position, with respect to that pixel, as for other pixels. Rays are emitted from visible surfaces in the respective ray direction supplied from the sampling pattern. Ray intersections can cause shaders to execute and contribute results to a sample buffer. With respect to shading of a given pixel, ray results from a selected subset of the pixels are used; the subset is selected by identifying a set of pixels, collectively from which rays were traced for the ray directions in the pattern, and requiring that surfaces from which rays were traced for those pixels satisfy a similarity criteria.

Abstract: Techniques for resolving hemisphere ambiguity are disclosed. One or more magnetic fields are emitted at a handheld controller. The one or more magnetic fields are detected by one or more sensors positioned relative to a headset. Movement data corresponding to the handheld controller or the headset is detected. During a first time interval, a first position and a first orientation of the handheld controller within a first hemisphere are determined based on the detected one or more magnetic fields, and a first discrepancy is calculated based on the first position, the first orientation, and the movement data. During a second time interval, a second position and a second orientation of the handheld controller within a second hemisphere are determined based on the detected one or more magnetic fields, and a second discrepancy is calculated based on the second position, the second orientation, and the movement data.

Abstract: Embodiments disclosed herein are related to systems and methods for implementing a customizable compact overlay window in a display. In one embodiment, a computing system includes one or more processors and a storage device that stores computer executable instructions that can be executed by the processors to cause the computing system to perform the following. The system receives from an application running on the computing system customization parameters that define how the application is to be configured in a compact overlay window. The system generates the compact overlay window so that the compact overlay window is customizable according to the customization parameters. The system positions the compact overlay window in a portion of a display of the computing system.

Abstract: A graphics system has a rendering space divided into a plurality of rectangular areas, each being sub-divided into a plurality of smaller rectangular areas of a plurality of pixels. Data is received representing a tiled set of polygons to be rendered in a selected one of the rectangular areas. For each polygon, a determination is made whether that polygon is located at least partially inside a selected one of the smaller rectangular areas in the selected rectangular area. If so, which pixels of the plurality of pixels in the selected smaller rectangular area are inside the polygon are identified. Or, if that polygon is not located at least partially inside the selected smaller rectangular area, no further processing of the polygon is performed at one or more of the plurality of pixels in the smaller rectangular area.

Abstract: An imaging device contained in a contact lens captures images of the external environment, which for convenience will be referred to as real-world images. These real-world images are used to stabilize images produced by a femtoprojector also in the contact lens. For convenience, the images produced by the femtoprojector will be referred to as augmented reality or AR images. The femtoprojector is inward-facing (i.e., facing towards the interior of the eye) and projects the AR images onto the user's retina, creating the appearance of virtual images in the external environment. The imaging device, referred to as a femtoimager for convenience, is outward-facing and captures a sequence of actual real-world images of the external environment. Because the femtoimager and femtoprojector move together, the real-world images captured by the femtoimager reflect the motion of the virtual AR images from the femtoprojector relative to the external environment.

Abstract: There is provided a playback apparatus and method, and generation apparatus and method capable of performing enlargement/reduction display of an image while preventing an occurrence of motion sickness. In a case where enlargement/reduction of omnidirectional image is selected, the playback apparatus includes a vertex data transformer that generates a 3D model for enlargement/reduction. The present disclosure can be applied, for example, to a playback apparatus and the like that generates an image obtained by perspective-projecting an omnidirectional image as a display image according to the viewer/listener's line-of-sight direction.

Abstract: The present technology relates to artificial reality systems. Such systems provide projections a user can create to specify object interactions. For example, when a user wishes to interact with an object outside her immediate reach, she can use a projection to select, move, or otherwise interact with the distant object. The present technology also includes object selection techniques for identifying and disambiguating between objects, allowing a user to select objects both near and distant from the user. Yet further aspects of the present technology include techniques for interpreting various bimanual (two-handed) gestures for interacting with objects. The present technology further includes a model for differentiating between global and local modes for, e.g., providing different input modalities or interpretations of user gestures.

Abstract: A cross reality system enables any of multiple types of devices to efficiently and accurately access previously stored maps and render virtual content specified in relation to those maps. The cross reality system may include a cloud-based localization service that responds to requests from devices to localize with respect to a stored map. Devices of any type, with native hardware and software configured for augmented reality operations may be configured to work with the cross reality system by incorporating components that interface between the native AR framework of the device and the cloud-based localization service. These components may present position information about the device in a format recognized by the localization service. Additionally, these components may filter or otherwise process perception data provided by the native AR framework to increase the accuracy of localization.

Abstract: Configurations are disclosed for a health system to be used in various healthcare applications, e.g., for patient diagnostics, monitoring, and/or therapy. The health system may comprise a light generation module to transmit light or an image to a user, one or more sensors to detect a physiological parameter of the user's body, including their eyes, and processing circuitry to analyze an input received in response to the presented images to determine one or more health conditions or defects.

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for iteratively decimating a three-dimensional mesh utilizing successive self-parameterization. For example, the disclosed system can self-parameterize local geometries of a three-dimensional mesh using surface mappings within a two-dimensional surface mapping space. The disclosed system can collapse edges in the three-dimensional mesh to create new vertices from the collapsed edges. The disclosed system can parameterize the collapsed edges based on the surface mappings to collapse corresponding edges within the surface mapping space. The disclosed system can thus generate a decimated three-dimensional mesh by collapsing edges in the three-dimensional mesh while providing a bijective map between points in the decimated three-dimensional mesh and corresponding points in the three-dimensional mesh.

Abstract: Systems and methods are disclosed for secret sharing for secure collaborative graphical design. Graphical secret shares are generated from a three-dimensional graphical design and distributed to one or more contributor devices. Contributor graphical designs modifying graphical secret shares may be received from contributor devices. Various corresponding and related systems, methods, and software are described.

Abstract: A method for displaying virtual content to a user, the method includes determining an accommodation of the user's eyes. The method also includes delivering, through a first waveguide of a stack of waveguides, light rays having a first wavefront curvature based at least in part on the determined accommodation, wherein the first wavefront curvature corresponds to a focal distance of the determined accommodation. The method further includes delivering, through a second waveguide of the stack of waveguides, light rays having a second wavefront curvature, the second wavefront curvature associated with a predetermined margin of the focal distance of the determined accommodation.

Abstract: Approaches presented herein can reduce temporal lag that may be introduced in a generated image sequence that utilizes temporal accumulation for denoising in dynamic scenes. A fast historical frame can be generated along with a full historical frame generated for a denoising process, with the fast historical frame being accumulated using an exponential moving average with a significantly higher blend weight. This fast history frame can be used to determine a clamping window that can be used to clamp a corresponding full historical value before, or after, reprojection. The fast historical blend weight can be adjusted to control the amount of noise versus temporal lag in an image sequence. In some embodiments, differences between fast and full historical values can also be used to determine an amount of spatial filtering to be applied.

Abstract: A method of calibrating a registration of an augmented reality device 2 comprised in a surgical navigation system 100 is provided. The method comprises obtaining a first transformation 38 between a coordinate system 40 of the augmented reality device 2 and a reference coordinate system 42 of the surgical navigation system 100, a second transformation 44 between a coordinate system of a reference object 24 and the reference coordinate system 42 and obtaining geometrical properties of the reference object 24. The method further comprises determining a visual representation 34 of the reference object 24 to be displayed by the augmented reality device 2 and obtaining at least one first viewing direction 56 of a user using the augmented reality device 2, the at least one first viewing direction 56 being associated with the reference coordinate system 42.

Abstract: As three-dimensional (3D) printing and additive manufacturing becomes a way for individuals and companies to distribute physical goods, there is a growing need for creators of physical goods to enable customers to customize 3D printed objects while protecting core electronic assets in the form of the files used to define and print the objects. Server-side rendering of 3D object images provides an opportunity to protect 3D object files while offering performance advantages. A scripting language may be central to delivering a seamless user experience interacting with 3D object models on client devices. Object creators and vendors may rely on the scripting language to create user interfaces for selling customizable objects. And once the user interface is developed, it may provide the basis for users accessing, viewing, manipulating, selecting materials, rendering, pricing, and printing a range of 3D objects.

Abstract: A correlation system can be implemented on a user device (e.g., smartphone) to perform image processing tasks e.g., point to point correlations for tasks such as alignment, tracking, and reconstruction of model data. The correlation system can implement normalized cross correlation in a least squares optimization scheme without use of approximations. Normalized cross correlation optimized via least squares can further implement global and local cost functions that are invariant to dynamic lighting conditions.

Abstract: A three-dimensional graphical user interface (3D GUI) configured to be used by a computer, a display system, an electronic system, or an electro-mechanical system. The 3D GUI provides an enhanced user-engaging experience while enabling a user to manipulate the motion of an object of arbitrary size and a multiplicity of independent degrees of freedom, using sufficient degrees of freedom to represent the motion. The 3D GUI is configured to process the kinematics of objects interacting with vector fields by using the analytics of Stokes' law. The 3D GUI is also configured to process distributed neural networks by methods including combining the actions of individual nodes and storing the result as a T matrix product in a central cluster node.

Abstract: A method includes a computing system receiving a first-person image that captures an artificial-reality environment from a first-person perspective of a user of a head-mounted device, wherein the first-person image is rendered based on a pose of the head-mounted device. Based on the pose of the head-mounted device, the computing system determines a spectator perspective wherein the spectator perspective and the first-person perspective are co-located in a three-dimensional space and the spectator perspective has a predetermined rotational orientation about a view axis. The computing system generates a spectator image that captures the first-person image from the spectator perspective, and causes the first-person image to be displayed by the head-mounted device and the spectator image to be displayed on a device separate from the head-mounted device.