Abstract: A method generates synchronized auditory and haptic feedback for artificial-reality environments. The method includes performing a simulation of a user interaction with a virtual object in an artificial-reality environment. The user interaction (i) traverses a surface of the virtual object (e.g., running a finger over a textured surface), and (ii) includes a set of contact events (e.g., a sparse set of events). The method also includes estimating a trajectory of the user interaction with the virtual object based on the set of contact events. The method also includes determining a surface profile associated with the surface of the virtual object, generating an excitation force profile according to (i) the estimated trajectory and (ii) the surface profile, and rendering, based on the excitation force profile, audio and synchronized haptic feedback for the user interaction.

Abstract: A method generates synchronized auditory and haptic feedback for artificial-reality environments. The method includes performing a simulation of a user interaction with a virtual object in an artificial-reality environment. The user interaction (i) traverses a surface of the virtual object (e.g., running a finger over a textured surface), and (ii) includes a set of contact events (e.g., a sparse set of events). The method also includes estimating a trajectory of the user interaction with the virtual object based on the set of contact events. The method also includes determining a surface profile associated with the surface of the virtual object, generating an excitation force profile according to (i) the estimated trajectory and (ii) the surface profile, and rendering, based on the excitation force profile, audio and synchronized haptic feedback for the user interaction.

Abstract: A method generates synchronized auditory and haptic feedback for artificial-reality environments. The method includes performing a simulation of a user interaction with a virtual object in an artificial-reality environment. The user interaction (i) traverses a surface of the virtual object (e.g., running a finger over a textured surface), and (ii) includes a set of contact events (e.g., a sparse set of events). The method also includes estimating a trajectory of the user interaction with the virtual object based on the set of contact events. The method also includes determining a surface profile associated with the surface of the virtual object, generating an excitation force profile according to (i) the estimated trajectory and (ii) the surface profile, and rendering, based on the excitation force profile, audio and synchronized haptic feedback for the user interaction.

Abstract: The present invention is directed to a system and method for interactive and iterative reconstruction in a manner that helps to reduce computational requirements by generating a model from a subset of the available data, and then refining that model using additional data. Example embodiments directed to scene reconstruction, reconstruct a 3D scene from a plurality of 2D images of that scene by first generating a model of the 3D scene from a subset a of the 2D images. The model can then be refined using specific characteristics of each image in the subset that are calculated using the other images in the subset. The model is further refined using images not in the original subset.

Abstract: The present invention relates to a method and system for processing a volumetric dataset for providing close-up visualization of a subset therefrom. A volumetric dataset is processed based on a dual access gradient quantization data structure. The data structure is generated in a fast pre-processing stage and provides substantially immediate access to a quantized gradient using either an index or an arbitrary normalized vector. The method provides a clear, enlarged high-resolution image of a user selected region of interest at interactive rates and allows the user to freely move and visualize the region of interest within the volumetric dataset and with any orientation.

Abstract: The present invention is directed to a system and method for interactive and iterative reconstruction in a manner that helps to reduce computational requirements by generating a model from a subset of the available data, and then refining that model using additional data. Example embodiments directed to scene reconstruction, reconstruct a 3D scene from a plurality of 2D images of that scene by first generating a model of the 3D scene from a subset a of the 2D images. The model can then be refined using specific characteristics of each image in the subset that are calculated using the other images in the subset. The model is further refined using images not in the original subset.

Abstract: The present invention relates to a method and system for processing a volumetric dataset for providing close-up visualization of a subset therefrom. A volumetric dataset is processed based on a dual access gradient quantization data structure. The data structure is generated in a fast pre-processing stage and provides substantially immediate access to a quantized gradient using either an index or an arbitrary normalized vector. The method provides a clear, enlarged high-resolution image of a user selected region of interest at interactive rates and allows the user to freely move and visualize the region of interest within the volumetric dataset and with any orientation.