Abstract: Techniques for representing a scene or map based on statistical data of captured environmental data are discussed herein. In some cases, the data (such as covariance data, mean data, or the like) may be stored as a multi-resolution voxel space that includes a plurality of semantic layers. In some instances, individual semantic layers may include multiple voxel grids having differing resolutions. Multiple multi-resolution voxel spaces may be merged to generate combined scenes based on detected voxel covariances at one or more resolutions.

Abstract: A method for correcting a bending of a flexible device is described. In one aspect, the method includes accessing feature data of a first stereo frame that is generated by stereo optical sensors of the flexible device, the feature data generated based on a visual-inertial odometry (VIO) system of the flexible device, accessing depth map data of the first stereo frame, the depth map data generated based on a depth map system of the flexible device, estimating a pitch-roll bias and a yaw bias based on the features data and the depth map data of the first stereo frame, and generating a second stereo frame after the first stereo frame, the second stereo frame based on the pitch-roll bias and the yaw bias of the first stereo frame.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person; tracking three-dimensional (3D) movement of the person within the video using a 3D reference point; computing a 3D position for placement of an augmented reality item relative to the 3D reference point; causing to be displayed the augmented reality item within the video at the 3D position; and updating the 3D position of the augmented reality item in the video as the 3D reference point changes based on the 3D movement of the person.

Abstract: Systems, methods, and non-transitory computer-readable media are disclosed for selectively rendering augmented reality content based on predictions regarding a user's ability to visually process the augmented reality content. For instance, the disclosed systems can identify eye tracking information for a user at an initial time. Moreover, the disclosed systems can predict a change in an ability of the user to visually process an augmented reality element at a future time based on the eye tracking information. Additionally, the disclosed systems can selectively render the augmented reality element at the future time based on the predicted change in the ability of the user to visually process the augmented reality element.

Abstract: Data visualization processes can utilize machine learning algorithms applied to visualization data structures to determine visualization parameters that most effectively provide insight into the data, and to suggest meaningful correlations for further investigation by users. In numerous embodiments, data visualization processes can automatically generate parameters that can be used to display the data in ways that will provide enhanced value. For example, dimensions can be chosen to be associated with specific visualization parameters that are easily digestible based on their importance, e.g. with higher value dimensions placed on more easily understood visualization aspects (color, coordinate, size, etc.). In a variety of embodiments, data visualization processes can automatically describe the graph using natural language by identifying regions of interest in the visualization, and generating text using natural language generation processes.

Abstract: A wearing simulation device includes a first animation generation unit that generates a first animation indicating a change in a movement of a body and a surface shape of the body from a second posture to a first posture, a second animation generation unit that generates a second animation indicating a change in a movement of the body and a surface shape of the body in a continuous movement, a third animation generation unit that generates a third animation by connecting the first animation and the second animation, and a simulation execution unit that makes the body wear a clothing model in at least one frame from beginning of the third animation, deforms the clothing model so as to follow the change in the movement of the body and the surface shape of the body in the frame after wearing, and simulates a shape change of the clothing model.

Abstract: A method for transferring a gait pattern of a first user to a second user to simulate augmented reality content in a virtual simulation environment is described. In one aspect, the method includes identifying a gait pattern of a first user operating a first visual tracking system in a first physical environment, identifying a trajectory from a second visual tracking system operated by a second user in a second physical environment, the trajectory based on poses of the second visual tracking system over time, modifying the trajectory from the second visual tracking system based on the gait pattern of the first user, applying the modified trajectory in a plurality of virtual environments, and generating simulated ground truth data based on the modified trajectory in the plurality of virtual environments.

Abstract: A method for transmitting video, according to embodiments, comprises: a pre-processing step of processing video data; a step of encoding the video data; and/or a step of transmitting a bitstream including the video data. A method for receiving video, according to embodiments, comprises the steps of: receiving video data; decoding the video data; and/or rendering the video data.

Abstract: A method includes accessing a scene graph defining a spatial relationship of a plurality of first bounding boxes associated with a plurality of virtual objects in a field of view of a user of an artificial reality (AR) device; accessing a second bounding box associated with a first bounding box of the plurality of first bounding boxes; determining, based on the second bounding box, a subregion within a sensing region of a depth sensor; obtaining first depth data within the subregion; generating, based on the first depth data, a three-dimensional model for one or more real objects; determining a visibility of a first virtual object in the AR environment associated with the first bounding box based on the three-dimensional model for the one or more real objects; and generating an output image of an AR environment based on the determined visibility of the first virtual object.

Abstract: A method for generating a live VR broadcast of a three-dimensional (3D) virtual reality (VR) performance environment is provided. 3D VR avatars are generated and displayed on a VR performance area representing a performance area. A VR broadcast of the 3D VR performance environment, including the plurality of 3D VR avatars displayed on the VR performance area and including the audio data such that the facial expressions and the body movements of the plurality of 3D VR avatars are synchronized with the audio data, is transmitted to audience devices that output the VR broadcast to audience members.

Abstract: Apparatus and methods for providing software and hardware based solutions to the problem of synthesizing noise for a digital image. According to one aspect, a probability image is generated and noise blocks are randomly placed at locations in the probability image where the locations have probability values that are compared to a threshold criterion, creating a synthesized noise image. Embodiments include generating synthesized film grain images and synthesized digital camera noise images.

Abstract: A lower dynamic range visual content (21) of a virtual reality or VR scene represented in a curved shape form is adapted to a higher dynamic range display of the virtual reality scene. At least two planar key views (230) of the VR scene area obtained at least two parameter values (240) respectively associated with those planar key views are obtained, corresponding to at least one parameter adapted to expand a dynamic range of a visual content, and a higher dynamic range visual content (22) corresponding to the lower dynamic range visual content in at least part of the VR scene extending beyond the planar key views is determined, based on the parameter values. Applications to Inverse Tone Mapping.

Abstract: Embodiments of the present disclosure relate to a method, an electronic device, and a computer program product for rendering a target scene. The method includes acquiring from a server rendering data including a point cloud and a color of the target scene. The method further includes determining a pose used for rendering the target scene at user equipment. The method further includes rendering the target scene on the basis of the rendering data and the pose, so as to show the target scene in the pose. In embodiments of the present disclosure, a rendering effect on the target scene can be improved, and the rendering speed is higher.

Abstract: In one implementation, a method involves tessellating a surface of a 3D object by identifying vertices having 3D positions. The method transforms the 3D positions into positions for a first sphere-based projection for a left eye viewpoint and positions for a second sphere-based projection for a right eye viewpoint. Transforming the 3D positions of the vertices involves transforming the vertices based on a user orientation (i.e., camera position) and differences left and right eye viewpoints (e.g., based on interaxial distance and convergence angle). The method further renders a stereoscopic 360° rendering of the 3D object based on the first sphere-based projection for the left eye viewpoint and the second sphere-based projection for the right eye viewpoint. For example, an equirectangular representation of the first sphere-based projection can be combined with an equirectangular representation of the second sphere-based projection to provide a file defining a stereoscopic 360° image.

Abstract: An example disclosed method includes (i) transmitting a first point cloud to a client, wherein the first point cloud corresponds to a reference point cloud, (ii) receiving a second point cloud, and (iii) hierarchically determining changes in the second point cloud from the reference point cloud, wherein hierarchically determining the changes includes (a) identifying first areas in the second point cloud that have changed from the reference point cloud, and (b) for a first area having a highest priority, determining a first rigid 3D transformation that approximates a first change from the reference point cloud, and if the first rigid 3D transformation cannot be determined, further determining first points to be used to modify the reference point cloud, wherein the first points are representative of the first change.

Abstract: The graphics processing unit described herein is configured to process graphics data using a rendering space which is sub-divided into a plurality of tiles. The graphics processing unit comprises a tiling unit and rendering logic. The tiling unit is arranged to generate a tile control list for each tile, the tile control list identifying each graphics data item present in the tile. The rendering logic is arranged to render the tiles using the tile control lists generated by the tiling unit. The tiling unit comprises per-tile hash generation logic arranged to generate, for each tile, a per-tile hash value based on a set of textures that will be accessed when processing the tile in the rendering logic, and the tiling unit is further arranged to store the per-tile hash value for a tile within the tile control list for the tile.

Abstract: Implementations provide methods including actions of processing patient data to generate one or more graphical representations of the patient data, at least one graphical representation of the one or more graphical representations including a waveform, displaying at least one waveform segment of the waveform, and displaying calipers associated with the at least one waveform segment, each caliper being associated with an interval, where displaying the calipers includes, for each caliper: receiving a measurement value of the interval associated with the caliper, determining respective positions of a first handle and a second handle of the caliper based on the measurement, and displaying the first handle and the second handle in the respective positions relative to the at least one waveform segment.

Abstract: Systems and methods are disclosed for visualizing products in a single-page application. Consistent with disclosed embodiments, an application system can receive from a client system, during rendering of a webpage received by the client system from a host system, a request for a script associated with the host system. The script can be executable by the client system to perform operations including modifying the webpage to include a visualization application in response to a selection of a visualization control in the webpage by a user of the client system. Consistent with disclosed embodiments, the application system can receive, from the visualization application, a request to display a product in a first image. A location can be identified in the first image using a machine learning model. Instructions can be provided to the visualization application for displaying the product at the location.

Abstract: An apparatus to facilitate compression of memory data is disclosed. The apparatus comprises one or more processors to receive uncompressed data, adapt a format of the uncompressed data to a compression format, perform a color transformation from a first color space to a second color space, perform a residual computation to generate residual data, compress the residual data via entropy encoding to generate compressed data and packing the compressed data.

Abstract: A method includes: receiving synchronization and navigation data from a navigation system; generating a physical frame of reference with respect to a registered physical model based on the synchronization and navigation data; registering an augmented reality head mounted display with the navigation system using the synchronization and navigation data; receiving data representative of a virtual model; anchoring the virtual model to the physical frame of reference; receiving tracking data indicative of the position and angle of view of the augmented reality head mounted display with respect to the physical frame of reference; and responsive to determining that the physical model is within a field of view of the augmented reality head mounted display: rendering a virtual image from the virtual model in real time based on the received tracking data; and streaming the virtual image to the augmented reality head mounted display, thereby generating a synchronized and augmented realty view.