Abstract: Systems and methods for ray tracing acceleration structure level of detail processing are described. An example graphics processing system is to retrieve a first level of detail value for a sub-tree from a level of detail residency map corresponding to a bounding volume hierarchy of objects. The graphics processing system is to determine a second level of detail value for the sub-tree. The graphics processing system is to select a final level of detail value for the sub-tree based on a comparison between the first level of detail value for the sub-tree and the second level of detail value for the sub-tree. The graphics processing system is to, based on the final level of detail value for the sub-tree, select child nodes in an acceleration structure tree and trace the selected child nodes.

Abstract: Methods, systems, and media for generating compressed images are provided. In some embodiments, the method comprises: identifying a multi-plane image, MPI, that represents a three-dimensional image, wherein the MPI comprises a plurality of fronto-parallel planes; splitting the MPI into a plurality of sub-volumes, wherein each sub-volume in the plurality of sub-volumes includes a subset of the plurality of fronto-parallel planes; calculating, for each sub-volume of the MPI, a depthmap; converting each depthmap to a mesh, wherein each mesh corresponds to a layer of a plurality of layers associated with a multi-depth image, MDI, to be rendered; calculating, for each layer of the plurality of layers, an image; and storing the meshes corresponding to the plurality of layers of the MDI and the images corresponding to the plurality of layers of the MDI as the MDI.

Abstract: An electronic device that provides a virtual representation is described. During operation, the electronic device may receive sensory inputs associated with a user. Then, the electronic device may determine one or more behavioral or emotional inputs based at least in part on the sensory inputs. Moreover, the electronic device may compute a modification to a behavioral or an emotional response of a virtual representation based at least in part on the one or more behavioral or emotional inputs, a behavioral and emotional model, and a set of predefined or predetermined parameters, where the behavioral and emotional model includes one or more purposes that reflect a personality of the virtual representation, and where a given purpose models an expected reward associated with a given need of the virtual representation. Next, the electronic device may provide or present the modification to the behavioral or the emotional response of the virtual representation.

Abstract: A system for generating a virtual reality environment includes a mocap suit having a plurality of sensors for generating at least one mocap suit output responsive to movement of an individual within the mocap suit within the virtual reality environment. At least one virtual reality player headset generates at least one virtual reality headset output responsive to actions of a player within the virtual reality environment. A virtual reality controller receives the at least one mocap suit output and the at least one virtual reality headset output and generates the virtual reality environment for display in the at least one virtual reality player headset. The virtual reality controller selectively generates an avatar associated with the mocap suit responsive to the at least one mocap suit output. The avatar being selectively inserted into the virtual reality world responsive to a first input and selectively removed from the virtual reality environment responsive to a second input.

Abstract: A virtual representation of an operating room is generated based on robot information and sensing of the OR with depth cameras. One of the depth cameras is integrated with a portable electronic device, operated by a local user in the operating room. The virtual representation of the OR is communicated to the virtual reality headset, with three-dimensional point cloud data. A virtual reality environment is rendered to a display of the virtual reality headset, operated by a remote user. A virtual representation of the remote user is rendered in augmented reality to a display of the portable electronic device.

Abstract: Combined use of a recommended viewpoint and a free viewpoint is achieved without display of a position of the recommended viewpoint using a frame or the like. A detection unit detects a viewpoint position change instruction. An output unit outputs a part of an image to a display unit. In this case, an output range (an image range corresponding to a current viewpoint) is changed according to a viewpoint position change unit instruction after output of a recommended range such that the output range transits in a direction toward the recommended range on the basis of a predetermined condition. For example, the predetermined condition is deviation of the output range from the recommended range. Moreover, for example, a transition speed is controlled such that return to the recommended range is achieved faster as a positional difference between the output range and the recommended range becomes larger.

Abstract: In one implementation, a method of displaying a task list is performed by a device including an image sensor, a display, one or more processors, and non-transitory memory. The method includes obtaining, using the image sensor, a video stream of a physical environment. The method includes displaying, on the display in association with the physical environment, a task list including a plurality of task elements respectively associated with a plurality of tasks, wherein the plurality of task elements includes a first task element associated with a first task and a second task element associated with a second task. The method includes detecting, in the video stream of the physical environment, completion of the first task. The method includes, in response to detecting completion of the first task, changing display of the first task element.

Abstract: A data generation program includes instructions of: acquiring three-dimensional data representing a three-dimensional shape of a three-dimensional product; acquiring an arrangement condition for arranging a support member to the three-dimensional product; setting an extending direction, a width direction, and a height direction of the support member; adding a cutting margin of a particular thickness to a cutting surface of the three-dimensional product at one side in the height direction; setting the support member in accordance with the arrangement condition, one end of the support member in the extending direction being connected to the cutting margin added to the three-dimensional product; setting a beam, the beam being spaced from the three-dimensional product having the cutting margin in the extending direction, the beam extending in the width direction; generating three-dimensional modeling data for modeling a modeled object by using a three-dimensional modeling apparatus; and outputting the three-dimen

Abstract: A method for producing an image of a body tissue surface. The method includes transforming a source 3-D model of the body tissue surface into a flattened model comprising details of the body tissue surface represented visually on an unwrapped and flattened surface, wherein the flattened model represents transformed positions of the source 3-D model of the body tissue surface defined between a first edge and a second edge. The first edge is formed about a lumen defined by the body tissue surface, and the body tissue surface projects about the lumen to the second edge. The method further includes producing an image from the flattened model.

Abstract: A device receives an image including image data of a scale model of a vehicle, and processes the image data, with a model, to identify a make, a model, and a year represented by the scale model. The device determines augmented reality (AR) vehicle information based on the make, the model, and the year represented by the scale model of the vehicle, and provides the AR vehicle information to enable a user device to associate the AR vehicle information with the image of the scale model of the vehicle. The device receives an input associated with the AR vehicle information, and determines updated AR vehicle information based on the input associated with the AR vehicle information. The device provides the updated AR vehicle information to enable the user device to associate the updated augmented reality vehicle information with the image of the scale model of the vehicle.

Abstract: A system and method are disclosed to generate one or more mixed-reality visualizations and objects to facilitate efficient interaction with large volumes of data. Embodiments include a computer comprising a processor and memory and a mixed-reality display device comprising a display and one or more sensors. Embodiments generate a mixed-reality object comprising a first cuboid, the first cuboid comprising one or more adjustable display dimensions corresponding to one or more key process indicators (KPIs) and one or more cubelets divided along at least one of the one or more adjustable display dimensions. Embodiments display the mixed-reality object on the display, and adjust at least one of the one or more adjustable display dimensions in response to receiving a first input to the one or more sensors. In response to a second input, embodiments transform the one or more cubelets of the first cuboid.

Abstract: A method includes a computing device interpreting a request for a requesting entity to access a set of learning objects pertaining to a common topic represented in a virtual reality environment to produce a set of requested learning object identifiers. The method further includes determining whether a license smart contract for the set of learning objects associated with a non-fungible token of the object distributed ledger affirms access by the requesting entity to the set of learning objects. When access is affirmed, the method furth includes generating the virtual reality environment utilizing a group of object representations in accordance with interaction information for at least some of the object representations of the group of object representations. The method further includes outputting the virtual reality environment to the requesting entity for interactive consumption.

Abstract: An apparatus, computer readable storage medium and method of generating a diverse set of images from few-shot images, includes a parameter input receiving values for control parameters to control an extent to which each reference image impacts a newly generated image. The apparatus involves an image generation deep learning network for generating an image for each of the values for the control parameters. The deep learning network has an encoder, a transformer-based fusion block, and a decoder. The transformer-based fusion block includes a mapping network that computes meta-weights from features extracted from the reference images and the control parameters, and a cross-attention block to generate modulation weights based on the meta-weights. An output displays high-quality and diverse images generated based on the values for the control parameter.

Abstract: Systems and methods of generating a three-dimensional (3D) reconstruction of a scene or environment surrounding a user of a spatial computing system, such as a virtual reality, augmented reality or mixed reality system, using only multiview images comprising, and without the need for depth sensors or depth data from sensors. Features are extracted from a sequence of frames of RGB images and back-projected using known camera intrinsics and extrinsics into a 3D voxel volume wherein each pixel of the voxel volume is mapped to a ray in the voxel volume. The back-projected features are fused into the 3D voxel volume. The 3D voxel volume is passed through a 3D convolutional neural network to refine the and regress truncated signed distance function values at each voxel of the 3D voxel volume.

Abstract: Examples described herein provide a method that includes obtaining, by a processing device, three-dimensional (3D) voxel data. The method further includes performing, by the processing device, gray value thresholding based at least in part on the 3D voxel data and assigning a classification value to at least one voxel of the 3D voxel data. The method further includes defining, by the processing device, segments based on the classification value. The method further includes filtering, by the processing device, the segments based on the classification value. The method further includes evaluating, by the processing device, the segments to identify a surface voxel per segment. The method further includes determining, by the processing device, a position of a surface point within the surface voxel.

Abstract: In one example, a method includes causing presentation of a camera interface, the camera interface displaying a first image captured by a camera of a computing device of a first user of an interaction system, identifying a set of users of the interaction system that are associated with the first user, determining a subset of the set of users that have been active on the interaction system within a determinable time period, causing presentation, within the camera interface, of a graphical element for each user of the subset of users, each graphical element being user-selectable to invoke an augmentation mechanism, detecting user selection of a first graphical element associated with a second user of the subset, and causing presentation, within the camera interface and responsive to the detection of the user selection of the first graphical element, of an augmentation of the first image to generate augmented image.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for robot programming. One of the methods comprises generating an interactive user interface that includes an illustration of a first virtual robot, the first virtual robot having an initial pose that defines respective joint angles of one or more joints of the first virtual robot; receiving user input data specifying a target pose of the first virtual robot; and generating an animation of the first virtual robot transitioning between the initial pose and the target pose.

Abstract: Real-time monitoring of surroundings of a marine vessel. One or more observation sensor modules are configured and positioned to generate sensor data extending around the marine vessel. One or more data processors are configured to map and visualize the sensor data in relation to a virtual model of the marine vessel. A user interface is configured to display the virtual model together with the visualized sensor data from a user selectable point of view to a mariner of the marine vessel.

Abstract: Disclosed are systems and methods for voice-based control of augmented reality (AR) objects on a wearable device. The systems and methods perform operations comprising: instructing a display element of the AR wearable device to present a visual indicator representing a cursor; receiving voice input representing a first virtual object; determining a real-world position within a real-world environment being viewed through the AR wearable device based on a current position of the visual indicator; and instructing the display element of the AR wearable device to present the first virtual object within the real-world environment at the real-world position.

Abstract: The present disclosure relates to systems, non-transitory computer-readable media, and methods for generating and modifying digital animations based on user interactions with a unique user interface portraying a one-dimensional layer motion element and/or elements for generating and utilizing animation path for digital design objects and animation layers. The disclosed system can provide a dynamic one-dimensional layer motion element that adapts to a selected animation layer and portrays selectable animation frames from the animation layer. The disclosed systems can provide options for generating and modifying various frames of the digital animation based on user interactions with the one-dimensional layer motion element, an animation timeline, and/or a corresponding animation canvas.