Abstract: A method includes the steps of receiving a three-dimensional input model of an underground tunnel system of a worksite, determining an initial first location in the input model for a virtual probe, determining distances between the first location and tunnel walls on the basis of the input model; determining tunnel heading on the basis of processing the determined distances, relocating the virtual probe at a second location in the input model along with the determined tunnel heading, and generating a logical tunnel model indicative of path of the virtual probe travelling in the input model, on the basis of determined locations of the virtual probe being relocated in the input model.

Abstract: This disclosure provides systems, devices, apparatus, and methods, including computer programs encoded on storage media, for runtime optimization of the shader execution flow. A graphics processor may obtain instruction execution data associated with a graphics workload, the instruction execution data including graphics data for a set of shader operations. The graphics processor may configure, at a first iteration, at least one predication value based on the instruction execution data including the graphics data for the set of shader operations. The graphics processor may adjust, at a second iteration, an execution flow of the graphics workload based on the configured at least one predication value, the execution flow of the graphics workload including the set of shader operations. The graphics processor may execute or refrain from executing, at the second iteration, each of the set of shader operations based on the adjusted execution flow of the graphics workload.

Abstract: Aspects include a multistage collector to receive outputs from plural processing elements. Processing elements may comprise (each or collectively) a plurality of clusters, with one or more ALUs that may perform SIMD operations on a data vector and produce outputs according to the instruction stream being used to configure the ALU(s). The multistage collector includes substituent components each with at least one input queue, a memory, a packing unit, and an output queue; these components can be sized to process groups of input elements of a given size, and can have multiple input queues and a single output queue. Some components couple to receive outputs from the ALUs and others receive outputs from other components. Ultimately, the multistage collector can output groupings of input elements. Each grouping of elements (e.g., at input queues, or stored in the memories of component) can be formed based on matching of index elements.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, method, and user interface to facilitate context based augmented reality communication between multiple users over a network. Virtual content item configuration data indicative of a selection by a first user of virtual content item to apply to a real-world environment that is visible to a second user via a second device is received from a first device. The virtual content item configuration data also includes one or more criteria to trigger application of the virtual content item to the real-world environment. A triggering event is detected based on satisfaction of the one or more criteria determined from context data generated at the second device. The second device presents the virtual content item overlaid on the real-world environment that is visible to the second user based on the triggering event.

Abstract: A transcript of an audio conversation between multiple users (e.g., two users) is generated. The transcript is displayed in real time within a VR environment as the conversation takes place. A virtual selection tool is displayed within the VR environment to allow for a selection of different portions of the transcript. In addition, a virtual keyboard and or virtual panels with characters may be displayed and the virtual selection tool may be used to make selections from these displays as well. These selections are used to generate new text. The new text may form part of a user's notes of the conversation or an entry for a text field within the VR environment.

Abstract: Systems and methods for ray tracing acceleration structure level of detail processing are described. An example graphics processing system is to retrieve a first level of detail value for a sub-tree from a level of detail residency map corresponding to a bounding volume hierarchy of objects. The graphics processing system is to determine a second level of detail value for the sub-tree. The graphics processing system is to select a final level of detail value for the sub-tree based on a comparison between the first level of detail value for the sub-tree and the second level of detail value for the sub-tree. The graphics processing system is to, based on the final level of detail value for the sub-tree, select child nodes in an acceleration structure tree and trace the selected child nodes.

Abstract: Methods, systems, and media for generating compressed images are provided. In some embodiments, the method comprises: identifying a multi-plane image, MPI, that represents a three-dimensional image, wherein the MPI comprises a plurality of fronto-parallel planes; splitting the MPI into a plurality of sub-volumes, wherein each sub-volume in the plurality of sub-volumes includes a subset of the plurality of fronto-parallel planes; calculating, for each sub-volume of the MPI, a depthmap; converting each depthmap to a mesh, wherein each mesh corresponds to a layer of a plurality of layers associated with a multi-depth image, MDI, to be rendered; calculating, for each layer of the plurality of layers, an image; and storing the meshes corresponding to the plurality of layers of the MDI and the images corresponding to the plurality of layers of the MDI as the MDI.

Abstract: An electronic device that provides a virtual representation is described. During operation, the electronic device may receive sensory inputs associated with a user. Then, the electronic device may determine one or more behavioral or emotional inputs based at least in part on the sensory inputs. Moreover, the electronic device may compute a modification to a behavioral or an emotional response of a virtual representation based at least in part on the one or more behavioral or emotional inputs, a behavioral and emotional model, and a set of predefined or predetermined parameters, where the behavioral and emotional model includes one or more purposes that reflect a personality of the virtual representation, and where a given purpose models an expected reward associated with a given need of the virtual representation. Next, the electronic device may provide or present the modification to the behavioral or the emotional response of the virtual representation.

Abstract: A system for generating a virtual reality environment includes a mocap suit having a plurality of sensors for generating at least one mocap suit output responsive to movement of an individual within the mocap suit within the virtual reality environment. At least one virtual reality player headset generates at least one virtual reality headset output responsive to actions of a player within the virtual reality environment. A virtual reality controller receives the at least one mocap suit output and the at least one virtual reality headset output and generates the virtual reality environment for display in the at least one virtual reality player headset. The virtual reality controller selectively generates an avatar associated with the mocap suit responsive to the at least one mocap suit output. The avatar being selectively inserted into the virtual reality world responsive to a first input and selectively removed from the virtual reality environment responsive to a second input.

Abstract: A virtual representation of an operating room is generated based on robot information and sensing of the OR with depth cameras. One of the depth cameras is integrated with a portable electronic device, operated by a local user in the operating room. The virtual representation of the OR is communicated to the virtual reality headset, with three-dimensional point cloud data. A virtual reality environment is rendered to a display of the virtual reality headset, operated by a remote user. A virtual representation of the remote user is rendered in augmented reality to a display of the portable electronic device.

Abstract: Combined use of a recommended viewpoint and a free viewpoint is achieved without display of a position of the recommended viewpoint using a frame or the like. A detection unit detects a viewpoint position change instruction. An output unit outputs a part of an image to a display unit. In this case, an output range (an image range corresponding to a current viewpoint) is changed according to a viewpoint position change unit instruction after output of a recommended range such that the output range transits in a direction toward the recommended range on the basis of a predetermined condition. For example, the predetermined condition is deviation of the output range from the recommended range. Moreover, for example, a transition speed is controlled such that return to the recommended range is achieved faster as a positional difference between the output range and the recommended range becomes larger.

Abstract: In one implementation, a method of displaying a task list is performed by a device including an image sensor, a display, one or more processors, and non-transitory memory. The method includes obtaining, using the image sensor, a video stream of a physical environment. The method includes displaying, on the display in association with the physical environment, a task list including a plurality of task elements respectively associated with a plurality of tasks, wherein the plurality of task elements includes a first task element associated with a first task and a second task element associated with a second task. The method includes detecting, in the video stream of the physical environment, completion of the first task. The method includes, in response to detecting completion of the first task, changing display of the first task element.

Abstract: A data generation program includes instructions of: acquiring three-dimensional data representing a three-dimensional shape of a three-dimensional product; acquiring an arrangement condition for arranging a support member to the three-dimensional product; setting an extending direction, a width direction, and a height direction of the support member; adding a cutting margin of a particular thickness to a cutting surface of the three-dimensional product at one side in the height direction; setting the support member in accordance with the arrangement condition, one end of the support member in the extending direction being connected to the cutting margin added to the three-dimensional product; setting a beam, the beam being spaced from the three-dimensional product having the cutting margin in the extending direction, the beam extending in the width direction; generating three-dimensional modeling data for modeling a modeled object by using a three-dimensional modeling apparatus; and outputting the three-dimen

Abstract: A method for producing an image of a body tissue surface. The method includes transforming a source 3-D model of the body tissue surface into a flattened model comprising details of the body tissue surface represented visually on an unwrapped and flattened surface, wherein the flattened model represents transformed positions of the source 3-D model of the body tissue surface defined between a first edge and a second edge. The first edge is formed about a lumen defined by the body tissue surface, and the body tissue surface projects about the lumen to the second edge. The method further includes producing an image from the flattened model.

Abstract: A device receives an image including image data of a scale model of a vehicle, and processes the image data, with a model, to identify a make, a model, and a year represented by the scale model. The device determines augmented reality (AR) vehicle information based on the make, the model, and the year represented by the scale model of the vehicle, and provides the AR vehicle information to enable a user device to associate the AR vehicle information with the image of the scale model of the vehicle. The device receives an input associated with the AR vehicle information, and determines updated AR vehicle information based on the input associated with the AR vehicle information. The device provides the updated AR vehicle information to enable the user device to associate the updated augmented reality vehicle information with the image of the scale model of the vehicle.

Abstract: A method includes a computing device interpreting a request for a requesting entity to access a set of learning objects pertaining to a common topic represented in a virtual reality environment to produce a set of requested learning object identifiers. The method further includes determining whether a license smart contract for the set of learning objects associated with a non-fungible token of the object distributed ledger affirms access by the requesting entity to the set of learning objects. When access is affirmed, the method furth includes generating the virtual reality environment utilizing a group of object representations in accordance with interaction information for at least some of the object representations of the group of object representations. The method further includes outputting the virtual reality environment to the requesting entity for interactive consumption.

Abstract: A system and method are disclosed to generate one or more mixed-reality visualizations and objects to facilitate efficient interaction with large volumes of data. Embodiments include a computer comprising a processor and memory and a mixed-reality display device comprising a display and one or more sensors. Embodiments generate a mixed-reality object comprising a first cuboid, the first cuboid comprising one or more adjustable display dimensions corresponding to one or more key process indicators (KPIs) and one or more cubelets divided along at least one of the one or more adjustable display dimensions. Embodiments display the mixed-reality object on the display, and adjust at least one of the one or more adjustable display dimensions in response to receiving a first input to the one or more sensors. In response to a second input, embodiments transform the one or more cubelets of the first cuboid.

Abstract: An apparatus, computer readable storage medium and method of generating a diverse set of images from few-shot images, includes a parameter input receiving values for control parameters to control an extent to which each reference image impacts a newly generated image. The apparatus involves an image generation deep learning network for generating an image for each of the values for the control parameters. The deep learning network has an encoder, a transformer-based fusion block, and a decoder. The transformer-based fusion block includes a mapping network that computes meta-weights from features extracted from the reference images and the control parameters, and a cross-attention block to generate modulation weights based on the meta-weights. An output displays high-quality and diverse images generated based on the values for the control parameter.

Abstract: Systems and methods of generating a three-dimensional (3D) reconstruction of a scene or environment surrounding a user of a spatial computing system, such as a virtual reality, augmented reality or mixed reality system, using only multiview images comprising, and without the need for depth sensors or depth data from sensors. Features are extracted from a sequence of frames of RGB images and back-projected using known camera intrinsics and extrinsics into a 3D voxel volume wherein each pixel of the voxel volume is mapped to a ray in the voxel volume. The back-projected features are fused into the 3D voxel volume. The 3D voxel volume is passed through a 3D convolutional neural network to refine the and regress truncated signed distance function values at each voxel of the 3D voxel volume.

Abstract: Examples described herein provide a method that includes obtaining, by a processing device, three-dimensional (3D) voxel data. The method further includes performing, by the processing device, gray value thresholding based at least in part on the 3D voxel data and assigning a classification value to at least one voxel of the 3D voxel data. The method further includes defining, by the processing device, segments based on the classification value. The method further includes filtering, by the processing device, the segments based on the classification value. The method further includes evaluating, by the processing device, the segments to identify a surface voxel per segment. The method further includes determining, by the processing device, a position of a surface point within the surface voxel.