Abstract: The disclosure introduces polar stroking for representing paths. A system, method, and apparatus are disclosed for representing and rendering stroked paths employing polar stroking. In one example, a method of approximating a path is provided that includes: (1) evaluating, in parallel, multiple links of a path, wherein each link of the multiple links is evaluated in steps based on tangent angle changes of the link, and (2) providing a polar stroked representation of the path employing the steps. A computing system for rendering is also provided. In one example, the computing system includes one or more processing units to perform one or more operations including generating, in parallel, a polar stroked representation of individual links of a path, and rendering a stroked tessellation of the path based on the polar stroked representations of the individual links.

Abstract: A system comprises a processor and a memory having computer readable instructions stored thereon. The computer readable instructions, when executed by the processor, cause the system to display a surgical environment image. The surgical environment image includes a virtual control element for controlling a component of a surgical system. The virtual control element includes a real-time image of the component of the surgical system in the surgical environment image. The computer readable instructions also cause the system to display an image of a body part of a user used to interact with the virtual control element, receive a gesture of the body part of the user in a predetermined motion via a gesture based input device, and adjust a setting of the component of the surgical system based on the received gesture.

Abstract: A system and method of creating customized characters and selectively displaying them in an electronic display, such as an augmented reality or virtual reality display is provided. A digital character may be provided by a character provider for customization by others using the system. Such customizations may be instantiated in user devices that provide electronic displays. Instantiation of the custom digital character may be conditioned on one or more trigger conditions, which may be specified by the character customizer. For example, a digital character customized using the system may be conditioned on triggering events in the real-world or in a virtual world. When a relevant triggering condition is satisfied at a user device, the custom character (i.e., information for instantiating the custom character) may be transmitted to that user device. In this manner, the system may push custom characters to user devices that satisfy the triggering condition.

Abstract: A system that includes a depth perception camera to estimate or otherwise measure the dimensions of a proposed carry-on item to determine whether the proposed carry-on item complies with limitations associated with a user. The system is configured to enable checking the proposed carry-on item and receiving payment for the checked item when the item exceeds the limitations associated with the user. Displayed to the user are dimension lines associated with the maximum dimensions of the limitations and/or the captured dimensions of the proposed carry-on item.

Abstract: An information processing apparatus includes an acquiring unit and a command unit. The acquiring unit acquires positional information of a container containing a contained object from an image acquired as a result of photographing the container by using a display device that displays a virtual-space image and a real space in an overlapping manner and that has a photographing function. The command unit commands the display device to display information related to the contained object stored in association with the positional information as the virtual-space image near the container.

Abstract: Appropriate housing equipment according to the physical ability of a trainee who has performed rehabilitation in order to restore or maintain the physical ability is easily presented. A housing equipment presentation apparatus includes a storage unit configured to store definition information defining housing equipment information according to a physical ability, an acquisition unit configured to externally acquire physical ability information of a trainee who has performed training in order to restore or maintain his/her physical ability, a conversion unit configured to convert the acquired physical ability information into the housing equipment information based on the definition information, and an output unit configured to output presentation information including the converted housing equipment information.

Abstract: Examples are disclosed that relate to hand gesture-based emojis. One example provides, on a display device, a method comprising receiving hand tracking data representing a pose of a hand in a coordinate system, based on the hand tracking data, recognizing a hand gesture, and identifying an emoji corresponding to the hand gesture. The method further comprises presenting the emoji on the display device, and sending an instruction to one or more other display devices to present the emoji.

Abstract: The present disclosure provides an apparatus and method for training a machine learning engine configured to determine whether an object in a two dimensional (2D) image is in-scope or out-of-scope relative to the one or more 3D objects that includes receiving a 3D model of each of the one or more 3D objects, for each 3D model receiving a set of specifications and thresholds for the 3D model, augmenting the specifications of the 3D model to generate a plurality of augmented 3D models, and generating auxiliary training data based on the plurality of augmented 3D models, and utilizing the auxiliary training data to train the machine learning engine.

Abstract: An offsite device for remote augmented reality communication for guided surgery configured to receive, by an offsite device, a plurality of representations of a plurality of frames and a plurality of indices, wherein the plurality of indices includes at least a first frame index and at least a second frame index, display, by the offsite device and to an offsite surgeon, a second frame of the second frame index, input, by the offsite device, an illustration from the offsite surgeon, wherein the illustration is drawn on the second frame, register, by the offsite device, the illustration to the second frame, wherein registering produces registration data, and transmit, by the offsite device, the illustration and the registration data.

Abstract: Certain aspects of the present disclosure provide techniques for providing a chronologically-based search engine. Example methods includes presenting, on a display of an end-user device, live image data being captured by a camera of the end-user device, determining a pose of the end-user device, and sending the pose of the device to a server. The method also includes receiving location specific data from the server, the location specific data based on the pose of the end-user device, the location specific data including a first topic, and superimposing, on the live image data, based on the location specific data, (i) at least one highlighted area of an object associated with the first topic, and (ii) a query panel associated with the first topic superimposed proximate the object, the at least one highlighted area and the query panel being interactive elements associated with the first topic.

Abstract: A graphics processing hardware pipeline is arranged to perform an edge test or a depth calculation. Each hardware arrangement includes a microtile component hardware element, multiple pixel component hardware elements, one or more subsample component hardware elements and a final addition and comparison unit. The microtile component hardware element calculates a first output using a sum-of-products and coordinates of a microtile within a tile in the rendering space. Each pixel component hardware element calculates a different second output using the sum-of-products and coordinates for different pixels defined relative to an origin of the microtile. The subsample component hardware element calculates a third output using the sum-of-products and coordinates for a subsample position defined relative to an origin of a pixel.

Abstract: This specification describes systems and methods for refining point cloud data. Methods can include receiving point cloud data for a physical space, iteratively selecting points along an x, y, and z dimension, clustering the selected points into 2D histograms, determining a slope value for each 2D histogram, and removing, based on the slope value exceeding a predetermined value, points from the point cloud data. Methods can also include iteratively voxelizing each 2D histogram into predetermined mesh sizes, summating points in each voxelized 2D histogram, removing, based on determining the summation is below a predetermined sum value, points from the point cloud data, keeping, based on determining that a number of points in each voxelized 2D histogram exceeds a threshold value, a center point, selecting, for each histogram, a point, identifying, nearest neighbors in the point cloud data, removing the identified nearest neighbors from the data, and returning remaining points.

Abstract: Methods, systems, and storage media for initiating communication between artificial reality devices are disclosed. Exemplary implementations may: enable a discovery setting by a first user wearing a first artificial reality device; detect a presence of at least a second user wearing a second artificial reality device; determine a familiarity level of the first user with the second user; and in response to the familiarity level breaching a familiarity threshold, initiate a call with the second artificial reality device by the first artificial reality device, the call including an interaction in an artificial reality environment accessed via the first artificial reality device and the second artificial reality device.

Abstract: A system automatically identifies objects in an environment based on a walkthrough video and an annotated floorplan of the environment. The annotated floorplan indicates locations and types of objects that are expected to be in the environment. The system receives the walkthrough video and generates a 3D model of the environment. The system applies a machine learning model to the walkthrough video to identify regions within frames where objects are captured. After identifying the regions within frames of the walkthrough video that include objects, the system modifies corresponding regions of the 3D model to include the identified objects. For each of the identified objects, the system determines a likelihood of the identified object being present at a location in the environment based on a comparison of the modified 3D model and the annotated floorplan.

Abstract: A system that displays a set of polygons is described. This system obtains a set of line segments that defines the set of polygons. The system forms a horizontal index that keeps track of where line segments vertically project onto a horizontal reference line and similarly forms a vertical index for horizontal projections onto a vertical reference line. The system obtains a clip rectangle that defines a view into the set of polygons and uses the horizontal and vertical indexes to determine intersections between borders of the clip rectangle and line segments in the set of line segments. Next, the system uses the determined intersections to clip polygons in the set of polygons that intersect the clip rectangle. Finally, the system transfers the clipped polygons, and also unclipped polygons that fit completely within the clip rectangle, to a display device that displays the view into the set of polygons.

Abstract: Disclosed are systems, methods, and devices for generating a visualization of a deep reinforcement learning (DRL) process. State data is received, reflective of states of an environment explored by an DRL agent, each state corresponding to a time step. For each given state, saliency metrics are calculated by processing the state data, each metric measuring saliency of a feature at the time step corresponding to the given state. A graphical visualization is generated, having at least two dimensions in which: each feature of the environment is graphically represented along a first axis; and each time step is represented along a second axis; and a plurality of graphical markers representing corresponding saliency metrics, each graphical marker having a size commensurate with the magnitude of the particular saliency metric represented, and a location along the first and second axes corresponding to the feature and time step for the particular saliency metric.

Abstract: Various implementations disclosed herein include devices, systems, and methods that generate floorplans and measurements using a three-dimensional (3D) representation of a physical environment generated based on sensor data.

Abstract: In some implementations, a method includes obtaining a virtual object kit that includes a set of virtual object templates of a particular virtual object type. In some implementations, the virtual object kit includes a plurality of groups of components. In some implementations, each of the plurality of groups of components is associated with a particular portion of a virtual object. In some implementations, the method includes receiving a request to assemble a virtual object. In some implementations, the request includes a selection of components from at least some of the plurality of groups of components. In some implementations, the method includes synthesizing the virtual object in accordance with the request.

Abstract: The present disclosure provides a computation device and method. The device may include an input module configured to acquire input data; a model generation module configured to construct an offline model according to an input network structure and weight data; a neural network operation module configured to generate a computation instruction based on the offline model and cache the computation instruction, and compute the data to be processed based on the computation instruction to obtain a computation result; and an output module configured to output a computation result. The device and method may avoid the overhead caused by running an entire software architecture, which is a problem in a traditional method.

Abstract: Techniques are provided for identifying objects (such as products within a physical store) within a captured video scene and indicating which of object in the captured scene matches a desired object requested by a user. The matching object is then displayed in an accentuated manner to the user in real-time (via augmented reality). Object identification is carried out via a multimodal methodology. Objects within the captured video scene are identified using a neural network trained to identify different types of objects. The identified objects can then be compared against a database of pre-stored images of the desired product to determine if a close match is found. Additionally, text on the identified objects is analyzed and compared to the text of the desired object. Based on either or both identification methods, the desired object is indicated to the user on their display, via an augmented reality graphic.