Abstract: Aspects of the present disclosure involve a system for presenting AR items. The system performs operations including: receiving an image that includes a depiction of a first real-world body part in a real-world environment; applying a machine learning technique to the image to generate a plurality of dense outputs each associated with a respective pixel of a plurality of pixels in the image; applying a first task-specific decoder to the plurality of dense outputs to identify a pixel corresponding to a center of the first real-world body part; applying a second task-specific decoder using the identified pixel to retrieve a 3D rotation, translation and scale of first real-world body part from the plurality of dense outputs; modifying an AR object based on the 3D rotation, translation, and scale of first real-world body part; and modifying the image to include a depiction of the modified AR object.

Abstract: A method and system for training a neural network to perform processing of digital data. The input data can be heterogeneous and the method or system obtains a multiple of loss signals. The input data can be selected so that the loss signals are balanced and can fulfill several conditions of the output data. When running a trained neural network on digital frame images, intermediate results of processing a frame can be used on later frames and in this way processing delay can be decreased.

Abstract: Disclosed is a virtual dressing room that allows a user to virtually try on clothing, clothing accessories, and/or other related items on a model of the user's own body, and a virtual stylist that automatically selects and curates items to match, accentuate, and/or otherwise complement the body type, physical features, look, and/or style of the user. The virtual stylist may receive images of the user over a data network, may determine attributes of the user by analyzing the images, may input the user attributes into a relationship model, and may receive item preferences as output from the relationship model. The virtual stylist may select a set of items from a plurality of items based on the set of items comprising tags that satisfy the item preferences, and may generate and present generate a site with the selected set of items.

Abstract: The present invention provides a method for determining a plane, a method for displaying Augmented Reality (AR) display information and corresponding devices. The method comprises the steps of: performing region segmentation and depth estimation on multimedia information; determining, according to the result of region segmentation and the result of depth estimation, 3D plane information of the multimedia information; and, displaying AR display information according to the 3D plane information corresponding to the multimedia information. With the method for determining a plane, the method for displaying AR display information and the corresponding devices provided by the present invention, virtual display information can be added into a 3D plane, the reality of the display effect of enhanced display can be improved, and the user experience can be improved.

Abstract: A method for scheduling construction of a power plant at a telecommunications site is disclosed. The method includes assessing the telecommunication site and the power plant. The method also includes obtaining data from the location utilizing one or more data capture techniques. The method also includes generating a model of the existing infrastructure and a model of the power plant and inserting the model of the power plant therein. The method further includes developing a draft schedule. The method also includes publishing the final schedule with the model of the power plant inserted into the model of the existing infrastructure.

Abstract: A method for a placement of a virtual object of an augmented or mixed reality application in a real-world 3D environment, comprises: selecting (14), at a runtime of the augmented or mixed reality application, one of a finite set of at least two candidate insertion areas predetermined in the real-world 3D environment for the placement of the virtual object in the real-world 3D environment, based on criteria combining, for each of the candidate insertion areas, relationships between each of: the real-world 3D environment, the virtual object considered with respect to a placement of that virtual object in that candidate insertion area, and a user position; and inserting (14) the virtual object in the selected candidate insertion area.

Abstract: A mobile device is fitted with a camera and an extended reality (XR) software application program executing on a processor within an XR system. Via the XR software application program, techniques are performed for manipulating virtual objects in an XR environment. In one technique, the XR software application program facilitates the movement of a virtual object from a first location to a second location, within a plane parallel to a touchscreen of a mobile device, responsive to a displacement determined based on user input detected via the touchscreen.

Abstract: A method for preparing and vetting a power plant for implementation at a telecommunications site is disclosed. The method includes assessing the power plant and a location for the power plant at the telecommunications site. The method also includes obtaining data from the location utilizing one or more data capture techniques, the one or more data capture techniques including capturing one or more of photos and videos of existing infrastructure at the telecommunications site. The method further includes generating one of a 360 degree view and a model of the existing infrastructure. The method also includes identifying installation obstacles and flaws utilizing the model including the conditions of the existing infrastructure selected to receive and interface with the power plant. The method further includes re-designing the power plant installation based on the obstacles and flaws identified. The method also includes developing a project plan for the power plant installation.

Abstract: Devices and techniques are generally described for three dimensional room modeling. In various examples, 3D mesh data representing a room may be received. Plane data comprising a plurality of planes may be received. Each plane of the plurality of planes may represent a planar surface detected in the room. In some cases, a first plurality of wall candidates for a 3D model of the room may be determined based at least in part on the plane data. A second plurality of wall candidates for the 3D model of the room may be determined by modifying the first plurality of wall candidates based on a comparison of the first plurality of wall candidates to the 3D mesh data. The 3D model of the room may be generated based at least in part on the second plurality of wall candidates.

Abstract: Apparatus and method for grouping rays based on quantized ray directions. For example, one embodiment of an apparatus comprises: An apparatus comprising: a ray generator to generate a plurality of rays; ray direction evaluation circuitry/logic to generate approximate ray direction data for each of the plurality of rays; ray sorting circuitry/logic to sort the rays into a plurality of ray queues based, at least in part, on the approximate ray direction data.

Abstract: Individual nodes of a plurality of nodes can be fixed to the architectural structure and associated with a different segment of a plurality of segments of a first model of an architectural structure. Positional data associated with the nodes can be received. A structural change to the architectural structure can be estimated based on a comparison of positional data associated with the nodes. A second model representing the architectural structure as modified by the structural change can be generated. The second model can be generated based on (i) the first model and (ii) the estimated change to the architectural structure.

Abstract: A system and method of creating customized characters and selectively displaying them in an electronic display, such as an augmented reality or virtual reality display is provided. A digital character may be provided by a character provider for customization by others using the system. Such customizations may be instantiated in user devices that provide electronic displays. Instantiation of the custom digital character may be conditioned on one or more trigger conditions, which may be specified by the character customizer. For example, a digital character customized using the system may be conditioned on triggering events in the real-world or in a virtual world. When a relevant triggering condition is satisfied at a user device, the custom character (i.e., information for instantiating the custom character) may be transmitted to that user device. In this manner, the system may push custom characters to user devices that satisfy the triggering condition.

Abstract: A system comprises a processor and a memory having computer readable instructions stored thereon. The computer readable instructions, when executed by the processor, cause the system to display a surgical environment image. The surgical environment image includes a virtual control element for controlling a component of a surgical system. The virtual control element includes a real-time image of the component of the surgical system in the surgical environment image. The computer readable instructions also cause the system to display an image of a body part of a user used to interact with the virtual control element, receive a gesture of the body part of the user in a predetermined motion via a gesture based input device, and adjust a setting of the component of the surgical system based on the received gesture.

Abstract: The disclosure introduces polar stroking for representing paths. A system, method, and apparatus are disclosed for representing and rendering stroked paths employing polar stroking. In one example, a method of approximating a path is provided that includes: (1) evaluating, in parallel, multiple links of a path, wherein each link of the multiple links is evaluated in steps based on tangent angle changes of the link, and (2) providing a polar stroked representation of the path employing the steps. A computing system for rendering is also provided. In one example, the computing system includes one or more processing units to perform one or more operations including generating, in parallel, a polar stroked representation of individual links of a path, and rendering a stroked tessellation of the path based on the polar stroked representations of the individual links.

Abstract: A system that includes a depth perception camera to estimate or otherwise measure the dimensions of a proposed carry-on item to determine whether the proposed carry-on item complies with limitations associated with a user. The system is configured to enable checking the proposed carry-on item and receiving payment for the checked item when the item exceeds the limitations associated with the user. Displayed to the user are dimension lines associated with the maximum dimensions of the limitations and/or the captured dimensions of the proposed carry-on item.

Abstract: An information processing apparatus includes an acquiring unit and a command unit. The acquiring unit acquires positional information of a container containing a contained object from an image acquired as a result of photographing the container by using a display device that displays a virtual-space image and a real space in an overlapping manner and that has a photographing function. The command unit commands the display device to display information related to the contained object stored in association with the positional information as the virtual-space image near the container.

Abstract: Appropriate housing equipment according to the physical ability of a trainee who has performed rehabilitation in order to restore or maintain the physical ability is easily presented. A housing equipment presentation apparatus includes a storage unit configured to store definition information defining housing equipment information according to a physical ability, an acquisition unit configured to externally acquire physical ability information of a trainee who has performed training in order to restore or maintain his/her physical ability, a conversion unit configured to convert the acquired physical ability information into the housing equipment information based on the definition information, and an output unit configured to output presentation information including the converted housing equipment information.

Abstract: Examples are disclosed that relate to hand gesture-based emojis. One example provides, on a display device, a method comprising receiving hand tracking data representing a pose of a hand in a coordinate system, based on the hand tracking data, recognizing a hand gesture, and identifying an emoji corresponding to the hand gesture. The method further comprises presenting the emoji on the display device, and sending an instruction to one or more other display devices to present the emoji.

Abstract: The present disclosure provides an apparatus and method for training a machine learning engine configured to determine whether an object in a two dimensional (2D) image is in-scope or out-of-scope relative to the one or more 3D objects that includes receiving a 3D model of each of the one or more 3D objects, for each 3D model receiving a set of specifications and thresholds for the 3D model, augmenting the specifications of the 3D model to generate a plurality of augmented 3D models, and generating auxiliary training data based on the plurality of augmented 3D models, and utilizing the auxiliary training data to train the machine learning engine.

Abstract: An offsite device for remote augmented reality communication for guided surgery configured to receive, by an offsite device, a plurality of representations of a plurality of frames and a plurality of indices, wherein the plurality of indices includes at least a first frame index and at least a second frame index, display, by the offsite device and to an offsite surgeon, a second frame of the second frame index, input, by the offsite device, an illustration from the offsite surgeon, wherein the illustration is drawn on the second frame, register, by the offsite device, the illustration to the second frame, wherein registering produces registration data, and transmit, by the offsite device, the illustration and the registration data.