Abstract: An augmented-reality system is combined with a surveying system to make measurement and/or layout at a construction site more efficient. A reflector can be mounted to a wearable device having an augmented-reality system. A total station can be used to track a reflector, and truth can be transferred to the wearable device while an obstruction is between the total station and the reflector. Further, a target can be used to orient a local map of a wearable device to an environment based on a distance between the target and the wearable device.

Abstract: An apparatus for configuring an avatar responsive to a content having at least one of a video and an audio signal includes an authoring unit configured to detect one or more events in a content comprising at least one of a video and an audio signal, categorise one or more of the detected events, and generate an event track for the content, the event track comprising one or more of the categorised events associated with a respective time; a selecting unit configured to select a configuration of an avatar to correspond to a respective categorised event of the event track; and an output generator configured to generate control data to configure an avatar in response to a selected configuration.

Abstract: A method, device, and computer-readable storage medium with instructions for controlling a display of an augmented-reality head-up display device for a transportation vehicle. A position of the transportation vehicle is determined relative to a map; at least one reference point is extracted from the map, the at least one reference point is obtained from an area within a visual range of a driver of the transportation vehicle; transforming the at least one reference point into transportation vehicle coordinates; generating a virtual object for display by the augmented-reality head-up display device, considering the at least one transformed reference point; and outputting the virtual object for display by the augmented-reality head-up display device.

Abstract: A system and method for generating a full three-dimensional (3D) digital geometry for an ear provides a 3D reconstruction model that not only includes the outer area of an ear, but also the inner canal area up to the second bend. The system includes at least one remote server and a PC device. The remote server manages and processes data needed for the 3D model for an ear. The PC device allows a user to access the system and method. The remote server processes a series of video frames to generate outer ear 3D data points. Full ear geometry 3D data points are generated by comparing the outer ear 3D data points with a plurality of ear impressions. Canal 3D data points are then adjusted with a tragus angle for accuracy. The 3D reconstruction model that includes the outer ear area and inner canal area is finally generated.

Abstract: There is provided an information processing system capable of appropriately assisting in creation of a marker, an information processing method, and a program. The information processing system includes an acquisition part configured to acquire a recognition result of a marker that a user is making, and a display control part configured to cause a display face to display assistance information for assisting in creation of the marker depending on the recognition result in association with the marker in process of creation.

Abstract: A portable electronic device is used with a mixed reality (MR) headset. The MR headset includes a lens and a holder that retains the portable electronic device in a defined orientation relative to the lens. The portable electronic device includes a camera, a display device, and a processor. The camera outputs video frames and is arranged to view the lens. The display device is arranged to display information that is projected on the lens for reflection directly or indirectly toward the user's eyes and the camera. The processor performs operations that include processing the video frames from the camera to identify locations of at least one real-world feature, displaying information on the display device, and controlling at least one of the processing of the video frames and the displaying of the information on the display device to at least partially reduce occurrence in the video frames of the displayed information.

Abstract: A portable electronic device is used with a mixed reality headset. The MR headset includes a lens and a holder that retains the portable electronic device in a defined orientation relative to the lens. The portable electronic device includes a camera, a display device, and a processor. The camera outputs video frames and is arranged to view the lens. The display device is arranged to display information that is projected on the lens for reflection directly or indirectly toward the user's eyes and the camera. The processor performs operations that include processing the video frames from the camera to identify locations of at least one real-world feature, displaying information on the display device, and controlling at least one of the processing of the video frames and the displaying of the information on the display device to at least partially reduce occurrence in the video frames of the displayed information.

Abstract: In some implementations, a method includes obtaining an objective for a computer-generated reality (CGR) representation of an objective-effectuator. In some implementations, the objective is associated with a plurality of time frames. In some implementations, the method includes determining a plurality of candidate plans that satisfy the objective. In some implementations, the method includes selecting a first candidate plan of the plurality of candidate plans based on a selection criterion. In some implementations, the method includes effectuating the first candidate plan in order to satisfy the objective. In some implementations, the first candidate plan triggers the CGR representation of the objective-effectuator to perform a series of actions over the plurality of time frames associated with the objective.

Abstract: A system and corresponding method is disclosed for monitoring and conducting large-scale performance verification of a city's lighting infrastructure. In particular, the current invention combines measurements of lighting performance measurements along city roadways with regulatory requirements for the roadways. In various embodiments, the current invention then presents a three-dimensional visualization of the 5 adequacy of existing roadway lighting with respect to these regulatory requirements.

Abstract: The present disclosure provides a system and method for medical image visualization. The method may include obtaining original image data of a subject, the original image data including a first region of interest (ROI) and a second ROI. The method may also include generating first image data associated with the first ROI according to a first instruction, and causing the first ROI to be displayed on a display device as a first image based on the first image data. The method may further include generating, according to a second instruction, second image data corresponding to a target region that includes the second ROI, updating the first image data based on the second image data, and causing the second ROI to be displayed on the display device as a second image based on the updated first image data.

Abstract: Provided are techniques for providing animation in electronic communications. An image is generated by capturing multiple photographs from a camera or video camera. The first photograph is called the “key photo”. Using a graphics program, photos subsequent to the key photo are edited to cut an element common to the subsequent photos. The cut images are pasted into the key photo as layers. The modified key photo, including the layers, is stored as a web-enabled graphics file, which is then transmitted in conjunction with electronic communication. When the electronic communication is received, the key photo is displayed and each of the layers is displayed and removed in the order that each was taken with a short delay between photos. In this manner, a movie is generated with much smaller files than is currently possible.

Abstract: An image generation system includes a region of interest identifying unit operable to identify a region of interest within a piece of content, the piece of content comprising one or more objects, and an image generation unit operable to generate an image for display comprising one or more of the one or more objects such that objects at a different visual depth to the region of interest are present in the generated image at a lower quality.

Abstract: A surgical implant planning computer is connectable to a fluoroscopy imager, a marker tracking camera, and a robot having a robot base coupled to a robot arm that is movable by motors relative to the robot base. Operations include performing a registration setup mode that determines occurrence of a first condition indicating the marker tracking camera can observe to track reflective markers that are on a fluoroscopy registration fixture of the fluoroscopy imager, and determines occurrence of a second condition indicating the marker tracking camera can observe to track dynamic reference base markers attached to the robot arm and/or an end-effector connected to the robot arm. While both of the first and second conditions occur, operations are allowed to be performed to obtain a first intra-operative fluoroscopic image of a patient along a first plane and to obtain a second intra-operative fluoroscopic image of the patient along a second plane that is orthogonal to the first plane.

Abstract: In accordance with some aspects, systems, methods and media for detecting manipulations of point cloud data are provided. In some aspects, a method for presenting information indicative of whether a manipulation of point cloud data has occurred is provided, the method comprising: receiving point cloud data comprising a plurality of points, wherein each point of the plurality of points is associated with a position; determining, for each of the plurality of points, a value indicative of a density of points in a region surrounding the respective point; associating, for each of the plurality of points, the value indicative of density with the respective point; and causing a representation of at least a portion of the point cloud data to be presented based on the location information associated with each point of the plurality of points, and the value indicative of density associated with each of the plurality of points.

Abstract: Insertion of supplemental content into a virtual environment is automated using a machine learning model. The machine learning model is trained to calculate a confidence value that a candidate virtual object fits into a virtual environment based on an input that includes a candidate virtual object, a list of persistent virtual objects, and a list of temporary virtual objects. The machine learning model is trained using the persistent and temporary objects displayed in the current virtual environment until it predicts that a selected virtual object fits into the current virtual environment. The trained machine learning model is then used to select a virtual object comprising supplemental content to be inserted as a new virtual object in the virtual environment.

Abstract: The invention relates to a spectacle-type device (1) in which a full image can be depicted in a reliable manner by overlapping the first partial image (?3) and the second partial image (?4), wherein a correct full image can be perceived by the operator (2), and an action can be carried out with reliability when at least two items of image information coincide. The invention also relates to a method for depicting a full image and/or for carrying out an action using a spectacle-type device.

Abstract: An apparatus for building a map is disclosed. The apparatus for building a map according to the present invention includes a data collection unit configured to separately collect vector data and raster data, a vector data processing unit configured to generate ground-truth images of a previously set size by processing the vector data, a raster data processing unit configured to generate divided raster images of the set size by processing the raster data, and a polygon generation unit configured to generate predicted polygons through machine learning of the ground-truth images and the divided raster images and generate polygons which can be applied to map building based on the raster data on the basis of the predicted polygons and the ground-truth images.

Abstract: The present invention discloses a method and a system for rendering content in low light condition for field assistance. The method comprising receiving real-time input data from a user device in a low light condition, identifying at least one object from the real-time input data and corresponding operational state of the at least one object based on a correlation of the at least one object in the input data and corresponding operational state of the at least object with pre-stored objects and corresponding operational state of the pre-stored objects, predicting at least one action to be performed on the identified at least one object, extracting an Augmented Reality (AR) object associated with the identified at least one object on which the selected action is to be performed, and rendering the location, the selected at least one action to be performed, and the AR object on the user device.

Abstract: Provided are techniques for providing animation in electronic communications. An image is generated by capturing multiple photographs from a camera or video camera. The first photograph is called the “key photo.” Using a graphics program, photos subsequent to the key photo are edited to cut an element common to the subsequent photos. The cut images are pasted into the key photo as layers. The modified key photo including the layers, is stored as a web-enabled graphics file, which is then transmitted in conjunction with electronic communication. When the electronic communication is received, the key photo is displayed and each of the layers is displayed and removed in the order that each was taken with a short delay between photos. In this manner, a movie is generated with much smaller files than is currently possible.

Abstract: One embodiment provides for a general-purpose graphics processing unit comprising a processing array including multiple compute blocks, each compute block including multiple processing clusters and a thread dispatch unit to dispatch threads of a workload to the multiple compute blocks based on a parallelism metric, wherein the thread dispatch unit, based on the parallelism metric, is to perform one of a first operation and a second operation, the first operation to distribute threads across the multiple compute blocks and the second operation is to concentrate threads within one of the multiple compute blocks.