Abstract: A system, method or compute program product for generating composite images. One of the systems includes a capture device to capture an image of a physical environment; and one or more storage devices storing instructions that are operable, when executed by one or more processors of the system, to cause the one or more processors to: obtain an image of the physical environment as captured by the capture device, identify a visually-demarked region on a surface in the physical environment as depicted in the image, process the image to generate a composite image of the physical environment that includes a depiction of a virtual object, wherein a location of the depiction of the virtual object in the composite image is based on a location of the depiction of the visually-demarked region in the image, and cause the composite image to be displayed for a user.

Abstract: A method of motion compensation for geometry representation of 3D data is described herein. The method performs motion compensation by first identifying correspondent 3D surfaces in time domain, then followed by a 3D to 2D projection of motion compensated 3D surface patches, and then finally performing 2D motion compensation on the projected 3D surface patches.

Abstract: The disclosure relates to a method and also to a correspondingly configured imaging device for planning support for an interventional procedure. In the method, a model of a hollow organ is created from a 3D image dataset. A deformation of the hollow organ is then simulated based on a course of a guide facility in the hollow organ through a deformation of the model. In accordance with the deformed model, a spatially resolved compression and/or stretching of the hollow organ, which is brought about by an introduction of the guide facility, is determined and specified.

Abstract: A virtual or augmented reality display system that controls a display using control information included with the virtual or augmented reality imagery that is intended to be shown on the display. The control information can be used to specify one of multiple possible display depth planes. The control information can also specify pixel shifts within a given depth plane or between depth planes. The system can also enhance head pose measurements from a sensor by using gain factors which vary based upon the user's head pose position within a physiological range of movement.

Abstract: Disclosed is a method to derive the absorption coefficient, transparency, and/or the scattering coefficient from the user-specified parameters including roughness, phase function, index of refraction (IOR), and color by performing the simulation once, and storing the results of the simulation in an easy to retrieve representation, such as a lookup table, or an analytic function. To create the analytic function, one or more analytic functions can be fitted to the results of the simulation for the multiple parameters including roughness, phase function, IOR, and color. The lookup table can be combined with the analytic representation. For example, the lookup table can be used to represent the color, roughness, and phase function, while the IOR can be represented by an analytic function. For example, when the IOR is above 2, the lookup table becomes three-dimensional and the IOR is calculated using the analytic function.

Abstract: An objective of the present invention is to substantially enable fitting without using a reference object model being three-dimensional point cloud data directly for fitting and enable comparison between an actual object model and the reference object model.

Abstract: A head-mounted device (HMD) is structured to include at least one computer vision camera that omits an IR light filter. Consequently, this computer vision's sensor is able to detect IR light, including IR laser light, in the environment. The HMD is configured to generate an image of the environment using the computer vision camera. This image is then fed as input into a machine learning (ML) algorithm that identifies IR laser light, which is detected by the sensor and which is recorded in the image. The HMD then visually displays a notification comprising information corresponding to the detected IR laser light.

Abstract: Provided are a virtual stent placement apparatus, a virtual stent placement method, and a virtual stent placement program that simplify an operation of virtually placing a stent in a blood vessel extracted from a medical image. An extraction unit (22) extracts a blood vessel region (30) from a three-dimensional image (V0). A display control unit (26) displays a three-dimensional image (V1) including the blood vessel region (30). The information acquisition unit (23) acquires information of the diameter of a virtual stent placed in the blood vessel region (30), a maximum contour length of the virtual stent, and a start position (S1) in a case in which the virtual stent is placed. A placement unit (24) places the virtual stent having a maximum contour length (L0) from the start position (S1) along a maximum contour line of the blood vessel region (30) in the blood vessel region (30).

Abstract: There are disclosed various apparatuses, methods, and computer program products for coding volumetric video, where information of a three-dimensional scene is obtained and at least one projection plane for the scene is determined (602). At least a first projection direction is determined for a first part of the projection plane and a second projection direction is determined for a second part of the projection plane so that the first projection direction is different from the second projection direction (604). A first part of the scene is projected on the projection plane from the first projection direction (610); and a second part of the scene is projected on the projection plane from the second projection direction (610). The projection plane is encoded (612).

Abstract: An integrated circuit including a multiplier-accumulator execution pipeline including a plurality of multiplier-accumulator circuits to process the data, using filter weights, via a plurality of multiply and accumulate operations. The integrated circuit includes first conversion circuitry, coupled the pipeline, having inputs to receive a plurality of sets of data, wherein each set of data includes a plurality of data, Winograd conversion circuitry to convert each set of data to a corresponding Winograd set of data, floating point format conversion circuitry, coupled to the Winograd conversion circuitry, to convert the data of each Winograd set of data to a floating point data format. In operation, the multiplier-accumulator circuits are configured to: perform the plurality of multiply and accumulate operations using the data of the plurality of Winograd sets of data from the first conversion circuitry and the filter weights, and generate output data based on the multiply and accumulate operations.

Abstract: Disclosed is a system for dynamically classifying different data point sets within a point cloud with different classifications that may alter how data point sets with different classifications are processed, edited, and/or rendered. The system may generate a model based on a first set of relationships between a first set of data point elements that result in the first classification, and a second set of relationships between a second set of data point elements that result in the second classification. The system may compare the data point elements from unclassified data point sets against the first set of relationships and the second set of relationships in the model, and may assign the first classification to a particular unclassified data point set in response to the data point elements of the particular data point set having a threshold amount of the first set of relationships.

Abstract: Preoperative planning techniques are described such as for hip surgery. Rather than pre-operatively planning by reorienting a model of the boundaries of the acetabulum derived from a 3D medical image, the proposed solution reorients portions of the 3D medical image itself and simulates one or more x-ray images using the reoriented 3D data. Optionally, simulated x-ray(s) of the un-modified CT scan may also be generated for comparison purposes. The user then measures acetabular metrics on the simulated x-ray(s) in order to determine the radiographic outcomes that a given magnitude and direction of reorientation would achieve. By iteratively selecting a reorientation and measuring the simulated x-ray(s), an optimal reorientation plan is determined by the user.

Abstract: A mapping method for identifying density which includes determining at least one geographical boundary about a geographical location of interest, the at least one geographical boundary is free of any self-intersections, dividing the at least one geographical boundary into a plurality of regions of interests, each region of interest is defined by a start point and an end point on the at least one geographical boundary, wherein the end point associated with one region of interest coincides with a start point of a neighboring region of interest wherein the region of interest falls within the at least one geographical boundary, for each of the plurality of regions of interest, calculating at least one parameter of interest within the region of interest, and graphically presenting a segment between the start point and the end point on the at least one geographical boundary with a line thickness proportional to the calculation results.

Abstract: A method comprising: switching between a first mode for controlling a relative position of a virtual sound object from a notional listener in a virtual space in dependence upon a point of view of the notional listener and a second mode for controlling the relative position of the virtual sound object from the notional listener in the virtual space in dependence upon the point of view of the notional listener, wherein during the first mode there is a higher dependency of the relative position of the virtual sound object from the notional listener upon a currently determined relative position of the virtual sound object from the notional listener in the virtual space based on the current measured location of a user in a real space and during the second mode there is a lower dependency of the relative position of the virtual sound object from the notional listener upon a currently determined relative position of the virtual sound object from the notional listener in the virtual space based on the current measure

Abstract: Systems and methods for simulating animation of an object are provided. Such systems and methods include capturing a first sequence of images of the object with a camera while in an activated lighting apparatus, importing the first sequence of images into a first stage video file having a preconfigured size and masked off such that the first surface appears over a first background, and incorporating the first stage video file into a template of a three-dimensional (3D) model by aligning the first surface with a video mask of the template such that the video mask obscures the first background of the first stage video file and superimposes a location of the first surface in the first stage video file onto a virtual surface of the 3D model.

Abstract: The disclosure notably relates to a computer-implemented method for learning a neural network configured for inference, from a discrete geometrical representation of a 3D shape, of an editable feature tree representing the 3D shape. The editable feature tree includes a tree arrangement of geometrical operations applied to leaf geometrical shapes. The method includes obtaining a dataset including discrete geometrical representations each of a respective 3D shape, and obtaining a candidate set of leaf geometrical shapes. The method also includes learning the neural network based on the dataset and on the candidate set. The candidate set includes at least one continuous subset of leaf geometrical shapes. The method forms an improved solution for digitization.

Abstract: Embodiments of the invention provide systems and methods of generating a complete and accurate geometrically optimized environment. Stereo pair images depicting an environment are selected from a plurality of images to generate a Digital Surface Model (DSM). Characteristics of objects in the environment are determined and identified. The geometry of the objects may be determined and fit with polygons and textured facades. By determining the objects, the geometry, and the material from original satellite imagery and from a DSM created from the matching stereo pair point clouds, a complete and accurate geometrically optimized environment is created.

Abstract: Certain embodiments involve techniques for generating a 3D representation based on a provided 2D image of an object. An image generation system receives the 2D image representation and generates a multi-dimensional vector of the input that represents the image. The image generation system samples a set of points and provides the set of points and the multi-dimensional vector to a neural network that was trained to predict a 3D surface representing the image such that the 3D surface is consistent with a 3D surface of the object calculated using an implicit function for representing the image. The neural network predicts, based on the multi-dimensional vector and the set of points, the 3D surface representing the object.

Abstract: An example method includes capturing a plurality of images of a rotating object using an imaging device optically coupled to a microscope. The method removing a first portion of a model of the rotating object based on a first contour of the rotating object in a first image of the plurality of images. The method includes orienting the model based on an amount of rotation of the rotating object between capture of the first image and capture of a second image of the plurality of images. The method also includes removing a second portion of the model of the rotating object based on a second contour of the rotating object in the second image.

Abstract: A portable electronic device is disclosed comprising: data processing means; data repository containing data representative of a digital map; and display means. The device further comprises means for, in relation to data representative of a plurality locations relevant to the digital map, providing, on a representation of the digital map displayed on the display, for each of the locations, one of a plurality of different graphical user interface (GUI) elements characterised by different prominence levels to indicate the locations, wherein the prominence level of the GUI element used for each location is dependent on the level of detail at which the digital map is displayed and a deemed relevance of that location to a user query.