Abstract: Disclosed are embodiments of in-situ display monitoring and calibration systems and methods. An image acquisition system captures images of the viewing plane of the display. Captured images may then be processed to characterize various visual performance characteristics of the display. When not in use capturing images of the display, the image acquisition system can be stored in a manner that protects it from environmental hazards such as dust, dirt, precipitation, direct sunlight, etc. A calibration image in which a plurality of light emitting elements is set to a particular color and intensity may be displayed, an image then captured, and then a difference between what was expected and what was captured may be developed for each light emitting element. Differences between captured images and expected images may be used to create a calibration data set which then may be used to adjust the display of further images upon the display.

Abstract: Aspects of this disclosure relate to a process for rendering graphics that includes performing, with a hardware unit of a graphics processing unit (GPU) designated for vertex shading, a vertex shading operation to shade input vertices so as to output vertex shaded vertices, wherein the hardware unit adheres to an interface that receives a single vertex as an input and generates a single vertex as an output. The process also includes performing, with the hardware unit of the GPU designated for vertex shading, a hull shading operation to generate one or more control points based on one or more of the vertex shaded vertices, wherein the one or more hull shading operations operate on at least one of the one or more vertex shaded vertices to output the one or more control points.

Abstract: Methods for assessing trailer utilization are disclosed herein. An example method includes capturing an image featuring a trailer, and segmenting the image into a plurality of regions. For each region the example method may include cropping the image to exclude data that exceeds a respective forward distance threshold, and iterating over each data point to determine whether or not a matching point is included. Responsive to whether or not a matching point included for a respective data point, the method may include adding the respective data point or the matching point to a respective region based on a position of the respective data point. Further, the method may include calculating a normalized height of the respective region based on whether or not a gap is present in the respective region; and creating a 3D model visualization of the trailer that depicts trailer utilization.

Abstract: Disclosed is an editing system that accounts for or leverages the three-dimensional (“3D”) positioning of 3D image data to edit attributes of a selected first set of image data based on attributes of an unselected second set of image data that is determined to be a threshold distance from the first set of image data and on the same surface as the first set of image data. The system leverages x, y, and z coordinates as well as surface normals to exclude image data from the editing that is within the threshold distance but that forms part of a different object, surface, or side about an edge of a surface than the first set of image data. The system also modifies the attribute adjustment based on the distance separating the first set of image data from a render position or each instance of the second set of image data.

Abstract: A method of tiled rendering of an image for display is provided which comprises receiving an image comprising one or more three dimensional (3D) objects and executing a visibility pass for determining locations of primitives of the image. The method also comprises executing, concurrently with the executing of the visibility pass, front end geometry processing of one of the primitives determined, from the visibility pass, to be in a first one of a plurality of tiles of the image and executing, concurrently with the executing of the visibility pass, back end processing of the one primitive in the first tile.

Abstract: Disclosed herein are CPM support systems, as well as related apparatuses, methods, computing devices, and computer-readable media. For example, in some embodiments, a charged particle microscope computational support apparatus may include: first logic to, for each angle of a plurality of angles, receive an associated image of a specimen at the angle, and generate an associated scan mask based on one or more regions-of-interest in the associated image; second logic to, for each angle of the plurality of angles, generate an associated data set of the specimen by processing data from a scan, in accordance with the associated scan mask, by a charged particle microscope of the specimen at the angle; and third logic to provide, for each angle of the plurality of angles, the associated data set of the specimen to reconstruction logic to generate a three-dimensional reconstruction of the specimen.

Abstract: Systems and methods are described for mirroring 3D content from a first display (which may be a handheld 2D display) to a second display (which may be a 3D display, such as a light field display). The 3D content is initially displayed (e.g. as a 2D projection) on a the first display. The relative positions and/or orientations of the first and second displays are determined. The position of a user viewing the content may also be determined or may be inferred from the position and orientation of the first display. The second display is provided with information used to display the 3D content with a size and/or orientation that preserves the original apparent size and/or apparent orientation of that content from the perspective of the user.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for sensor calibration with environment map. In some implementations, a three-dimensional surfel representation of a real-world environment is obtained. One or more surfels of the surfel representation having a particular classification of the different classifications are selected. Input sensor data from one or more sensors installed on an autonomous or semi-autonomous vehicle are received. The input sensor data is compared to the surfel representation to identify one or more differences between the observation and the surfel representation. At least one sensor of the one or more sensors is calibrated using the one or more differences between the observation and the surfel representation.

Abstract: A medical device position guidance system is provided. The system includes at least one reference transmitter and a receiver system configured to receive signals from the at least one reference transmitter. The reference transmitter is configured to maintain a static position on a subject. The system further includes a processor configured to (i) receive signals relating to the location and orientation of each sensor of the receiver system relative to the at least one reference transmitter; and (ii) using the received signals, create an anatomical coordinate system. The system may further include an inserted transmitter configured to be attached to a medical device. The inserted transmitter is adapted to establish the location and orientation of the medical device within the anatomical coordinate system. A method for medical device position guidance is also provided.

Abstract: A method and apparatus are provided to allow the viewing of an item from several virtual positions for evaluation and potential purchase. The information, including photographs, about the item is made available using the Internet.

Abstract: The disclosed computer-implemented method may include acquiring, from a client device within a real-world environment, information representative of the real-world environment, and transmitting the information representative of the real-world environment to a relocalization service. The method may further include receiving, from the relocalization service, (1) an anchor point that may include a mapped position within the real-world environment, and (2) a determined position within the real-world environment of a client device relative to the mapped position of the anchor point. The method may further include sending an identifier of the anchor point to an asset management service, and obtaining, from the asset management service, a digital asset. The method may further include presenting the digital asset at a position within an artificial environment relative to the mapped position of the anchor point. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: Disclosed is an image processing apparatus for supplying display information indicating a three-dimensional image to a recording device including a discharge section that discharges liquid to an object having a three-dimensional shape to form a three-dimensional image on the object. The image processing apparatus includes an obtaining section that obtains virtual space information and a generating section that generates the display information based on the virtual space information. The virtual space information indicates a virtual image in which the three-dimensional image is represented in a three-dimensional virtual space, and a virtual discharge section, in which the discharge section is represented in the virtual space. The relative positional relationship in the virtual space between the virtual image and the virtual discharge section indicated by the virtual space information corresponds to the relative relationship between the three-dimensional image and the discharge section.

Abstract: Various implementations disclosed herein include devices, systems, and methods for modifying character motion for 3D animated assets (e.g., modifying character motions). In some implementations, an object to be animated is identified, where the object is a part of a three dimensional (3-D) digital model. In some implementations, a motion descriptor is identified that includes path-generating components that generate a preliminary motion path for animation of the object. The motion descriptor is modified to generate a modified motion path, where the motion descriptor is modified by deforming at least one path-generating component of the motion descriptor, and the object is animated based on the modified motion path. In some implementations, the modified motion path is transferred to another 3D animated asset (e.g., the same or a different type of 3D animated asset).

Abstract: A method for displaying annotation information, an electronic device and a storage medium, related to the field of computers and image information processing, are provided. The method includes: acquiring depth information and annotation information of a target region in a first image at a first angle of view; establishing an association relationship between the depth information and the annotation information; and in a case that a second image at a second angle of view is acquired, determining a display region of the target region in the second image based on the depth information, and displaying, in the display region in the second image, the annotation information of the target region based on the association relationship. Thereby, the cross-image display of the annotation information of the target region with the depth information can be realized.

Abstract: In one embodiment, a method for generating a three-dimensional (3D) anatomical map, including applying a trained artificial neural network to (a) a set of two-dimensional (2D) fluoroscopic images of a body part of a living subject, and (b) respective first 3D coordinates of the set of 2D fluoroscopic images, yielding second 3D coordinates of the 3D anatomical map, and rendering to a display the 3D anatomical map responsively to the second 3D coordinates.

Abstract: In some embodiments, a method comprises receiving a plurality of digital images depicting an indoor scene of a room and captured using a capture device, and trajectory data of a trajectory that the capture device followed as the capture device was capturing the images; wherein the images and the trajectory data satisfy quality checks, including a closed loop check that requires that first images, of the plurality of digital images, and last images, of the plurality of digital images, overlap; determining a point cloud by preprocessing the digital images and the trajectory data to satisfy optimization constraints, and by identifying and labelling a plurality of feature points in data obtained by preprocessing the digital images and the trajectory data; based on the point cloud and the trajectory data, generating room geometry for the room and a 3D model of the room; and displaying a graphical representation of the 3D model.

Abstract: The subject technology generates depth data using a machine learning model based at least in part on captured image data from at least one camera of a client device. The subject technology applies, to the captured image data and the generated depth data, a 3D effect based at least in part on an augmented reality content generator. The subject technology generates a depth map using at least the depth data. The subject technology generates a packed depth map based at least in part on the depth map, the generating the packed depth map. The subject technology converts a single channel floating point texture to a raw depth map. The subject technology generates multiple channels based at least in part on the raw depth map. The subject technology generates a segmentation mask based at least on the captured image data. The subject technology performs background inpainting and blurring of the captured image data using at least the segmentation mask to generate background inpainted image data.

Abstract: Disclosed are editing tools for manipulating a three-dimensional (“3D”) data file or point cloud. An editing application may generate a visualization of the 3D data file or point cloud, and a user may invoke an editing tool over a particular region of the visualization that is rendered based on the positional and non-positional values of a first data point set and a second data point set from the 3D data file or point cloud. The editing tool may differentiate the first data point set from the second data point set based on unique commonality in the positional and/or non-positional values of the first data point set, and may edit less than all of the particular region by adjusting one or more of the positional and/or non-positional values of the first data point set while retaining the positional and non-positional values of the second data point set.

Abstract: In various example embodiments, relevant changes between 3D models of a scene are detected and classified by transforming the 3D models into point clouds and applying a deep learning model to the point clouds. The model may employ a Siamese arrangement of sparse lattice networks each including a number of modified BCLs. The sparse lattice networks may each take a point cloud as input and extract features in 3D space to provide a primary output with features in 3D space and an intermediate output with features in lattice space. The intermediate output from both sparse lattice networks may be compared using a lattice convolution layer. The results may be projected into the 3D space of the point clouds using a slice process and concatenated to the primary io outputs of the sparse lattice networks. Each concatenated output may be subject to a convolutional network to detect and classify relevant changes.

Abstract: An image processing apparatus includes a display section that displays a background image and a processing target image on a display screen, a receiving section that receives an input position on the display screen input by user, and a processing section that processes editing to the processing target image based on a relationship between the input position and a position of the processing target image.