Abstract: The invention provides a viewing system including an augmented reality system that generates a visual presentation to a user based at least in part on an IPD of the user, and an IPD compensator that adjusts the visual presentation based on an IPD compensation factor.

Abstract: A display device includes a controller and a display panel. The controller receives original image data and output a display image signal. The display panel receives the display image signal and displays a display image corresponding to the display image signal. The controller includes an image shift controller and a memory. The image shift controller generates shifted image data by modulating the original image data to shift the display image sequentially along a preset shift path on the display panel. The memory stores a shift path value indicating a distance by which the display image has been shifted on the preset shift path. The image shift controller generates the display image signal by processing the shifted image data. When the display device is powered on, the image shift controller generates shifted image data corresponding to a shift path value stored in the memory.

Abstract: The disclosure relates to a method for processing an image. The method includes: obtaining a colorized image of a light-receiving object in a current scene; obtaining a target position of the light-receiving object in a camera coordinate system based on a current position of the light-receiving object in an image coordinate system of the current scene; obtaining a lighting-color map of the imaging device; and obtaining a lighting image of the light-receiving object by processing the colorized image based on the target position and the lighting-color map of the imaging device.

Abstract: Disclosed is surface guided cropping in volume rendering of 3D volumetric data from intervening anatomical structures in the patient's body. A digital 3D representation expressing the topography of a first anatomical structure is used to define a clipping surface or a bounding volume which then is used in the volume rendering to exclude data from an intervening structure when generating a 2D projection of the first anatomical structure.

Abstract: A computer system maintains structure data indicating geometrical constraints for each structure category of a plurality of structure categories. The computer system generates a virtual 3D representation of a structure based on a set of images depicting the structure. For each image in the set of images, one or more landmarks are identified. Based on the landmarks, a candidate structure category is selected. The virtual 3D representation is generated based on the geometrical constraints of the candidate structure category and the landmarks identified in the set of images.

Abstract: A network for category-level 6D pose and size estimation, including a 3D-OCR module for 3D Orientation-Consistent Representation, a GeoReS module for Geometry-constrained Reflection Symmetry, and a MPDE module for Mirror-Paired Dimensional Estimation; wherein the 3D-OCR module and the GeoReS module are incorporated in parallel; the 3D-OCR module receives a canonical template shape including canonical category-specific keypoints; the GeoReS module receives an original input depth observation including pre-processed predicted category labels and potential masks of the target instances; the MPDE module receives the output from the GeoReS module as well as the original input depth observation; and the network outputs the estimation results based on the output of the MPDE module, the output of the 3D-OCR module, as well as the canonical template shape. Also provided are corresponding systems and methods.

Abstract: Various embodiments are generally directed to techniques of overlaying a virtual object on a physical object in augmented reality (AR). A computing device may receive one or more images of the physical object, perform analysis on the images (such as image segmentation) to generate a digital outline, and determine a position and a scale of the physical object based at least in part on the digital outline. The computing device may configure (e.g., rotate, scale) a 3D model of the physical object to match the determined position and scale of the physical object. The computing device may place or overlay a 3D virtual object on the physical object in AR based on a predefined location relation between the 3D virtual object and the 3D model of the physical object, and further, generate a composite view of the placement or overlay.

Abstract: A computer vision method for generating a three dimensional reconstruction of an object, the method comprising: receiving a set of photometric stereo images of the object, the set of photometric stereo images comprising a plurality of images using illumination from different directions using one or more light sources; using a trained neural network to generate a normal map of the object; and producing a 3D reconstruction of said object from said normal map, wherein using said trained neural network comprises converting said set of photometric stereo images to an input form suitable for an input layer of said neural network, wherein said input form comprises, for each pixel, a representation of the different lighting directions and their corresponding intensities which have been obtained from photometric stereo images to which a compensation has been applied, the compensation being determined from an estimate of the distance between the lighting source and a point on the object to which the pixel correspond

Abstract: A system and method for determining a viewpoint of a traffic camera includes obtaining images of a real road captured by the traffic camera, segmenting a road surface from the captured images to generate a mask of the real road, generating a 3D model of a simulated road corresponding to the real road, from geographical data of the real road, adding a simulated camera corresponding to the traffic camera to a location in the 3D model that is corresponding to a location of the traffic camera in the real road, generating a plurality of simulated images of the simulated road using the 3D model, each corresponding to a set of viewpoint parameters of the simulated traffic camera, selecting the simulated image that provides the best fit between the simulated image and the mask, and generating mapping between pixel locations in the captured images and locations on the real road.

Abstract: Systems, methods, and computer-readable media for using full waveform inversion for imaging surveyed mediums are provided. The full waveform inversion uses a Sifrian functional to fully leverage Hessian information and update a model by augmenting and assembling data derived from the Sifrian functional when equilibrated. The Sifrian inversion produces high resolution images of the surveyed medium typically only seen with full Hessian inversions and can produce such images without requiring supercomputer computation power or extremely long computation time.

Abstract: Some embodiments provide a non-transitory machine-readable medium that stores a program. The program receives, from a client device, a percentage value for a set of points. The program further determines a triangulation based on the set of points. The program also determines an alpha value based on the triangulation and the percentage value. The program further determines an alpha shape based on the alpha value. The program also provides the client device the alpha shape.

Abstract: A system for generating a path for navigating an environment, the system comprising a bounding volume hierarchy, BVH, generation unit operable to generate a BVH comprising a plurality of bounding volumes representing one or more objects in the environment, a BVH analysis unit operable to identify information about the geometry of the environment from the BVH, and a path planning unit operable to generate a path through the environment in dependence upon the identified geometry.

Abstract: A system for modeling a three-dimensional structure utilizing two-dimensional segments comprising a memory and a processor in communication with the memory. The processor extracts a plurality of two-dimensional segments corresponding to the three-dimensional structure from a plurality of images indicative of different views of the three-dimensional structure. The processor determines a plurality of three-dimensional candidate segments based on the extracted plurality of two-dimensional segments and adds the plurality of three-dimensional candidate segments to a three-dimensional segment cloud. The processor transforms the three-dimensional segment cloud into a wireframe indicative of the three-dimensional structure by performing a wireframe extraction process on the three-dimensional segment cloud.

Abstract: Implementations generally relate to providing augmented reality in a web browser. In one implementation, a method includes capturing images of a physical scene with a camera of a device. The method further includes determining motion of the camera using six degrees of freedom (6DoF) markerless tracking. The method further includes overlaying virtual three-dimensional (3D) content onto a depicted physical scene in the images, resulting in augmented reality (AR) images. The method further includes rendering the AR images in a browser of the device.

Abstract: Novel tools and techniques are provided for implementing augmented reality (AR)-based assistance within a work environment. In various embodiments, a computing system might receive, from a camera having a field of view of a work environment, first images of at least part of the work environment, the first images overlapping with a field of view of a user wearing an AR headset; might analyze the received first images to identify objects; might query a database(s) to determine a task associated with a first object(s) among the identified objects; might generate an image overlay providing at least one of graphical icon-based, text-based, image-based, and/or highlighting-based instruction(s) each indicative of instructions presented to the user to implement the task associated with the first object(s); and might display, to the user's eyes through the AR headset, the generated first image overlay that overlaps with the field of view of the user's eyes.

Abstract: Medical imaging methods for processing a three-dimensional (3D) image data set with two-dimensional X-ray images from an X-ray machine using a target function. Methods can include providing a 3D image data set of at least one examination zone in which anatomical structures are present, segmenting the image data set to provide a 3D vascular structure model and a 3D bone structure model, recording a first two-dimensional (2D) X-ray image containing at least a portion of the vascular structure and at least a portion of the bone structure, recording a second 2D X-ray image of the examination zone at a different contrast agent concentration, and subtracting the first and second 2D X-ray images to generate a subtraction image. An optimum projective geometry may then be determined using a three-part target function based on the 3D image data and the 2D X-ray images.

Abstract: Assisting robotic arm setup in a surgical robotic system using augmented reality can include capturing a live video of a user setting up a robotic arm in a surgical robotic system. A visual guide representing a target pose of the robotic arm can be rendered onto the live video, resulting in an augmented live video for guiding the arm setup. The augmented live video can be displayed to the user while the user is following the visual guide to set up the robotic arm. The captured live video can be continuously processed to determine whether the robotic arm has reached the target pose.

Abstract: Provided are systems, methods, and machine-readable storage media for presenting animations overlying multimedia files in accordance with the present disclosure. Embodiments are described for linking an animation to a multimedia file and presenting the animation overlying a concurrent playback of the multimedia file (e.g., its content). Embodiments are described for including additional elements to the presentation of the animation outside of the playback of the animation, including residual elements that relate to the content of the animation and/or allow a user to receive further information about the content of the animation. Embodiments are described for linking an animation to more than one multimedia file.

Abstract: Provided are a method and apparatus for generating a three-dimensional model. The method includes following. A first image containing a first face is acquired. First point cloud data including contour information of the first face is determined based on the first image. First albedo information of the first face and second point cloud data including detail information of the first face are determined based on the first point cloud data and the first image. A three-dimensional model of the first face is generated based on the first albedo information and the second point cloud data.

Abstract: Systems, apparatuses, and methods for implementing fine-grain power management for virtual reality (VR) systems are disclosed. A VR compositor monitors workload tasks while rendering and displaying content of a VR application. The VR compositor determines the priorities of different tasks of a given VR frame and cause power states to be assigned to processing units to match the priorities of the tasks being performed. For example, if a first task within a first frame period is assigned a high priority, a processing unit executing the task operates at a relatively high power performance state when performing the first task. If a second task within the first frame period is assigned a low priority, the processing unit operates at a relatively low power performance state when performing the second task. By implementing fine-grain power management in a VR environment, the likelihood of the processing unit suffering a thermal event or impaired performance is reduced.