Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that generate sample circle representations for digital shapes. For example, the disclosed systems can generate a sample circle representation for a digital shape by selecting a subset of sample circles generated using a medial axis corresponding to the digital shape. In some embodiments, the disclosed systems generate the sample circle representation for the digital shape by generating one or more enclosing circles based on one or more sampled boundary points of the digital shape. In some embodiments, the disclosed systems generate the sample circle representation for the digital shape by further connecting the sample circles generated for the digital shape.

Abstract: Method, system, and program products are disclosed herein for creating a 3D model based on a plurality of received 2D medical images. Once the 2D images are received, a determination is made regarding any potential processing steps required to put the images into a standard view. Once the images are processed, a plurality of points are identified that are associated with a portion of an anatomical landmark. Various historical 2D images are then identified based on a comparison between the plurality of points. Using the historical information, a 3D image is generated of an anatomical feature of a patient.

Abstract: An imaging system, including a head-mounted display worn by a system operator. A marker defines a plane when attached to a human subject. Optically reflective elements are disposed on the marker and on opposing sides of the plane in a non-symmetrical arrangement with respect to the plane. A memory stores a graphical representation of a tool used in a procedure performed on the human subject, and an image of anatomy of the human subject. A camera attached to the display acquires an image of the marker and the tool. A processor analyzes the image to identify the plane and to identify a side of the plane wherein the camera is located, and to render to the display the image of the anatomy of the human subject with the graphical representation of the tool superimposed thereon from a point of view in the identified side of the plane.

Abstract: A system and method of image processing including a processor in communication with a display and a computer readable recording medium having instructions executed by the processor to read an image data set from the memory, segment the image data set, and skeletonize the segmented image data set. The instructions cause the processor to graph the skeletonized image data set, assign a branch identification (ID) for each branch in the graph, and associate each voxel of the segmented image data set with a branch ID. The instructions cause the processor to generate a three-dimensional (3D) mesh model from the graphed skeletonized image data set, associate each vertex of the 3D mesh model with a branch ID; and display in a user interface the 3D mesh model, and an image of the image data set.

Abstract: Methods and systems for displaying information in augmented reality are described. In one embodiment, a system comprises a camera, a memory, a display, and a processor configured to (a) detect a first prescription drug in a field of view of a camera by detecting a glyph printed on a label on a container of the first prescription drug, (b) determine a first identifier associated with the first prescription drug using optical character recognition, (c) determine whether a user has access to additional data about the first prescription drug, (d) request the additional data about the first prescription drug from a database, and (e) display the additional data in augmented reality adjacent to the first prescription drug on the display such that the additional data moves when the field of view of the camera changes such that the additional data remains displayed adjacent to the first prescription drug.

Abstract: Systems and methods are disclosed for generating a 3D computer model of an eyewear product, using a computer system, the method including obtaining an inventory comprising a plurality of product frames; scanning a user's anatomy; extracting measurements of the user's anatomy; obtaining a first model of a contour and/or surface of the user's anatomy, based on the extracted measurements of the user's anatomy; identifying, based on the contour and/or the surface of the user's anatomy, a first product frame among the plurality of product frames; determining adjustments to the first product frame based on the contour and/or the surface of the user's anatomy; generating a second model rendering comprising the adjusted first product frame matching the contours and/or the surface of the user's anatomy.

Abstract: In some embodiments, contextual image variations are generated for an input image. For example, a contextual composite image depicting a variation is generated based on a input image and a synthetic image component. The synthetic image component includes contextual features of a target object from the input image, such as shading, illumination, or depth that are depicted on the target object. The synthetic image component also includes a pattern from an additional image, such as a fabric pattern. In some cases, a mesh is determined for the target object. Illuminance values are determined for each mesh block. An adjusted mesh is determined based on the illuminance values. The synthetic image component is based on a combination of the adjusted mesh and the pattern from the additional image, such as a depiction of the fabric pattern with stretching, folding, or other contextual features from the target image.

Abstract: An image processing apparatus in which image processing is executed by each of objects of an object group in which the objects each executing the image processing are connected to one another in a directed acyclic graph form, includes: a division portion that divides image data, which is a target of the image processing, into plural first divided image data pieces when the image processing is processing having sequentiality in processing sequence; and a control portion that makes control to enable computing devices to execute first partial processings in parallel, the first partial processings being pieces of the image processing to be performed on the first divided image data pieces and being allowed to be processed in accordance with dependent relations with front and rear stages and a processing sequence dependent relation.

Abstract: Methods and systems for the delivery of interactive messaging and instructions through an augmented reality device in a batch production or a sequential operation, can involve displaying a menu through a user interface associated with an augmented reality device configured with a scope of responsibility awareness that allows the augmented reality device to display a visualization of batch production data associated with a batch production or sequential operation data associated with a sequential operation that is within an assigned scope of responsibility of a user, and graphically expanding the menu in response to an input by the user. The expanded menu can include graphically displayed buttons that allow the user to select and view the batch production data or the sequential operation data. The visualization of the batch production data or the sequential operation data can be displayed without the need for an operator station.

Abstract: The present invention relates to a method and an arrangement for providing a 3D model of an environment. The method comprises the step of forming a mesh modelling the environment in three dimensions, said mesh comprising nodes interconnected by edges and having surfaces boarded by the edges, wherein each node is associated to a 3D coordinate in a geographical coordinate system, determining for a plurality of the nodes and/or surfaces and/or edges in the mesh a mesh uncertainty and associating the determined mesh uncertainty to the corresponding node and/or surface and/or edge.

Abstract: A medical system may utilize a modular and extensible sensing device to derive a two-dimensional (2D) or three-dimensional (3D) human model for a patient in real-time based on images of the patient captured by a sensor such as a digital camera. The 2D or 3D human model may be visually presented on one or more devices of the medical system and used to facilitate a healthcare service provided to the patient. In examples, the 2D or 3D human model may be used to improve the speed, accuracy and consistency of patient positioning for a medical procedure. In examples, the 2D or 3D human model may be used to enable unified analysis of the patient's medical conditions by linking different scan images of the patient through the 2D or 3D human model. In examples, the 2D or 3D human model may be used to facilitate surgical navigation, patient monitoring, process automation, and/or the like.

Abstract: A method includes receiving a first image including color data and depth data, determining a viewpoint associated with an augmented reality (AR) and/or virtual reality (VR) display displaying a second image, receiving at least one calibration image including an object in the first image, the object being in a different pose as compared to a pose of the object in the first image, and generating the second image based on the first image, the viewpoint and the at least one calibration image.

Abstract: A method for creating a house visualization template can comprise receiving a first exterior image of a first house. The method can also include creating a set of first boundaries that define a first type of decorative feature of the first house. Additionally, the method can include receiving a first set of decorative images that depict various different instances of the first type of decorative feature. The method can also comprise generating from each of the decorative images of the first set of decorative images respective first decorative feature masks. The first decorative feature masks may be configured to selectively overlay an area encompassed by the set of first boundaries, such that the first exterior image of the first house is selectively displayable with any of the instances of the first type of decorative features within the first set of decorative images.

Abstract: [Problem] To highly accurately color a target image based on information such as morphological features and shapes in the target image. [Solution] According to the present disclosure, an image coloring apparatus is provided. The image coloring apparatus includes: an acquisition unit configured to acquire a decolored image that is decolored; and a coloring unit configured to, based on morphological information obtained from the decolored image, with reference to learning result information obtained as a result of previously learning correspondence between the morphological information and color information, color the decolored image using a color that corresponds to the morphological information. This configuration enables a target image to be highly accurately colored based on information such as morphological features and shapes in the target image.

Abstract: Systems and methods for using three-dimensional scans of a physical subject to determine positions and/or orientations of skeletal joints in the rigging for a virtual character. At least one articulation segment of a polygon mesh for the virtual character may be determined. The articulation segment may include a subset of vertices in the polygon mesh. An indicator of the position or orientation of the articulation segment of the polygon mesh may be determined. Based on the indicator of the position or orientation of the articulation segment, the position or orientation of at least one joint for deforming the polygon mesh may be determined.

Abstract: Systems and techniques are described for determining image handle locations. An image is provided to a neural network as input, and the neural network translates the input image to an output image that includes clusters of pixels against a background that have intensities greater than an intensity of the background and that indicate candidate handle locations. Intensities of clusters of pixels in an output image are compared to a threshold intensity level to determine a set of the clusters of pixels satisfying an intensity constraint. The threshold intensity level can be user-selectable, so that a user can control a density of handles. A handle location for each cluster of the set of clusters is determined from a centroid of each cluster. Handle locations include a coordinate for the handle location and an attribute classifying a degree of freedom for a handle at the handle location.

Abstract: In graphics processing data is received representing one or more vertices for a scene in a virtual space. Primitive assembly is performed on the vertices to compute projections of the vertices from virtual space onto a viewport of the scene in a screen space of a display device containing a plurality of pixels, the plurality of pixels being subdivided into a plurality of subsections. Scan conversion determines which pixels of the plurality of pixels are part of each primitive that has been converted to screen space coordinates. Coarse rasterization for each primitive determines which subsection or subsections the primitive overlaps. Metadata associated with the subsection a primitive overlaps determines a pixel resolution for the subsection. The metadata is used in processing pixels for the subsection to generate final pixel values for the viewport of the scene that is displayed on the display device in such a way that parts of the scene in two different subsections have different pixel resolution.

Abstract: A graphics processing unit (GPU) is configured to receive metadata specifying an active sample configuration for a particular region of a display device among a plurality of regions of the display device and receive pixel data for one or more pixels in the particular region. The pixel data specifies the same number of color samples for each pixel. For each pixel in the particular region, the GPU invokes a pixel shader only for color samples specified to be active samples by the configuration.

Abstract: The present invention provides a system and method of displaying a representation of a road sign. The method comprises receiving information associated with the road sign, the information associated with the road sign comprising a front face of the road sign and a location of the road sign in a road system; receiving an image from a camera, the road sign being within the field of view of the camera; determining, using the image, an amount of the road sign that is obstructed; generating, in dependence on the amount obstructed, the representation of the road sign using the information associated with the road sign; and outputting the representation of the road sign for display.

Abstract: Disclosed herein are systems, methods, and software for providing a virtual environment with enhanced visual textures and haptic detail. In some embodiments, a texture atlas and UV mapping is used to render virtual objects having multiple textures that can be manipulated in real time. In some cases, UV coordinates are used to provide enhanced haptic detail.