Abstract: A medical system comprising a display is presented. In response to the reception of triggering information, a subset of data is selected from a displayed or non-displayed dataset according to a data priority scheme and the displayed dataset is replaced by the display of the selected subset of data. The display of the selected subset of data uses a variety of rendering options. The triggering information is provided by the user or provided by one or more sensors. The data priority scheme is predefined or computed. It is static or dynamic. The data priority scheme can comprise a threshold which is applied for the selection or determination of the subset of data. Examples of priorities associated with data for diabetes care are provided. A range of displays can be used and combined.

Abstract: A method for using data driven shrinkage compensation to fabricate an object using an additive manufacturing process includes predicting one or more dimensional changes in one or more directional strands disposed between facets of one or more respective predetermined facet pairs as a result of the fabrication of an object using an additive manufacturing process based on a shape shrinkage model. The object is modeled from a file and includes one or more dimensions calculated from the one or more directional strands. The method further includes correcting coordinate data of at least one facet of the one or more predetermined facet pairs to compensate for the one or more predicted dimensional changes in the one or more directional strands.

Abstract: An x-ray imaging system and method for reconstructing three-dimensional images of a region of interest from spatially and temporally overlapping x-rays using novel reconstruction techniques are provided. The x-ray imaging system may include a detector to generate a signal in response to x-rays incident upon the detector, wherein the signal indicates the intensity of the x-rays incident upon a pixel of the detector, a plurality of x-ray sources arranged to emit x-rays such that said x-rays pass through a region of interest (ROI) and spatially and temporally overlap at the pixel of the detector, and a processing unit to receive the signal indicating the intensity of x-rays incident upon the pixel of the detector and generate an estimate of the intensity attributable to each of the two or more x-rays overlapping at the pixel of the detector.

Abstract: A method of transmitting omnidirectional video is provided according to one aspect of the present invention. The method of transmitting omnidirectional video according to an embodiment of the present invention includes: acquiring an image for the omnidirectional video; projecting the image for the omnidirectional video onto a 3D projection structure; packing the image projected on the 3D projection structure into a 2D frame; encoding the image packed into the 2D frame; and transmitting a data signal including the encoded image and metadata about the omnidirectional video.

Abstract: A method for operating a robotic system includes determining a discretized object model representative of a target object; determining a discretized platform model representative of a task location; determining height measures based on real-time sensor data representative of the task location; and dynamically deriving a placement location based on (1) overlapping the discretized object model and the discretized platform model for stacking objects at the task location and (2) calculating a placement score associated with the overlapping based on the height measures.

Abstract: An editing device for three-dimensional shape data includes: an editor that edits a three-dimensional shape in a second coordinate system different from a first coordinate system, the three-dimensional shape being configurated by multiple voxels and represented by three-dimensional shape data in the first coordinate system; and a converter that converts the three-dimensional shape in the second coordinate system, which is edited by the editor using arrangement information that indicates a positional relationship between the multiple voxels, into a three-dimensional shape in the first coordinate system.

Abstract: For interactive rendering in medical imaging, physically-based volume rendering of a volume of a patient may better assist physicians in diagnosis, prognosis, and/or planning. To provide for more rapid interaction, direct volume rendering is used during interaction. The rendering then transitions to physically-based rendering when there is no interaction. For smoothing the transition and/or preserving cohesive perceptual details, images from the different types of rendering may be blended in the transition and/or during interaction.

Abstract: The present invention relates to a method and system for constructing isosurfaces from 3D data sets, such as 3D image data that are based on a cubic grid (voxel image data). Specifically, 3D image is rendered from a voxel image that can be generated by a variety of medical modalities. The present invention is a modification of the MCA that allows for constructing an isosurface without holes resulting from some cubes having ambiguous isosurface topology. Specifically, to avoid holes resulting from ambiguities, multiple isosurfaces having different resolution levels are generated for ambiguous cubes to resolve the ambiguity.

Abstract: Multi-scale deep reinforcement learning generates a multi-scale deep reinforcement model for multi-dimensional (e.g., 3D) segmentation of an object. In this context, segmentation is formulated as learning an image-driven policy for shape evolution that converges to the object boundary. The segmentation is treated as a reinforcement learning problem, and scale-space theory is used to enable robust and efficient multi-scale shape estimation. By learning an iterative strategy to find the segmentation, the learning challenges of end-to-end regression systems may be addressed.

Abstract: An automated truck unloader for unloading/unpacking product, such as boxes or cases, from trailers and containers is disclosed. In one embodiment, a mobile base structure provides a support framework for a drive subassembly, conveyance subassembly, an industrial robot, a distance measurement subassembly, and a control subassembly. Under the operation of the control subassembly, an industrial robot having a suction cup-based gripper arm selectively removes boxes from the trailer and places the boxes on a powered transportation path. The control subassembly coordinates the selective articulated movement of the industrial robot and the activation of the drive subassembly based upon a perception-based robotic manipulation system.

Abstract: A method to culling parts of a 3D reconstruction volume is provided. The method makes available to a wide variety of mobile XR applications fresh, accurate and comprehensive 3D reconstruction data with low usage of computational resources and storage spaces. The method includes culling parts of the 3D reconstruction volume against a depth image. The depth image has a plurality of pixels, each of which represents a distance to a surface in a scene. In some embodiments, the method includes culling parts of the 3D reconstruction volume against a frustum. The frustum is derived from a field of view of an image sensor, from which image data to create the 3D reconstruction is obtained.

Abstract: In a graphics processing system, a first bounding volume (20) representative of the volume of all or part of a scene to be rendered is defined. Then, when rendering a scene for output, an intersection position (27) for a vector (24) with the first bounding volume (20) is determined by determining the position (51) intersected by the vector (24) on a second bounding volume (50) associated with the first bounding volume (20), using the determined position (51) to determine information indicative of an intersection position (27) for the first bounding volume (20) and the vector (24), and using the determined information to determine an intersection position (27) for the vector (24) with the first bounding volume (20).

Abstract: Systems and methods improve virtual reality and augmented reality functionality for mobile devices using radio frequency (RF) signals transmitted by a tracked device and received at four or more spatially separated antennae. These antennae are connected, wirelessly or through wired connections, to a base station. Through RF signal time of arrival information acquired at the antennae, the base station can continuously determine accurate position information of the tracked device, without lighting or line of sight limitations experienced by camera and other optical systems. As the position of the RF-transmitting tracked device is registered within a virtual environment produced by an interactive software program in communication with (or part of) the base station, the virtual viewpoint of the tracked device is controlled to reflect the relative position and orientation of the tracked device with respect to the virtual environment produced by the software program and displayed on a view screen.

Abstract: [Object] To make it possible to achieve a favorable disparity by setting an operation depth of medical operation as a target while reducing an influence of correction of a disparity for stereoscopic vision over accuracy of an image. [Solution] There is provided a medical image processing device including: a depth determination unit configured to determine an operation depth of medical operation whose image is to be captured; a disparity determination unit configured to determine a disparity by using a captured image showing a visual field observed in the operation and generate disparity information; and a correction unit configured to correct the disparity information depending on the operation depth determined by the depth determination unit.

Abstract: In one embodiment, a method includes sending information configured to render a virtual space on a display device associated with a first user, the virtual space comprising a virtual room; receiving an input from a first user selecting a particular virtual object; calculating a score for a set of interactive-surface types, the score being based on a current context, wherein the current context is based on information associated with the virtual object; selecting, from the set of interactive-surface types, one of the interactive-surface types based on the selected interactive-surface type having a score greater than a threshold score; and sending information configured to render an interactive surface that is of the selected interactive-surface type.

Abstract: For rendering in medical imaging, a transfer function is determined. A simple approach to setting the transfer function uses a combination of a rendered image and the voxel data, providing a hybrid of both image and data-driven approaches. A region of interest on a rendered image is used to select some of the voxel data. A characteristic of the selected voxel data is used to determine the transfer function for rendering another image. Both the visual aspect of the rendered image and the voxel data from the scan are used to set the transfer function.

Abstract: A computer implemented method for determining a centerline of a three-dimensional tubular structure is described. The method includes providing an edge-detected data set of voxels that characterize a boundary of the tubular structure according to a three-dimensional voxel data set for the tubular structure. A gradient field of a distance transformation is computed for the edge-detected dataset. A voxel data set corresponding to a centerline of the tubular structure is computed according to derivative of gradient field. A trajectory within the tubular structure is computed based on the centerline.

Abstract: Embodiments of the present disclosure provide a rendering method in an AR scene, the method includes: creating a virtual scene including a virtual object; obtaining depth information of a real shielding object and generating a grid map; creating a shielding object virtual model of the real shielding object in the virtual scene; and setting a property of the shielding object virtual model to be absorbing light, and rendering the shielding object virtual model. The present disclosure further provides a processor and AR glasses.

Abstract: The present system and method determine a position on an external surface of an object. The system comprises a magnetic field measurement module and an ultrasound measurement module. A control unit stores a magnetic field map of the object comprising a first plurality of reference areas of the external surface of the object and associated reference magnetic field value. The control unit also stores an ultrasound map of the object comprising a second plurality of reference areas of the external surface of the object and associated reference ultrasound characteristic. The processing unit determines: a subset of the reference areas for which the associated reference magnetic field value is substantially equal to a measured magnetic field value, a subset of the reference areas for which the associated reference ultrasound characteristic is substantially equal to a measured ultrasound characteristic, and determines the position on the external surface of the object.

Abstract: A display control method includes: obtaining a position of an object which is arranged in an area when receiving an input; determining, in accordance with the position of the object, a first display position of at least a first image between the first image and a second image in a display area of a display device adjacent to the area; displaying the first image and the second image on the display device; and changing, after receiving the input, the first display position of the first image in accordance with a change in a position of the object in the area without changing a second display position of the second image.

Abstract: Disclosed are systems and methods for compositing an augmented reality scene, the methods including the steps of extracting, by an extraction component into a memory of a data-processing machine, at least one object from a real-world image detected by a sensing device; geometrically reconstructing at least one virtual model from at least one object; and compositing AR content from at least one virtual model in order to augment the AR content on the real-world image, thereby creating AR scene. Preferably, the method further includes; extracting at least one annotation from the real-world image into the memory of the data-processing machine for modifying at least one virtual model according to at least one annotation. Preferably, the method further includes: interacting with AR scene by modifying AR content based on modification of at least one object and/or at least one annotation in the real-world image.

Abstract: There is provided an information processing device including an action possibility analysis unit configured to acquire data of a three-dimensional shape of an environment, and by breaking down the data of the three-dimensional shape, analyzes an action possibility of the environment for a user, and a picture generation unit configured to use an analysis result of the action possibility analysis unit to generate a picture to project onto the environment.

Abstract: Aspects of the disclosed apparatuses, methods and systems provide sharing virtual elements between users of different 3-D virtual spaces. In another generation aspect, virtual elements may be sent, shared, or exchanged between different client devices whether the communication sharing the virtual element occurs synchronously or asynchronously.

Abstract: Systems, methods, devices, and non-transitory media of the various embodiments provide for a three dimensional tool for depicting the variability of probability of collision (Pc) inputs to Pc estimates. The depictions generated by the various embodiments may be used to quantify the quality of Pc input data required to yield actionable Pc estimates. Various embodiments may provide a graphical user interface (GUI) for a computing device that may display a three dimensional depiction of the variability of Pc inputs to Pc estimates.

Abstract: A device comprising an input for obtaining consumption data relating to the consumption of a utility provided by a utility provider, an output for outputting modified consumption data and a processor arranged to generate the modified consumption data based on obtained consumption data so that the modified consumption data starts to converge with the obtained consumption data if a deviation of the obtained consumption data from the modified consumption data exceeds a predetermined threshold.

Abstract: A robot arm control device includes a pressure sensing module, a workspace defining module and a control module. The pressure sensing module, arranged on a robot arm, detects whether an object hits or touches the robot arm to switch the operating mode of the robot arm. The workspace defining module includes a sensing region arranged on a peripheral area around the robot arm. The workspace defining module determines whether the object enters an operating space according to the position of the object in the sensing region, and sets the working range and the working mode of the robot arm according to which operating space the object has entered. The control module, connected to the robot arm, the pressure sensing module and the workspace defining module, switches the operating mode and outputs a motor driving signal to the robot arm according to the working mode of the robot arm.

Abstract: A method and system provides an acquisition scheme for generating magnetic resonance elastography displacement data with whole-sample coverage, high spatial resolution, and adequate SNR in a short scan time. The method and system can acquire in-plane and through-plane k-space shots over a volume of a sample divided into a plurality of slabs that each include a plurality of non-adjacent slices to obtain three dimensional multiband, multishot data, can apply multiband radio frequency refocusing pulses to the sample, can acquire navigators before readout, and can correct for non-linear motion errors.

Abstract: A magnetic resonance tomography scanner is provided for the determination a diffusion tensor of an examination object, and a method is provided for operating the magnetic resonance tomography scanner. The magnetic resonance tomography scanner acquires a volume image of the examination object by imaging magnetic resonance tomography without diffusion encoding. The control system segments the image according to diffusion-relevant symmetry properties and also determines volume elements of a symmetry group. A first and a second component of a diffusion tensor are acquired by the magnetic resonance tomography scanner at different angles and the control unit uses the symmetry property with the acquired components and the volume image to determine a diffusion tensor for the volume elements.

Abstract: The present invention provides a system and method for generating a CT slice image. The system comprises an MIP image generation module, a region of interest determination module, an angle setting module, a curve determination module, a match module and a slice generation module.

Abstract: Pose of a probe is detected in x-ray medical imaging. Since the TEE probe is inserted through the esophagus of a patient, the pose is limited to being within the esophagus. The path of the esophagus is determined from medical imaging prior to the intervention. During the intervention, the location in 2D is found from one x-ray image at a given time. The 3D probe location is provided by assigning the depth of the esophagus at that 2D location to be the depth of the probe. A single x-ray image may be used to determine the probe location in 3D, allowing for real-time pose determination without requiring space to rotate a C-arm during the intervention.

Abstract: Embodiments that relate to interacting with a physical object in a mixed reality environment via a head-mounted display are disclosed. In one embodiment a mixed reality interaction program identifies an object based on an image from captured by the display. An interaction context for the object is determined based on an aspect of the mixed reality environment. A profile for the physical object is queried to determine interaction modes for the object. A selected interaction mode is programmatically selected based on the interaction context. A user input directed at the object is received via the display and interpreted to correspond to a virtual action based on the selected interaction mode. The virtual action is executed with respect to a virtual object associated with the physical object to modify an appearance of the virtual object. The modified virtual object is then displayed via the display.

Abstract: Various approaches described herein improve the quality of results when fusing depth maps to generate dynamic three-dimensional (“3D”) models, applying texture details to dynamic 3D models, or rendering views of textured, dynamic 3D models. For example, when fusing depth maps to generate a dynamic 3D model, a fusion component can also incorporate intrinsic color values for points of the dynamic 3D model, potentially making the dynamic 3D model more accurate, especially for areas in which depth values are not reliable or not available. As another example, when applying texture details, a rendering component can apply smoothed, viewpoint-dependent texture weights to texture values from different texture maps, which can reduce blurring and avoid the introduction of noticeable seams. As another example, a rendering component can apply special effects indicated by metadata to rendered views, thereby allowing a content provider to assert artistic control over presentation.

Abstract: An X-ray diagnostic apparatus of an embodiment includes processing circuitry. The processing circuitry acquires two medical images, a moving distance of a region of interest between the medical images corresponding to a distance derived from a parallax angle. The processing circuitry causes a display to display a stereoscopic image based on the medical images.

Abstract: Methods and systems for presenting an image of a user interacting with a video game includes providing images of a virtual reality (VR) scene of the video game for rendering on a display screen of a head mounted display (HMD). The images of the VR scene are generated as part of game play of the video game. An input provided at a user interface on the HMD received during game play is used to initiate a signal to pause the video game and to generate an activation signal to activate an image capturing device. The activation signal causes the image capturing device to capture an image of the user interacting in a physical space. The image of the user captured by the image capturing device during game play is associated with a portion of the video game that corresponds with a time when the image of the user was captured. The association causes the image of the user to be transmitted to the HMD for rendering on the display screen of the HMD.

Abstract: Systems and methods are provided for system for generating a physical model for engineering design or visualization. A system includes a processor-readable memory that further includes one or more data structures containing physical data associated with points in a three dimensional volume. A system also includes a plurality of data processors that operate in parallel to perform calculations using the physical data to generate a physical model for providing real-time visualization and calculation associated with the three dimensional volume.

Abstract: In some embodiments, a memory may store programming for selecting values describing a frame of pixels by modeling, based on camera data, object data, and material data, a geometric projection of light in a visual simulation, the modeling including identifying voxel data and building a voxel tree from the voxel data. A processor may, responsive to executing the programming, invoke one or more of a clipping module to generate a portion of the voxel data, a depth occlusion module to check for spatial visibility of one or more outputs of the clipping module and generate an output including one or more layers of a voxel tree, a re-projection module to conditionally generate a re-projection layer of the voxel tree, and an aggregation module to aggregate data of a final layer of the voxel tree with preceding layers to select an individual one of the values. Other embodiments may be disclosed and/or claimed.

Abstract: Multivariate graphs specific to a company's performance, alone or in relation to a benchmark, and methods for producing same include defining on a display screen an origin having a first value, extending from the origin at least three axes on the display screen, the axes being generally equidistant from each other and representing a respective variable, plotting on the display screen a value of each variable concerning the company as a point on a respective axis, and using the plotted points to interpolate first segments between the axes on the display screen. Benchmark information, extrinsic to the company, can be obtained, processed into a rating in the same manner as the company data, and superimposed for ready visual comparison of the company's performance to the obtained benchmark. The benchmark information, if shown, is distinguished from the company's performance graph.

Abstract: Disclosed are methods and systems for analyzing data. An example method can comprise receiving volume data representative of an object. A first graph can be generated based on the volume data. The first graph can comprise nodes arranged in a Euclidean space. A deformation field can be determined based on the volume data. The deformation field can be applied to the first graph to form a second graph. The second graph can comprise nodes arranged in a non-Euclidean space. The second graph can be segmented.

Abstract: A computer-implemented method for determining a quantification of the deformation of the sample is implemented using a computer device in communication with a memory. The method includes receiving, by the computer device, a first image of the sample and a second image of the sample. The method also includes registering the first image to the second image using a warping function. The warping function maps a plurality of pixels in the first image to a plurality of pixels in the second image. A first displacement field for the sample is determined based on the warping function, where the first displacement field includes at least a portion of the warping function. A first quantification of the deformation of the sample is determined based at least in part on the displacement field.

Abstract: A computing device is provided, including a display configured to display a plurality of holograms superimposed upon a physical environment. The computing device may further comprise a processor configured to store in non-volatile memory a representation of the physical environment, including a plurality of hologram anchors indicating locations at which the holograms are displayed. The processor may store a priority level of each hologram anchor, wherein each priority level is selected from a plurality of priority levels including a high priority level and a low priority level, and wherein at least one hologram anchor has the low priority level. The processor may determine that a total size of the plurality of hologram anchors exceeds a predetermined size threshold. The processor may, for at least one hologram anchor assigned the low priority level, delete that hologram anchor from the representation of the physical environment.

Abstract: Various methods and systems are provided for generating a volume-rendered image with shading from a three-dimensional ultrasound dataset. As one example, a method for ultrasound imaging includes generating a volume-rendered image with shading and shadowing from a three-dimensional ultrasound dataset, the shading and shadowing based on an angle between a probe axis of a transducer probe used to acquire the three-dimensional ultrasound dataset and a viewing direction of the volume-rendered image.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for obtaining a minimum visible change value for a particular animation comprising multiple frames, the minimum visible change value corresponding to a condition at which change to the particular animation is not visible; determining, based on the minimum visible change value, a termination threshold distance from an animation endpoint and a termination threshold velocity for the particular animation; for each frame of the particular animation, determining whether a current distance from the animation endpoint satisfies the termination threshold distance from the animation endpoint and a current velocity satisfies the termination threshold velocity; and in response to determining that the current distance from the animation endpoint satisfies the termination threshold distance from the animation endpoint and the current velocity satisfies the termination threshold velocity, initiating termination of the animatio

Abstract: A computer readable storage medium stores a facetization processing program that causes a computer to execute a process. The process includes: voxelizing a three-dimensional shape; generating first voxels corresponding to the three-dimensional shape; specifying an area surrounded by the generated first voxels; setting the specified area as voxels to generate second voxels; and facetizing third voxels at a boundary between at least one of the first voxels and a non-voxel area, and the second voxels and the non-voxel area.

Abstract: A system and method for visualizing data obtained by performing a three-dimensional scan with penetrating radiation. Raw density arrays are formed from the scan, each raw density array being a three-dimensional array. A processed density array is formed by one or more operations, such as taking the difference between two raw density arrays, rotating the processed density array, multiplying the processed density array by a front-lighting array, and projecting the processed density array onto a plane to form an image, the projecting including calculating one or more of a plurality of statistics for each of a set of vectors each corresponding to a pixel of the image, the plurality of statistics including a vector mean, a vector maximum, and a vector standard deviation.

Abstract: A camera 14 acquires a background image B0, and a virtual object acquisition unit 22 acquires a virtual object S0. A display information acquisition unit 23 acquires display information indicating a position, at which the virtual object S0 is displayed, from the background image B0, and a display control unit 24 displays the virtual object S0 on a display 15 based on the display information. A change information acquisition unit 25 acquires change information for changing the display state of the virtual object S0 according to the relative relationship between a reference marker image 36 and each of the other marker images 37, among a plurality of marker images 36 and 37 for changing the display state of the virtual object S0 that are included in the background image B0. A display state change unit 26 changes the display state of the virtual object according to the change information.

Abstract: An automated truck unloader for unloading/unpacking product, such as boxes or cases, from trailers and containers is disclosed. In one embodiment, a mobile base structure provides a support framework for a drive subassembly, conveyance subassembly, an industrial robot, a distance measurement subassembly, and a control subassembly. Under the operation of the control subassembly, an industrial robot having a suction cup-based gripper arm selectively removes boxes from the trailer and places the boxes on a powered transportation path. The control subassembly coordinates the selective articulated movement of the industrial robot and the activation of the drive subassembly based upon a perception-based robotic manipulation system.

Abstract: A method and apparatus for classifying light detection and ranging sensor data are provided. The method includes transforming sensor data of the LIDAR into point cloud data, selecting a cell including a subset of the point cloud data, dividing the selected cell into a plurality of voxels, calculating a difference of gradients for the plurality of voxels, performing a first pass on the plurality of voxels to identify voxels that contain an object based the difference of gradients, performing a second pass on the plurality of voxels to identify voxels that contain the object by adjusting a voxel with at least one from among a jitter parameter and a rotation parameter, and outputting a centroid average of voxels identified as containing the object.

Abstract: A method, device and non-transitory computer readable medium for presenting an afterimage are provided. In some embodiments, the method includes: determining a target object, wherein the target object is an image element, an afterimage of which is to be presented; obtaining a motion track of the target object; replicating the target object to obtain the preset number of replicated objects; arranging, according to the motion track of the target object, the target object and the replicated objects; setting transparencies of the replicated objects, wherein a transparency of a replicated object spaced from the target object by a first distance is larger than a transparency of a replicated object spaced from the target object by a second distance; and displaying, on the display device, the target object and the replicated objects with the set transparencies.

Abstract: A process executes at an electronic system. The process identifies device characteristics of an imaging device. The imaging device has signal emitters and signal detectors. The process determines a modulation signal for controlling the signal emitters to illuminate a field of view. The process partitions the field of view into a 3-dimensional plurality of voxels. According to the modulation signal and the device characteristics, the process generates unit response signals. Each unit response signal is associated with one of the voxels, and each unit response signal represents reflection from the voxel when the voxel is filled and reflects illumination generated by one of the signal emitters according to the modulation signal. The process samples the unit response signals to form unit response vectors. Each unit response vector corresponds to one of the plurality of voxels. The process then combines the unit response vectors to form the lookup table.

Abstract: A 2D medical image is colorized. In one approach, a deep-learnt classifier is trained to colorize from color 2D medical images. The color 2D medical images for training are cinematically rendered from slabs to add color. In another approach, a deep machine-learnt generator creates slices as if adjacent to the 2D medical image. The slices and 2D medical image form a slab, which is cinematically rendered to add color. The result is a colorized 2D medical image.