Abstract: A display control method includes: obtaining a position of an object which is arranged in an area when receiving an input; determining, in accordance with the position of the object, a first display position of at least a first image between the first image and a second image in a display area of a display device adjacent to the area; displaying the first image and the second image on the display device; and changing, after receiving the input, the first display position of the first image in accordance with a change in a position of the object in the area without changing a second display position of the second image.

Abstract: Embodiments of the present disclosure provide a rendering method in an AR scene, the method includes: creating a virtual scene including a virtual object; obtaining depth information of a real shielding object and generating a grid map; creating a shielding object virtual model of the real shielding object in the virtual scene; and setting a property of the shielding object virtual model to be absorbing light, and rendering the shielding object virtual model. The present disclosure further provides a processor and AR glasses.

Abstract: The present system and method determine a position on an external surface of an object. The system comprises a magnetic field measurement module and an ultrasound measurement module. A control unit stores a magnetic field map of the object comprising a first plurality of reference areas of the external surface of the object and associated reference magnetic field value. The control unit also stores an ultrasound map of the object comprising a second plurality of reference areas of the external surface of the object and associated reference ultrasound characteristic. The processing unit determines: a subset of the reference areas for which the associated reference magnetic field value is substantially equal to a measured magnetic field value, a subset of the reference areas for which the associated reference ultrasound characteristic is substantially equal to a measured ultrasound characteristic, and determines the position on the external surface of the object.

Abstract: Disclosed are systems and methods for compositing an augmented reality scene, the methods including the steps of extracting, by an extraction component into a memory of a data-processing machine, at least one object from a real-world image detected by a sensing device; geometrically reconstructing at least one virtual model from at least one object; and compositing AR content from at least one virtual model in order to augment the AR content on the real-world image, thereby creating AR scene. Preferably, the method further includes; extracting at least one annotation from the real-world image into the memory of the data-processing machine for modifying at least one virtual model according to at least one annotation. Preferably, the method further includes: interacting with AR scene by modifying AR content based on modification of at least one object and/or at least one annotation in the real-world image.

Abstract: Aspects of the disclosed apparatuses, methods and systems provide sharing virtual elements between users of different 3-D virtual spaces. In another generation aspect, virtual elements may be sent, shared, or exchanged between different client devices whether the communication sharing the virtual element occurs synchronously or asynchronously.

Abstract: There is provided an information processing device including an action possibility analysis unit configured to acquire data of a three-dimensional shape of an environment, and by breaking down the data of the three-dimensional shape, analyzes an action possibility of the environment for a user, and a picture generation unit configured to use an analysis result of the action possibility analysis unit to generate a picture to project onto the environment.

Abstract: A device comprising an input for obtaining consumption data relating to the consumption of a utility provided by a utility provider, an output for outputting modified consumption data and a processor arranged to generate the modified consumption data based on obtained consumption data so that the modified consumption data starts to converge with the obtained consumption data if a deviation of the obtained consumption data from the modified consumption data exceeds a predetermined threshold.

Abstract: A robot arm control device includes a pressure sensing module, a workspace defining module and a control module. The pressure sensing module, arranged on a robot arm, detects whether an object hits or touches the robot arm to switch the operating mode of the robot arm. The workspace defining module includes a sensing region arranged on a peripheral area around the robot arm. The workspace defining module determines whether the object enters an operating space according to the position of the object in the sensing region, and sets the working range and the working mode of the robot arm according to which operating space the object has entered. The control module, connected to the robot arm, the pressure sensing module and the workspace defining module, switches the operating mode and outputs a motor driving signal to the robot arm according to the working mode of the robot arm.

Abstract: Systems, methods, devices, and non-transitory media of the various embodiments provide for a three dimensional tool for depicting the variability of probability of collision (Pc) inputs to Pc estimates. The depictions generated by the various embodiments may be used to quantify the quality of Pc input data required to yield actionable Pc estimates. Various embodiments may provide a graphical user interface (GUI) for a computing device that may display a three dimensional depiction of the variability of Pc inputs to Pc estimates.

Abstract: A method and system provides an acquisition scheme for generating magnetic resonance elastography displacement data with whole-sample coverage, high spatial resolution, and adequate SNR in a short scan time. The method and system can acquire in-plane and through-plane k-space shots over a volume of a sample divided into a plurality of slabs that each include a plurality of non-adjacent slices to obtain three dimensional multiband, multishot data, can apply multiband radio frequency refocusing pulses to the sample, can acquire navigators before readout, and can correct for non-linear motion errors.

Abstract: A magnetic resonance tomography scanner is provided for the determination a diffusion tensor of an examination object, and a method is provided for operating the magnetic resonance tomography scanner. The magnetic resonance tomography scanner acquires a volume image of the examination object by imaging magnetic resonance tomography without diffusion encoding. The control system segments the image according to diffusion-relevant symmetry properties and also determines volume elements of a symmetry group. A first and a second component of a diffusion tensor are acquired by the magnetic resonance tomography scanner at different angles and the control unit uses the symmetry property with the acquired components and the volume image to determine a diffusion tensor for the volume elements.

Abstract: The present invention provides a system and method for generating a CT slice image. The system comprises an MIP image generation module, a region of interest determination module, an angle setting module, a curve determination module, a match module and a slice generation module.

Abstract: Pose of a probe is detected in x-ray medical imaging. Since the TEE probe is inserted through the esophagus of a patient, the pose is limited to being within the esophagus. The path of the esophagus is determined from medical imaging prior to the intervention. During the intervention, the location in 2D is found from one x-ray image at a given time. The 3D probe location is provided by assigning the depth of the esophagus at that 2D location to be the depth of the probe. A single x-ray image may be used to determine the probe location in 3D, allowing for real-time pose determination without requiring space to rotate a C-arm during the intervention.

Abstract: Embodiments that relate to interacting with a physical object in a mixed reality environment via a head-mounted display are disclosed. In one embodiment a mixed reality interaction program identifies an object based on an image from captured by the display. An interaction context for the object is determined based on an aspect of the mixed reality environment. A profile for the physical object is queried to determine interaction modes for the object. A selected interaction mode is programmatically selected based on the interaction context. A user input directed at the object is received via the display and interpreted to correspond to a virtual action based on the selected interaction mode. The virtual action is executed with respect to a virtual object associated with the physical object to modify an appearance of the virtual object. The modified virtual object is then displayed via the display.

Abstract: Various approaches described herein improve the quality of results when fusing depth maps to generate dynamic three-dimensional (“3D”) models, applying texture details to dynamic 3D models, or rendering views of textured, dynamic 3D models. For example, when fusing depth maps to generate a dynamic 3D model, a fusion component can also incorporate intrinsic color values for points of the dynamic 3D model, potentially making the dynamic 3D model more accurate, especially for areas in which depth values are not reliable or not available. As another example, when applying texture details, a rendering component can apply smoothed, viewpoint-dependent texture weights to texture values from different texture maps, which can reduce blurring and avoid the introduction of noticeable seams. As another example, a rendering component can apply special effects indicated by metadata to rendered views, thereby allowing a content provider to assert artistic control over presentation.

Abstract: An X-ray diagnostic apparatus of an embodiment includes processing circuitry. The processing circuitry acquires two medical images, a moving distance of a region of interest between the medical images corresponding to a distance derived from a parallax angle. The processing circuitry causes a display to display a stereoscopic image based on the medical images.

Abstract: Methods and systems for presenting an image of a user interacting with a video game includes providing images of a virtual reality (VR) scene of the video game for rendering on a display screen of a head mounted display (HMD). The images of the VR scene are generated as part of game play of the video game. An input provided at a user interface on the HMD received during game play is used to initiate a signal to pause the video game and to generate an activation signal to activate an image capturing device. The activation signal causes the image capturing device to capture an image of the user interacting in a physical space. The image of the user captured by the image capturing device during game play is associated with a portion of the video game that corresponds with a time when the image of the user was captured. The association causes the image of the user to be transmitted to the HMD for rendering on the display screen of the HMD.

Abstract: Systems and methods are provided for system for generating a physical model for engineering design or visualization. A system includes a processor-readable memory that further includes one or more data structures containing physical data associated with points in a three dimensional volume. A system also includes a plurality of data processors that operate in parallel to perform calculations using the physical data to generate a physical model for providing real-time visualization and calculation associated with the three dimensional volume.

Abstract: In some embodiments, a memory may store programming for selecting values describing a frame of pixels by modeling, based on camera data, object data, and material data, a geometric projection of light in a visual simulation, the modeling including identifying voxel data and building a voxel tree from the voxel data. A processor may, responsive to executing the programming, invoke one or more of a clipping module to generate a portion of the voxel data, a depth occlusion module to check for spatial visibility of one or more outputs of the clipping module and generate an output including one or more layers of a voxel tree, a re-projection module to conditionally generate a re-projection layer of the voxel tree, and an aggregation module to aggregate data of a final layer of the voxel tree with preceding layers to select an individual one of the values. Other embodiments may be disclosed and/or claimed.

Abstract: Multivariate graphs specific to a company's performance, alone or in relation to a benchmark, and methods for producing same include defining on a display screen an origin having a first value, extending from the origin at least three axes on the display screen, the axes being generally equidistant from each other and representing a respective variable, plotting on the display screen a value of each variable concerning the company as a point on a respective axis, and using the plotted points to interpolate first segments between the axes on the display screen. Benchmark information, extrinsic to the company, can be obtained, processed into a rating in the same manner as the company data, and superimposed for ready visual comparison of the company's performance to the obtained benchmark. The benchmark information, if shown, is distinguished from the company's performance graph.

Abstract: Disclosed are methods and systems for analyzing data. An example method can comprise receiving volume data representative of an object. A first graph can be generated based on the volume data. The first graph can comprise nodes arranged in a Euclidean space. A deformation field can be determined based on the volume data. The deformation field can be applied to the first graph to form a second graph. The second graph can comprise nodes arranged in a non-Euclidean space. The second graph can be segmented.

Abstract: A computer-implemented method for determining a quantification of the deformation of the sample is implemented using a computer device in communication with a memory. The method includes receiving, by the computer device, a first image of the sample and a second image of the sample. The method also includes registering the first image to the second image using a warping function. The warping function maps a plurality of pixels in the first image to a plurality of pixels in the second image. A first displacement field for the sample is determined based on the warping function, where the first displacement field includes at least a portion of the warping function. A first quantification of the deformation of the sample is determined based at least in part on the displacement field.

Abstract: A computing device is provided, including a display configured to display a plurality of holograms superimposed upon a physical environment. The computing device may further comprise a processor configured to store in non-volatile memory a representation of the physical environment, including a plurality of hologram anchors indicating locations at which the holograms are displayed. The processor may store a priority level of each hologram anchor, wherein each priority level is selected from a plurality of priority levels including a high priority level and a low priority level, and wherein at least one hologram anchor has the low priority level. The processor may determine that a total size of the plurality of hologram anchors exceeds a predetermined size threshold. The processor may, for at least one hologram anchor assigned the low priority level, delete that hologram anchor from the representation of the physical environment.

Abstract: Various methods and systems are provided for generating a volume-rendered image with shading from a three-dimensional ultrasound dataset. As one example, a method for ultrasound imaging includes generating a volume-rendered image with shading and shadowing from a three-dimensional ultrasound dataset, the shading and shadowing based on an angle between a probe axis of a transducer probe used to acquire the three-dimensional ultrasound dataset and a viewing direction of the volume-rendered image.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for obtaining a minimum visible change value for a particular animation comprising multiple frames, the minimum visible change value corresponding to a condition at which change to the particular animation is not visible; determining, based on the minimum visible change value, a termination threshold distance from an animation endpoint and a termination threshold velocity for the particular animation; for each frame of the particular animation, determining whether a current distance from the animation endpoint satisfies the termination threshold distance from the animation endpoint and a current velocity satisfies the termination threshold velocity; and in response to determining that the current distance from the animation endpoint satisfies the termination threshold distance from the animation endpoint and the current velocity satisfies the termination threshold velocity, initiating termination of the animatio

Abstract: A system and method for visualizing data obtained by performing a three-dimensional scan with penetrating radiation. Raw density arrays are formed from the scan, each raw density array being a three-dimensional array. A processed density array is formed by one or more operations, such as taking the difference between two raw density arrays, rotating the processed density array, multiplying the processed density array by a front-lighting array, and projecting the processed density array onto a plane to form an image, the projecting including calculating one or more of a plurality of statistics for each of a set of vectors each corresponding to a pixel of the image, the plurality of statistics including a vector mean, a vector maximum, and a vector standard deviation.

Abstract: A computer readable storage medium stores a facetization processing program that causes a computer to execute a process. The process includes: voxelizing a three-dimensional shape; generating first voxels corresponding to the three-dimensional shape; specifying an area surrounded by the generated first voxels; setting the specified area as voxels to generate second voxels; and facetizing third voxels at a boundary between at least one of the first voxels and a non-voxel area, and the second voxels and the non-voxel area.

Abstract: A camera 14 acquires a background image B0, and a virtual object acquisition unit 22 acquires a virtual object S0. A display information acquisition unit 23 acquires display information indicating a position, at which the virtual object S0 is displayed, from the background image B0, and a display control unit 24 displays the virtual object S0 on a display 15 based on the display information. A change information acquisition unit 25 acquires change information for changing the display state of the virtual object S0 according to the relative relationship between a reference marker image 36 and each of the other marker images 37, among a plurality of marker images 36 and 37 for changing the display state of the virtual object S0 that are included in the background image B0. A display state change unit 26 changes the display state of the virtual object according to the change information.

Abstract: A method and apparatus for classifying light detection and ranging sensor data are provided. The method includes transforming sensor data of the LIDAR into point cloud data, selecting a cell including a subset of the point cloud data, dividing the selected cell into a plurality of voxels, calculating a difference of gradients for the plurality of voxels, performing a first pass on the plurality of voxels to identify voxels that contain an object based the difference of gradients, performing a second pass on the plurality of voxels to identify voxels that contain the object by adjusting a voxel with at least one from among a jitter parameter and a rotation parameter, and outputting a centroid average of voxels identified as containing the object.

Abstract: An automated truck unloader for unloading/unpacking product, such as boxes or cases, from trailers and containers is disclosed. In one embodiment, a mobile base structure provides a support framework for a drive subassembly, conveyance subassembly, an industrial robot, a distance measurement subassembly, and a control subassembly. Under the operation of the control subassembly, an industrial robot having a suction cup-based gripper arm selectively removes boxes from the trailer and places the boxes on a powered transportation path. The control subassembly coordinates the selective articulated movement of the industrial robot and the activation of the drive subassembly based upon a perception-based robotic manipulation system.

Abstract: A method, device and non-transitory computer readable medium for presenting an afterimage are provided. In some embodiments, the method includes: determining a target object, wherein the target object is an image element, an afterimage of which is to be presented; obtaining a motion track of the target object; replicating the target object to obtain the preset number of replicated objects; arranging, according to the motion track of the target object, the target object and the replicated objects; setting transparencies of the replicated objects, wherein a transparency of a replicated object spaced from the target object by a first distance is larger than a transparency of a replicated object spaced from the target object by a second distance; and displaying, on the display device, the target object and the replicated objects with the set transparencies.

Abstract: A process executes at an electronic system. The process identifies device characteristics of an imaging device. The imaging device has signal emitters and signal detectors. The process determines a modulation signal for controlling the signal emitters to illuminate a field of view. The process partitions the field of view into a 3-dimensional plurality of voxels. According to the modulation signal and the device characteristics, the process generates unit response signals. Each unit response signal is associated with one of the voxels, and each unit response signal represents reflection from the voxel when the voxel is filled and reflects illumination generated by one of the signal emitters according to the modulation signal. The process samples the unit response signals to form unit response vectors. Each unit response vector corresponds to one of the plurality of voxels. The process then combines the unit response vectors to form the lookup table.

Abstract: A 2D medical image is colorized. In one approach, a deep-learnt classifier is trained to colorize from color 2D medical images. The color 2D medical images for training are cinematically rendered from slabs to add color. In another approach, a deep machine-learnt generator creates slices as if adjacent to the 2D medical image. The slices and 2D medical image form a slab, which is cinematically rendered to add color. The result is a colorized 2D medical image.

Abstract: A surgical microscope for producing an observation image of an object region for an observer is provided. The surgical microscope includes an image acquisition device to acquire an image of the object region, a display device, an image processing and control device, a computer unit, a switchable imaging optical unit, an eyepiece and an optical observation beam path. The switchable imaging optical unit feeds the observation image to the eyepiece via the optical observation beam path in a first switching state. In a second switching state, the switchable imaging optical unit interrupts the optical observation beam path between the object region and the eyepiece to display an acquired image in the eyepiece and to electronically superpose the object region image data at a predefined position onto the image of the object region.

Abstract: Disclosed herein in a method and system for creating and utilizing a virtual-three dimensional image in a real-world environment to guide medical procedures. The process may include receiving image data related to a patient and creating and displaying a three-dimensional holographic model of the patient utilizing the received image data, wherein creating a three-dimensional holographic model of the patient utilizing the received image data. Exemplary methods include organizing image data in a unique manner and utilizing subvolume skipping techniques allowing for more efficient accurate rendering of holographic images.

Abstract: An image processing apparatus includes: an acquisition unit configured to acquire viewpoint information indicating a viewpoint; a generation unit configured to generate a determined-viewpoint image based on a plurality of captured images captured from a plurality of directions and the viewpoint information acquired by the acquisition unit, wherein the generation unit performs an inclination correction process for correcting an inclination, according to the viewpoint information, of the determined-viewpoint image; and an output unit configured to output the determined-viewpoint image generated by the generation unit.

Abstract: Datasets such as two dimensional raster images or three dimensional voxel based representations are often processed for representation using a transfer function defined by a curve. A mechanism for manually adjusting such curves is described, whereby a user adds a second curve. The transfer curve is recalculated so as to draw closer to the second curve. By drawing the second curve in the shape required for the transfer curve, and repeating this gesture as the transfer curve evolves, the user can subtly and interactively develop the transfer curve until the processed representation is exactly as required. The attractive effect of the points of the first curve on those of adjacent point on the first curve and on those of the second may be attractive or repellent, may vary in any manner as a function of distance, and in particular may imitate the effects of physical forces such as magnetic, elastic, etc.

Abstract: Techniques are described for transforming image data, such as two dimensional (2D) or partial three dimensional (3D) image data, into a 3D model. Upon receiving image data including color information, the image data may be converted into a height map based on the color information. The height map may be used to construct an image data mesh, which forms a 3D model. In some aspects, constructing the image data mesh may include associating vertices with pixels of the image data, connecting neighboring vertices to define at least one surface, applying texture to at least one of the surfaces, generating bottom and side surfaces, and connecting the bottom and side surface(s) to the textured surface to enclose a volume within the 3D model. In some aspects, the height map may include an edge based height map, such that color distances between pixels may be used form edges from the image data.

Abstract: A method, system, and one or more computer-readable storage media for controlling a robot in the presence of a moving object are provided herein. The method includes capturing a number of frames from a three-dimensional camera system and analyzing a frame to identify a connected object. The frame is compared to a previous frame to identify a moving connected object (MCO). If an unexpected MCO is in the frame a determination is made if the unexpected MCO is in an actionable region. If so, the robot is instructed to take an action.

Abstract: Systems and methods for creating a thickness grid for determining reserve estimates for a reservoir by performing a fast sweep thickness extraction on a sealed triangulated mesh to create the thickness grid.

Abstract: An information processing device that detects the position of a subject shot by a camera in a three-dimensional space is provided. The information processing device includes a depth image acquiring section that acquires a depth image in which the distance of a subject in the depth direction from the camera is represented as a pixel value on an image plane, a spatial structure identifying section that identifies the position of a plane forming a predetermined angle with a gravity vector among subject surfaces by detecting a coordinate point collection representing the plane on the basis of the distribution of coordinate points obtained by inverse projection of pixels of the depth image to the three-dimensional space based on the direction of the gravity vector, and a target object extracting section that generates and outputs position information of a predetermined target object on the basis of the position of the plane.

Abstract: A computer-implemented method of preparing a polygon mesh for printing by a process of additive manufacturing includes the steps of receiving a model of an object to be printed in the form of a polygon mesh, converting the polygon mesh into a signed distance field which comprises voxels identified as interior or exterior to the object, the conversion including a process for resolving degeneracies in the model so that the signed distance field defines an outer surface that is an orientable manifold, and thus may exist in reality and an output step which converts the signed distance field to a format that facilitates additive manufacturing of the object.

Abstract: An apparatus for examining components comprising laid fiber composite fabrics or woven fiber composite fabrics which comprise a number of thin plies with in part different alignment, comprises a measuring device for carrying out a non-destructive measurement to collect volumetric data of the component and comprising an evaluation device for evaluating the collected data of the component, wherein the evaluation by the evaluation device comprises selecting a first analysis region in the collected data of the component, determining a local coordinate system of the first analysis region, successively establishing local material properties layer-by-layer at predetermined distances in a direction perpendicular to the lateral extent of the first analysis region, detecting ply boundaries along the established material properties, and averaging the local material properties in each detected ply.

Abstract: Systems and methods are provided for generating a mesh assembly. A specification of a system having first and second objects is received. The specification includes, for each of the first and second objects, geometric data for the object and mesh data comprising settings for creating a mesh representation of the object. The first object is associated with a first mesh, and the second object is associated with a second mesh. The associating includes, for each of the first and second objects, determining whether a mesh with geometric data and mesh data corresponding to that of the object has been previously generated. If the mesh has been previously generated, the object is associated with the mesh, and if the mesh has not been previously generated, the object is meshed to generate a new mesh that is associated with the object. A mesh assembly including the first and second meshes is generated.

Abstract: Example methods and systems for background subtraction re-initialization are disclosed. In an example method, computing system may use a set of active sensors to determine a background representation of a space that can be divided into subspaces with each subspace depicted by a quantity of data points that depends on the active sensors. The system may determine locations of objects moving the space using the active sensors and the background representation. In some instances, the system may receive an indication of a change in the active sensors and responsively determine new quantities of data points that depict each subspace after the change. The system may further adjust the background representation of the space by subtracting data points corresponding to the determined locations of the objects moving in the space from the new quantities of data points that depict each subspace of the space after the change in the active sensors.

Abstract: Systems and methods monitor a workspace for safety purposes using sensors distributed about the workspace. The sensors are registered with respect to each other, and this registration is monitored over time. Occluded space as well as occupied space is identified, and this mapping is frequently updated.

Abstract: A method can include sampling points for at least a portion of a model of a geologic environment; generating a meshless model based at least in part on the points where the points correspond to nodes having respective domains of influence; and, based at least in part on the meshless model, computing a tensor field associated with forces experienced by at least a portion of the nodes. Various other apparatuses, systems, methods, etc., are also disclosed.

Abstract: In a graphics processing system, a bounding volume 20 representing the volume of a scene to be rendered and a cube texture 30 representing the transparency of the surface of the bounding volume are defined. Then, when the scene is to be rendered for output, a color to be used to represent a first sampling point 25 as seen from a viewpoint position 24 for the scene is determined by determining, for each of plural second sampling points 27 along a vector 26 from the first sampling point 25 to the viewpoint position 24, a transparency parameter indicative of the amount of light that falls on the second sampling point 27, and then using the determined transparency parameter values for each of the plural second sampling points 27 to determine the color.

Abstract: Methods, apparatus, systems, and computer-readable media are provided for efficient mapping of a robot environment. In various implementations, a group of data points may be sensed by a three-dimensional sensor. One or more voxels of a three-dimensional voxel model that are occupied by the group of data points may be identified. For each occupied voxel, a column of the three-dimensional voxel model that contains the occupied voxel may be identified. Occupied voxels contained in each column may be indexed by elevation. In various implementations, one or more sparse linked data structures may be used to represent the columns.

Abstract: During an analysis technique, a three-dimensional (3D) image of a portion of an individual is transformed to facilitate accurate determination of detailed annotation of an anatomical structure (such as: specifying the size of the anatomical structure based on annotation markers, an orientation of the anatomical structure, a direction of the anatomical structure and/or a location of the anatomical structure). In particular, in response to receiving information specifying a two-dimensional (2D) plane having an angular position in the 3D image, the 3D image is translated and rotated from an initial position and orientation so that the 2D plane is presented in an orientation parallel to a reference 2D plane of a display. Then, after information specifying the detailed annotation in the 2D plane is received, the 3D image is translated and rotated back to the initial position and orientation.