Voxel Patents (Class 345/424)
  • Patent number: 11857271
    Abstract: Provided herein are devices, systems, and methods for a three-dimensional registering, tracking, and/or guiding an object of interest, such a body part, a surgical tool, or an implant, during a surgical procedure. Such devices, systems, and methods may offer minimally invasive, high precision registering, tracking, and/or guiding of the object of interest using a patterned light beam and data processing using artificial intelligence. The methods, devices, and systems disclosed herein may be compatible with a simple marker or markers placed by a minimally invasive method on the object of interest.
    Type: Grant
    Filed: April 28, 2021
    Date of Patent: January 2, 2024
    Inventors: Thomas Harte, Huy Quoc Phan
  • Patent number: 11850113
    Abstract: A system includes one or more processors coupled to a non-transitory memory, where the one or more processors are configured to generate, using a training set comprising one or more two-dimensional (2D) training images of a dental arch and a three-dimensional (3D) dental arch model, a machine-learning model configured to generate 3D models of dental arches from 2D images of the dental arches, receive one or more 2D images of a dental arch of a user obtained by a user device of the user, and execute the machine-learning model using the one or more 2D images as input to generate a 3D model of the dental arch of the user.
    Type: Grant
    Filed: June 27, 2022
    Date of Patent: December 26, 2023
    Assignee: SDC U.S. SmilePay SPV
    Inventors: Jordan Katzman, Christopher Yancey, Tim Wucher
  • Patent number: 11836939
    Abstract: A control apparatus includes a first information acquiring section that acquires three-dimensional information of a first region of surfaces of a plurality of objects, the information being obtained by imaging or scanning the plurality of objects from a first location; a second information acquiring section that acquires three-dimensional information of a second region of surfaces of the plurality of objects, the information being obtained by imaging or scanning the plurality of objects from a second location; and a combining section that generates information indicating three-dimensional shapes of at least a portion of the surfaces of the plurality of objects, based on the three-dimensional information of the first region acquired by the first information acquiring section and the three-dimensional information of the second region acquired by the second information acquiring section.
    Type: Grant
    Filed: March 1, 2021
    Date of Patent: December 5, 2023
    Assignee: MUJIN, INC.
    Inventors: Rosen Diankov, Xutao Ye, Ziyan Zhou
  • Patent number: 11830128
    Abstract: Disclosed is a system for differentiating the selection of three-dimensional (“3D”) image data in a 3D space from other unselected 3D image data that may be positioned in front of the selected 3D image data, and for customizing editing operations that are presented in a user interface based on the object or material property represented in the selection. The system selects a set of 3D image data in response to a user input, and adjusts the transparency of unselected 3D image data that is positioned in front of the selected set of 3D image data. The system presents a differentiated visualization by rendering the selected set of 3D image data according to an original size, position, and visual characteristics defined for the selected set of 3D image, and by performing a partial or fully transparent rendering of the unselected 3D image as a result of the transparency adjustment.
    Type: Grant
    Filed: February 2, 2023
    Date of Patent: November 28, 2023
    Assignee: Illuscio, Inc.
    Inventor: Max Good
  • Patent number: 11830194
    Abstract: Space-based ground-imaging lidar has become increasingly feasible with recent advances in compact fiber lasers and single-photon-sensitive Geiger-mode detector arrays. A challenge with such a system is imperfect pointing knowledge caused by angular jitter, exacerbated by long distances between the satellite and the ground. Unless mitigated, angular jitter blurs the 3D lidar data. Unfortunately, using mechanical isolation, advanced IMUs, star trackers, or auxiliary passive optical sensors to reduce the error in pointing knowledge increases size, weight, power, and/or cost. Here, the 2-axis jitter time series is estimated from the lidar data. Simultaneously, a single-surface model of the ground is estimated as nuisance parameters. Expectation Maximization separates signal and background detections, while maximizing the joint posterior probability density of the jitter and surface states.
    Type: Grant
    Filed: April 24, 2020
    Date of Patent: November 28, 2023
    Assignee: Massachusetts Institute of Technology
    Inventors: Ethan Phelps, Charles Primmerman, Eric Statz
  • Patent number: 11823322
    Abstract: Systems, methods, and non-transitory computer-readable media are disclosed for utilizing an encoder-decoder architecture to learn a volumetric 3D representation of an object using digital images of the object from multiple viewpoints to render novel views of the object. For instance, the disclosed systems can utilize patch-based image feature extraction to extract lifted feature representations from images corresponding to different viewpoints of an object. Furthermore, the disclosed systems can model view-dependent transformed feature representations using learned transformation kernels. In addition, the disclosed systems can recurrently and concurrently aggregate the transformed feature representations to generate a 3D voxel representation of the object. Furthermore, the disclosed systems can sample frustum features using the 3D voxel representation and transformation kernels.
    Type: Grant
    Filed: June 16, 2022
    Date of Patent: November 21, 2023
    Assignee: Adobe Inc.
    Inventors: Tong He, John Collomosse, Hailin Jin
  • Patent number: 11810255
    Abstract: Techniques for determining a swept volume of an object moving along a trajectory in a 3D space are disclosed. In some examples, a computer graphics application accesses a representation of the object, such as the signed distance field (SDF), and the trajectory information describing the movement path in the 3D space over a time period. The 3D space is represented using a grid of voxels each having multiple vertices. The computer graphics application determines the swept volume of the object in the 3D space by evaluating a subset of the grid of voxels (e.g., the voxels surrounding the surface of the swept volume). The number of voxels in the subset of voxels is less than the number of voxels in the grid of voxels. The computer graphics application further generates a representation of the swept volume surface for output.
    Type: Grant
    Filed: May 28, 2021
    Date of Patent: November 7, 2023
    Assignee: Adobe Inc.
    Inventors: Noam Aigerman, Silvia Gonzalez Sellan, Alec Jacobson
  • Patent number: 11801097
    Abstract: A registration fixture for use with a surgical navigation system for registration of a medical image or images to a three-dimensional tracking space that includes a first ring having at least one tracking marker, a second ring coupled to the first ring having at least one tracking marker and wherein the first ring and the second ring are spaced apart from one another and further include optical markers.
    Type: Grant
    Filed: August 12, 2020
    Date of Patent: October 31, 2023
    Assignee: GLOBUS MEDICAL, INC.
    Inventors: Neil R. Crawford, Norbert Johnson, Wes Weber, Alexander Krull
  • Patent number: 11790595
    Abstract: A hardware-based traversal coprocessor provides acceleration of tree traversal operations searching for intersections between primitives represented in a tree data structure and a ray. The primitives may include opaque and alpha triangles used in generating a virtual scene. The hardware-based traversal coprocessor is configured to determine primitives intersected by the ray, and return intersection information to a streaming multiprocessor for further processing. The hardware-based traversal coprocessor is configured to provide a deterministic result of intersected triangles regardless of the order that the memory subsystem returns triangle range blocks for processing, while opportunistically eliminating alpha intersections that lie further along the length of the ray than closer opaque intersections.
    Type: Grant
    Filed: September 30, 2021
    Date of Patent: October 17, 2023
    Assignee: NVIDIA Corporation
    Inventors: Samuli Laine, Tero Karras, Greg Muthler, William Parsons Newhall, Jr., Ronald Charles Babich, Jr., Ignacio Llamas, John Burgess
  • Patent number: 11790567
    Abstract: The present disclosure relates to an information processing apparatus and method that are capable of suppressing a decrease in encoding efficiency. When point cloud data is to be Octree-encoded, a point distribution of child nodes of a current node is updated in accordance with a peripheral point distribution around the current node, and then a sequence of signals is generated by performing Octree encoding with the updated point distribution. The present disclosure is applicable, for example, to information processing apparatuses, image processing apparatuses, electronic equipment, information processing methods, or programs.
    Type: Grant
    Filed: March 28, 2019
    Date of Patent: October 17, 2023
    Assignee: SONY CORPORATION
    Inventors: Ohji Nakagami, Koji Yano, Satoru Kuma, Tsuyoshi Kato
  • Patent number: 11751948
    Abstract: Methods and systems for performing robot-assisted surgery, including methods for defining a boundary surface for a robotic surgery system, methods for operating a robotic arm in an image-guided surgery system, methods and systems for providing haptic feedback to a user during robot-assisted surgery, and a robotic arm for use in robot-assisted surgery.
    Type: Grant
    Filed: October 24, 2017
    Date of Patent: September 12, 2023
    Assignee: Mobius Imaging, LLC
    Inventors: Eugene Gregerson, Todd Furlong, Scott Coppen, Jeff Baker, Steve White, Russell Stanton
  • Patent number: 11734897
    Abstract: A system configured to improve the operations associated with generating virtual representations on limited resources of a mobile device. In some cases, the system may utilize viewpoint bundles that include collection of image data with an associated pose in relative physical proximity to each other to render a virtual scene. In other cases, the system may utilize 2.5D manifolds including 2D image data and a weighted depth value to render the 3D environment.
    Type: Grant
    Filed: July 1, 2021
    Date of Patent: August 22, 2023
    Assignee: Occipital, Inc.
    Inventors: Jeffrey Roger Powers, Nicolas Burrus, Yuping Lin, Paul Schroeder
  • Patent number: 11734881
    Abstract: A method and system for providing access to and control of parameters within a scenegraph includes redefining components or nodes' semantic within a scenegraph. The set of components or nodes (depending on the scenegraph structure) are required to enable access from the Application User Interface to selected scenegraph information. In one embodiment, a user interface is generated for controlling the scenegraph parameters. In addition, constraints can be implemented that allow or disallow access to certain scenegraph parameters and restrict their range of values.
    Type: Grant
    Filed: August 2, 2021
    Date of Patent: August 22, 2023
    Assignee: GRASS VALLEY CANADA
    Inventors: Ralph Andrew Silberstein, David Sahuc, Donald Johnson Childers
  • Patent number: 11726554
    Abstract: A computer-implemented simulation of a virtual hand in a virtual environment can include reading in a hand dataset that is representative of a shape of a real hand of a user, applying the hand dataset to a trained, artificial neural network, and determining an output dataset with the artificial neural network to which the dataset has been applied indicative of forces acting on a virtual object.
    Type: Grant
    Filed: August 17, 2021
    Date of Patent: August 15, 2023
    Assignee: Ford Global Technologies, LLC
    Inventors: Turgay Isik Aslandere, Cem Mengi
  • Patent number: 11727635
    Abstract: A method for determining three-dimensional (3D) coordinates of an object surface with a 3D measuring device includes forming from the determined 3D coordinates a mesh having a first face, constructing a voxel array aligned to the first face, obtaining a plurality of images from a first camera having a corresponding plurality of poses, obtaining for each voxel in the voxel array a plurality of voxel values obtained from the corresponding plurality of images, determining for each voxel row a quality value determined based at least in part on an average value of a first quantity and a dispersion of the first quantity, the first quantity based at least in part on first voxel values determined as a function of pose, and determining a distance from a point on the first face to the object surface based at least in part on the determined quality values for the voxel rows.
    Type: Grant
    Filed: September 28, 2021
    Date of Patent: August 15, 2023
    Assignee: FARO TECHNOLOGIES, INC.
    Inventors: Martin Ossig, Johannes Buback
  • Patent number: 11710270
    Abstract: A programmatic arbitrary distribution of items in a modeling system may be provided. To perform the distribution, a surface may be received, and a point count of application points associated with locations on the surface may be determined. A density map may be applied over the surface to assign a density to portions of the surface for the point count. Application points are then assigned to locations on the surface according to the density map and a scattering function of the point count, where the scattering function is based on one or more repulsion forces between neighboring points. The one or more repulsion forces are treated as pushing each of the neighboring point apart. Thereafter, the surface may be provided having the application points scattered across the surface based on the one or more repulsion forces.
    Type: Grant
    Filed: June 7, 2022
    Date of Patent: July 25, 2023
    Assignee: Unity Technologies SF
    Inventor: Philip Hunter
  • Patent number: 11704537
    Abstract: The implementations of the subject matter described herein relate to an octree-based convolutional neural network. In some implementations, there is provided a computer-implemented method for processing a three-dimensional shape. The method comprises obtaining an octree for representing the three-dimensional shape. Nodes of the octree include empty nodes and non-empty nodes. The empty nodes exclude the three-dimensional shape and are leaf nodes of the octree, and the non-empty nodes include at least a part of the three-dimensional shape. The method further comprises for nodes in the octree with a depth associated with a convolutional layer of a convolutional neural network, performing a convolutional operation of the convolutional layer to obtain an output of the convolutional layer.
    Type: Grant
    Filed: April 20, 2018
    Date of Patent: July 18, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Pengshuai Wang, Yang Liu, Xin Tong
  • Patent number: 11670000
    Abstract: Disclosed is an imaging system and associated methods for mapping in-focus image data from two-dimensional (“2D”) images of a scene to a three-dimensional (“3D”) model of the scene. The imaging system receives the 2D images and the 3D model, determines the depth of field (“DOF”) and the field of view (“FOV”) for each 2D image, and selects a subset of 3D model constructs that form the FOV and are within the DOF of a particular 2D image. The imaging system determines pixels of the particular 2D image that represent a same set of points in the scene as the subset of 3D model constructs, and maps the visual characteristics from those pixels to non-positional elements of the subset of 3D model constructs.
    Type: Grant
    Filed: January 4, 2023
    Date of Patent: June 6, 2023
    Assignee: Illuscio, Inc.
    Inventors: Kevan Spencer Barsky, Nicholas Frank Hammerle
  • Patent number: 11645746
    Abstract: A system and method are disclosed for representing and studying anatomy in the oral region such as parts of a subject's teeth and adjoining tissues. Types of inputs are used to form segmented outputs representing the teeth and can include segmented crown and root portions of the teeth. Machine learning methods are used for optimum and accurate results and to generate data objects corresponding to respective anatomical features of the subject.
    Type: Grant
    Filed: November 29, 2019
    Date of Patent: May 9, 2023
    Assignee: Orca Dental AI LTD.
    Inventors: Zeev Abraham, Daniel Abraham, Shlomo Avigdor
  • Patent number: 11625813
    Abstract: The present disclosure describes systems, non-transitory computer-readable media, and methods for accurately and efficiently removing objects from digital images taken from a camera viewfinder stream. For example, the disclosed systems access digital images from a camera viewfinder stream in connection with an undesired moving object depicted in the digital images. The disclosed systems generate a temporal window of the digital images concatenated with binary masks indicating the undesired moving object in each digital image. The disclosed systems further utilizes a 3D to 2D generator as part of a 3D to 2D generative adversarial neural network in connection with the temporal window to generate a target digital image with the region associated with the undesired moving object in-painted. In at least one embodiment, the disclosed systems provide the target digital image to a camera viewfinder display to show a user how a future digital photograph will look without the undesired moving object.
    Type: Grant
    Filed: October 30, 2020
    Date of Patent: April 11, 2023
    Assignee: Adobe, Inc.
    Inventors: Sheng-Wei Huang, Wentian Zhao, Kun Wan, Zichuan Liu, Xin Lu, Jen-Chan Jeff Chien
  • Patent number: 11625891
    Abstract: A method and apparatus for performing preemptive rendering of a 3D dataset is disclosed. Some rendering engines are too slow to render a large dataset quickly. In this patent, a list of possible views is generated. For each possible view includes a viewing position and viewing angle. For each possible view, rendering of a 3D dataset is performed to generate a corresponding preemptively rendered image for said each possible view. Each possible view and corresponding preemptively rendered image are stored. A head display unit's position and orientation are tracked and at a time epoch when said head display unit's position and orientation correspond to a possible view in said list of possible views, the corresponding preemptively rendered image is displayed.
    Type: Grant
    Filed: November 15, 2021
    Date of Patent: April 11, 2023
    Inventors: Robert Edwin Douglas, David Byron Douglas
  • Patent number: 11593986
    Abstract: A method and an intersection testing module in a ray tracing system for performing intersection testing for a ray with respect to a plurality of convex polygons, each of which is defined by an ordered set of vertices, wherein at least one of the vertices is a shared vertex which is used to define at least two of the convex polygons. The vertices of the convex polygons are projected onto a pair of axes orthogonal to the ray direction. A vertex ordering scheme defines an ordering of the projected vertices which is independent of the ordering of the vertices in the ordered sets.
    Type: Grant
    Filed: March 21, 2022
    Date of Patent: February 28, 2023
    Assignee: Imagination Technologies Limited
    Inventors: Peter Smith-Lacey, Rostam King, Gregory Clark, Simon Fenney
  • Patent number: 11582469
    Abstract: An apparatus for point cloud decoding includes processing circuitry. The processing circuitry receives, from a coded bitstream for a point cloud, encoded occupancy codes for nodes in an octree structure for the point cloud. The nodes in the octree structure correspond to three dimensional (3D) partitions of a space of the point cloud. Sizes of the nodes are associated with sizes of the corresponding 3D partitions. Further, the processing circuitry decodes, from the encoded occupancy codes, occupancy codes for the nodes. At least a first occupancy code for a child node of a first node is decoded without waiting for a decoding of a second occupancy code for a second node having a same node size as the first node. Then, the processing circuitry reconstructs the octree structure based on the decoded occupancy codes for the nodes, and reconstructs the point cloud based on the octree structure.
    Type: Grant
    Filed: October 5, 2021
    Date of Patent: February 14, 2023
    Assignee: TENCENT AMERICA LLC
    Inventors: Xiang Zhang, Wen Gao, Shan Liu
  • Patent number: 11562530
    Abstract: A system and method for volume rendering a light field, wherein the light field data is subjected to a layering scheme introducing a partitioning of the hogels into subsets. Each subset corresponding to a sub-volume of the layer volume, corresponds to the sub-region of the layer. Novel partitioning of the data combined with an efficient local memory caching technique, plenoptic downsampling strategies to reduce memory bandwidth requirements and volume rendering algorithm to produce a rendered light field image. A reduction in the total number of samples required can be obtained while still maintaining the quality of the resulting image. A method is also provided to order memory accesses aligned with ray calculations in order to maximize access coherency. Real-time layered scene decomposition can be combined with surface rendering method to create a hybrid real-time rendering method that supports rendering of scenes containing superimposed volumes and surfaces.
    Type: Grant
    Filed: April 26, 2021
    Date of Patent: January 24, 2023
    Assignee: Avalon Holographics Inc.
    Inventor: Matthew Hamilton
  • Patent number: 11552778
    Abstract: A method of multi-sensor data fusion includes determining a plurality of first data sets using a plurality of sensors, each of the first data sets being associated with a respective one of a plurality of sensor coordinate systems, and each of the sensor coordinate systems being defined in dependence of a respective one of a plurality of mounting positions for the sensors; transforming the first data sets into a plurality of second data sets using a transformation rule, each of the second data sets being associated with a unified coordinate system, the unified coordinate system being defined in dependence of at least one predetermined reference point; and determining at least one fused data set by fusing the second data sets.
    Type: Grant
    Filed: February 26, 2020
    Date of Patent: January 10, 2023
    Assignee: APTIV TECHNOLOGIES LIMITED
    Inventors: Yu Su, Weimeng Zhu, Mirko Meuter
  • Patent number: 11546721
    Abstract: A system and method enabling location-based activation of applications. A server system stores and provides a persistent virtual world system comprising one or more applications virtually attached to virtual-world entities positioned according to real-world coordinates, the server system being configured to compute the state of the virtual-world entities and to process the applications. Upon detecting the user devices in a corresponding zone (e.g., by the wireless network detecting user devices connecting to the server), the server system sends a minimum amount of application graphical representation to the user devices. Upon user interaction with the application graphical representation, the user devices download a minimum amount of application data, prompting the server system to determine suitable application media streams.
    Type: Grant
    Filed: June 15, 2020
    Date of Patent: January 3, 2023
    Assignee: THE CALANY HOLDING S.À.R.L.
    Inventor: Cevat Yerli
  • Patent number: 11498004
    Abstract: In an exemplary embodiment, on the basis of a first direction input performed on an operation device, a player object is caused to perform a posturing action of holding an item object in an orientation corresponding to an input direction according to the first direction input. Further, in accordance with cancelation of the first direction input, the player object is caused to perform a swinging action of swinging the item object.
    Type: Grant
    Filed: May 26, 2021
    Date of Patent: November 15, 2022
    Assignee: NINTENDO CO., LTD.
    Inventor: Eiji Aonuma
  • Patent number: 11488323
    Abstract: A method for operating a robotic system includes determining a discretized object model representative of a target object; determining a discretized platform model representative of a task location; determining height measures based on real-time sensor data representative of the task location; and dynamically deriving a placement location based on (1) overlapping the discretized object model and the discretized platform model for stacking objects at the task location and (2) calculating a placement score associated with the overlapping based on the height measures.
    Type: Grant
    Filed: April 24, 2020
    Date of Patent: November 1, 2022
    Assignee: MUJIN, Inc.
    Inventors: Rosen Nikolaev Diankov, Denys Kanunikov
  • Patent number: 11488347
    Abstract: A method may include providing geometry data and attribute information of the model in one or more data structures on a data storage device and performing a rendering process for providing a visualization of the model on the display for each of the multitude of viewpoints. The rendering process may include rendering a multitude of like 3D arrays in a single draw call, each array comprising at least eight voxels, removing voxels that are not to be visualized by folding vertices to a centre of the array, computing a distortion on a mapping from voxel space to attribute volume space in dependence on the removed voxels, assigning attributes to the voxels of the multitude of arrays using distorted values for retrieving attribute values from attribute volume space, the attributes being assigned to the remaining voxels according to the computed distortion, and visualizing the voxels of the multitude of arrays.
    Type: Grant
    Filed: July 2, 2021
    Date of Patent: November 1, 2022
    Assignee: MY VIRTUAL REALITY SOFTWARE AS
    Inventors: Jørn Are Sjulsen, Roy Morten Brenna
  • Patent number: 11482068
    Abstract: Embodiments of the present invention are directed to gaming devices that provide audio-visual animated characters in response to game play. The character has a personality that may be encouraging, taunting or another quality. A plurality of expressions of the personality is presented, between one extreme and another, dependant upon the history of game outcomes.
    Type: Grant
    Filed: May 6, 2020
    Date of Patent: October 25, 2022
    Assignee: ACRES TECHNOLOGY
    Inventor: John F. Acres
  • Patent number: 11465864
    Abstract: An automated truck unloader for unloading/unpacking product, such as boxes or cases, from trailers and containers is disclosed. In one embodiment, a mobile base structure provides a support framework for a drive subassembly, conveyance subassembly, an industrial robot, a distance measurement subassembly, and a control subassembly. Under the operation of the control subassembly, an industrial robot having a suction cup-based gripper arm selectively removes boxes from the trailer and places the boxes on a powered transportation path. The control subassembly coordinates the selective articulated movement of the industrial robot and the activation of the drive subassembly based upon a perception-based robotic manipulation system.
    Type: Grant
    Filed: April 28, 2020
    Date of Patent: October 11, 2022
    Assignees: Wynright Corporation, Daifuku Co. Ltd.
    Inventors: Christopher D. McMurrough, Pavlos Doliotis, Matthew B. Middleton, Alex Criswell, Samarth Rajan, Justry Weir
  • Patent number: 11455072
    Abstract: A user, a manipulator such as a hand, and at least one entity such as a virtual or augmented reality object are in an interface such as a 3D environmental interface. The manipulation distance is the distance between a reference feature of the user and a manipulation feature of the manipulator. The entity distance is the distance between the reference feature and an entity feature of the entity. When the manipulation distance becomes greater than the entity distance, the entity is caused to fade, disappear, move out of the way, shrink, etc. so as to be less of an obstruction to the user's field of view, for example to avoid obstructing more distant entities. Other factors than the manipulation distance and entity distance may be considered in determining whether to reduce the obstructivity of the entity, and exceptions to the obstruction relation may be considered.
    Type: Grant
    Filed: April 24, 2019
    Date of Patent: September 27, 2022
    Assignee: WEST TEXAS TECHNOLOGY PARTNERS, LLC
    Inventors: Nathan Abercrombie, Theo Goguely
  • Patent number: 11450066
    Abstract: 3D reconstruction method based on deep learning includes the following steps: (1) The potential vector constrained in the input image is used to reconstruct the complete 3D shape of the target, and the mapping between the part and the complete 3D shape is learned, then the 3D reconstruction of a single depth image is realized. (2) Learn the intermediate feature representation between the 3D real object and the reconstructed object to obtain the target potential variables in step (1). (3) The voxel floating value predicted in step (1) is transformed into binary value by using the limit learning machine to complete high-precision reconstruction.
    Type: Grant
    Filed: March 4, 2020
    Date of Patent: September 20, 2022
    Assignee: BEIJING UNIVERSITY OF TECHNOLOGY
    Inventors: Dehui Kong, Caixia Liu, Shaofan Wang, Jinghua Li, Lichun Wang
  • Patent number: 11430179
    Abstract: Techniques for improving remote rendering and reprojection are disclosed herein. A color image is generated, where this color image includes overlapping content regions. A depth buffer is generated for the color image and includes depth values for the pixels in the color image. The depth buffer includes both essential and non-essential depth discontinuities. While preserving the essential depth discontinuities, the non-essential depth discontinuities are eliminated from the depth buffer. New non-essential discontinuities are prevented from being included in the final version of the depth buffer. The color image is encoded into a color image video stream, and the modified depth buffer is encoded into a depth buffer stream. The color image video stream and the depth buffer stream are then transmitted to a remotely located HMD. The HMD then reprojects the color image based on the depth values in the depth buffer.
    Type: Grant
    Filed: February 24, 2020
    Date of Patent: August 30, 2022
    Assignee: Microsoft Technology Licensing, LLC
    Inventor: Christian Voss-Wolff
  • Patent number: 11412200
    Abstract: A method of transmitting three-dimensional (3D) video content, according to an embodiment of the present disclosure, includes: defining a 3D space; obtaining placement information about at least one 3D object to be placed in the 3D space; dividing the at least one 3D object; compressing 3D video content including the divided at least one 3D object into a two-dimensional (2D) video frame; obtaining, from the 2D video frame, location information about compressed data corresponding to the divided at least one 3D object; encoding the 2D video frame; generating a media file including the encoded 2D video frame and the location information; and transmitting the media file.
    Type: Grant
    Filed: January 8, 2020
    Date of Patent: August 9, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Eric Yip, Jaehyeon Bae, Hyunkoo Yang
  • Patent number: 11410430
    Abstract: A surround view system for a vehicle includes a detection unit and an evaluation unit. The detection unit is designed to detect data relating to the surroundings. The evaluation unit is designed to identify an object in the detected surroundings data and to determine the 3D shape of this object. The evaluation unit is additionally designed to add the determined 3D shape to a projection surface of the surround view system to produce a modified projection surface. The evaluation unit is designed to project the surroundings data onto the modified projection surface.
    Type: Grant
    Filed: February 26, 2019
    Date of Patent: August 9, 2022
    Assignee: CONTI TEMIC MICROELECTRONIC GMBH
    Inventors: Martin Buerker, Charlotte Gloger, Andreas Panakos, Frank Kittmann
  • Patent number: 11406339
    Abstract: A system and method are provided for determining vascular velocity using non-invasively acquired medical images. The method includes reconstructing CT angiography (CTA) data into a plurality of images of the subject by producing a composite image using the CTA data corresponding to a set of the plurality of view angles, backprojecting each view angle in the CTA data and weighting a value backprojected into at image pixel by an attenuation value of a corresponding pixel in the composite image, and summing backprojected values for each image pixel to produce a CT image of the subject. The method also includes determining a flow direction or a velocity of flow within a vessel, calculating, using the flow direction or velocity, a pressure in the vessel, and generating a quantitative map of the subject indicating the flow direction, velocity, or pressure in the vessel against an image of the subject including the vessel.
    Type: Grant
    Filed: November 15, 2019
    Date of Patent: August 9, 2022
    Assignee: Wisconsin Alumni Research Foundation
    Inventors: Charles A. Mistretta, Martin Wagner
  • Patent number: 11403813
    Abstract: Systems and methods for generating a three-dimensional (3D) model of a user's dental arch based on two-dimensional (2D) images include a model training system that receives data packets of a training set. Each data packet may include data corresponding to training images of a respective dental arch and a 3D training model of the respective dental arch. The model training system identifies, for a data packet, correlation points between the one or more training images and the 3D training model of the respective dental arch. The model training system generates a machine learning model using the correlation points for the data packets of the training set. A model generation system receives one or more images of a dental arch. The model generation system generates a 3D model of the dental arch by applying the images of the dental arch to the machine learning model.
    Type: Grant
    Filed: November 25, 2020
    Date of Patent: August 2, 2022
    Assignee: SDC U.S. SMILEPAY SPV
    Inventors: Jordan Katzman, Christopher Yancey, Tim Wucher
  • Patent number: 11403820
    Abstract: A method for preemptively generating and rendering a view of a computerized image is provided. The method may include determining rendering parameters for the computerized image by predicting an action to be performed on the computerized image, wherein the action modifies a view of the computerized image, and wherein the determined rendering parameters are based on the modified view of the computerized image. The method may further include preemptively rendering the view of the computerized image that is based on the determined rendering parameters before the action is performed on the computerized image.
    Type: Grant
    Filed: March 11, 2021
    Date of Patent: August 2, 2022
    Inventors: Dustin Michael Sargent, Hui Shen, Sun Young Park
  • Patent number: 11393158
    Abstract: Systems, methods, and non-transitory computer-readable media are disclosed for utilizing an encoder-decoder architecture to learn a volumetric 3D representation of an object using digital images of the object from multiple viewpoints to render novel views of the object. For instance, the disclosed systems can utilize patch-based image feature extraction to extract lifted feature representations from images corresponding to different viewpoints of an object. Furthermore, the disclosed systems can model view-dependent transformed feature representations using learned transformation kernels. In addition, the disclosed systems can recurrently and concurrently aggregate the transformed feature representations to generate a 3D voxel representation of the object. Furthermore, the disclosed systems can sample frustum features using the 3D voxel representation and transformation kernels.
    Type: Grant
    Filed: April 2, 2020
    Date of Patent: July 19, 2022
    Assignee: Adobe Inc.
    Inventors: Tong He, John Collomosse, Hailin Jin
  • Patent number: 11366454
    Abstract: In one example, a representation of a volume of a part to be printed by an additive manufacturing system is generated, where the representation depicts a plurality of voxels. A plurality of slices of the representation are generated. Each slice relates to a plurality of voxels within a first plane. A first process is performed in respect of a slice of the plurality of slices, wherein in the first process at least one voxel that has a predetermined colour and is located on a predetermined surface of the part is identified and a data file is updated to include data representative of the identified at least one voxel. The first process is repeated in respect of another slice. A three-dimensional preview of the part to be printed is generated based on the data file.
    Type: Grant
    Filed: August 20, 2018
    Date of Patent: June 21, 2022
    Assignee: Hewlett-Packard Development Company, L.P.
    Inventors: Sergio Gonzalez Martin, Alex Carruesco Llorens, Arturo Domingo Millan, Matthew A. Shepherd
  • Patent number: 11367190
    Abstract: The disclosure herein relates to systems, methods, and devices for medical image analysis, diagnosis, risk stratification, decision making and/or disease tracking. In some embodiments, the systems, devices, and methods described herein are configured to analyze non-invasive medical images of a subject to automatically and/or dynamically identify one or more features, such as plaque and vessels, and/or derive one or more quantified plaque parameters, such as radiodensity, radiodensity composition, volume, radiodensity heterogeneity, geometry, location, and/or the like. In some embodiments, the systems, devices, and methods described herein are further configured to generate one or more assessments of plaque-based diseases from raw medical images using one or more of the identified features and/or quantified parameters.
    Type: Grant
    Filed: July 5, 2021
    Date of Patent: June 21, 2022
    Assignee: CLEERLY, INC.
    Inventors: James K. Min, James P. Earls, Hugo Miguel Rodrigues Marques, Ben Hootnick
  • Patent number: 11348326
    Abstract: There is provided a display control device including a display controller configured to place a virtual object within an augmented reality space corresponding to a real space in accordance with a recognition result of a real object shown in an image captured by an imaging part, and an operation acquisition part configured to acquire a user operation. When the user operation is a first operation, the display controller causes the virtual object to move within the augmented reality space.
    Type: Grant
    Filed: January 29, 2021
    Date of Patent: May 31, 2022
    Assignee: SONY CORPORATION
    Inventor: Shingo Tsurumi
  • Patent number: 11341687
    Abstract: Disclosed herein is a point cloud data transmission method. The transmission method may include encoding point cloud data, and transmitting point cloud data. Disclosed herein is a point cloud data reception device. Disclosed herein is a point cloud data reception method. The reception method may include receiving point cloud data, decoding the point cloud data, and rendering the point cloud data.
    Type: Grant
    Filed: January 8, 2021
    Date of Patent: May 24, 2022
    Assignee: LG Electronics Inc.
    Inventor: Sejin Oh
  • Patent number: 11335073
    Abstract: Examples disclosed herein relate to selecting a 3D printing parameter based on voxel property association and conflict resolution. In one implementation, a processor assigns properties to a voxel of a 3D print object based on a first and second zone including the voxel and a condition of a first property associated with the first zone and a condition of a second property associated with the second zone. The processor may update the assigned properties to resolve conflicts between the properties and select a 3D printing parameter based on the assigned properties.
    Type: Grant
    Filed: September 26, 2016
    Date of Patent: May 17, 2022
    Assignee: Hewlett-Packard Development Company, L.P.
    Inventors: Jun Zeng, Scott White, Federico Martinez, Ana Del Angel, Gary J. Dispoto, Sebastia Cortes I Herms
  • Patent number: 11315239
    Abstract: Methods and system for guiding user data capture during a scan of a vehicle using a mobile device are disclosed. A user may scan a vehicle using a camera or other sensors of the mobile device to capture data from which a three-dimensional virtual model may be generated. During the scanning process, models may be generated and evaluated according to quality metrics. Visual cues may be determined and presented to the user during scanning to indicate areas sufficiently scanned or areas requiring additional scanning to meet data quality requirements for model generation. Damage to vehicle components may be identified by analysis of the generated model, and addition data capture or user annotation entry may be directed based upon the identified damage.
    Type: Grant
    Filed: May 20, 2020
    Date of Patent: April 26, 2022
    Assignee: State Farm Mutual Automobile Insurance Company
    Inventors: Bryan R. Nussbaum, Rebecca A. Little, Kevin L. Mitchell, Nathan C. Summers, An Ho
  • Patent number: 11313677
    Abstract: A method for automatic surveying of a real word object by a surveying or metrology instrument. It comprises an acquiring of a picture by the surveying or metrology instrument, which picture is comprising the real world object to be surveyed, and an automatic detecting and classifying of the detected real world object to be surveyed in the picture, and also an automatic surveying of the detected real world object by the surveying or metrology instrument for determining a location and/or a geometrical property of the real world object. The automatic detecting and classifying is done with a classifier based on data acquired by machine learning, which machine learning is based on machine learning training data derived from a virtual digital 3d-model which is representing the real world object and which comprises meta information of this 3d-model.
    Type: Grant
    Filed: November 26, 2018
    Date of Patent: April 26, 2022
    Assignee: HEXAGON TECHNOLOGY CENTER GMBH
    Inventors: Bernhard Metzler, Michal Pawel Pryczek
  • Patent number: 11308266
    Abstract: Systems and methods are described for receiving, at a wearable electronic device, a cue to trigger a form-filling mode in which the wearable electronic device includes memory, at least one camera and the at least one processing device. Responsive to receiving the cue, the systems and methods may trigger the at least one camera to capture an image of a physical form where the physical form includes a plurality of fields, and wherein the wearable electronic device uses the image to analyze the plurality of fields, obtain information to complete said fields. The systems and methods may also include detecting a hover input over a respective blank field in the plurality of fields, retrieving, based on the respective blank field and the stored information, a portion of the stored information to fill in the respective blank field, and providing, by the wearable device, the retrieved portion.
    Type: Grant
    Filed: October 20, 2020
    Date of Patent: April 19, 2022
    Assignee: Google LLC
    Inventor: Omar Estrada Diaz
  • Patent number: 11304759
    Abstract: Systems, methods, and media for presenting medical imaging data in an interactive virtual environment reality are provided. In some embodiments, a system comprises a head mounted display (HMD) that: determines that a transparent 3D object overlaps a 3D model of a portion of anatomy based on a medical imaging scan; sets values for pixels corresponding to portions of the 3D model not occluded by the transparent object by performing a shading operation; sets values for pixels corresponding to portions of the 3D model at the boundary of the transparent object to intensity values taken from the medical imaging data; displays the 3D model with an exterior surface shaded to evoke a 3D object, and internal surfaces at the boundaries of the transparent object not shaded to preserve details embedded in the medical imaging data.
    Type: Grant
    Filed: January 28, 2021
    Date of Patent: April 19, 2022
    Assignee: THE BRIGHAM AND WOMEN'S HOSPITAL, INC.
    Inventors: Konstantin Kovtun, Christopher Williams
  • Patent number: 11284861
    Abstract: A first acoustic wave image is displayed in a first display color, and a second acoustic wave image is displayed in a second display color different from the first display color. A group of first menu icons for designating a process to be performed on the first acoustic wave image and a group of second menu icons for designating a process to be performed on the second acoustic wave image are displayed on menu icon display means. The group of first menu icons is displayed in the first display color, and the group of second menu icons is displayed in the second display color.
    Type: Grant
    Filed: August 17, 2018
    Date of Patent: March 29, 2022
    Assignee: FUJIFILM Corporation
    Inventors: Kaku Irisawa, Dai Murakoshi, Tomoki Inoue