Patents Examined by Said Broome
  • Patent number: 11295536
    Abstract: An information processing apparatus includes a processor. The processor is configured to set in three-dimensional space in which plural users are present, an intersection area that is an area in which fields of view of the plural users intersect as a shared area that is an area to be shared by the plural users.
    Type: Grant
    Filed: July 30, 2020
    Date of Patent: April 5, 2022
    Assignee: FUJIFILM Business Innovation Corp.
    Inventor: Atsushi Maruyama
  • Patent number: 11284963
    Abstract: A method for generating and updating a three-dimensional representation of a surgical site based on imaging data from an imaging system is disclosed. The method comprises the steps of generating a first image of the surgical site based on structured electromagnetic radiation emitted from the imaging system, receiving a second image of the surgical site, aligning the first image and the second image, generating a three-dimensional representation of the surgical site based on the first image and the second image as aligned, displaying the three-dimensional representation on a display screen, receiving a user selection to manipulate the three-dimensional representation, and updating the three-dimensional representation as displayed on the display screen from a first state to a second state according to the received user selection.
    Type: Grant
    Filed: December 30, 2019
    Date of Patent: March 29, 2022
    Assignee: Cilag GmbH International
    Inventors: Frederick E. Shelton, IV, Andrew C. Deck, Jason L. Harris, Chad E. Eckert, Daniel J. Mumaw, Kevin M. Fiebig, Sarah A. Worthington
  • Patent number: 11282265
    Abstract: There is provided an image processing apparatus and an image processing method capable of transmitting data of a 3D model in object units. The image processing apparatus includes a 3D model selection unit that selects an object that satisfies a predetermined condition from among objects of a plurality of 3D models and a transmitter that transmits 3D model data of the selected object. The present technology is applied to, for example, an apparatus and the like for transmitting 3D model data of a 3D model via a network.
    Type: Grant
    Filed: June 15, 2018
    Date of Patent: March 22, 2022
    Assignee: SONY CORPORATION
    Inventor: Goh Kobayashi
  • Patent number: 11282238
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. The encoder is configured project the point cloud on to patch planes to compress the point cloud, and supports multiple layered patch planes. For example, some point clouds may have a depth, and points at different depths may be assigned to different layered patch planes.
    Type: Grant
    Filed: September 25, 2020
    Date of Patent: March 22, 2022
    Assignee: Apple Inc.
    Inventors: Khaled Mammou, Yeping Su, David W. Singer, Alexandros Tourapis, Fabrice A. Robinet, Hsi-Jung Wu
  • Patent number: 11263820
    Abstract: A method of operating a computing system to generate a model of an environment represented by a mesh is provided. The method allows to update 3D meshes to client applications in real time with low latency to support on the fly environment changes. The method provides 3D meshes adaptive to different levels of simplification requested by various client applications. The method provides local update, for example, updating the mesh parts that are changed since last update. The method also provides 3D meshes with planarized surfaces to support robust physics simulations. The method includes segmenting a 3D mesh into mesh blocks. The method also includes performing a multi-stage simplification on selected mesh blocks. The multi-stage simplification includes a pre-simplification operation, a planarization operation, and a post-simplification operation.
    Type: Grant
    Filed: October 26, 2020
    Date of Patent: March 1, 2022
    Assignee: Magic Leap, Inc.
    Inventors: David Geoffrey Molyneaux, Frank Thomas Steinbrücker, Zhongle Wu, Xiaolin Wei, Jianyuan Min, Yifu Zhang
  • Patent number: 11257288
    Abstract: Provided are a first DSM generating unit, a ground DEM storing unit, a first DEM generating unit, a 2 m ground DEM storing unit, a first DHM generating unit, a first inclination image generating unit, a first inclination image storing unit, a first red relief image generating unit, a first gradient-tinted image generating unit, a first feature height-based colored image generating unit, a first building height comparison image generating unit, and the like. Accordingly, an image does not look dirty, and an image in which a shape of a feature is outlined clearly is obtained.
    Type: Grant
    Filed: December 5, 2018
    Date of Patent: February 22, 2022
    Assignee: ASIA AIR SURVEY CO., LTD.
    Inventor: Tatsuro Chiba
  • Patent number: 11244496
    Abstract: An information processing device including a control unit that senses a state that causes decrease of a display frame rate of a virtual object presented to a user and dynamically change a display detail level of the virtual object in accordance with a result of the sensing is provided.
    Type: Grant
    Filed: May 10, 2018
    Date of Patent: February 8, 2022
    Assignee: SONY CORPORATION
    Inventors: Jun Kimura, Kazuyuki Yamamoto
  • Patent number: 11244504
    Abstract: In one embodiment, a computing system accesses a plurality of images captured by one or more cameras from a plurality of camera poses. The computing system generates, using the plurality of images, a plurality of semantic segmentations comprising semantic information of one or more objects captured in the plurality of images. The computing system accesses a three-dimensional (3D) model of the one or more objects. The computing system determines, using the plurality of camera poses, a corresponding plurality of virtual camera poses relative to the 3D model of the one or more objects. The computing system generates a semantic 3D model by projecting the semantic information of the plurality of semantic segmentations towards the 3D model using the plurality of virtual camera poses.
    Type: Grant
    Filed: May 3, 2019
    Date of Patent: February 8, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Yu Fan Chen, Richard Andrew Newcombe, Lingni Ma
  • Patent number: 11232628
    Abstract: An image dataset is processed with a shadow map generated from objects in a virtual scene that can cast shadows and the scene is rendered independent of the shadows. The shadow might be edited separately, and then applied to a post-render image of the scene to form a shadowed image. Light factor values for pixels of the shadow map might be stored as summed-area table values.
    Type: Grant
    Filed: March 11, 2021
    Date of Patent: January 25, 2022
    Assignee: Weta Digital Limited
    Inventor: Peter M. Hillman
  • Patent number: 11232623
    Abstract: A method of generating a high-resolution image frame for a state of a video game within a 2D or 3D environment is disclosed. A low-resolution data map of a virtual camera frustum view of the 2D or 3D environment for the state is determined. The data map is of a data type. A high-resolution output data map of the data type is generated from the low-resolution data map. The generating of the high-resolution output data map includes training a neural network. The training includes associating a low-resolution data map of the data type with a high-resolution data map of the data type within the 2D or 3D environment. A high-resolution image of the frustum view is generated from the high-resolution output data map. The generated high-resolution image is displayed on a display device.
    Type: Grant
    Filed: June 26, 2020
    Date of Patent: January 25, 2022
    Assignee: Unity IPR ApS
    Inventor: Dominic Laflamme
  • Patent number: 11219501
    Abstract: A visualization system including multiple light sources, an image sensor configured to detect imaging data from the multiple light sources, and a control circuit is disclosed. At least one of the light sources is configured to emit a pattern of structured light. The control circuit is configured to receive the imaging data from the image sensor, generate a three-dimensional digital representation of the anatomical structure from the pattern of structured light detected by the imaging data, obtain metadata from the imaging data, overlay the metadata on the three-dimensional digital representation, receive updated imaging data from the image sensor, and generate an updated three-dimensional digital representation of the anatomical structure based on the updated imaging data. The visualization system can be communicatively coupled to a situational awareness module configured to determine a surgical scenario based on input signals from multiple surgical devices.
    Type: Grant
    Filed: December 30, 2019
    Date of Patent: January 11, 2022
    Assignee: Cilag GmbH International
    Inventors: Frederick E. Shelton, IV, Jason L. Harris
  • Patent number: 11210849
    Abstract: A computer-implemented method for procedurally simulating braided strands of fibers may include, under the control of one or more computer systems configured with executable instructions, obtaining a set of parameters of the braided strands of the fibers, the set of parameters indicating a braid spine, generating, based at least in part on the set of parameters, a set of interlacing strand spines that follow the braid spine within a tolerance according to the set of parameters, and computing a set of first geometric structures corresponding to the set of interlacing strand spines.
    Type: Grant
    Filed: February 26, 2021
    Date of Patent: December 28, 2021
    Assignee: Weta Digital Limited
    Inventors: Olivier Gourmel, Paolo Selva
  • Patent number: 11205293
    Abstract: An avatar display system in virtual space, an avatar display method in virtual space, and a computer program in which avatar motion data is thinned out within a certain time due to the circumstances of a system and is intermittently distributed. Accordingly, when avatars try to high-touch with each other, the avatars go too far before the hands touch each other in the transmission of coarse motion data, and thus a natural avatar operation cannot be performed. When avatars are intended to perform an operation with contact, such as a high touch operation between the avatars, as the avatars approach each other, a transmission interval in which data required for rendering avatars such as motion data, or rendered avatar data is transmitted from a server to a client terminal is made smaller, and a more natural avatar contact operation can be performed.
    Type: Grant
    Filed: October 29, 2019
    Date of Patent: December 21, 2021
    Assignee: DWANGO CO., LTD.
    Inventors: Takashi Kojima, Hiroaki Saito, Shinnosuke Iwaki
  • Patent number: 11205295
    Abstract: Aspects comprise systems implementing 3-D graphics processing functionality in a multiprocessing system. Control flow structures are used in scheduling instances of computation in the multiporcessing system, where different points in the control flow structure serve as points where deferral of some instances of computation can be performed in favor of scheduling other instances of computation. In some examples, the control flow structure identifies particular tasks, such as intersection testing of a particular portion of an acceleration structure, and a particular element of shading code. In some examples, the aspects are used in 3-D graphics processing systems that can perform ray tracing based rendering.
    Type: Grant
    Filed: November 10, 2015
    Date of Patent: December 21, 2021
    Assignee: Imagination Technologies Limited
    Inventors: Luke T. Peterson, James Alexander McCombe, Ryan R. Salsbury, Steven J. Clohset
  • Patent number: 11200721
    Abstract: An apparatus and method for efficient image reprojection in a virtual reality system. For example, one embodiment of an apparatus comprises: a sensor interface to collect motion data from one or more sensors during a virtual reality session; graphics circuitry to execute graphics program code to render an image frame during the virtual reality session; a processor to generate motion transform data using the motion data, the motion transform data specifying how the image frame is to be adjusted prior to display; a reprojection engine to perform an in-line reprojection of the frame using the motion transform data to generate a reprojected image frame; and display circuitry to display the reprojected frame.
    Type: Grant
    Filed: September 10, 2019
    Date of Patent: December 14, 2021
    Assignee: INTEL CORPORATION
    Inventors: Kyle Anderson, Wesley J. Holland
  • Patent number: 11200689
    Abstract: A system configured to perform an accurate and fast estimation of an object shape from a single input image. The system may process image data representing a first surface of an object using image-to-image translation techniques. A first trained model may generate depth information for the object, such as front distance estimates and back distance estimates. The system may use the depth information to generate an output mesh shaped like the object, such as, in the case of a pliable object a reposable avatar. The system may improve depth estimation by including a loss on surface normals in the first trained model. A second trained model may generate color information to be applied to the output mesh to accurately represent the object. The output mesh may include detailed geometry and appearance of the object, useful for a variety of purposes such as gaming, virtual/augmented reality, virtual shopping, and other implementations.
    Type: Grant
    Filed: June 21, 2019
    Date of Patent: December 14, 2021
    Assignee: Amazon Technologies, Inc.
    Inventors: David Smith, Javier Romero Gonzalez-Nicolas, Xiaochen Hu, Matthew Maverick Loper
  • Patent number: 11178021
    Abstract: A system and method for managing large numbers of computing devices such as cryptocurrency miners in a data center are disclosed. A three-dimensional (3D) model of the data center is created using machine-readable codes. The 3D model includes device and bin location information. Status data is captured from the computing devices, associated with location, stored in a database, and used to populate the 3D model, which is rendered in various two-dimensional and 3D views to provide the user with information helpful in managing the data center.
    Type: Grant
    Filed: December 9, 2019
    Date of Patent: November 16, 2021
    Assignee: Core Scientific, Inc.
    Inventors: Ganesh Balakrishnan, Thomas Fuller, Chandra Ponneganti, Kristy-Leigh Minehan
  • Patent number: 11176759
    Abstract: A computer-implemented method of displaying a subset of a digitally modeled assembly (A) of objects (O1, O2, O3), the method comprising the steps of: a) generating and displaying a three-dimensional graphical representation of the assembly in a three-dimensional scene (3DSC); b) using a graphical tool (PT) for selecting one or more objects of said assembly from said three-dimensional graphical representation; c) determining a central point (CP) of the selected object or objects, and computing a distance of each object of the assembly from said central point; and d) modifying the displayed three-dimensional graphical representation of the assembly by hiding objects whose distance from the central point exceeds a threshold, or reducing their visibility. A computer program product, a non-transitory computer-readable data-storage medium and a Computer Aided Design system for carrying out such a method.
    Type: Grant
    Filed: September 5, 2018
    Date of Patent: November 16, 2021
    Assignee: DASSAULT SYSTEMES
    Inventor: Pierre Coulet
  • Patent number: 11164373
    Abstract: A graphics processing apparatus includes a tessellation circuit and a post-processing circuit. The tessellation circuit performs tessellation processing to subdivide a patch in an image frame into a plurality of triangles. The tessellation circuit further performs triangle striping processing to convert data of the plurality of triangles into data of a triangle strip. The post-processing circuit performs subsequent processing on the data of the triangle strip.
    Type: Grant
    Filed: May 5, 2020
    Date of Patent: November 2, 2021
    Assignee: GlenFly Technology Co., Ltd.
    Inventors: Huaisheng Zhang, Maoxin Sun, Juding Zheng
  • Patent number: 11151684
    Abstract: The described embodiments include systems, methods, and apparatuses for increased efficiency processing flow. One method includes a plurality of stages configured to process an execution graph that includes a plurality of logical nodes with defined properties and resources associated with each logical node of the plurality of logical nodes, a recirculating ring buffer, wherein the recirculating ring buffer is configured to holding only any one of a control information, input, and, or out data necessary to stream a temporary data between each logical node of the execution graph, and a data producer, wherein the data producer is configured to stall from writing control information into a command buffer upon the command buffer being full, preventing command buffer over-writing.
    Type: Grant
    Filed: June 22, 2020
    Date of Patent: October 19, 2021
    Assignee: Blaize, Inc.
    Inventors: Val G. Cook, Satyaki Koneru, Ke Yin, Dinakar C. Munagala