Patents Examined by Said Broome
  • Patent number: 11219501
    Abstract: A visualization system including multiple light sources, an image sensor configured to detect imaging data from the multiple light sources, and a control circuit is disclosed. At least one of the light sources is configured to emit a pattern of structured light. The control circuit is configured to receive the imaging data from the image sensor, generate a three-dimensional digital representation of the anatomical structure from the pattern of structured light detected by the imaging data, obtain metadata from the imaging data, overlay the metadata on the three-dimensional digital representation, receive updated imaging data from the image sensor, and generate an updated three-dimensional digital representation of the anatomical structure based on the updated imaging data. The visualization system can be communicatively coupled to a situational awareness module configured to determine a surgical scenario based on input signals from multiple surgical devices.
    Type: Grant
    Filed: December 30, 2019
    Date of Patent: January 11, 2022
    Assignee: Cilag GmbH International
    Inventors: Frederick E. Shelton, IV, Jason L. Harris
  • Patent number: 11210849
    Abstract: A computer-implemented method for procedurally simulating braided strands of fibers may include, under the control of one or more computer systems configured with executable instructions, obtaining a set of parameters of the braided strands of the fibers, the set of parameters indicating a braid spine, generating, based at least in part on the set of parameters, a set of interlacing strand spines that follow the braid spine within a tolerance according to the set of parameters, and computing a set of first geometric structures corresponding to the set of interlacing strand spines.
    Type: Grant
    Filed: February 26, 2021
    Date of Patent: December 28, 2021
    Assignee: Weta Digital Limited
    Inventors: Olivier Gourmel, Paolo Selva
  • Patent number: 11205295
    Abstract: Aspects comprise systems implementing 3-D graphics processing functionality in a multiprocessing system. Control flow structures are used in scheduling instances of computation in the multiporcessing system, where different points in the control flow structure serve as points where deferral of some instances of computation can be performed in favor of scheduling other instances of computation. In some examples, the control flow structure identifies particular tasks, such as intersection testing of a particular portion of an acceleration structure, and a particular element of shading code. In some examples, the aspects are used in 3-D graphics processing systems that can perform ray tracing based rendering.
    Type: Grant
    Filed: November 10, 2015
    Date of Patent: December 21, 2021
    Assignee: Imagination Technologies Limited
    Inventors: Luke T. Peterson, James Alexander McCombe, Ryan R. Salsbury, Steven J. Clohset
  • Patent number: 11205293
    Abstract: An avatar display system in virtual space, an avatar display method in virtual space, and a computer program in which avatar motion data is thinned out within a certain time due to the circumstances of a system and is intermittently distributed. Accordingly, when avatars try to high-touch with each other, the avatars go too far before the hands touch each other in the transmission of coarse motion data, and thus a natural avatar operation cannot be performed. When avatars are intended to perform an operation with contact, such as a high touch operation between the avatars, as the avatars approach each other, a transmission interval in which data required for rendering avatars such as motion data, or rendered avatar data is transmitted from a server to a client terminal is made smaller, and a more natural avatar contact operation can be performed.
    Type: Grant
    Filed: October 29, 2019
    Date of Patent: December 21, 2021
    Assignee: DWANGO CO., LTD.
    Inventors: Takashi Kojima, Hiroaki Saito, Shinnosuke Iwaki
  • Patent number: 11200689
    Abstract: A system configured to perform an accurate and fast estimation of an object shape from a single input image. The system may process image data representing a first surface of an object using image-to-image translation techniques. A first trained model may generate depth information for the object, such as front distance estimates and back distance estimates. The system may use the depth information to generate an output mesh shaped like the object, such as, in the case of a pliable object a reposable avatar. The system may improve depth estimation by including a loss on surface normals in the first trained model. A second trained model may generate color information to be applied to the output mesh to accurately represent the object. The output mesh may include detailed geometry and appearance of the object, useful for a variety of purposes such as gaming, virtual/augmented reality, virtual shopping, and other implementations.
    Type: Grant
    Filed: June 21, 2019
    Date of Patent: December 14, 2021
    Assignee: Amazon Technologies, Inc.
    Inventors: David Smith, Javier Romero Gonzalez-Nicolas, Xiaochen Hu, Matthew Maverick Loper
  • Patent number: 11200721
    Abstract: An apparatus and method for efficient image reprojection in a virtual reality system. For example, one embodiment of an apparatus comprises: a sensor interface to collect motion data from one or more sensors during a virtual reality session; graphics circuitry to execute graphics program code to render an image frame during the virtual reality session; a processor to generate motion transform data using the motion data, the motion transform data specifying how the image frame is to be adjusted prior to display; a reprojection engine to perform an in-line reprojection of the frame using the motion transform data to generate a reprojected image frame; and display circuitry to display the reprojected frame.
    Type: Grant
    Filed: September 10, 2019
    Date of Patent: December 14, 2021
    Inventors: Kyle Anderson, Wesley J. Holland
  • Patent number: 11178021
    Abstract: A system and method for managing large numbers of computing devices such as cryptocurrency miners in a data center are disclosed. A three-dimensional (3D) model of the data center is created using machine-readable codes. The 3D model includes device and bin location information. Status data is captured from the computing devices, associated with location, stored in a database, and used to populate the 3D model, which is rendered in various two-dimensional and 3D views to provide the user with information helpful in managing the data center.
    Type: Grant
    Filed: December 9, 2019
    Date of Patent: November 16, 2021
    Assignee: Core Scientific, Inc.
    Inventors: Ganesh Balakrishnan, Thomas Fuller, Chandra Ponneganti, Kristy-Leigh Minehan
  • Patent number: 11176759
    Abstract: A computer-implemented method of displaying a subset of a digitally modeled assembly (A) of objects (O1, O2, O3), the method comprising the steps of: a) generating and displaying a three-dimensional graphical representation of the assembly in a three-dimensional scene (3DSC); b) using a graphical tool (PT) for selecting one or more objects of said assembly from said three-dimensional graphical representation; c) determining a central point (CP) of the selected object or objects, and computing a distance of each object of the assembly from said central point; and d) modifying the displayed three-dimensional graphical representation of the assembly by hiding objects whose distance from the central point exceeds a threshold, or reducing their visibility. A computer program product, a non-transitory computer-readable data-storage medium and a Computer Aided Design system for carrying out such a method.
    Type: Grant
    Filed: September 5, 2018
    Date of Patent: November 16, 2021
    Inventor: Pierre Coulet
  • Patent number: 11164373
    Abstract: A graphics processing apparatus includes a tessellation circuit and a post-processing circuit. The tessellation circuit performs tessellation processing to subdivide a patch in an image frame into a plurality of triangles. The tessellation circuit further performs triangle striping processing to convert data of the plurality of triangles into data of a triangle strip. The post-processing circuit performs subsequent processing on the data of the triangle strip.
    Type: Grant
    Filed: May 5, 2020
    Date of Patent: November 2, 2021
    Assignee: GlenFly Technology Co., Ltd.
    Inventors: Huaisheng Zhang, Maoxin Sun, Juding Zheng
  • Patent number: 11151684
    Abstract: The described embodiments include systems, methods, and apparatuses for increased efficiency processing flow. One method includes a plurality of stages configured to process an execution graph that includes a plurality of logical nodes with defined properties and resources associated with each logical node of the plurality of logical nodes, a recirculating ring buffer, wherein the recirculating ring buffer is configured to holding only any one of a control information, input, and, or out data necessary to stream a temporary data between each logical node of the execution graph, and a data producer, wherein the data producer is configured to stall from writing control information into a command buffer upon the command buffer being full, preventing command buffer over-writing.
    Type: Grant
    Filed: June 22, 2020
    Date of Patent: October 19, 2021
    Assignee: Blaize, Inc.
    Inventors: Val G. Cook, Satyaki Koneru, Ke Yin, Dinakar C. Munagala
  • Patent number: 11145110
    Abstract: In examples, the number of rays used to sample lighting conditions of a light source in a virtual environment with respect to particular locations in the virtual environment may be adapted to scene conditions. An additional ray(s) may be used for locations that tend to be associated with visual artifacts in rendered images. A determination may be made on whether to cast an additional ray(s) to a light source for a location and/or a quantity of rays to cast. To make the determination variables such as visibilities and/or hit distances of ray-traced samples of the light source may be analyzed for related locations in the virtual environment, such as those in a region around the location (e.g., within an N-by-N kernel centered at the location). Factors may include variability in visibilities and/or hit distances, differences between visibilities and/or hit distances relative to the location, and magnitudes of hit distances.
    Type: Grant
    Filed: March 18, 2020
    Date of Patent: October 12, 2021
    Assignee: NVIDIA Corporation
    Inventor: Jonathan Paul Story
  • Patent number: 11138715
    Abstract: A method for determining experience quality of virtual reality (VR) multimedia includes, in a process of playing VR multimedia, obtaining a first sensory parameter, a second sensory parameter, and a third sensory parameter of the VR multimedia, where the first sensory parameter, the second sensory parameter, and the third sensory parameter are obtained by performing sampling separately according to at least two same perceptual dimensions, and are respectively parameters that affect fidelity experience, enjoyment experience, and interaction experience, and determining a mean opinion score (MOS) of the VR multimedia based on the first sensory parameter, the second sensory parameter, and the third sensory parameter of the VR multimedia. Because the third sensory parameter is a parameter that affects the interaction experience, an interaction feature of the VR multimedia is considered.
    Type: Grant
    Filed: November 8, 2019
    Date of Patent: October 5, 2021
    Inventors: Yi Li, Haoping Yu
  • Patent number: 11120301
    Abstract: Machine learning vision systems rely on very large numbers of training images to learn to recognize particular shapes and configurations of shapes. Traditionally, such datasets of training images needed to be selected and tagged (or labelled) manually. To recognize a particular object, such as a dog or vehicle, under realistic settings with an acceptable degree of reliability, may require data sets of thousands of images per object class. To improve this, a method is provided to generate datasets with a multiplicity of corresponding images are generated using a 3D rendering engine using a plurality of lighting arrangements and a plurality of views. Artefacts may also be introduced. In this way, very large data sets become feasible, with a variable degree of correspondence in each data set.
    Type: Grant
    Filed: June 6, 2019
    Date of Patent: September 14, 2021
    Assignee: Mastercard International Incorporated
    Inventor: Robert Collins
  • Patent number: 11120522
    Abstract: A method for graphics processing. The method including rendering graphics for an application using graphics processing units (GPUs). The method including using the plurality of GPUs in collaboration to render an image frame including a plurality of pieces of geometry. The method including during the rendering of the image frame, subdividing one or more of the plurality of pieces of geometry into smaller pieces, and dividing the responsibility for rendering these smaller portions of geometry among the plurality of GPUs, wherein each of the smaller portions of geometry is processed by a corresponding GPU. The method including for those pieces of geometry that are not subdivided, dividing the responsibility for rendering the pieces of geometry among the plurality of GPUs, wherein each of these pieces of geometry is processed by a corresponding GPU.
    Type: Grant
    Filed: February 3, 2020
    Date of Patent: September 14, 2021
    Assignee: Sony Interactive Entertainment Inc.
    Inventor: Mark E. Cerny
  • Patent number: 11120621
    Abstract: Systems, methods, devices, and non-transitory media of the various embodiments enable for updating a point cloud, such as a two-and-a-half-dimensional (2.5D) point cloud. Various embodiments include receiving two point clouds, such as a base point cloud of a terrain area and a new point cloud of the terrain area, and fusing the received two point clouds to generate an up-to-date point cloud, such as an up-to-date point cloud model of the terrain. Various embodiments may be especially useful in generating models of terrain areas, such as construction sites, earthwork projects, shorelines, etc., surveyed by surveying technologies, such as drone-based aerial photogrammetry systems, Light Detection and Ranging (LiDAR) systems, etc.
    Type: Grant
    Filed: November 20, 2020
    Date of Patent: September 14, 2021
    Assignee: CESIUM GS, INC
    Inventors: Sean Lilley, Kangning Li
  • Patent number: 11107274
    Abstract: A data-driven, object-oriented, and customizable method for visualizing a three-dimensional (3D) structure is disclosed which includes receiving a model-based data file including instantiation of elements of a structure, identifying one or more instances of one or more objects, providing data associated with the plurality of polygons for the object geometry to a visualization engine, providing data associated with the plurality of polygons for the object placement information to the visualization engine, providing data associated with the plurality of polygons for the object color and transparency information to the visualization engine, providing data associated with the plurality of polygons for the object functional information to the visualization engine, generating a 3D model of the object based on the plurality of polygons, and outputting a rendering of the 3D model for displaying on a digital display.
    Type: Grant
    Filed: September 17, 2019
    Date of Patent: August 31, 2021
    Assignee: Purdue Research Foundation
    Inventor: Jiansong Zhang
  • Patent number: 11107273
    Abstract: In a computing environment comprising a plurality of equipment racks wherein each equipment rack comprises one or more of compute, storage and network assets, the method captures an image of at least one equipment rack in the computing environment. The method identifies a known object in the image to determine physical characteristics of the equipment rack. The method receives, from a peer-to-peer network, positioning beacon signals respectively associated with at least a portion of the compute, storage and network assets in and around the equipment rack. The method determines a closest asset among the portion of the compute, storage and network assets for which positioning beacon signals are received. The method obtains data indicative of physical characteristics associated with the closest asset, obtains a model of the computing environment based on the obtained data, and then obtains a three-dimensional map of the computing environment based on the model.
    Type: Grant
    Filed: August 2, 2019
    Date of Patent: August 31, 2021
    Assignee: EMC IP Holding Company LLC
    Inventors: James R. King, Nicole Reineke
  • Patent number: 11107227
    Abstract: Distance measurements are received from one or more distance measurement sensors, which may be coupled to a vehicle. A three-dimensional (3D) point cloud are generated based on the distance measurements. In some cases, 3D point clouds corresponding to distance measurements from different distance measurement sensors may be combined into one 3D point cloud. A voxelized model is generated based on the 3D point cloud. An object may be detected within the voxelized model, and in some cases may be classified by object type. If the distance measurement sensors are coupled to a vehicle, the vehicle may avoid the detected object.
    Type: Grant
    Filed: February 19, 2020
    Date of Patent: August 31, 2021
    Assignee: GM Cruise Holdings, LLC
    Inventors: Sandeep Gangundi, Sarthak Sahu, Nathan Harada, Phil Ferriere
  • Patent number: 11102520
    Abstract: An image display method includes displaying an integrated video in which videos of a scene from different viewpoints are arranged in a frame, the videos including at least one real video and at least one virtual video generated from the at least one real video. A first user interface into which a first operation is input is displayed. Viewpoints of the displayed videos are changed according to the first operation. A second user interface into which a second operation is input is displayed. A playing speed of the displayed videos is changed according to the second operation.
    Type: Grant
    Filed: October 24, 2019
    Date of Patent: August 24, 2021
    Inventors: Satoshi Yoshikawa, Toshiyasu Sugio, Toru Matsunobu, Tatsuya Koyama
  • Patent number: 11094119
    Abstract: A method is provided, comprising: preventing rendering of specific audio in a virtual space to a user through virtual reality; enabling the user to explore the virtual space through user-perspective controlled virtual reality without hearing the specific audio; and in response to an interrupt, performing a visual transition to audio-visual content comprising the specific audio and visual content associated with the specific audio and then rendering specific audio and the visual content associated with the specific audio in the virtual space to the user through virtual reality.
    Type: Grant
    Filed: February 20, 2018
    Date of Patent: August 17, 2021
    Inventors: Lasse Laaksonen, Miikka Vilermo, Arto Lehtiniemi, Mikko Tammi