Patents Examined by Hai Tao Sun
  • Patent number: 11127215
    Abstract: An artificial reality system is described that includes a head mounted display (HMD) configured to output artificial reality content and image capture devices configured to capture image data of a peripheral device positioned within a physical environment, where the image data comprises a plurality of successive image frames and the image capture devices capture each image frame during an exposure window of a respective frame period. The artificial reality system further includes a waveform controller configured to program a pulse waveform for a plurality of emitters on a peripheral device, wherein the pulse waveform specifies a pattern by which the plurality of emitters emit light and a pulse emitter synchronizer configured to synchronize the emission of light by the plurality of emitters according to the pulse waveform with the exposure window over the successive image frames from the image capture devices.
    Type: Grant
    Filed: September 20, 2019
    Date of Patent: September 21, 2021
    Assignee: Facebook Technologies, LLC
    Inventors: Mauricio Narvaez, Shreyas Narendra Basarge
  • Patent number: 11119313
    Abstract: An imaging system for producing extended-reality images for a display apparatus. The imaging system including camera that is employed to capture input image representing captured region of real-world environment; and processor configured to: generate intermediate image by correcting spatial distortion of input image; determine capturing region of intermediate image representing captured region of real-world environment and non-capturing regions of intermediate image corresponding to non-captured regions of real-world environment; generate image data for non-capturing region of intermediate image, based on at least one of: information pertaining to virtual object that is to be virtually superimposed, capturing region neighbouring non-capturing region, previous extended-reality image, photogrammetric model of real-world environment; and process intermediate image, based on generated image data, to produce extended-reality image to be presented at display apparatus.
    Type: Grant
    Filed: July 31, 2020
    Date of Patent: September 14, 2021
    Assignee: Varjo Technologies Oy
    Inventor: Mikko Ollila
  • Patent number: 11113885
    Abstract: An immersive content presentation system can capture the motion or position of a performer in a real-world environment. A game engine can be modified to receive the position or motion of the performer and identify predetermined gestures or positions that can be used to trigger actions in a 3-D virtual environment, such as generating a digital effect, transitioning virtual assets through an animation graph, adding new objects, and so forth. The use of the 3-D environment can be rendered and composited views can be generated. Information for constructing the composited views can be streamed to numerous display devices in many different physical locations using a customized communication protocol. Multiple real-world performers can interact with virtual objects through the game engine in a shared mixed-reality experience.
    Type: Grant
    Filed: September 13, 2018
    Date of Patent: September 7, 2021
    Inventors: Roger Cordes, David Brickhill
  • Patent number: 11093264
    Abstract: Systems and methods for managing user input for a remote application session between a client device and a remote server are provided. Input command data is received from a client device for an application executing within a remote session established between the client device and the remote server. The input command data specifies a plurality of points within a graphical user interface where the input command data was captured on the client device. Spline curves are calculated based on a first subset of sequential points from the plurality of points. Simulated input events are generated that specify intermediate points calculated along the spline curves. The simulated input events are injected into the remote server for the application.
    Type: Grant
    Filed: June 14, 2019
    Date of Patent: August 17, 2021
    Assignee: Parallels International GmbH
    Inventors: Ivan Korobov, Dmitry Varentsov, Nikolay Dobrovolskiy
  • Patent number: 11087522
    Abstract: Apparatus and method for asynchronous ray tracing.
    Type: Grant
    Filed: March 15, 2020
    Date of Patent: August 10, 2021
    Assignee: Intel Corporation
    Inventors: Prasoonkumar Surti, Abhishek R. Appu, Karthik Vaidyanathan, Saikat Mandal, Michael Norris
  • Patent number: 11087039
    Abstract: Methods and apparatus for presenting data to a user with augmented reality headgear or augmented reality glasses that has been oriented in a direction based upon unique automated generation of a vector are described. Systems for determining a direction of interest are based upon orientation of an apparatus. Data collection systems such as cameras, stereoscopic cameras, and scanner systems may be included in the augmented reality gear. In combination with a geospatial position, the direction of interest may be referenced in the provision of content via a user interface displayed in a worn augmented reality gear of the user at the site of interest. Updating of model data may be coordinated through the interface of an oriented augmented reality headgear with data collection systems.
    Type: Grant
    Filed: July 1, 2020
    Date of Patent: August 10, 2021
    Assignee: Middle Chart, LLC
    Inventors: Jason E. Duff, Michael S. Santarone, Michael A. Wodrich, Randall Pugh
  • Patent number: 11080864
    Abstract: An example apparatus for tracking features in image data includes an image data receiver to receive initial image data corresponding to an image from a camera and store the image data a circular buffer. The apparatus also includes a feature detector to detect features in the image data. The apparatus further includes a feature sorter to sort the detected features to generate sorted feature points. The apparatus includes a feature tracker to track the sorted feature points in subsequent image data corresponding to the image received at the image data receiver. The subsequent image data is to replace the initial image data in the circular buffer.
    Type: Grant
    Filed: January 8, 2018
    Date of Patent: August 3, 2021
    Assignee: Intel Corporation
    Inventors: Dipan Kumar Mandal, Nagadastagiri Reddy C, Mahesh Mamidipaka, Om J Omer
  • Patent number: 11074739
    Abstract: Methods, devices, media, and other embodiments are described for managing and configuring a pseudorandom animation system and associated computer animation models. One embodiment involves generating image modification data with a computer animation model configured to modify frames of a video image to insert and animate the computer animation model within the frames of the video image, where the computer animation model of the image modification data comprises one or more control points. Motion patterns and speed harmonics are automatically associated with the control points, and motion states are generated based on the associated motions and harmonics. A probability value is then assigned to each motion state. The motion state probabilities can then be used when generating a pseudorandom animation.
    Type: Grant
    Filed: September 30, 2019
    Date of Patent: July 27, 2021
    Assignee: Snap Inc.
    Inventors: Gurunandan Krishnan Gorumkonda, Shree K. Nayar
  • Patent number: 11064889
    Abstract: A method for evaluating fit of an applicator can include receiving on a process first and second sets of digital data representing the target area and at least a portion of the applicator, respectively, digitally overlying the second set of digital data over the first set of digital data; calculating in the target area at a plurality of points of the overlay a separation distance between the sets of data and generating an electronic image that includes a visual depiction of the calculated separation distance.
    Type: Grant
    Filed: August 1, 2019
    Date of Patent: July 20, 2021
    Assignee: The Procter & Gamble Company
    Inventors: Scott Kendyl Stanley, Andrew Paul Rapach, Robert Webbink
  • Patent number: 11048018
    Abstract: Systems, methods, and computer-readable media are provided for a near-well unstructured grid model builder for generating a full-field unstructured grid for reservoir simulation. As described further below, the near-well unstructured grid model builder may include a workflow interface and a parallel unstructured grid model builder. The inputs to the near-well unstructured grid model builder may include existing well trajectory and completion data, future well data, a geological model, a structured grid simulation model, or any combination thereof. The near-well unstructured grid model builder may output a near-well unstructured grid having a specified grid resolution in regions of interest that include a well.
    Type: Grant
    Filed: March 7, 2018
    Date of Patent: June 29, 2021
    Assignee: Saudi Arabian Oil Company
    Inventors: Larry Siu-Kuen Fung, Xiang Yang Ding
  • Patent number: 11049297
    Abstract: A polygon Boolean operation and topology correction algorithm generates valid polygons despite polygon data containing self-intersecting polygons, overlapping polygons, polygons including a chain of holes, and/or polygons including complex intersections. A polygon Boolean operation and topology correction algorithm uses two variants of the Vatti algorithm along with a topology correction algorithm to address problematic areas within input data, such as the overlapping area shared between one or more polygons or a polygon having no area at all. Upon performing a variant of the Vatti algorithm to identify hot pixels within an arrangement of polygons, the polygon Boolean operation and topology correction algorithm runs a second variant of the Vatti algorithm to generate polygons within an integer coordinate system using snap-rounding.
    Type: Grant
    Filed: January 23, 2020
    Date of Patent: June 29, 2021
    Assignee: Mapbox, Inc.
    Inventor: Mackenzie Blake Thompson
  • Patent number: 11037341
    Abstract: Generative shape creation and editing is leveraged in a digital medium environment. An object editor system represents a set of training shapes as sets of visual elements known as “handles,” and converts sets of handles into signed distance field (SDF) representations. A handle processor model is then trained using the SDF representations to enable the handle processor model to generate new shapes that reflect salient visual features of the training shapes. The trained handle processor model, for instance, generates new sets of handles based on salient visual features learned from the training handle set. Thus, utilizing the described techniques, accurate characterizations of a set of shapes can be learned and used to generate new shapes. Further, generated shapes can be edited and transformed in different ways.
    Type: Grant
    Filed: January 15, 2020
    Date of Patent: June 15, 2021
    Assignee: Adobe Inc.
    Inventors: Giorgio Gori, Tamy Boubekeur, Radomir Mech, Nathan Aaron Carr, Matheus Abrantes Gadelha, Duygu Ceylan Aksit
  • Patent number: 11024099
    Abstract: Computer-implemented methods and systems for curating virtual models and populating overlays within a virtual environment are described herein. A server may receive a data request from a user electronic device. The data request may comprise a property of interest located at a particular portion of an overall region. The server may then dynamically acquire a virtual model for rendering the property within a virtual environment at the user electronic device based on the data request. The server may then curate the virtual model in accordance with rules that emphasize features associated with the property that are relevant to assessing risks associated with the property when assessing the property. The server may then identify the curated property modeled by the virtual model, obtain annotation records associated with the features of the property, and populate an annotations overlay rendered in the virtual environment with information included in the annotation records.
    Type: Grant
    Filed: October 17, 2018
    Date of Patent: June 1, 2021
    Assignee: State Farm Mutual Automobile Insurance Company
    Inventors: Rebecca A. Little, Bryan R. Nussbaum, Deanna L. Stockweather, Nathan C. Summers, An Ho, Vicki King
  • Patent number: 11017230
    Abstract: Systems and methods are provided for depicting information about a vehicle in augmented reality. An exemplary method may include determining identification information of a vehicle based on input received from a client device and obtaining, from an information source, vehicle information based on the identification information. The method may also include analyzing the vehicle information using an artificial intelligence engine and extracting vehicle history data from the vehicle information based on the analysis. The method may also include identifying a portion of the vehicle associated with the vehicle history data and providing instructions, based on the vehicle history data, to an augmented reality-enabled device to superimpose an indicator on a visual representation of the vehicle at a location corresponding to the portion of the vehicle.
    Type: Grant
    Filed: January 15, 2019
    Date of Patent: May 25, 2021
    Assignee: Capital One Services, LLC
    Inventors: Satish Chikkaveerappa, Liju Mathews, Ponnazhakan Subramanian
  • Patent number: 11010955
    Abstract: Methods for mapping 3D point cloud data into 2D surfaces are described herein. The methods utilize 3D surface patches to represent point clouds and perform flexible mapping of 3D patch surface data into 2D canvas images. Patches representing geometry and patches representing attributes such as textures are placed in different canvases, where the placement of each patch is done independently for geometry and texture, that is, geometry and texture patches do not need to be co-located, as in conventional point cloud mapping. Furthermore, methods include transformations of the 3D patch when placing it into the 2D canvas, for more efficient packing.
    Type: Grant
    Filed: December 27, 2018
    Date of Patent: May 18, 2021
    Assignee: Sony Group Corporation
    Inventor: Danillo Graziosi
  • Patent number: 11011135
    Abstract: A head-up display has an image generator, an optical system, a transmissive screen and a transparency mask. The transparency mask is arranged close to a display of the image generator. A mask pixel map is applied to the processed image to get a masked image.
    Type: Grant
    Filed: September 25, 2018
    Date of Patent: May 18, 2021
    Assignee: Continental Automotive Systems, Inc.
    Inventors: Andrei Pasca, Ferenc Markus
  • Patent number: 11004255
    Abstract: Examples are disclosed that relate to culling of polygons for efficient rendering of a high-density polygon mesh using one or more compute shaders. Examples include monoscopic and stereoscopic rendering, foveated and non-foveated rendering, and selectively utilizing one or more computer shaders to rasterize very small triangles instead of using a regular rendering pipeline for increased performance.
    Type: Grant
    Filed: April 24, 2019
    Date of Patent: May 11, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Adam Andrzej Cichocki, Marc Schirski, Dag Birger Frommhold
  • Patent number: 11004250
    Abstract: A point cloud data display system includes a target unit including a reflection target, a scanner device configured to acquire point cloud data, a surveying instrument configured to obtain a distance and an angle to the reflection target, measured coordinates and a direction angle of the scanner device, and a display device configured to display data output from the scanner device and the surveying instrument. The scanner device outputs point cloud data in association with an observation point each time of acquisition of the point cloud data. The surveying instrument outputs coordinates, a direction angle of the scanner device at the observation point. When the point cloud data, coordinates and direction angle with respect to the observation point are obtained, the display device converts point cloud data into data in a map coordinate system and displays the converted data on a display unit in association with a map.
    Type: Grant
    Filed: September 17, 2019
    Date of Patent: May 11, 2021
    Inventors: Satoshi Yasutomi, Takahiro Komeichi
  • Patent number: 10997699
    Abstract: The present invention allows to estimate a continuous surface that defines a boundary surface of an object using image data, even if the image data was acquired by an imaging method in which image information on the boundary surface of the object is limited. An image processing apparatus according to the present invention includes a calculating unit that calculates a brightness gradient of a voxel group constituting volume data which represents a reconstructed image, and an estimating unit that estimates by using the brightness gradient a continuous surface which defines a boundary surface of an object corresponding to the volume data.
    Type: Grant
    Filed: June 5, 2019
    Date of Patent: May 4, 2021
    Assignee: Canon Kabushiki Kaisha
    Inventors: Hiroyuki Sekiguchi, Kohtaro Umezawa
  • Patent number: 10997756
    Abstract: When processing a primitive when generating a render output in a graphics processor, the vertices for the primitive are loaded by a vertex loader, but before a primitive setup stage generates per-primitive data for the primitive using the loaded vertices for the primitive, an early culling test is performed for the primitive using data of the loaded vertices for the primitive. When the primitive passes the early culling test, the primitive is sent onwards to the primitive setup stage and to a rasteriser for rasterising the primitive, but when the primitive fails the early culling test, it is discarded from further processing at the early culling test.
    Type: Grant
    Filed: October 21, 2019
    Date of Patent: May 4, 2021
    Assignee: Arm Limited
    Inventor: Olof Henrik Uhrenholt