Patents Examined by Martin Mushambo
  • Patent number: 11475633
    Abstract: A three-dimensional (3D) image dynamic correction evaluation and auxiliary design method for orthotics includes the following steps. 3D scanning information of the human body is obtained. A plurality of 2D images of the human body is obtained for identification, and the pixel values of the 2D images are calculated so as to synthesize an original 3D spine curve. The 2D images of the human body and the 3D scan information are synthesized. An image deformation prediction and correction method of body shape is used to generate a deformed body shape of the human body. A spine material properties and mechanical model prediction method is used to predict parameters of the position, direction and magnitude of the force applied by an orthotics to the human body according to the deformed body shape.
    Type: Grant
    Filed: May 5, 2021
    Date of Patent: October 18, 2022
    Assignee: INDUSTRIAL TECHNOLOGY RESEARCH INSTITUTE
    Inventors: Po-Fu Yen, Zhong-Yi Haung, Shang-Yi Lin, Tian-Li Yu, Tzong-Ming Wu, Tsung-Wen Tsai
  • Patent number: 11468613
    Abstract: Various embodiments provide for systems, methods, and computer-readable storage media for annotating a digital image with a texture fill. An annotation system may receive a user input defining a border separating a first portion of a target digital image from a second portion of the target digital image. The annotation system may then generate a contour mask, such as a binary mask, for the target digital image based on the user-defined border. The annotation system may then apply a media overlay to the target image based on the contour mask. In particular, the contour mask can define portions of the target digital image such that the annotation system will apply a media overlay to at least one of those portions while not applying the media overlay to remaining portions of the target digital image.
    Type: Grant
    Filed: December 10, 2020
    Date of Patent: October 11, 2022
    Assignee: Snap Inc.
    Inventors: Nan Hu, Xing Mei, Chongyang Ma, Kun Duan
  • Patent number: 11467656
    Abstract: Systems, methods and apparatuses of virtual object control of a physical device and/or physical device control of a virtual object are disclosed. In one aspect, embodiments of the present disclosure include a method, which may be implemented on a system, to present a depiction of a virtual object in the augmented reality environment. In the method, one or more functions of the virtual object accessible in the augmented reality environment are used for control of a physical device.
    Type: Grant
    Filed: March 2, 2020
    Date of Patent: October 11, 2022
    Assignee: Magical Technologies, LLC
    Inventor: Nova Spivack
  • Patent number: 11459116
    Abstract: An example system includes a processor and a non-transitory computer-readable medium having stored therein instructions that are executable to cause the system to perform various functions. The functions include: (i) acquiring an image of a first aerial vehicle, the image depicting an object of a second aerial vehicle prior to contact between the object and a surface of the first aerial vehicle; (ii) providing the image as input to a data-driven analyzer that is trained in a supervised setting with example images for determining a predetermined point of contact between the object and the surface of the first aerial vehicle; (iii) determining, based on an output of the data-driven analyzer corresponding to the input, an estimated point of contact between the object and the surface of the first aerial vehicle; and (iv) providing the estimated point of contact to a display system.
    Type: Grant
    Filed: June 24, 2020
    Date of Patent: October 4, 2022
    Assignee: The Boeing Company
    Inventors: Trent M. Kyono, Steven F. Griffin, Jacob A. Lucas, James L. Clayton, Justin C. Hatcher
  • Patent number: 11461644
    Abstract: Fully-supervised semantic segmentation machine learning models are augmented by ancillary machine learning models which generate high-detail predictions from low-detail, weakly-supervised data. The combined model can be trained over both fully- and weakly-supervised data. Only the primary model is required for inference, post-training. The combined model can be made self-correcting during training by adjusting the ancillary model's output based on parameters learned over both the fully- and weakly-supervised data. The self-correction module may combine the output of the primary and ancillary models in various ways, including through linear combinations and via neural networks. The self-correction module and ancillary model may benefit from disclosed pre-training techniques.
    Type: Grant
    Filed: November 13, 2019
    Date of Patent: October 4, 2022
    Assignee: D-WAVE SYSTEMS INC.
    Inventors: Arash Vahdat, Mostafa S. Ibrahim, William G. Macready
  • Patent number: 11461970
    Abstract: An electronic apparatus performs a method of extracting color from a two-dimensional (2D) facial image of a real-life person that includes: identifying a plurality of keypoints in the 2D facial image based on a keypoint prediction model; rotating the 2D facial image until the selected keypoints from the plurality of keypoints are aligned; locating a plurality of parts in the rotated 2D facial image, wherein each part is defined by a respective subset of the plurality of keypoints; extracting, from the pixel values of the 2D facial image, the average color for each of the plurality of the parts defined by a corresponding subset of keypoints; and generating a personalized three-dimensional (3D) model of the real-life person that mimics the respective facial feature color of the 2D facial image using the extracted colors of the plurality of the parts in the 2D facial image.
    Type: Grant
    Filed: March 15, 2021
    Date of Patent: October 4, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Bo Yang, Songrun Liu, Bo Wang
  • Patent number: 11455771
    Abstract: A method of surveying a venue includes scanning at least a portion of the venue using an unmanned aerial vehicle having at least one scanner, converting scan data gathered by the at least one scanner into three-dimensional location data, displaying the three-dimensional location data as a three-dimensional model, analyzing the three-dimensional model, and designating portions of the three-dimensional model with semantic mapping.
    Type: Grant
    Filed: May 15, 2020
    Date of Patent: September 27, 2022
    Assignee: Electronic Theatre Controls, Inc.
    Inventors: Koen Buys, Joshua Jordan, Timothy P. Nolan
  • Patent number: 11455894
    Abstract: Described herein are systems and methods for structure scan using an unmanned aerial vehicle. For example, some methods include accessing a three-dimensional map of a structure; generating facets based on the three-dimensional map, wherein the facets are respectively a polygon on a plane in three-dimensional space that is fit to a subset of the points in the three-dimensional map; generating a scan plan based on the facets, wherein the scan plan includes a sequence of poses for an unmanned aerial vehicle to assume to enable capture, using image sensors of the unmanned aerial vehicle, of images of the structure; causing the unmanned aerial vehicle to fly to assume a pose corresponding to one of the sequence of poses of the scan plan; and capturing one or more images of the structure from the pose.
    Type: Grant
    Filed: June 8, 2020
    Date of Patent: September 27, 2022
    Assignee: Skydio, Inc.
    Inventors: Peter Henry, Jack Zhu, Brian Richman, Harrison Zheng, Hayk Martirosyan, Matthew Donahoe, Abraham Galton Bachrach, Adam Bry
  • Patent number: 11443511
    Abstract: Systems and methods provided for presenting supplemental content in an augmented reality environment where an object within a field of view of an augmented reality device of a user is identified and processed to detect a reference related to a participant in an event. A user profile or user social network is searched to identify a message from the user about the participant. The message may be combined with the object in the augmented reality field of view.
    Type: Grant
    Filed: February 9, 2021
    Date of Patent: September 13, 2022
    Assignee: ROVl GUIDES, INC.
    Inventors: Adam Bates, Jesse F. Patterson, Mark K. Berner, Eric Dorsey, Jonathan A. Logan, David W. Chamberlin, Paul Stevens, Herbert A. Waterman
  • Patent number: 11443467
    Abstract: Automated correlation of process attribute value changes with events related to the changes. A managed historian utilizes a namespace property to correlate process tag values with corresponding events. The managed historian generates and provides to remote user devices a graphical user interface that includes a plot of data values of the process tag and a visual icon representing the event overlaid atop the plot of data values.
    Type: Grant
    Filed: January 20, 2021
    Date of Patent: September 13, 2022
    Assignee: AVEVA SOFTWARE, LLC
    Inventors: Brian Kenneth Erickson, Sripraneeth Kumar Nara, Ravi Kumar Herunde Prakash, Vinay T. Kamath, Abhijit Manushree
  • Patent number: 11436473
    Abstract: API gateway log data of HTTP response information is collected and aggregated for each API service. The log data is streamed and formed into a feature vector. A model training module trains a neural network model based on the feature vector and model metadata. The model training module also retrains the neural network model based on a new feature vector. Neural network model artifacts are stored and used to detect anomalous patterns and generate alerts of the detection.
    Type: Grant
    Filed: September 11, 2019
    Date of Patent: September 6, 2022
    Assignee: Intuit Inc.
    Inventors: Miroslav S. Boussarov, Jason Webb, Laurent Benchimol, Gao Pan
  • Patent number: 11436387
    Abstract: The present disclosure is directed to a software tool that facilitates coordination between various parties that are involved in the process of rectifying a problem identified in a combined three-dimensional model file. In one implementation, the software tool may cause a computing device to (a) receive an indication requesting creation of a coordination issue that relates to a portion of a rendered three-dimensional view of a construction project, (b) in response to the receipt of the indication, create a data set defining the coordination issue, the data set including (i) a representation of the portion of the rendered three-dimensional view, and (ii) data indicating an assignee of the coordination issue, and (c) cause an indication of the coordination issue to be presented to a client station associated with the assignee.
    Type: Grant
    Filed: March 30, 2021
    Date of Patent: September 6, 2022
    Assignee: Procore Technologies, Inc.
    Inventors: Dave McCool, Chris Bindloss
  • Patent number: 11436812
    Abstract: A system automatically identifies objects in an environment based on a walkthrough video and an annotated floorplan of the environment. The annotated floorplan indicates locations and types of objects that are expected to be in the environment. The system receives the walkthrough video and generates a 3D model of the environment. The system applies a machine learning model to the walkthrough video to identify regions within frames where objects are captured. After identifying the regions within frames of the walkthrough video that include objects, the system modifies corresponding regions of the 3D model to include the identified objects. For each of the identified objects, the system determines a likelihood of the identified object being present at a location in the environment based on a comparison of the modified 3D model and the annotated floorplan.
    Type: Grant
    Filed: April 8, 2021
    Date of Patent: September 6, 2022
    Assignee: OPEN SPACE LABS, INC.
    Inventors: Michael Ben Fleischman, Gabriel Hein, Thomas Friel Allen, Abraham Botros
  • Patent number: 11430181
    Abstract: In one implementation, a method of enriching a three-dimensional scene model with a three-dimensional object model based on a semantic label is performed at a device including one or more processors and non-transitory memory. The method includes obtaining a three-dimensional scene model of a physical environment including a plurality of points, wherein each of the plurality of points is associated with a set of coordinates in a three-dimensional space, wherein a subset of the plurality of points is associated with a particular cluster identifier and a particular semantic label. The method includes retrieving a three-dimensional object model based on the particular semantic label, the three-dimensional object model including at least a plurality of points. The method includes updating the three-dimensional scene model by replacing the subset of the plurality of points with the three-dimensional object model.
    Type: Grant
    Filed: January 26, 2021
    Date of Patent: August 30, 2022
    Assignee: Apple Inc.
    Inventor: Payal Jotwani
  • Patent number: 11423595
    Abstract: A system and method is provided for generating a modified Cartesian representation of received data. In some aspects, a Cartesian graph may be transformed to form a modified Cartesian representation by connecting a first end and second end of the Cartesian graph. In further aspects, a pattern may be overlaid over the modified Cartesian representation to produce an artistic representation.
    Type: Grant
    Filed: December 8, 2020
    Date of Patent: August 23, 2022
    Assignee: Google LLC
    Inventors: Tyler Gough, Philip Dam Roadley-Battin, Seth Benson, Curtis Flanagan, Richard Lee Marks
  • Patent number: 11418628
    Abstract: A communication terminal shares data with another communication terminal. The communication terminal includes circuitry. The circuitry receives, from a communication management apparatus that manages the data shared with the another communication terminal, storage location information representing a storage location of background image data transmitted from the another communication terminal, and transmits a download request to an image storing apparatus corresponding to the storage location to request download of the background image data. The circuitry further starts downloading the background image data from the image storing apparatus and receives, from the communication management apparatus, stroke data of a stroke image rendered on the another communication terminal.
    Type: Grant
    Filed: January 5, 2021
    Date of Patent: August 16, 2022
    Assignee: RICOH COMPANY, LTD.
    Inventors: Hideki Shiro, Shigeru Nakamura, Yuichi Kawasaki, Hiroshi Hinohara, Takeshi Homma
  • Patent number: 11417069
    Abstract: An object and camera localization system and localization method for mapping of the real world. The mapping can be done in real-time or near real-time to the detection of the real objects by a camera device which is used to capture one or more images of an object. The localization method can be used to generate an object label of the object and a bounding box of the object in the image. The localization method can be used to generate anchor points in real world coordinates of the real 3D space of the object, a cuboid of the object, and a centroid of the cuboid. A virtual 3D map can be generated that which includes the location and pose of the real object in the real-world coordinates.
    Type: Grant
    Filed: October 5, 2021
    Date of Patent: August 16, 2022
    Assignee: AWE Company Limited
    Inventors: Neetika Gupta, Srinivas Krishna, Laura Thomas, Daniel Chantal Mills, Naimul Mefraz Khan
  • Patent number: 11416962
    Abstract: Methods and apparatus relating to techniques for power management. In an example, an apparatus comprises logic, at least partially comprising hardware logic, to receive one or more frames for a workload, determine one or more compute resource parameters for the workload, and store the one or more compute resource parameters for the workload in a memory in association with workload context data for the workload. Other embodiments are also disclosed and claimed.
    Type: Grant
    Filed: March 24, 2021
    Date of Patent: August 16, 2022
    Assignee: INTEL CORPORATION
    Inventors: Balaji Vembu, Josh B. Mastronarde, Altug Koker, Nikos Kaburlasos, Abhishek R. Appu, Joydeep Ray
  • Patent number: 11403848
    Abstract: The present disclosure relates to an augmented reality (AR) enabled electronic device and method. The electronic device includes a camera, a display, touch input circuitry, a motion sensor, and a processor. The processor implements the method, including acquiring a preview image captured by the at least one camera, setting an object area and/or a space area in the preview image, displaying the acquired preview image on the display, detecting an input to the display using the touch input circuitry, determining whether the detected input requests application of an object-based drawing or a space-based drawing, and applying the object-based drawing or the space-based drawing to the to the acquired preview image according to the detected input.
    Type: Grant
    Filed: July 21, 2020
    Date of Patent: August 2, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Daiwoong Choi, Hyunjin Kim, Hongil Kim, Laejung Park, Byungjun Son, Sanghun Lee, Jiyoon Park
  • Patent number: 11403817
    Abstract: This specification describes systems and methods for refining point cloud data. Methods can include receiving point cloud data for a physical space, iteratively selecting points along an x, y, and z dimension, clustering the selected points into 2D histograms, determining a slope value for each 2D histogram, and removing, based on the slope value exceeding a predetermined value, points from the point cloud data. Methods can also include iteratively voxelizing each 2D histogram into predetermined mesh sizes, summating points in each voxelized 2D histogram, removing, based on determining the summation is below a predetermined sum value, points from the point cloud data, keeping, based on determining that a number of points in each voxelized 2D histogram exceeds a threshold value, a center point, selecting, for each histogram, a point, identifying, nearest neighbors in the point cloud data, removing the identified nearest neighbors from the data, and returning remaining points.
    Type: Grant
    Filed: April 14, 2021
    Date of Patent: August 2, 2022
    Assignee: Lineage Logistics, LLC
    Inventors: Christopher Frank Eckman, Brady Michael Lowe, Alexander Hall