Patents Examined by Ping Y Hsieh
  • Patent number: 11410546
    Abstract: Systems and methods determining velocity of an object associated with a three-dimensional (3D) scene may include: a LIDAR system generating two sets of 3D point cloud data of the scene from two consecutive point cloud sweeps; a pillar feature network encoding data of the point cloud data to extract two-dimensional (2D) bird's-eye-view embeddings for each of the point cloud data sets in the form of pseudo images, wherein the 2D bird's-eye-view embeddings for a first of the two point cloud data sets comprises pillar features for the first point cloud data set and the 2D bird's-eye-view embeddings for a second of the two point cloud data sets comprises pillar features for the second point cloud data set; and a feature pyramid network encoding the pillar features and performing a 2D optical flow estimation to estimate the velocity of the object.
    Type: Grant
    Filed: May 18, 2020
    Date of Patent: August 9, 2022
    Assignee: TOYOTA RESEARCH INSTITUTE, INC.
    Inventors: Kuan-Hui Lee, Matthew T. Kliemann, Adrien David Gaidon
  • Patent number: 11398097
    Abstract: A target detection method based on the fusion of prior positioning of a millimeter-wave radar and a visual feature includes: simultaneously obtaining, based on the millimeter-wave radar and a vehicle-mounted camera after being calibrated, point cloud data of the millimeter-wave radar and a camera image; performing spatial 3D coordinate transformation on the point cloud data to project transformed point cloud data onto a camera plane; generating a plurality of anchor samples based on projected point cloud data according to a preset anchor strategy, and obtaining a final anchor sample based on a velocity-distance weight of each candidate region; fusing RGB information of the camera image and intensity information of an RCS in the point cloud data to obtain a feature of the final sample; and inputting the feature of the final anchor sample into a detection network to generate category and position information of a target in a scenario.
    Type: Grant
    Filed: December 13, 2021
    Date of Patent: July 26, 2022
    Assignee: BEIHANG UNIVERSITY
    Inventors: Xinyu Zhang, Li Wang, Yilong Ren, Haiyang Yu, Rentao Sun, Zhiwei Li, Yunpeng Wang
  • Patent number: 11397974
    Abstract: The present disclosure relates to method and system for assessing quality of commodities. An image of bulk commodity is captured and segmented into one or more segmented images for classification into one of predefined categories of commodities. The method and system classify the commodities based on generalized features created from training images. One or more features in the training images are determined and grouped to obtain the generalized features. A feature score and corresponding weightage score of the generalized feature is then determined to estimate a predetermined regression score. Based on the generalized features and predetermined regression score, a likelihood score of the segmented image is determined that enables the classification of the input image to one of the predefined categories of commodities.
    Type: Grant
    Filed: April 6, 2018
    Date of Patent: July 26, 2022
    Assignee: NEBULAA INNOVATIONS PRIVATE LIMITED
    Inventors: Tanmay Sethi, Mohit Dadhich, Yogesh Kumar Gupta, Tapish Rathore
  • Patent number: 11398043
    Abstract: Systems and methods for generating depth models and depth maps from images obtained from an imaging system are presented. A self-supervised neural network may be capable of regularizing depth information from surface normals. Rather than rely on separate depth and surface normal networks, surface normal information is extracted from the depth information and a smoothness function is applied to the surface normals instead of a depth gradient. Smoothing the surface normal may provide improved representation of environmental structures by both smoothing texture-less areas while preserving sharp boundaries between structures.
    Type: Grant
    Filed: June 26, 2020
    Date of Patent: July 26, 2022
    Assignee: TOYOTA RESEARCH INSTITUTE, INC.
    Inventors: Vitor Guizilini, Adrien David Gaidon, Rares A. Ambrus
  • Patent number: 11392635
    Abstract: Computer-implemented methods and systems for image analysis of multiband images of geographic regions are described, including a method by one or more computer executing executable instructions stored in one or more non-transitory, tangible, computer readable media, the method comprising: receiving one or more multiband image of a geographic region, the one or more multiband image having pixels; generating a grey level co-occurrence matrix for the pixels in the one or more multiband image; generating a surface index for the one or more multiband image containing information indicative of a surface type represented by one or more of the pixels in the one or more multiband image; and classifying the pixels of the one or more multiband image into one of a group of predefined land cover classes, based on the surface index in combination with the grey level co-occurrence matrix.
    Type: Grant
    Filed: August 3, 2020
    Date of Patent: July 19, 2022
    Assignee: OmniEarth, Inc.
    Inventors: Jonathan Fentzke, Shadrian Strong, David Murr, Lars Dyrud
  • Patent number: 11379968
    Abstract: An inspection system includes an acquisition unit and a determination unit. The acquisition unit acquires an image representing a surface of an object. The determination unit performs color determination processing. The color determination processing is performed to determine a color of the surface of the object based on a plurality of conditions of reflection. The plurality of conditions of reflection are obtained from the image representing the surface of the object as acquired by the acquisition unit, and have a specular reflection component and a diffuse reflection component at respectively different ratios on the surface of the object.
    Type: Grant
    Filed: December 7, 2018
    Date of Patent: July 5, 2022
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Takanobu Ojima, Jeffry Fernando, Hideto Motomura
  • Patent number: 11380084
    Abstract: Systems and methods for image classification include receiving imaging data of in-vivo or excised tissue of a patient during a surgical procedure. Local image features are extracted from the imaging data. A vocabulary histogram for the imaging data is computed based on the extracted local image features. A classification of the in-vivo or excised tissue of the patient in the imaging data is determined based on the vocabulary histogram using a trained classifier, which is trained based on a set of sample images with confirmed tissue types.
    Type: Grant
    Filed: February 11, 2020
    Date of Patent: July 5, 2022
    Inventors: Ali Kamen, Shanhui Sun, Terrence Chen, Tommaso Mansi, Alexander Michael Gigler, Patra Charalampaki, Maximilian Fleischer, Dorin Comaniciu
  • Patent number: 11379718
    Abstract: Methods, systems and computer program products for improving ground truth quality for modeling are provided. Aspects include receiving a plurality of data inputs, wherein each of the plurality of data inputs has an associated label. Aspects also include training a model based on the plurality of data inputs. Aspects also include generating a plurality of vector representations corresponding to the plurality of data inputs based on the model. Aspects also include clustering the plurality of vector representations into one or more clusters. Aspects also include identifying at least one anomalous data input based on the one or more clusters. The at least one anomalous data input can be a data input of the plurality of data inputs that is mislabeled, contributes to an ambiguous class structure or is an outlier. Aspects also include outputting a notification that provides an indication of the at least one anomalous data input.
    Type: Grant
    Filed: December 10, 2019
    Date of Patent: July 5, 2022
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Michael Desmond, Matthew Arnold, Jeffrey Scott Boston
  • Patent number: 11379693
    Abstract: Systems and methods are described, and an example method includes a training an artificial intelligence (AI) classifier of electromagnetic (EM) scanned items, including obtaining a training set of sample raw EM scans. The set includes a population of sample in-class raw EM scans, which include blocks of EM sensor data from EM scans of regions having in-class objects, and the set includes a population of sample not-in-class raw EM scans, which include blocks of EM sensor data from EM scan of regions without in-class objects. The example includes applying the AI classifier to sample raw EM scans in the training set, measuring errors in the results, and updating classifier parameters based on the errors, until detecting a training completion state.
    Type: Grant
    Filed: November 2, 2021
    Date of Patent: July 5, 2022
    Assignee: The Government of the United States of America, as represented by the Secretary of Homeland Security
    Inventor: Mark A. Fry
  • Patent number: 11379722
    Abstract: The disclosure provides a method for training generative adversarial network (GAN), a method for generating images by using GAN, and a computer readable storage medium. The method may train the first generator of the GAN with available training samples belonging to the first type category and share the knowledge learnt by the first generator to the second generator. Accordingly, the second generator may learn to generate (fake) images belonging to the second type category even if there are no available training data during training the second generator.
    Type: Grant
    Filed: May 22, 2020
    Date of Patent: July 5, 2022
    Assignee: HTC Corporation
    Inventors: Edward Chang, Che-Han Chang, Chun-Hsien Yu, Szu-Ying Chen
  • Patent number: 11374612
    Abstract: A printed circuit board includes a mounting surface, a transceiver mounted on the mounting surface and configured to process radio-frequency signals, and a radio-frequency module mounted on the mounting surface in communication with the transceiver, the radio-frequency module including an interface including M inputs and N outputs, each of the quantities M and N greater than 1, the interface configured so that each of at least two of the M inputs is coupled to a separate output through a separate switch.
    Type: Grant
    Filed: June 1, 2020
    Date of Patent: June 28, 2022
    Assignee: Skyworks Solutions, Inc.
    Inventor: Ryan Weichih Ku
  • Patent number: 11373313
    Abstract: An image processing method executed by an image includes acquiring image data, acquiring region of interest data indicating a targeted region in recognition processing for an object included in the image data, acquiring information of a candidate region based on a degree of being similar to an object included in the image data, estimating an object region in the acquired image data based on the region of interest data and the information of a candidate, performing a preview display of a plurality of candidate images to be cropped on a display unit by using information of the estimate object region, and receiving a selection by a user from among the plurality of displayed candidate images. Cropping is performed on the image data that corresponds to the candidate image, for a received selection.
    Type: Grant
    Filed: July 29, 2020
    Date of Patent: June 28, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventor: Masaaki Obayashi
  • Patent number: 11373290
    Abstract: A monitoring system implements a method for versatile and efficient training of a machine learning-based model for subsequent detection and grading of deviations in packaging containers for liquid food in a manufacturing plant. The method comprises creating a virtual model of a packaging container or of a starting material for use in producing the packaging container; obtaining probability distributions for features that are characteristic of a deviation type; producing reproductions of the virtual model with deviations included among the reproductions in correspondence with the probability distributions; associating gradings with the reproductions; and inputting the reproductions and the associated gradings for training of the machine learning-based model for subsequent detection and grading of an actual deviation in image data acquired in the manufacturing plant.
    Type: Grant
    Filed: June 15, 2020
    Date of Patent: June 28, 2022
    Assignee: Tetra Laval Holdings & Finance S.A.
    Inventors: Peter Johannesson, Erik Bergvall
  • Patent number: 11367206
    Abstract: In order to provide monocular depth prediction, a trained neural network may be used. To train the neural network, edge detection on a digital image may be performed to determine at least one edge of the digital image, and then a first point and a second point of the digital image may be sampled, based on the at least one edge. A relative depth between the first point and the second point may be predicted, and the neural network may be trained to perform monocular depth prediction using a loss function that compares the predicted relative depth with a ground truth relative depth between the first point and the second point.
    Type: Grant
    Filed: February 13, 2020
    Date of Patent: June 21, 2022
    Assignee: ADOBE INC.
    Inventors: Zhe Lin, Oliver Wang, Mai Long, Ke Xian, Jianming Zhang
  • Patent number: 11361424
    Abstract: This neural network-type image processing device is provided with an input layer which comprises one unit where an input image is inputted, an output layer which comprises one unit where an output image is outputted, and multiple intermediate layers which are arranged between the input layer and the output layer and each of which comprises multiple units, the unit of the input layer, the units of the intermediate layers, and the unit of the output layer are fully connected with connection coefficients. The units of the intermediate layers are image processing modules which perform image processing on the image inputted to said units. The input image is inputted from the unit of the input layer, passes through the units of the intermediate layers, and is then outputted as an output image from the unit of the output layer; the connection coefficients are updated with learning based on a backpropagation algorithm.
    Type: Grant
    Filed: February 20, 2019
    Date of Patent: June 14, 2022
    Assignee: OMRON Corporation
    Inventor: Yoshihisa Ijiri
  • Patent number: 11361423
    Abstract: An artificial intelligence (AI) based system for detecting defects in infrastructure uses an image recognizer and image data. A set of annotated training and validation data is generated to train and validate the image recognizer. The image data is annotated with classification data such as defect type and severity of the defect. Once trained and validated, the image recognizer can analyze inspection images to identify detects therein and generate an output report including the identification and classification of the defect, and remediation recommendations.
    Type: Grant
    Filed: June 17, 2020
    Date of Patent: June 14, 2022
    Assignee: RecognAIse Technologies Inc.
    Inventors: Janos Csaba Toth, David Stefan Hauser, Attila Daniel Toth, Melinda Meszaros
  • Patent number: 11361222
    Abstract: A cascaded system for classifying an image includes a first cascade layer including a first analysis module coupled to a first input terminal, and a first pooling module coupled to the first analysis module; a second cascade layer including a second analysis module coupled to a second input terminal, and a second pooling module coupled to the first pooling module and the second analysis module; a synthesis layer coupled to the second pooling module, and an activation layer coupled to the synthesis layer.
    Type: Grant
    Filed: June 20, 2019
    Date of Patent: June 14, 2022
    Assignee: BOE TECHNOLOGY GROUP CO., LTD.
    Inventors: Pablo Navarrete Michelini, Dan Zhu, Hanwen Liu
  • Patent number: 11354817
    Abstract: Systems and methods are provided for estimating the 3D joint location of skeleton joints from an image segment of an object and a 2D joint heatmaps comprising 2D locations of skeleton joints on the image segment. This includes applying the image segment and 2D joint heatmaps to a convolutional neural network containing at least one 3D convolutional layer block, wherein the 2D resolution is reduced at each 3D convolutional layer and the depth resolution is expanded to produce an estimated depth for each joint. Combining the 2D location of each kind of joint with the estimated depth of the kind of joint generates an estimated 3D joint position of the skeleton joint.
    Type: Grant
    Filed: December 14, 2021
    Date of Patent: June 7, 2022
    Assignee: HINGE HEALTH, INC.
    Inventors: Colin Brown, Louis Harbour
  • Patent number: 11354541
    Abstract: The present specification discloses a method, apparatus, and device for video frame interpolation.
    Type: Grant
    Filed: March 7, 2019
    Date of Patent: June 7, 2022
    Assignee: PEKING UNIVERSITY SHENZHEN GRADUATE SCHOOL
    Inventors: Ronggang Wang, Haoxian Zhang, Zhenyu Wang, Wen Gao
  • Patent number: 11354892
    Abstract: A computer system for verifying hail damage and/or detecting hail fraud includes a processor and a non-transitory, tangible, computer-readable storage medium having instructions stored thereon that, in response to execution by the processor, cause the processor to perform operations including: (i) receiving at least one image of at least a portion of a rooftop; (ii) analyzing the at least one image to identify a plurality of damaged locations; (iii) analyzing damaged locations to determine a shape and a size of each of the damaged locations; and (vi) determining, based upon the analyzing, whether the damaged locations are a result of hail damage by comparing the shape and the size of at least one damaged location to the shape and the size of at least one other damaged location.
    Type: Grant
    Filed: August 10, 2020
    Date of Patent: June 7, 2022
    Assignee: STATE FARM MUTUAL AUTOMOBILE INSURANCE COMPANY
    Inventor: Brian N. Harvey