Patents Examined by Xuemei G Chen
  • Patent number: 11538143
    Abstract: Systems and methods for detecting anomaly in video data are provided. The system includes a generator that receives past video frames and extracts spatio-temporal features of the past video frames and generates frames. The generator includes fully convolutional transformer based generative adversarial networks (FCT-GANs). The system includes an image discriminator that discriminates generated frames and real frames. The system also includes a video discriminator that discriminates generated video and real video. The generator trains a fully convolutional transformer network (FCTN) model and determines an anomaly score of at least one test video based on a prediction residual map from the FCTN model.
    Type: Grant
    Filed: October 24, 2019
    Date of Patent: December 27, 2022
    Inventors: Dongjin Song, Yuncong Chen, Haifeng Chen, Xinyang Feng
  • Patent number: 11531743
    Abstract: A system of enhancing biometric analysis matching utilizes an image sensor, such as a digital camera, to capture an image of a face of a person. The system may perform image enhancement, such as edge and contrast enhancement, prior to performing face matching. The enhancement may be localized to a given image region based on determined region illumination. The system may perform image processing and analysis comprising face detection, alignment, feature extraction, and recognition. A biometric recognition confidence indicator may be generated using the results of the image enhancement and analysis. At least partly in response to the biometric recognition confidence indicator falling below a threshold enhancing recognition confidence using an image of visual indicia captured using the image sensor.
    Type: Grant
    Filed: February 1, 2022
    Date of Patent: December 20, 2022
    Assignee: Flash Seats, LLC
    Inventors: Michael J. Rojas, Benjamin Charles Cohen, Andrew Michael Rosenbaum
  • Patent number: 11526971
    Abstract: The present disclosure provides a computer-implemented method for translating an image and a computer-implemented method for training an image translation model. In the computer-implemented method for translating an image, an image translation request carrying an original image is obtained. The original image is processed to generate a pre-translated image, a mask image and a deformation parameter. The original image is deformed based on the deformation parameter to obtain a deformed image. The deformed image, the pre-translated image and the mask image are merged to generate a target translated image.
    Type: Grant
    Filed: November 30, 2020
    Date of Patent: December 13, 2022
    Assignee: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
    Inventors: Shaoxiong Yang, Chen Zhao
  • Patent number: 11527891
    Abstract: Waveforms in power grids typically reveal a certain pattern with specific features and peculiarities driven by the system operating conditions, internal and external uncertainties, etc. This prompts an observation of different types of waveforms at the measurement points (substations). An innovative next-generation smart sensor technology includes a measurement unit embedded with sophisticated analytics for power grid online surveillance and situational awareness. The smart sensor brings additional levels of smartness into the existing phasor measurement units (PMUs) and intelligent electronic devices (IEDs). It unlocks the full potential of advanced signal processing and machine learning for online power grid monitoring in a distributed paradigm.
    Type: Grant
    Filed: November 30, 2019
    Date of Patent: December 13, 2022
    Assignee: The George Washington University
    Inventors: Payman Dehghanian, Shiyuan Wang
  • Patent number: 11514311
    Abstract: A method, apparatus and a computer program product for automated data slicing based on an Artificial Neural Network (ANN). The method comprising: obtaining an ANN, wherein the ANN is configured to provide a prediction for a data instance, wherein the ANN comprises a set of nodes having interconnections therebetween; determining an attribute vector based on a subset of the nodes of the ANN; determining, based on the attribute vector, a plurality of data slices; obtaining a testing dataset comprising testing data instances; computing, for each data slice, a performance measurement of the ANN over the data slice, wherein said computing is based on an application of the ANN on each testing data instance that is mapped to the data slice; and performing an action based on at least a portion of the performance measurements of the data slices.
    Type: Grant
    Filed: July 3, 2019
    Date of Patent: November 29, 2022
    Assignee: International Business Machines Corporation
    Inventors: Rachel Brill, Eitan Farchi, Orna Raz, Aviad Zlotnick
  • Patent number: 11508050
    Abstract: A method for performing automatic visual inspection includes: capturing visual information of an object using a scanning system including a plurality of cameras; extracting, by a computing system including a processor and memory, one or more feature maps from the visual information using one or more feature extractors; classifying, by the computing system, the object by supplying the one or more feature maps to a complex classifier to compute a classification of the object, the complex classifier including: a plurality of simple classifiers, each simple classifier of the plurality of simple classifiers being configured to compute outputs representing a characteristic of the object; and one or more logical operators configured to combine the outputs of the simple classifiers to compute the classification of the object; and outputting, by the computing system, the classification of the object as a result of the automatic visual inspection.
    Type: Grant
    Filed: December 19, 2019
    Date of Patent: November 22, 2022
    Assignee: PACKSIZE LLC
    Inventors: Carlo Dal Mutto, Francesco Peruch, Alexander Ou, Robert Hayes
  • Patent number: 11508037
    Abstract: A method for denoising an image includes: receiving, by a processing circuit of a user equipment, an input image; supplying, by the processing circuit, the input image to a trained convolutional neural network (CNN) including a multi-scale residual dense block (MRDB), the MRDB including: a residual dense block (RDB); and an atrous spatial pyramid pooling (ASPP) module; computing, by the processing circuit, an MRDB output feature map using the MRDB; and computing, by the processing circuit, an output image based on the MRDB output feature map, the output image being a denoised version of the input image.
    Type: Grant
    Filed: September 2, 2020
    Date of Patent: November 22, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Zengli Yang, Long Bao, Shuangquan Wang, Dongwoon Bai, Jungwon Lee
  • Patent number: 11488375
    Abstract: A method for performing illumination color prediction on an image in a neural network model, comprising: inputting an image to the neural network model; extracting a semantic-based illumination color feature of the image and a statistical rule-based illumination color feature of the image; and predicting an illumination color of the image according to the semantic-based illumination color feature and the statistical rule-based illumination color feature.
    Type: Grant
    Filed: June 30, 2020
    Date of Patent: November 1, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Qiao Wang
  • Patent number: 11468542
    Abstract: This disclosure addresses the single-image compressive sensing (CS) and reconstruction problem. A scalable Laplacian pyramid reconstructive adversarial network (LAPRAN) facilitates high-fidelity, flexible and fast CS image reconstruction. LAPRAN progressively reconstructs an image following the concept of the Laplacian pyramid through multiple stages of reconstructive adversarial networks (RANs). At each pyramid level, CS measurements are fused with a contextual latent vector to generate a high-frequency image residual. Consequently, LAPRAN can produce hierarchies of reconstructed images and each with an incremental resolution and improved quality. The scalable pyramid structure of LAPRAN enables high-fidelity CS reconstruction with a flexible resolution that is adaptive to a wide range of compression ratios (CRs), which is infeasible with existing methods.
    Type: Grant
    Filed: January 17, 2020
    Date of Patent: October 11, 2022
    Assignee: ARIZONA BOARD OF REGENTS ON BEHALF OF ARIZONA STATE UNIVERSITY
    Inventors: Fengbo Ren, Kai Xu, Zhikang Zhang
  • Patent number: 11460394
    Abstract: The present invention provides a corrosive environment monitoring method capable of short-term to long-term identification of the type of corrosive gas, without requiring a power source such as a commercial power source or a storage battery, in a narrow place inside an equipment housing of an electric or electronic device to be evaluated.
    Type: Grant
    Filed: January 29, 2019
    Date of Patent: October 4, 2022
    Assignee: Hitachi, Ltd.
    Inventor: Rintarou Minamitani
  • Patent number: 11461881
    Abstract: A method for processing images comprising: capturing a plurality of degraded images of a first real-world environment with a first sensor; processing each degraded image with a first, untrained convolutional neural network, via a Deep Image Prior approach, to obtain a plurality of clean images, wherein each clean image corresponds to a degraded image; pairing each clean image with its corresponding degraded image to create a plurality of degraded/clean image pairs; training, via a supervised learning approach, a machine learning model to learn a function for converting degraded images into restored images based on the plurality of degraded/clean image pairs; capturing a second plurality of degraded images of a second real-world environment; and using the trained machine learning model to convert the second plurality of degraded images into restored images based on the learned function.
    Type: Grant
    Filed: November 25, 2020
    Date of Patent: October 4, 2022
    Assignee: United States of America as represented by the Secretary of the Navy
    Inventors: Shibin Parameswaran, Martin Thomas Jaszewski
  • Patent number: 11455813
    Abstract: Systems and methods are provided for producing a road layout model. The method includes capturing digital images having a perspective view, converting each of the digital images into top-down images, and conveying a top-down image of time t to a neural network that performs a feature transform to form a feature map of time t. The method also includes transferring the feature map of the top-down image of time t to a feature transform module to warp the feature map to a time t+1, and conveying a top-down image of time t+1 to form a feature map of time t+1. The method also includes combining the warped feature map of time t with the feature map of time t+1 to form a combined feature map, transferring the combined feature map to a long short-term memory (LSTM) module to generate the road layout model, and displaying the road layout model.
    Type: Grant
    Filed: November 12, 2020
    Date of Patent: September 27, 2022
    Inventors: Buyu Liu, Bingbing Zhuang, Samuel Schulter, Manmohan Chandraker
  • Patent number: 11455518
    Abstract: Systems and methods are described for user classification with semi-supervised machine learning. The systems and methods may include receiving user information for a first set of users, receiving survey data for a second set of users wherein the second set of users is a proper subset of the first set of users, training a first neural network and a second neural network based on the second set of users, mapping the user information for the first set of users to the embedding space using the first neural network, predicting category membership propensities for the first set of users using a low-density separation algorithm on the user information for the first set of users mapped to the embedding space, updating the first neural network and the second neural network based on the prediction, and reclassifying the first set of users based on the updated first neural network and the updated second neural network.
    Type: Grant
    Filed: November 12, 2019
    Date of Patent: September 27, 2022
    Assignee: ADOBE INC.
    Inventors: Michael Burkhart, Kyle Shan
  • Patent number: 11449702
    Abstract: The present disclosure relates to a system, method and non-transitory computer readable medium for reverse image searching. The system includes a storage device storing a set of instructions; and one or more processors in communication with the storage device. When executing the set of instructions, the one or more processors: obtain a target part of reference image features of a reference image; obtain a target part of target image features of a target image; determine, based on the target part of the reference image features and the target part of the target image features, whether the target image is similar to the reference image; and mark, upon a determination that the target image is similar to the reference image, the target image as a similar image of the reference image.
    Type: Grant
    Filed: January 22, 2020
    Date of Patent: September 20, 2022
    Assignee: ZHEJIANG DAHUA TECHNOLOGY CO., LTD.
    Inventor: Yufei Chen
  • Patent number: 11443170
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a neural network. One of the methods includes obtaining a batch of labeled training items and a batch of unlabeled training items; processing the labeled training items and the unlabeled training items using the neural network and in accordance with current values of the network parameters to generate respective embeddings; determining a plurality of similarity values, each similarity value measuring a similarity between the embedding for a respective labeled training item and the embedding for a respective unlabeled training item; determining a respective roundtrip path probability for each of a plurality of roundtrip paths; and performing an iteration of a neural network training procedure to determine a first value update to the current values of the network parameters that decreases roundtrip path probabilities for incorrect roundtrip paths.
    Type: Grant
    Filed: November 15, 2017
    Date of Patent: September 13, 2022
    Assignee: Google LLC
    Inventors: Philip Haeusser, Alexander Mordvintsev
  • Patent number: 11443414
    Abstract: A method of optimising an image signal processor (ISP), which is to be used to process sensor image data generating output image data. The method may include obtaining sensor image data; processing the sensor image data according to one or more ISP settings to produce output image data; producing quality metric data associated with the output image data and optimising the one or more ISP settings based on the quality metric data.
    Type: Grant
    Filed: October 20, 2020
    Date of Patent: September 13, 2022
    Assignee: Arm Limited
    Inventors: Maxim Novikov, James Stuart Imber, Yury Khrustalev, David Hanwell
  • Patent number: 11429824
    Abstract: A system, article, and method of deep supervision object detection for reducing resource usage is provided for image processing and that uses depth-wise dense blocks.
    Type: Grant
    Filed: September 11, 2018
    Date of Patent: August 30, 2022
    Assignee: Intel Corporation
    Inventors: Jianguo Li, Jiuwei Li, Yuxi Li
  • Patent number: 11410309
    Abstract: The present disclosure provides a computer-implemented method, a device, and a computer program product for deep lesion tracker. The method includes inputting a search image into a first three-dimensional DenseFPN (feature pyramid network) of an image encoder and inputting a template image into a second three-dimensional DenseFPN of the image encoder to extract image features; encoding anatomy signals of the search image and the template image as Gaussian heatmaps, and inputting the Gaussian heatmap of the template image into a first anatomy signal encoders (ASE) and inputting the Gaussian heatmap of the search image into a second ASE to extract anatomy features; inputting the image features and the anatomy features into a fast cross-correlation layer to generate correspondence maps, and computing a probability map according to the correspondence maps; and performing supervised learning or self-supervised learning to predict a lesion center in the search image.
    Type: Grant
    Filed: March 26, 2021
    Date of Patent: August 9, 2022
    Assignee: PING AN TECHNOLOGY (SHENZHEN) CO., LTD.
    Inventors: Jinzheng Cai, Youbao Tang, Ke Yan, Adam P Harrison, Le Lu
  • Patent number: 11410281
    Abstract: A processor performing postprocessing obtains an input image containing both bright and dark regions. The processor obtains a threshold between a first pixel value of the virtual production display and a second pixel value of the virtual production display. The processor modifies the region according to predetermined steps producing a pattern unlikely to occur within the input image, where the pattern corresponds to a difference between the original pixel value and the threshold. The processor can replace the region of the input image with the pattern to obtain a modified image. The virtual production display can present the modified image. A processor performing postprocessing detects the pattern within the modified image displayed on the virtual production display. The processor calculates the original pixel value of the region by reversing the predetermined steps. The processor replaces the pattern in the modified image with the original pixel value.
    Type: Grant
    Filed: November 30, 2021
    Date of Patent: August 9, 2022
    Assignee: Unity Technologies SF
    Inventors: Joseph W. Marks, Luca Fascione, Kimball D. Thurston, III, Millie Maier, Kenneth Gimpelson, Dejan Momcilovic, Keith F. Miller, Peter M. Hillman, Jonathan S. Swartz
  • Patent number: 11393248
    Abstract: Disclosed are a data detection method and device, a computer equipment, and a storage medium. The method includes: obtaining a designated identification picture including a human face; correcting the designated identification picture to be placed in a preset standard posture to obtain an intermediate picture; inputting the intermediate picture into a preset face feature point detection model to obtain multiple face feature points; calculating a cluster center position of the face feature points, and generating a minimum bounding rectangle of the face feature points; retrieving a standard identification picture from a preset database; scaling the standard identification picture in proportion to obtain a scaled picture; overlapping a reference center position in the scaled picture and a cluster center position in the intermediate picture, so as to obtain an overlapping part in the intermediate picture; and marking the overlapping part as an identification body of the designated identification picture.
    Type: Grant
    Filed: June 29, 2020
    Date of Patent: July 19, 2022
    Assignee: PING AN TECHNOLOGY (SHENZHEN) CO., LTD.
    Inventor: Jinlun Huang