Patents Examined by Sumati Lefkowitz
  • Patent number: 11928891
    Abstract: Systems and methods for adapting physical activities and exercises based on facial analysis by image processing are disclosed. A method includes: identifying, by a computer device, a user; receiving, by the computer device, video data of a face region of the user while the user is engaged in exercise or physical activity; analyzing, by the computer device, the video data to determine a detected state of the user, wherein the analyzing the video data includes performing facial analysis using the video data; and providing, by the computer device, feedback to the user based on the analyzing the video data.
    Type: Grant
    Filed: November 8, 2019
    Date of Patent: March 12, 2024
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Rogerio Abreu de Paula, Juliana de Melo Batista dos Santos, Andrea Britto Mattos Lima
  • Patent number: 11915467
    Abstract: Example solutions provide saliency for anchor-based object detection, and include: performing, with an object detector, a first object detection process on an image, wherein the first object detection process employs a plurality of anchor boxes; identifying an object detection result for the image; determining, from among the plurality of anchor boxes, a first anchor box associated with the object detection result; and while limiting the object detector to the first anchor box, generating, with the object detector, a saliency map for the image. In some examples, the saliency map is used for selecting further training data for the object detector. In some examples, the saliency map comprises a gradient-based saliency map, and is used for auditing or debugging the object detector.
    Type: Grant
    Filed: August 11, 2022
    Date of Patent: February 27, 2024
    Assignee: Microsoft Technology Licensing, LLC.
    Inventor: James Brian Hall
  • Patent number: 11908160
    Abstract: A method of detecting an object in an image using a convolutional neural network (CNN) includes generating, based on the image, a plurality of reference feature maps and a corresponding feature pyramid including a plurality of final feature maps; obtaining a proposed region of interest (ROI); generating at least a first context ROI having an area larger than an area of the proposed ROI; assigning the proposed ROI and the first context ROI to a first and second final feature maps having different sizes; extracting, by performing ROI pooling, a first set of features from the first final feature map using the proposed ROI and a second set of features from the second final feature map using the first context ROI; and determining, based on the first and second sets of extracted features, at least one of a location of the object and a class of the object.
    Type: Grant
    Filed: October 12, 2018
    Date of Patent: February 20, 2024
    Assignee: NOKIA TECHNOLOGIES OY
    Inventor: Jing Nie
  • Patent number: 11908149
    Abstract: Provided is a system configured to obtain a set of images via a camera of the computing device, input the set of images into a neural network, and detect a target physical object with the neural network. The system may determine a contour of the target physical object and a first three-dimensional reconstruction of the target physical object. The system may generate a virtual representation and a virtual object based on attributes of the virtual representation, where a first attribute of the set of attributes includes the first three-dimensional reconstruction. The system may associate the virtual object with the virtual representation and displays the virtual object at pixel coordinates of a display that at least partially occlude at least part of the target physical object, where a position of the virtual object is computed based on the contour.
    Type: Grant
    Filed: October 12, 2020
    Date of Patent: February 20, 2024
    Inventor: Andrew Thomas Busey
  • Patent number: 11900686
    Abstract: Techniques for improving image processing related to item deliveries are described. In an example, a computer system receives an image showing a drop-off of an item, the item associated with a delivery to a delivery location. The computer system inputs the image to a first artificial intelligence (AI) model. The computer system receives first data comprising an indication of whether the drop-off is correct from the first AI model. The computer system causes a presentation of the indication at a device associated with the delivery of the item to the delivery location.
    Type: Grant
    Filed: November 4, 2020
    Date of Patent: February 13, 2024
    Assignee: Amazon Tecnologies, Inc.
    Inventors: Zheshen Wang, Dimitris Papadimitriou, Mehran Kafai, Jarrod Sherwin, Anthony Sharma
  • Patent number: 11900706
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for tracking objects of interest using distance-based thresholding. One of the methods includes detecting an object depicted in an image captured by a camera, determining a predicted physical distance between the object and the camera, selecting, from a plurality of predetermined confidence thresholds, a confidence threshold for the predicted physical distance, each confidence threshold in the plurality of predetermined confidence thresholds for a different physical distance range, the confidence threshold having a physical distance range that includes the predicted physical distance, and determining, using the confidence threshold and a confidence score that indicates a likelihood that the object is an object of interest, that the object is likely an object of interest.
    Type: Grant
    Filed: September 24, 2020
    Date of Patent: February 13, 2024
    Assignee: ObjectVideo Labs, LLC
    Inventors: Gang Qian, Allison Beach, Sima Taheri, Sravanthi Bondugula, Sung Chun Lee, Narayanan Ramanathan
  • Patent number: 11869230
    Abstract: A computer-implemented method of forecasting the semantic output of at least one frame, the method comprising the steps of receiving the input frames from a camera up to a predetermined time, processing via a down-sampling module of a neural network the plurality of input frames to receive a plurality of feature tensors, determining spatio-temporal correlations between the plurality of feature tensors, processing the plurality of feature tensors and the spatio-temporal correlations to receive at least one forecasted feature tensor, and processing via an up-sampling module of the neural network the at least one forecasted feature to receive at least one forecasted semantic output for a time larger than the predetermined time.
    Type: Grant
    Filed: June 4, 2021
    Date of Patent: January 9, 2024
    Assignee: RIMAC AUTOMOBILES LTD.
    Inventors: Tonci Antunovic, Marin Orsic, Josip Saric, Sinisa Segvic, Sacha Vrazic
  • Patent number: 11854259
    Abstract: Aspects of the subject technology relate to determining a holdup measurement based on a gamma spectrum through machine learning. A spectral image based on a gamma spectrum generated downhole in a wellbore can be accessed. A component of a holdup measurement for the wellbore can be classified into a specific quantized level through application of a machine learning classification model to the spectral image. A continuous value for the component of the holdup measurement for the wellbore can be quantified by applying a machine learning quantization model associated with the quantized level.
    Type: Grant
    Filed: December 30, 2021
    Date of Patent: December 26, 2023
    Assignee: HALLIBURTON ENERGY SERVICES, INC.
    Inventors: Mayir Mamtimin, Jeffrey James Crawford, Weijun Guo
  • Patent number: 11835997
    Abstract: A system for determining a location of a lighting fixture in a venue includes a camera and a controller. The camera captures images of the lighting fixture. The controller is operatively coupled to the camera. The controller designates a first position of the camera, receives a first image of the lighting fixture from the camera in the first position, determines a first distance vector between the first position and the lighting fixture based on the first image, designates a second position of the camera, receives a second image of the lighting fixture from the camera in the second position, determines a second distance vector between the second position and the lighting fixture based on the second image, determines a vector relationship location to be a location nearest both the first distance vector and the second distance vector, and designates the vector relationship location as the location of the lighting fixture.
    Type: Grant
    Filed: September 22, 2020
    Date of Patent: December 5, 2023
    Assignee: Electronic Theatre Controls, Inc.
    Inventors: Matt Halberstadt, Josh Jordan, Zoe Wolter, Dennis Varian, Lowell Olcott
  • Patent number: 11830167
    Abstract: A system and a method for super-resolution image processing in remote sensing are disclosed. One or more sets of multi-temporal images with an input resolution and one or more first target images with a first output resolution are generated from one or more data sources. The first output resolution is higher than the input resolution. Each set of multi-temporal images is processed to improve an image match in the corresponding set of multi-temporal images. The one or more sets of multi-temporal images are associated with the one or more first target images to generate a training dataset. A deep learning model is trained using the training dataset. The deep learning model is provided for subsequent super-resolution image processing.
    Type: Grant
    Filed: June 21, 2021
    Date of Patent: November 28, 2023
    Inventors: Yuchuan Gou, Juihsin Lai, Mei Han
  • Patent number: 11823045
    Abstract: An encoding apparatus is provided. The apparatus comprises an input unit operable to obtain a plurality of training images, said training images being for use in training a machine learning model. The apparatus also comprises a label unit operable to obtain a class label associated with the training images; and a key unit operable to obtain a secret key for use in encoding the training images. The apparatus further comprises an image noise generator operable to generate, based on the obtained secret key, noise for introducing into the training images. The image noise generator is configured to generate noise that correlates with the class label associated with the training images such that a machine learning model subsequently trained with the modified training images learns to associate the introduced noise with the class label for those images. A corresponding decoding apparatus is also provided.
    Type: Grant
    Filed: October 20, 2020
    Date of Patent: November 21, 2023
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Mark Jacobus Breugelmans, Oliver Hume, Fabio Cappello, Nigel John Williams
  • Patent number: 11810333
    Abstract: A method and an apparatus for generating an image are provided. The method includes: acquiring a screenshot of a webpage preloaded by a terminal as a source image; recognizing connection areas in the source image, and generating first circumscribed rectangular frames outside outlines of the connection areas; combining, in response to determining that a distance between the connection areas is smaller than a preset distance threshold, the connection areas, and generating a second circumscribed rectangular frame outside outlines of the combined connection areas; and generating, based on a nested relationship between the first circumscribed rectangular frames and the second circumscribed rectangular frames and pictures in the first circumscribed rectangular frames, a target image. The first circumscribed rectangular frames and the second circumscribed rectangular frame are respectively generated by recognizing and combining the connection areas in the source image.
    Type: Grant
    Filed: March 19, 2021
    Date of Patent: November 7, 2023
    Assignee: Baidu Online Network Technology (Beijing) Co., Ltd.
    Inventors: Yang Jiao, Yi Yang, Jianguo Wang, Yi Li, Xiaodong Chen, Lin Liu, Xiang He, Yanfeng Zhu
  • Patent number: 11803941
    Abstract: A method for removing fringe noise in an image includes: acquiring an original image; acquiring an original frequency spectrum of one-dimensional signal of the original image; determining a noise frequency band in the original frequency spectrum, and the noise frequency band is a frequency band including a central frequency of the fringe noise; denoising the noise frequency band to obtain a denoised frequency spectrum, wherein a denoising intensity used in the denoising is gradually increased from a start frequency position of the noise frequency band, and the denoising intensity is gradually reduced from the central frequency until a stop frequency position of the noise frequency band; and generating a denoised image according to the denoised frequency spectrum.
    Type: Grant
    Filed: September 23, 2020
    Date of Patent: October 31, 2023
    Assignee: BOE TECHNOLOGY GROUP CO., LTD.
    Inventor: Guannan Chen
  • Patent number: 11790646
    Abstract: A method for human-object interaction detection includes receiving an image. A set of features are extracted from multiple positions of the image. One or more human-object pairs may be predicted based on the extracted set of features. A human-object interaction may be determined based on a set of candidate interactions and the predicted human-object pairs.
    Type: Grant
    Filed: June 25, 2021
    Date of Patent: October 17, 2023
    Assignee: QUALCOMM Technologies, Inc.
    Inventors: Mert Kilickaya, Arnold Wilhelmus Maria Smeulders
  • Patent number: 11776110
    Abstract: In a setting mode, a processor stores in a memory a reference image for pattern search, measurement location information indicating a plurality of measurement locations, and imaging setting information indicating at which magnification imaging is performed. In a measurement mode, the processor controls an imaging section, acquires a target image for pattern search, executes a pattern search on the target image using the reference image, specifies a plurality of imaging positions for imaging each of the plurality of measurement locations based on the measurement location information and a result of the pattern search, causes the imaging section to perform imaging at a magnification set for each measurement location, and measures a dimension of the measurement location.
    Type: Grant
    Filed: February 6, 2020
    Date of Patent: October 3, 2023
    Assignee: KEYENCE CORPORATION
    Inventor: Koji Takahashi
  • Patent number: 11776288
    Abstract: A target object detection model is provided. The target object detection model includes a YOLOv3-Tiny model. Through the target object detection model, low-level information in the YOLOv3-Tiny sub-model can be merged with high-level information therein, so as to fuse the low-level information and the high-level information. Since the low-level information can be further used, the comprehensiveness of target detection is effectively improved, and the detection effect of small targets is improved.
    Type: Grant
    Filed: July 30, 2021
    Date of Patent: October 3, 2023
    Assignee: UBTECH ROBOTICS CORP LTD
    Inventors: Yonghui Cai, Jun Cheng, Jianxin Pang, Youjun Xiong
  • Patent number: 11776116
    Abstract: A system and method of performing high precision anatomical measurements of non-visible aspects of features of living organisms that include a visible contoured shape on the anatomical region of the living organism is disclosed. The system and method include an imager configured to take a series of images of an anatomical region of a living organism, such as a human patient in a clinic, doctor's office, or hospital. The system and method create a three-dimensional digital anatomical model of the exterior or visible part of the anatomical region that includes a target feature, such as a breast, nose, foot, or tumor. The target feature within the three-dimensional digital model is then isolated and manipulated to find measurements of non-visible aspects of the feature, such as mass, distances between visible points which pass through invisible tissues, e.g., depth and base width, volume, area, and surface angle measurements of the feature.
    Type: Grant
    Filed: April 5, 2020
    Date of Patent: October 3, 2023
    Inventors: Terrence J. Kepner, Lawrence H. Fox
  • Patent number: 11769331
    Abstract: A method for detecting wheels of a vehicle on a road comprises directing a vehicle classification sensor onto a section of the road and recording a 3D representation of the vehicle, directing a camera onto the section and recording a source 2D image, determining a bounding box circumscribing the 3D representation, a side and four corner points of said bounding box side, identifying corner points in a source 2D image plane, defining four corner points of a rectangle in a destination 2D image plane, calculating a projective transformation between the source corner image points and the destination corner image points, transforming source 2D image pixels to destination 2D image pixels of a first destination 2D image, and detecting the wheels using the destination 2D image.
    Type: Grant
    Filed: May 20, 2021
    Date of Patent: September 26, 2023
    Assignee: KAPSCH TRAFFICCOM AG
    Inventors: Björn Crona, Christian Karlström, Emile Van Bergen, Simon Ljungvall, Simon Börjesson
  • Patent number: 11755104
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for eye gesture recognition. In one aspect, a method includes obtaining an electrical signal that represents a measurement, by a photodetector, of an optical signal reflected from an eye and determining a depth map of the eye based on phase differences between the electrical signal generated by the photodetector and a reference signal. Further, the method includes determining gaze information that represents a gaze of the eye based on the depth map and providing output data representing the gaze information.
    Type: Grant
    Filed: August 31, 2020
    Date of Patent: September 12, 2023
    Assignee: Artilux, Inc.
    Inventors: Yun-Chung Na, Chien-Lung Chen, Han-Din Liu, Shu-Lu Chen
  • Patent number: 11748838
    Abstract: This invention provides a system and method for using an area scan sensor of a vision system, in conjunction with an encoder or other knowledge of motion, to capture an accurate measurement of an object larger than a single field of view (FOV) of the sensor. It identifies features/edges of the object, which are tracked from image to image, thereby providing a lightweight way to process the overall extents of the object for dimensioning purposes. Logic automatically determines if the object is longer than the FOV, and thereby causes a sequence of image acquisition snapshots to occur while the moving/conveyed object remains within the FOV until the object is no longer present in the FOV. At that point, acquisition ceases and the individual images are combined as segments in an overall image. These images can be processed to derive overall dimensions of the object based on input application details.
    Type: Grant
    Filed: February 18, 2021
    Date of Patent: September 5, 2023
    Assignee: Cognex Corporation
    Inventors: Ben R. Carey, Andrew Parrett, Yukang Liu, Gilbert Chiang