Patents Examined by Justin P. Misleh
  • Patent number: 11151740
    Abstract: A method for determining the scale of a digital 3D model may include receiving, corresponding to a plurality of images, a respective plurality of first distances between the camera and the object in the environment and calculating, using a simultaneous localization and mapping (SLAM) algorithm, a plurality of second distances between the camera and the object in the 3D model of the environment. The method may include calculating a plurality of ratios corresponding to the plurality of images based on respective ones of the plurality of first distances and respective ones of the second distances and determining a scale of the 3D model based on the plurality of ratios. The method may include creating a scaled digital 3D model based on the 3 D model and the determined scale of the 3 D model. Distances and sizes in the scaled 3D model may correspond to actual distances and sizes of the environment.
    Type: Grant
    Filed: August 31, 2017
    Date of Patent: October 19, 2021
    Assignee: SONY GROUP CORPORATION
    Inventors: Daniel Linåker, Mattias Walls, Johannes Elg, Fredrik Olofsson, Fredrik Mattisson
  • Patent number: 11115635
    Abstract: A computer implemented color space encoding system, encoder, decoder, method and data signal are disclosed.
    Type: Grant
    Filed: July 12, 2019
    Date of Patent: September 7, 2021
    Inventor: Andrew Hugh Lauriston
  • Patent number: 11100669
    Abstract: A method includes obtaining surface samples that represent three-dimensional locations of surfaces of an environment; generating a voxelized representation of the surfaces of the environment in three-dimensional space using the surface samples; obtaining an image that shows the surfaces of the environment; associating each of the surface samples with image information that corresponds to a portion of the image that is spatially correlated with a respective one of the surface samples; determining voxel features for voxels from the voxelized representation based on the surface samples and the image information using a first trained machine learning model, wherein the voxel features each describe three-dimensional shapes present within a respective one of the voxels; and detecting objects based on the voxel features.
    Type: Grant
    Filed: August 7, 2019
    Date of Patent: August 24, 2021
    Assignee: Apple Inc.
    Inventors: Yin Zhou, Vishwanath A. Sindagi, Cuneyt Oncel Tuzel
  • Patent number: 11100662
    Abstract: According to one embodiment, an image processing apparatus includes a memory and one or more hardware processors electrically coupled to the memory. The one or more hardware processors acquire a first image of an object including a first shaped blur and a second image of the object including a second shaped blur. The first image and the second image are acquired by capturing at a time through a single image-forming optical system. The one or more hardware processors acquire distance information to the object based on the first image and the second image, with a statistical model that has learnt previously.
    Type: Grant
    Filed: March 7, 2019
    Date of Patent: August 24, 2021
    Assignee: KABUSHIKI KAISHA TOSHIBA
    Inventors: Nao Mishima, Takayuki Sasaki
  • Patent number: 11094153
    Abstract: It is provided a lock device for controlling access to a physical space. The lock device comprises: an electronically controllable lock; and a handle comprising a fingerprint sensor for capturing a fingerprint of a finger presented to the fingerprint sensor and obtaining fingerprint data based on a captured fingerprint, wherein the handle is configured to communicate wirelessly with the electronically controllable lock to selectively control unlocking of the electronically controllable lock based on the fingerprint data. The handle is configured to identify a user from the captured fingerprint, wherein an identifier of the identified user is communicated wirelessly from the handle to the electronically controllable lock to enable the electronically controllable lock to evaluate whether to perform an unlocking action.
    Type: Grant
    Filed: September 26, 2017
    Date of Patent: August 17, 2021
    Assignee: ASSA ABLOY AB
    Inventor: Fredrik Einberg
  • Patent number: 11087504
    Abstract: Systems and methods for transforming grayscale images into color images using deep neural networks are described. One of the systems include one or more computers and one or more storage devices storing instructions that, when executed by one or more computers, cause the one or more computers to implement a coloring neural network, a refinement neural network, and a subsystem. The coloring neural network is configured to receive a first grayscale image having a first resolution and to process the first grayscale image to generate a first color image having a second resolution lower than the first resolution. The subsystem processes the first color image to generate a set of intermediate image outputs. The refinement neural network is configured to receive the set intermediate image outputs, and to process the set of intermediate image outputs to generate a second color image having a third resolution higher than the second resolution.
    Type: Grant
    Filed: May 21, 2018
    Date of Patent: August 10, 2021
    Assignee: Google LLC
    Inventors: Sergio Guadarrama Cotado, Jonathon Shlens, David Bieber, Mohammad Norouzi, Kevin Patrick Murphy, Ryan Lienhart Dahl
  • Patent number: 11080812
    Abstract: An image recognition apparatus includes a processor including a plurality of arithmetic units; and a memory storing a plurality of data elements, each corresponding to one of candidate regions detected in an image and indicating a location and an evaluation value of the corresponding candidate region. The processor sorts the data elements by calculating in parallel, in reference to evaluation values, indexes each indicating a position of a corresponding one of the data elements in a sorted ordering and transferring in parallel, after the calculation of the indexes, the data elements based on the indexes. The processor selects part of the candidate regions based on the sorted ordering of the data elements.
    Type: Grant
    Filed: August 19, 2019
    Date of Patent: August 3, 2021
    Assignee: FUJITSU LIMITED
    Inventors: Takuya Fukagai, Kyosuke Maeda, Koichi Shirahata, Yasumoto Tomita
  • Patent number: 11069115
    Abstract: An electronic device and method are disclosed. The electronic device includes a camera, a display, and a processor. The processor implements the method, including capturing an image using a camera of the electronic device for animation of an avatar, the image including at least a part of a face of a user, analyzing, by a processor, a portion of the image including the at least the part of the face to determine whether an entirety of the face is captured within the image, and selecting a primary image or an alternative image for display of the avatar based on the determination, including: displaying the avatar on a display of the electronic device using the alternative image when less than the entirety of the face is captured within the image.
    Type: Grant
    Filed: February 20, 2020
    Date of Patent: July 20, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Donghwan Seo, Hyejin Kang, Junho An, Minsheok Choi, Yonggyoo Kim, Junyoung Park, Chanhee Yoon, Wooyong Lee, Jonghoon Won
  • Patent number: 11069048
    Abstract: Embodiments described herein provide a system for facilitating image sampling for training a target detector. During operation, the system obtains a first image depicting a first target. Here, the continuous part of the first target in the first image is labeled and enclosed in a target bounding box. The system then generates a set of positive image samples from an area of the first image enclosed by the target bounding box. A respective positive image sample includes at least a part of the first target. The system can train the target detector with the set of positive image samples to detect a second target from a second image. The target detector can be an artificial intelligence (AI) model capable of detecting an object.
    Type: Grant
    Filed: September 6, 2019
    Date of Patent: July 20, 2021
    Assignee: ADVANCED NEW TECHNOLOGIES CO., LTD.
    Inventor: Juan Xu
  • Patent number: 11060140
    Abstract: Disclosed herein are methods and systems for detection and discrimination of optical signals from a densely packed substrate. These have broad applications for biomolecule detection near or below the diffraction limit of optical systems, including in improving the efficiency and accuracy of polynucleotide sequencing applications.
    Type: Grant
    Filed: July 1, 2019
    Date of Patent: July 13, 2021
    Assignee: APTON BIOSYSTEMS, INC.
    Inventors: Bryan P. Staker, Niandong Liu, Manohar R. Furtado, Rixun Fang, Norman Burns, Windsor Owens
  • Patent number: 11047005
    Abstract: Disclosed herein are methods and systems for detection and discrimination of optical signals from a densely packed substrate. These have broad applications for biomolecule detection near or below the diffraction limit of optical systems, including in improving the efficiency and accuracy of polynucleotide sequencing applications.
    Type: Grant
    Filed: October 29, 2020
    Date of Patent: June 29, 2021
    Assignee: APTON BIOSYSTEMS, INC.
    Inventors: Bryan P. Staker, Niandong Liu, Manohar R. Furtado, Rixun Fang, Norman Burns, Windsor Owens
  • Patent number: 11042733
    Abstract: An information processing apparatus includes an acquiring unit, a confirming unit, and a controller. The acquiring unit acquires a text recognition result with respect to a first image showing a document and a certainty factor indicating a certainty of the text recognition result. The confirming unit confirms the text recognition result if the certainty factor is above or equal to a threshold value. The controller controls an output of a warning for the text recognition result with respect to the first image in a case where the text recognition result and a text recognition result with respect to a second image showing a relevant document related to the document do not match even when the certainty factor is above or equal to the threshold value.
    Type: Grant
    Filed: February 12, 2019
    Date of Patent: June 22, 2021
    Assignee: FUJIFILM Business Innovation Corp.
    Inventor: Takumi Kitamura
  • Patent number: 11037051
    Abstract: Planar regions in three-dimensional scenes offer important geometric cues in a variety of three-dimensional perception tasks such as scene understanding, scene reconstruction, and robot navigation. Image analysis to detect planar regions can be performed by a deep learning architecture that includes a number of neural networks configured to estimate parameters for the planar regions. The neural networks process an image to detect an arbitrary number of plane objects in the image. Each plane object is associated with a number of estimated parameters including bounding box parameters, plane normal parameters, and a segmentation mask. Global parameters for the image, including a depth map, can also be estimated by one of the neural networks. Then, a segmentation refinement network jointly optimizes (i.e., refines) the segmentation masks for each instance of the plane objects and combines the refined segmentation masks to generate an aggregate segmentation mask for the image.
    Type: Grant
    Filed: September 10, 2019
    Date of Patent: June 15, 2021
    Assignee: NVIDIA Corporation
    Inventors: Kihwan Kim, Jinwei Gu, Chen Liu, Jan Kautz
  • Patent number: 11030725
    Abstract: A video processing system and method apply a bilateral filter to images of a video stream in real time. The bilateral filter is executed and applied using a graphics processing unit (GPU) controlled by a processor. The bilateral filter may be encoded in a shader operated by the GPU. The GPU or processor may be configured to compress one or more video images of the video stream. Blurring or smoothing of the video images by the shader-implemented bilateral filter may reduce image noise thereby increasing a compression performance. The bilateral filter may be applied exclusively to a background of the video images which are substantially free of sharp edges. The video stream may be received from cameras covering an area of an airport, which may be an airport apron.
    Type: Grant
    Filed: December 1, 2016
    Date of Patent: June 8, 2021
    Assignee: Searidge Technologies Inc.
    Inventors: Christian Tim Thurow, Alex Sauriol, Moodie Cheikh
  • Patent number: 11030735
    Abstract: A method for characterizing damage to bits or bottom hole assemblies can include identifying, via a supervised learning model, a location, an extent, a type, a consistency, or any combination thereof of damage to a bit or a bottom hole assembly from an image of the bit or the bottom hole assembly. A graphical output is generated based on the damage to the at least one component of the bit or the bottom hole assembly.
    Type: Grant
    Filed: July 17, 2019
    Date of Patent: June 8, 2021
    Assignee: ExxonMobil Upstream Research Company
    Inventors: Benjamin J. Spivey, Paul E. Pastusek, Derek M. Sanderson
  • Patent number: 11024013
    Abstract: A generative adversarial network including a generator portion and a discriminator portion is constructed. The network is configured such that the network operates to enhance intensity images, wherein an intensity image is obtained by illuminating an object with an energy pulse and measuring the return strength of the energy pulse, and wherein a pixel of the intensity image corresponds to the return strength. As a part of the configuring, a loss function of the generative adversarial network is minimized, the loss function comprising a mean square error loss measurement of a noisy intensity image relative to a mean square error loss measurement of a corresponding clean intensity image. An enhanced intensity image is generated by applying the minimized loss function of the network to an original intensity image, the applying improving an image quality measurement of the enhanced intensity image relative to the original intensity image.
    Type: Grant
    Filed: March 8, 2019
    Date of Patent: June 1, 2021
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Kerry Halupka, Bhavna Josephine Antony, Suman Sedai, Rahil Garnavi, Hiroshi Ishikawa
  • Patent number: 11017208
    Abstract: A system and a method to analyze a phenotypical response of cells to a treatment are disclosed in which a model development module receives images of a plurality of reference cell carriers and treatment information associated with the plurality of reference cell carriers, identifies parameters of cells in the image that distinguish those reference cell carriers to which the treatment has been applied from other reference cell carriers, and trains a model using the identified parameters. A high-content imaging system includes an image capture device, and the image acquisition module receives from the image capture device a plurality of images of cell carriers to be evaluated. The model application module applies the trained model to the plurality of images of the cell carriers to be evaluated to predict a concentration of the treatment applied to each of the cell carriers evaluated.
    Type: Grant
    Filed: May 5, 2020
    Date of Patent: May 25, 2021
    Assignee: Molecular Devices, LLC
    Inventors: Avrum Isaac Cohen, Dihui Hong
  • Patent number: 11017552
    Abstract: A measurement method and apparatus are provided. The measurement method is applicable to an image acquisition device, and includes: acquiring image data to generate an image data file (S101); capturing an object to be measured in an image corresponding to the image data file (S102); obtaining a first distance between a horizontal line going through a lowest point of the object to be measured in the image and a horizontal line going through a center point of the image (S103); and calculating a second distance between the object to be measured and the image acquisition device based on the first distance, an installation height of the image acquisition device and a pitch angle of the image acquisition device (S104). Compared with the relevant art, the image acquisition device can measure the distance to an object to be measured while achieving relatively low production cost and easy installation. As a result, actual demands can be better satisfied.
    Type: Grant
    Filed: May 31, 2017
    Date of Patent: May 25, 2021
    Assignee: HANGZHOU HIKVISION DIGITAL TECHNOLOGY CO., LTD
    Inventors: Xiaowang Cai, Fei Xiao, Hai Yu, Meng Fan
  • Patent number: 11017242
    Abstract: A traffic monitoring system includes a first car moving on a first path; a camera having a field of vision including at least a portion of the first path; and a computing system. The computing system receives a plurality of images from the camera. The computing system has a processor. When instructed, the processor performs circling a perimeter of the first car on each of the images with a first rectangle; composing a first set of points, each point of the first set of points representing a center of the first rectangle; finding a first centroid using the first set of points, wherein the first centroid represents the first path; and calculating a speed of the first car using the first centroid.
    Type: Grant
    Filed: February 19, 2019
    Date of Patent: May 25, 2021
    Assignee: Unisys Corporation
    Inventors: Kelsey L Bruso, Dayln Limesand, James Combs
  • Patent number: 11010616
    Abstract: A system and method for semantic segmentation using hybrid dilated convolution (HDC) are disclosed. A particular embodiment includes: receiving an input image; producing a feature map from the input image; performing a convolution operation on the feature map and producing multiple convolution layers; grouping the multiple convolution layers into a plurality of groups; applying different dilation rates for different convolution layers in a single group of the plurality of groups; and applying a same dilation rate setting across all groups of the plurality of groups.
    Type: Grant
    Filed: May 5, 2020
    Date of Patent: May 18, 2021
    Assignee: TUSIMPLE, INC.
    Inventors: Zehua Huang, Pengfei Chen, Panqu Wang