Patents Examined by Feng Niu
  • Patent number: 11508096
    Abstract: The present disclosure relates to information processing apparatus and method that makes it possible to suppress a reduction in encoding efficiency. Information relating to quantization of a three-dimensional position of an encoding target is generated. For example, the information relating to the quantization includes information relating to a coordinate system to be subjected to the quantization, information relating to a bounding box for normalization of position information of the encoding target, or information relating to a voxel for quantization of position information of the encoding target. In addition, three-dimensional information of the encoding target is restored from a signal string on the basis of the information relating to the quantization of the three-dimensional position of the encoding target.
    Type: Grant
    Filed: June 26, 2018
    Date of Patent: November 22, 2022
    Assignee: SONY CORPORATION
    Inventors: Satoru Kuma, Ohji Nakagami, Koji Yano, Tsuyoshi Kato
  • Patent number: 11501551
    Abstract: There is a need for more effective and efficient document processing solution. Accordingly, various embodiments of the present invention introduce various document processing optimization solutions. In one example, a method includes identifying a plurality of input pages each associated with a related input document of a plurality of input documents; for each input page of the plurality of input pages, generating a segmented page; processing each segmented page using a trained encoder model to generate a fixed-dimensional representation of the input page; determining, based at least in part on each fixed-dimensional representation, a plurality of document clusters; determining a plurality of processing groups, where each processing group is associated with one or more related document clusters of the plurality of document clusters; and performing the document processing optimization based at least in part on the plurality of processing groups.
    Type: Grant
    Filed: June 8, 2020
    Date of Patent: November 15, 2022
    Assignee: Optum Services (Ireland) Limited
    Inventor: Raja Mukherji
  • Patent number: 11501123
    Abstract: A method and an apparatus for asynchronous data fusion, a storage medium and an electronic device are provided. The method includes: obtaining current frame LiDAR data, and determining current frame LiDAR three-dimensional embeddings; determining a previous frame fused hidden state, and performing a temporal fusion process based on the previous frame fused hidden state and the current frame LiDAR three-dimensional embeddings to generate a current frame temporary hidden state and a current frame output result; and obtaining current frame camera data, determining current frame camera three-dimensional embeddings, and generating a current frame fused hidden state based on the current frame camera three-dimensional embeddings and the current frame temporary hidden state. Asynchronous fusion is performed on the current frame LiDAR data and previous frame camera data, which leads to a low processing latency.
    Type: Grant
    Filed: September 25, 2020
    Date of Patent: November 15, 2022
    Assignee: BEIJING QINGZHOUZHIHANG INTELLIGENT TECHNOLOGY CO., LTD
    Inventor: Yu Zhang
  • Patent number: 11488379
    Abstract: In at least one embodiment, a computer-program product embodied in a non-transitory computer readable medium that is programmed to detect a performance threshold for one or more cameras is provided. The computer-program product includes instructions to capture a plurality of images from one or more cameras to compare an object within each captured image to a predetermined object to determine whether the object has been correctly identified and instructions to extract the object from each captured image. The computer-program product includes instructions to apply at least one gradient to each extracted object to generate a plurality of gradient images. The computer-program product includes instructions to compare the extracted object to the predetermined object and to determine whether the extracted object that is modified by the at least one gradient has been correctly identified. The computer-program product includes instructions to establish a performance threshold for the one or more cameras.
    Type: Grant
    Filed: March 13, 2018
    Date of Patent: November 1, 2022
    Assignee: Harman International Industries, Incorporated
    Inventor: Juan Garcia
  • Patent number: 11483463
    Abstract: Some implementations relate to determining whether glare is present in captured image(s) of an object (e.g., a photo) and/or to determining one or more attributes of any present glare. Some of those implementations further relate to adapting one or more parameters for a glare removal process based on whether the glare is determined to be present and/or based on one or more of the determined attributes of any glare determined to be present. Some additional and/or alternative implementations disclosed herein relate to correcting color of a flash image of an object (e.g., a photo). The flash image is based on one or more images captured by a camera of a client device with a flash component of the client device activated. In various implementations, correcting the color of the flash image is based on a determined color space of an ambient image of the object.
    Type: Grant
    Filed: May 26, 2020
    Date of Patent: October 25, 2022
    Assignee: Google LLC
    Inventors: Julia Winn, Abraham Stephens, Daniel Pettigrew, Aaron Maschinot, Ce Liu, Michael Krainin, Michael Rubinstein, Jingyu Cui
  • Patent number: 11475666
    Abstract: The present disclosure describes techniques for generating a mask frame data segment corresponding to a video frame. The disclosed techniques include obtaining a frame of a video; identifying a main area of the frame using an image segmentation algorithm; and generating a mask frame data segment corresponding to the frame based on the main area of the frame, wherein the generating a mask frame data segment corresponding to the frame based on the main area of the frame further comprises generating the mask frame data segment based on a timestamp of the frame in the video, a width and a height of the main area of the frame.
    Type: Grant
    Filed: May 13, 2020
    Date of Patent: October 18, 2022
    Assignee: Shanghai Bilibili Technology Co., Ltd.
    Inventors: Yingxuan Shi, Kangkang Zhang, Ruoheng Liu, Longwen Gao
  • Patent number: 11468913
    Abstract: Method for real time video processing for retouching an object in a video, comprising: providing an object in the video steam, the object being at least partially and at least occasionally presented in frames of the video; setting a degree of retouching; generating a list of at least one element of the object selected based on a request of retouching and the degree of retouching; detecting the at least one element of the object in the video and parameters of the at least one element; calculating new parameters of the at least one element according to the degree of retouching; detecting characteristic points for each of the at least one element of the object; generating a mesh based on the characteristic points for each of the at least one element of the object; tracking the at least one element of the object in the video, wherein the tracking comprises aligning the mesh for each of the at least one element with a position of the corresponding each of the at least one element; and transforming the frames of th
    Type: Grant
    Filed: August 22, 2019
    Date of Patent: October 11, 2022
    Assignee: Snap Inc.
    Inventors: Elena Shaburova, Victor Shaburov
  • Patent number: 11450349
    Abstract: Method involving: providing an object in the video that at least partially and at least occasionally is presented in frames of a video; detecting the object in the video, wherein said detection comprises detecting feature reference points of the object; tracking the detected object in the video, wherein the tracking comprises creating a mesh that is based on the detected feature reference points of the object and aligning the mesh to the object in each frame; generating a first set of node points on the created mesh based on a request for changing proportions; generating a second set of node points based on the first set of node points; and transforming the frames of the video in such way that the object's proportions are transformed in accordance with the second set of the node points using the mesh.
    Type: Grant
    Filed: January 22, 2020
    Date of Patent: September 20, 2022
    Assignee: Snap Inc.
    Inventor: Elena Shaburova
  • Patent number: 11449713
    Abstract: Systems, methods, tangible non-transitory computer-readable media, and devices associated with object localization and generation of compressed feature representations are provided. For example, a computing system can access training data including a target feature representation and a source feature representation. An attention feature representation can be generated based on the target feature representation and a machine-learned attention model. An attended target feature representation can be generated based on masking the target feature representation with the attention feature representation. A matching score for the source feature representation and the target feature representation can be determined. A loss associated with the matching score and a ground-truth matching score for the source feature representation and the target feature representation can be determined. Furthermore, parameters of the machine-learned attention model can be adjusted based on the loss.
    Type: Grant
    Filed: October 10, 2019
    Date of Patent: September 20, 2022
    Assignee: UATC, LLC
    Inventors: Raquel Urtasun, Xinkai Wei, Ioan Andrei Barsan, Julieta Martinez Covarrubias, Shenlong Wang
  • Patent number: 11438503
    Abstract: A system and method for generating high resolution images using a plenoptic camera, is provided. In one embodiment, the comprises capturing a first set of images in a first unexcited state of operation by using a birefringent medium disposed between a main lens and an array of lenses having a plurality of apertures. Each pixel of the first set of images is then mapped to a first set of apertures. The first unexcited state is then caused to become a second excited state by applying a voltage across said birefringent medium. A second set of images are captured in the second excited state and a second set of pixels of the second image is mapped to a second set of apertures. A value is calculated for each first and second set of images and the value associated with said first set of images is subtracted from at least two times the value calculated from said second set of image.
    Type: Grant
    Filed: October 5, 2020
    Date of Patent: September 6, 2022
    Assignee: InterDigital CE Patent Holdings, Inc.
    Inventors: Nicolas Le Scouarnec, Arno Schubert, Valter Drazic
  • Patent number: 11425281
    Abstract: Techniques of color image processing involve performing a transformation for each color channel that mixes intensity values from other channels to produce a new intensity value for that channel. The new intensity values, representing the effect of overlapped response spectra of the S, M, and L cones, then provide values of the sensitivities of the photoreceptors of each of the cones. These values of the sensitivities form the basis of more accurate color image processing. For example, compression ratios of gamma-compressed color images may be increased when more the sensitivities are more accurate.
    Type: Grant
    Filed: September 7, 2016
    Date of Patent: August 23, 2022
    Inventors: Robert Obryk, Jyrki Antero Alakuijala
  • Patent number: 11417126
    Abstract: A head-mounted display, a display control method, and a program that facilitate a user to understand proximity between the user and an object around the user are provided. A display block (36) is arranged in front of the eyes of the user wearing a HMD (12). In accordance with proximity between the user and an object around the user, the HMD (12) controls the display block (36) so as to have the user visually recognize a forward direction of the display block (36).
    Type: Grant
    Filed: April 22, 2020
    Date of Patent: August 16, 2022
    Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
    Inventors: Yuichiro Nakamura, Yasushi Okumura
  • Patent number: 11417083
    Abstract: In an image processing apparatus, an image obtaining unit obtains, from a vehicular camera, an image captured by the vehicular camera based on a predetermined imaging condition. An image processing unit executes an image-processing task of the image. A histogram generation unit generates a histogram based on the luminance values of the pixels included in the road-surface region in the image. The histogram graphically represents a frequency of each of the luminance values of the pixels included in the road-surface region in the image. A histogram determination unit determines whether the histogram has first and second separate crests. A change unit changes, upon determination that the histogram has first and second separate crests, at least one of 1. The imaging condition of the vehicular camera 2. The image-processing task to be executed by the image processing unit.
    Type: Grant
    Filed: April 14, 2020
    Date of Patent: August 16, 2022
    Assignee: DENSO CORPORATION
    Inventor: Kazuhiko Kobayashi
  • Patent number: 11395704
    Abstract: A method for guiding resection of local tissue from a patient includes generating at least one image of the patient, automatically determining a plurality of surgical guidance cues indicating three-dimensional spatial properties associated with the local tissue, and generating a visualization of the surgical guidance cues relative to the surface. A system for generating surgical guidance cues for resection of a local tissue from a patient includes a location module for processing at least one image of the patient to determine three-dimensional spatial properties of the local tissue, and a surgical cue generator for generating the surgical guidance cues based upon the three-dimensional spatial properties. A patient-specific locator form for guiding resection of local tissue from a patient includes a locator form surface matching surface of the patient, and a plurality of features indicating a plurality of surgical guidance cues, respectively.
    Type: Grant
    Filed: April 27, 2020
    Date of Patent: July 26, 2022
    Assignee: THE TRUSTEES OF DARTMOUTH COLLEGE
    Inventors: Venkataramanan Krishnaswamy, Richard J. Barth, Jr., Keith D. Paulsen
  • Patent number: 11367223
    Abstract: Systems, apparatuses and methods may provide for technology that partitions a high dynamic range (HDR) image into a plurality of regions and determines, on a per region basis, a luminance level of the HDR image. Additionally, the technology may select, on the per image basis, a encoding amount for each region in the plurality of regions based on the luminance level.
    Type: Grant
    Filed: September 9, 2019
    Date of Patent: June 21, 2022
    Assignee: Intel Corporation
    Inventors: Srikanth Kambhatla, Kunjal Parikh, Changliang Wang, Gary Smith
  • Patent number: 11347968
    Abstract: A computer includes a processor and a memory, the memory storing instructions executable by the processor to apply a transform function to a plurality of images from a real-world dataset to generate a plurality of feature vectors, to apply a subspace generation algorithm to generate basis vectors of a subspace, and to project a simulated image onto the subspace to generate a realistic synthetic image.
    Type: Grant
    Filed: February 25, 2020
    Date of Patent: May 31, 2022
    Assignee: Ford Global Technologies, LLC
    Inventors: Gaurav Pandey, Gautham Sholingar
  • Patent number: 11348678
    Abstract: Techniques are provided that include obtaining a vocabulary including a set of content indices that reference corresponding cells in a descriptor space based on an input set of descriptors. A plurality of local features of an image are identified based on the vocabulary, the local features being represented by a plurality of local descriptors. An associated visual word in the vocabulary is determined for each of the plurality of local descriptors. A plurality of global signatures for the image are generated based on the associated visual words, wherein some of the plurality of global signatures are generated using local descriptors corresponding to different cropped versions of the image, two or more of the different cropped versions of the image being centered at a same pixel location of the image, and an image recognition search is facilitated using the plurality of global signatures to search a document image dataset.
    Type: Grant
    Filed: February 14, 2020
    Date of Patent: May 31, 2022
    Assignee: Nant Holdings IP, LLC
    Inventor: Bing Song
  • Patent number: 11341354
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for machine learning. One of the methods includes receiving a document having a plurality of first text strings; extracting the plurality of first text strings from the document; providing the extracted plurality of first text strings to a first machine learning model, wherein the first machine learning model is trained to output a numerical vector representation for each input first text string; providing the output vector representations from the first machine learning model to a second machine learning model, wherein the second machine learning model is trained to output a second text string for each input vector representation; and processing the second text strings to generate an output.
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: May 24, 2022
    Assignee: States Title, Inc.
    Inventors: Allen Ko, Daniel Faddoul, Andy Mahdavi
  • Patent number: 11328521
    Abstract: A map construction method, an electronic device and a readable storage medium are disclosed. The map construction method includes: obtaining three-dimensional point cloud data corresponding to observed objects in current target frame data, the observed objects including a feature object and a non-feature object; obtaining a feature parameter corresponding to the feature object based on three-dimensional point cloud data corresponding to the feature object, the feature parameter being used to indicate a position and a size of the feature object; and adjusting a point cloud density of three-dimensional point cloud data corresponding to the non-feature object to a preset value, to construct a map according to the feature parameter and the three-dimensional point cloud data of which the point cloud density is adjusted.
    Type: Grant
    Filed: March 4, 2020
    Date of Patent: May 10, 2022
    Assignee: Beijing Horizon Robotics Technology Research and Development Co., Ltd.
    Inventors: Siyu Zeng, Degang Yang
  • Patent number: 11328152
    Abstract: There is provided a recognition system adaptable to a portable device or a wearable device. The recognition system senses a body heat using a thermal sensor, and performs functions such as the living body recognition, image denoising and body temperature prompting according to detected results.
    Type: Grant
    Filed: June 17, 2019
    Date of Patent: May 10, 2022
    Assignee: PIXART IMAGING INC.
    Inventors: Nien-Tse Chen, Yi-Hsien Ko, Yen-Min Chang