Patents by Inventor QIAN SONG

QIAN SONG has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20250014203
    Abstract: Techniques for training a model for detecting objects in an environment are discussed herein. For example, techniques can include determining losses associated with spatial features of candidate bounding boxes output by a machine-learned (ML) model and utilizing the losses to train the ML model. Techniques may include determining candidate bounding box(es) associated with an object detected in an environment using the ML model and receiving a ground truth bounding box associated with the detected object. A yaw error loss may be determined by comparing yaw features of the candidate bounding box to the ground truth bounding box. The candidate bounding box may be axis aligned with respect to the ground truth bounding box and an intersection over union (IoU) loss may be determined based on an IoU between the axis aligned candidate bounding box and the ground truth bounding box. The ML model may be trained based on the losses.
    Type: Application
    Filed: September 24, 2024
    Publication date: January 9, 2025
    Inventors: Shuangting Liu, Francesco Papi, Qian Song
  • Publication number: 20250005935
    Abstract: Techniques for detecting and tracking objects in an environment are discussed herein. For example, techniques can include detecting a center point of a block of pixels associated with an object. Unimodal (e.g., Gaussian) confidence values may be determined for a group of pixels associated with an object. Proposed detection box center points may be determined based on the Gaussian confidence values of the pixels and an output detection box may be determined using filtering and/or suppression techniques. Further, a machine-learned model can be trained by determining parameters of a center pixel of the detection box and a focal loss based on the unimodal confidence value which can then be backpropagated to the other pixels of the detection.
    Type: Application
    Filed: August 30, 2024
    Publication date: January 2, 2025
    Inventors: Qian Song, Benjamin Isaac Zwiebel
  • Patent number: 12175764
    Abstract: Techniques for performing deconvolution operations on data structures representing condensed sensor data are disclosed herein. Autonomous vehicle sensors can capture data in an environment that may include one or more objects. The sensor data may be processed by a convolutional neural network to generate condensed sensor data. The condensed sensor data may be processed by one or more deconvolution layers using a machine-learned upsampling transformation to generate an output data structure for improved object detection, classification, and/or other processing operations.
    Type: Grant
    Filed: November 30, 2021
    Date of Patent: December 24, 2024
    Assignee: Zoox, Inc.
    Inventors: Qian Song, Benjamin Isaac Zwiebel
  • Patent number: 12136229
    Abstract: Techniques for training a model for detecting objects in an environment are discussed herein. For example, techniques can include determining losses associated with spatial features of candidate bounding boxes output by a machine-learned (ML) model and utilizing the losses to train the ML model. Techniques may include determining candidate bounding box(es) associated with an object detected in an environment using the ML model and receiving a ground truth bounding box associated with the detected object. A yaw error loss may be determined by comparing yaw features of the candidate bounding box to the ground truth bounding box. The candidate bounding box may be axis aligned with respect to the ground truth bounding box and an intersection over union (IoU) loss may be determined based on an IoU between the axis aligned candidate bounding box and the ground truth bounding box. The ML model may be trained based on the losses.
    Type: Grant
    Filed: May 31, 2022
    Date of Patent: November 5, 2024
    Assignee: Zoox, Inc.
    Inventors: Shuangting Liu, Francesco Papi, Qian Song
  • Patent number: 12080074
    Abstract: Techniques for detecting and tracking objects in an environment are discussed herein. For example, techniques can include detecting a center point of a block of pixels associated with an object. Unimodal (e.g., Gaussian) confidence values may be determined for a group of pixels associated with an object. Proposed detection box center points may be determined based on the Gaussian confidence values of the pixels and an output detection box may be determined using filtering and/or suppression techniques. Further, a machine-learned model can be trained by determining parameters of a center pixel of the detection box and a focal loss based on the unimodal confidence value which can then be backpropagated to the other pixels of the detection.
    Type: Grant
    Filed: November 30, 2021
    Date of Patent: September 3, 2024
    Assignee: Zoox, Inc.
    Inventors: Qian Song, Benjamin Isaac Zwiebel
  • Publication number: 20240253659
    Abstract: Techniques for performing object detection in a vehicle environment using sensor data captured by one or more sensors of the vehicle are described herein. In some cases, an object in a vehicle environment can be detected based on at least one of (i) a first similarity matrix that represents a first similarity value for two sensor observations associated with the vehicle environment, or (ii) a second similarity matrix that represents a second similarity value for a sensor observation and a track associated with the vehicle environment.
    Type: Application
    Filed: January 31, 2023
    Publication date: August 1, 2024
    Inventors: Francesco Papi, Qian Song, John Bryan Carter, Shuangting Liu, Zachary Sun, Cong Ding, Murat Gevrekci
  • Patent number: 12030528
    Abstract: Techniques for a perception system of a vehicle that can detect and track objects in an environment are described herein. The perception system may include a machine-learned model that includes one or more different portions, such as different components, subprocesses, or the like. In some instances, the techniques may include training the machine-learned model end-to-end such that outputs of a first portion of the machine-learned model are tailored for use as inputs to another portion of the machine-learned model. Additionally, or alternatively, the perception system described herein may utilize temporal data to track objects in the environment of the vehicle and associate tracking data with specific objects in the environment detected by the machine-learned model. That is, the architecture of the machine-learned model may include both a detection portion and a tracking portion in the same loop.
    Type: Grant
    Filed: December 3, 2021
    Date of Patent: July 9, 2024
    Assignee: ZOOX, INC.
    Inventors: Cheng-Hsin Wuu, Subhasis Das, Po-Jen Lai, Qian Song, Benjamin Isaac Zwiebel
  • Patent number: 12012122
    Abstract: A computer implemented method. Includes: obtaining, from a sensor system onboard a vehicle, a plurality of hypotheses for an orientation of an object in a vicinity of the vehicle, relative to a coordinate system of the vehicle; estimating, based on the plurality of hypotheses, values of a probability distribution for the orientation of the object at a plurality of candidate orientations; and estimating, based at least in part on the estimated values of the probability distribution at the plurality of candidate orientations, the orientation of the object relative to the coordinate system.
    Type: Grant
    Filed: April 8, 2022
    Date of Patent: June 18, 2024
    Assignee: Zoox, Inc.
    Inventors: Francesco Papi, Qian Song, Stanley Lilian Volta, Allan Zelener
  • Publication number: 20240092397
    Abstract: A modified Kalman filter may include one or more neural networks to augment or replace components of the Kalman filter in such a way that the human interpretability of the filter's inner functions is preserved. The neural networks may include a neural network to account for bias in measurement data, a neural network to account for unknown controls in predicting a state of an object, a neural network ensemble that is trained differently based on different sensor data, a neural network for determining the Kalman gain, and/or a set of Kalman filters including various neural networks that determine independent estimated states, which may be fused using Bayesian fusion to determine a final estimated state.
    Type: Application
    Filed: August 26, 2022
    Publication date: March 21, 2024
    Inventors: John Bryan Carter, Francesco Papi, Qian Song, Zachary Sun
  • Publication number: 20230412890
    Abstract: Provided are a refreshing method and a display apparatus. The method includes: presenting a video on a display of the display apparatus; detecting whether a content type of the video is switched from a first content type to a second content type; obtaining first picture quality parameter information matching the second content type from preset data of the display apparatus, wherein the preset data includes a predefined relation between a content type and picture quality parameter information, updating the parameter of the at least one picture quality setting option in the picture mode settings menu according to the first picture quality parameter information, and presenting the second section of the video according to the updated parameter of the at least one picture quality setting option in the picture mode settings menu.
    Type: Application
    Filed: August 30, 2023
    Publication date: December 21, 2023
    Inventors: Qingna LIU, Xing WANG, Gang LEI, Yuxiu SUN, Wencai SUN, Yunying HAO, Qian SONG, Chunyu LI, Peng LI
  • Publication number: 20230306733
    Abstract: Apparatuses, systems, and methods for determining a field in a path of travel of a vehicle for detection of objects in the path of travel. An apparatus includes a path identifier configured to identify a path of travel for a vehicle. At least one camera is disposed on the vehicle and is configured to capture image data of an area including the path of travel. A region of interest selector is configured to select a region of interest within the image data. A horizon identifier is configured to identify a horizon in the image data. A field determiner is configured to project the horizon onto the region of interest to isolate a field specified by the path of travel and the horizon, the field being evaluatable for the presence of objects in the path of travel of the vehicle.
    Type: Application
    Filed: May 31, 2023
    Publication date: September 28, 2023
    Inventors: Vikram Appia, Umit Batur, Qian Song
  • Patent number: 11710296
    Abstract: Techniques for a perception system of a vehicle that can detect and track objects in an environment are described herein. The perception system may include a machine-learned model that includes one or more different portions, such as different components, subprocesses, or the like. In some instances, the techniques may include training the machine-learned model end-to-end such that outputs of a first portion of the machine-learned model are tailored for use as inputs to another portion of the machine-learned model. Additionally, or alternatively, the perception system described herein may utilize temporal data to track objects in the environment of the vehicle and associate tracking data with specific objects in the environment detected by the machine-learned model. That is, the architecture of the machine-learned model may include both a detection portion and a tracking portion in the same loop.
    Type: Grant
    Filed: December 3, 2021
    Date of Patent: July 25, 2023
    Assignee: Zoox, Inc.
    Inventors: Cheng-Hsin Wuu, Subhasis Das, Po-Jen Lai, Qian Song, Benjamin Isaac Zwiebel
  • Patent number: 11704902
    Abstract: Disclosed embodiments include apparatuses, systems, and methods for determining a field in a path of travel of a vehicle for detection of objects in the path of travel. In an illustrative embodiment, an apparatus includes a path identifier configured to identify a path of travel for a vehicle. At least one camera is disposed on the vehicle and is configured to capture image data of an area including the path of travel. A region of interest selector is configured to select a region of interest within the image data. A horizon identifier is configured to identify a horizon in the image data. A field determiner is configured to project the horizon onto the region of interest to isolate a field specified by the path of travel and the horizon, the field being evaluatable for the presence of objects in the path of travel of the vehicle.
    Type: Grant
    Filed: July 16, 2020
    Date of Patent: July 18, 2023
    Assignee: Rivian IP Holdings, LLC
    Inventors: Vikram Appia, Umit Batur, Qian Song
  • Publication number: 20230174110
    Abstract: Techniques for a perception system of a vehicle that can detect and track objects in an environment are described herein. The perception system may include a machine-learned model that includes one or more different portions, such as different components, subprocesses, or the like. In some instances, the techniques may include training the machine-learned model end-to-end such that outputs of a first portion of the machine-learned model are tailored for use as inputs to another portion of the machine-learned model. Additionally, or alternatively, the perception system described herein may utilize temporal data to track objects in the environment of the vehicle and associate tracking data with specific objects in the environment detected by the machine-learned model. That is, the architecture of the machine-learned model may include both a detection portion and a tracking portion in the same loop.
    Type: Application
    Filed: December 3, 2021
    Publication date: June 8, 2023
    Inventors: Cheng-Hsin Wuu, Subhasis Das, Po-Jen Lai, Qian Song, Benjamin Isaac Zwiebel
  • Publication number: 20230177804
    Abstract: Techniques for a perception system of a vehicle that can detect and track objects in an environment are described herein. The perception system may include a machine-learned model that includes one or more different portions, such as different components, subprocesses, or the like. In some instances, the techniques may include training the machine-learned model end-to-end such that outputs of a first portion of the machine-learned model are tailored for use as inputs to another portion of the machine-learned model. Additionally, or alternatively, the perception system described herein may utilize temporal data to track objects in the environment of the vehicle and associate tracking data with specific objects in the environment detected by the machine-learned model. That is, the architecture of the machine-learned model may include both a detection portion and a tracking portion in the same loop.
    Type: Application
    Filed: December 3, 2021
    Publication date: June 8, 2023
    Inventors: Cheng-Hsin Wuu, Subhasis Das, Po-Jen Lai, Qian Song, Benjamin Isaac Zwiebel
  • Publication number: 20230169777
    Abstract: Techniques for detecting and tracking objects in an environment are discussed herein. For example, techniques can include detecting a center point of a block of pixels associated with an object. Unimodal (e.g., Gaussian) confidence values may be determined for a group of pixels associated with an object. Proposed detection box center points may be determined based on the Gaussian confidence values of the pixels and an output detection box may be determined using filtering and/or suppression techniques. Further, a machine-learned model can be trained by determining parameters of a center pixel of the detection box and a focal loss based on the unimodal confidence value which can then be backpropagated to the other pixels of the detection.
    Type: Application
    Filed: November 30, 2021
    Publication date: June 1, 2023
    Inventors: Qian Song, Benjamin Isaac Zwiebel
  • Patent number: 11578361
    Abstract: A gene detection method, a gene detection kit, and a gene detection device, including the following steps: providing a plurality of separation cavities on a kit, using a plunger to separate adjacent separation cavities, and respectively providing a lysate solution, a washing solution and a reaction solution in the separation cavities; when detecting a sample, pushing each plunger to align a plunger hole of the plunger with the separation cavity, thereby making the separation cavities interconnected; then, controlling magnetic beads in the kit to drive the sample to be tested to pass through the separation cavities in sequence by an electromagnetic control method, carrying out a lysing, a washing and a reaction in sequence; and finally, performing a optical detection on a gene in the reaction solution from outside.
    Type: Grant
    Filed: June 6, 2018
    Date of Patent: February 14, 2023
    Assignee: HANGZHOU LIFEREAL BIOTECHNOLOGY CO., LTD.
    Inventors: Qian Song, Wenfei Xu, Xin Wang, Xiangzhao Zheng
  • Publication number: 20220017096
    Abstract: Disclosed embodiments include apparatuses, systems, and methods for determining a field in a path of travel of a vehicle for detection of objects in the path of travel. In an illustrative embodiment, an apparatus includes a path identifier configured to identify a path of travel for a vehicle. At least one camera is disposed on the vehicle and is configured to capture image data of an area including the path of travel. A region of interest selector is configured to select a region of interest within the image data. A horizon identifier is configured to identify a horizon in the image data. A field determiner is configured to project the horizon onto the region of interest to isolate a field specified by the path of travel and the horizon, the field being evaluatable for the presence of objects in the path of travel of the vehicle.
    Type: Application
    Filed: July 16, 2020
    Publication date: January 20, 2022
    Inventors: Vikram Appia, Umit Batur, Qian Song
  • Publication number: 20190376121
    Abstract: A gene detection method, a gene detection kit, and a gene detection device, including the following steps: providing a plurality of separation cavities on a kit, using a plunger to separate adjacent separation cavities, and respectively providing a lysate solution, a washing solution and a reaction solution in the separation cavities; when detecting a sample, pushing each plunger to align a plunger hole of the plunger with the separation cavity, thereby making the separation cavities interconnected; then, controlling magnetic beads in the kit to drive the sample to be tested to pass through the separation cavities in sequence by an electromagnetic control method, carrying out a lysing, a washing and a reaction in sequence; and finally, performing a optical detection on a gene in the reaction solution from outside.
    Type: Application
    Filed: June 6, 2018
    Publication date: December 12, 2019
    Applicant: HANGZHOU LIFEREAL BIOTECHNOLOGY CO., LTD.
    Inventors: Qian SONG, Wenfei XU, Xin WANG, Xiangzhao ZHENG
  • Publication number: 20190118711
    Abstract: A multiple camera control system includes at least two cameras shooting an image outside the vehicle when an ignition of the vehicle is turned on or a shift speed stage of the vehicle is a reverse speed stage, and an image output apparatus receiving the shot image from the cameras and selectively displaying the image received from the cameras according to a traveling direction indication signal of the vehicle and a shift speed stage information of the vehicle.
    Type: Application
    Filed: November 10, 2017
    Publication date: April 25, 2019
    Inventors: Jeong Hoon Kim, Rui Song, Shao Bo Qu, Ming Xia Xu, Sukku Kong, Qian Qian Song