Patents by Inventor QIAN SONG
QIAN SONG has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20250014203Abstract: Techniques for training a model for detecting objects in an environment are discussed herein. For example, techniques can include determining losses associated with spatial features of candidate bounding boxes output by a machine-learned (ML) model and utilizing the losses to train the ML model. Techniques may include determining candidate bounding box(es) associated with an object detected in an environment using the ML model and receiving a ground truth bounding box associated with the detected object. A yaw error loss may be determined by comparing yaw features of the candidate bounding box to the ground truth bounding box. The candidate bounding box may be axis aligned with respect to the ground truth bounding box and an intersection over union (IoU) loss may be determined based on an IoU between the axis aligned candidate bounding box and the ground truth bounding box. The ML model may be trained based on the losses.Type: ApplicationFiled: September 24, 2024Publication date: January 9, 2025Inventors: Shuangting Liu, Francesco Papi, Qian Song
-
Publication number: 20250005935Abstract: Techniques for detecting and tracking objects in an environment are discussed herein. For example, techniques can include detecting a center point of a block of pixels associated with an object. Unimodal (e.g., Gaussian) confidence values may be determined for a group of pixels associated with an object. Proposed detection box center points may be determined based on the Gaussian confidence values of the pixels and an output detection box may be determined using filtering and/or suppression techniques. Further, a machine-learned model can be trained by determining parameters of a center pixel of the detection box and a focal loss based on the unimodal confidence value which can then be backpropagated to the other pixels of the detection.Type: ApplicationFiled: August 30, 2024Publication date: January 2, 2025Inventors: Qian Song, Benjamin Isaac Zwiebel
-
Patent number: 12175764Abstract: Techniques for performing deconvolution operations on data structures representing condensed sensor data are disclosed herein. Autonomous vehicle sensors can capture data in an environment that may include one or more objects. The sensor data may be processed by a convolutional neural network to generate condensed sensor data. The condensed sensor data may be processed by one or more deconvolution layers using a machine-learned upsampling transformation to generate an output data structure for improved object detection, classification, and/or other processing operations.Type: GrantFiled: November 30, 2021Date of Patent: December 24, 2024Assignee: Zoox, Inc.Inventors: Qian Song, Benjamin Isaac Zwiebel
-
Patent number: 12136229Abstract: Techniques for training a model for detecting objects in an environment are discussed herein. For example, techniques can include determining losses associated with spatial features of candidate bounding boxes output by a machine-learned (ML) model and utilizing the losses to train the ML model. Techniques may include determining candidate bounding box(es) associated with an object detected in an environment using the ML model and receiving a ground truth bounding box associated with the detected object. A yaw error loss may be determined by comparing yaw features of the candidate bounding box to the ground truth bounding box. The candidate bounding box may be axis aligned with respect to the ground truth bounding box and an intersection over union (IoU) loss may be determined based on an IoU between the axis aligned candidate bounding box and the ground truth bounding box. The ML model may be trained based on the losses.Type: GrantFiled: May 31, 2022Date of Patent: November 5, 2024Assignee: Zoox, Inc.Inventors: Shuangting Liu, Francesco Papi, Qian Song
-
Patent number: 12080074Abstract: Techniques for detecting and tracking objects in an environment are discussed herein. For example, techniques can include detecting a center point of a block of pixels associated with an object. Unimodal (e.g., Gaussian) confidence values may be determined for a group of pixels associated with an object. Proposed detection box center points may be determined based on the Gaussian confidence values of the pixels and an output detection box may be determined using filtering and/or suppression techniques. Further, a machine-learned model can be trained by determining parameters of a center pixel of the detection box and a focal loss based on the unimodal confidence value which can then be backpropagated to the other pixels of the detection.Type: GrantFiled: November 30, 2021Date of Patent: September 3, 2024Assignee: Zoox, Inc.Inventors: Qian Song, Benjamin Isaac Zwiebel
-
Publication number: 20240253659Abstract: Techniques for performing object detection in a vehicle environment using sensor data captured by one or more sensors of the vehicle are described herein. In some cases, an object in a vehicle environment can be detected based on at least one of (i) a first similarity matrix that represents a first similarity value for two sensor observations associated with the vehicle environment, or (ii) a second similarity matrix that represents a second similarity value for a sensor observation and a track associated with the vehicle environment.Type: ApplicationFiled: January 31, 2023Publication date: August 1, 2024Inventors: Francesco Papi, Qian Song, John Bryan Carter, Shuangting Liu, Zachary Sun, Cong Ding, Murat Gevrekci
-
Patent number: 12030528Abstract: Techniques for a perception system of a vehicle that can detect and track objects in an environment are described herein. The perception system may include a machine-learned model that includes one or more different portions, such as different components, subprocesses, or the like. In some instances, the techniques may include training the machine-learned model end-to-end such that outputs of a first portion of the machine-learned model are tailored for use as inputs to another portion of the machine-learned model. Additionally, or alternatively, the perception system described herein may utilize temporal data to track objects in the environment of the vehicle and associate tracking data with specific objects in the environment detected by the machine-learned model. That is, the architecture of the machine-learned model may include both a detection portion and a tracking portion in the same loop.Type: GrantFiled: December 3, 2021Date of Patent: July 9, 2024Assignee: ZOOX, INC.Inventors: Cheng-Hsin Wuu, Subhasis Das, Po-Jen Lai, Qian Song, Benjamin Isaac Zwiebel
-
Patent number: 12012122Abstract: A computer implemented method. Includes: obtaining, from a sensor system onboard a vehicle, a plurality of hypotheses for an orientation of an object in a vicinity of the vehicle, relative to a coordinate system of the vehicle; estimating, based on the plurality of hypotheses, values of a probability distribution for the orientation of the object at a plurality of candidate orientations; and estimating, based at least in part on the estimated values of the probability distribution at the plurality of candidate orientations, the orientation of the object relative to the coordinate system.Type: GrantFiled: April 8, 2022Date of Patent: June 18, 2024Assignee: Zoox, Inc.Inventors: Francesco Papi, Qian Song, Stanley Lilian Volta, Allan Zelener
-
Publication number: 20240092397Abstract: A modified Kalman filter may include one or more neural networks to augment or replace components of the Kalman filter in such a way that the human interpretability of the filter's inner functions is preserved. The neural networks may include a neural network to account for bias in measurement data, a neural network to account for unknown controls in predicting a state of an object, a neural network ensemble that is trained differently based on different sensor data, a neural network for determining the Kalman gain, and/or a set of Kalman filters including various neural networks that determine independent estimated states, which may be fused using Bayesian fusion to determine a final estimated state.Type: ApplicationFiled: August 26, 2022Publication date: March 21, 2024Inventors: John Bryan Carter, Francesco Papi, Qian Song, Zachary Sun
-
Publication number: 20230412890Abstract: Provided are a refreshing method and a display apparatus. The method includes: presenting a video on a display of the display apparatus; detecting whether a content type of the video is switched from a first content type to a second content type; obtaining first picture quality parameter information matching the second content type from preset data of the display apparatus, wherein the preset data includes a predefined relation between a content type and picture quality parameter information, updating the parameter of the at least one picture quality setting option in the picture mode settings menu according to the first picture quality parameter information, and presenting the second section of the video according to the updated parameter of the at least one picture quality setting option in the picture mode settings menu.Type: ApplicationFiled: August 30, 2023Publication date: December 21, 2023Inventors: Qingna LIU, Xing WANG, Gang LEI, Yuxiu SUN, Wencai SUN, Yunying HAO, Qian SONG, Chunyu LI, Peng LI
-
Publication number: 20230306733Abstract: Apparatuses, systems, and methods for determining a field in a path of travel of a vehicle for detection of objects in the path of travel. An apparatus includes a path identifier configured to identify a path of travel for a vehicle. At least one camera is disposed on the vehicle and is configured to capture image data of an area including the path of travel. A region of interest selector is configured to select a region of interest within the image data. A horizon identifier is configured to identify a horizon in the image data. A field determiner is configured to project the horizon onto the region of interest to isolate a field specified by the path of travel and the horizon, the field being evaluatable for the presence of objects in the path of travel of the vehicle.Type: ApplicationFiled: May 31, 2023Publication date: September 28, 2023Inventors: Vikram Appia, Umit Batur, Qian Song
-
Patent number: 11710296Abstract: Techniques for a perception system of a vehicle that can detect and track objects in an environment are described herein. The perception system may include a machine-learned model that includes one or more different portions, such as different components, subprocesses, or the like. In some instances, the techniques may include training the machine-learned model end-to-end such that outputs of a first portion of the machine-learned model are tailored for use as inputs to another portion of the machine-learned model. Additionally, or alternatively, the perception system described herein may utilize temporal data to track objects in the environment of the vehicle and associate tracking data with specific objects in the environment detected by the machine-learned model. That is, the architecture of the machine-learned model may include both a detection portion and a tracking portion in the same loop.Type: GrantFiled: December 3, 2021Date of Patent: July 25, 2023Assignee: Zoox, Inc.Inventors: Cheng-Hsin Wuu, Subhasis Das, Po-Jen Lai, Qian Song, Benjamin Isaac Zwiebel
-
Patent number: 11704902Abstract: Disclosed embodiments include apparatuses, systems, and methods for determining a field in a path of travel of a vehicle for detection of objects in the path of travel. In an illustrative embodiment, an apparatus includes a path identifier configured to identify a path of travel for a vehicle. At least one camera is disposed on the vehicle and is configured to capture image data of an area including the path of travel. A region of interest selector is configured to select a region of interest within the image data. A horizon identifier is configured to identify a horizon in the image data. A field determiner is configured to project the horizon onto the region of interest to isolate a field specified by the path of travel and the horizon, the field being evaluatable for the presence of objects in the path of travel of the vehicle.Type: GrantFiled: July 16, 2020Date of Patent: July 18, 2023Assignee: Rivian IP Holdings, LLCInventors: Vikram Appia, Umit Batur, Qian Song
-
Publication number: 20230174110Abstract: Techniques for a perception system of a vehicle that can detect and track objects in an environment are described herein. The perception system may include a machine-learned model that includes one or more different portions, such as different components, subprocesses, or the like. In some instances, the techniques may include training the machine-learned model end-to-end such that outputs of a first portion of the machine-learned model are tailored for use as inputs to another portion of the machine-learned model. Additionally, or alternatively, the perception system described herein may utilize temporal data to track objects in the environment of the vehicle and associate tracking data with specific objects in the environment detected by the machine-learned model. That is, the architecture of the machine-learned model may include both a detection portion and a tracking portion in the same loop.Type: ApplicationFiled: December 3, 2021Publication date: June 8, 2023Inventors: Cheng-Hsin Wuu, Subhasis Das, Po-Jen Lai, Qian Song, Benjamin Isaac Zwiebel
-
Publication number: 20230177804Abstract: Techniques for a perception system of a vehicle that can detect and track objects in an environment are described herein. The perception system may include a machine-learned model that includes one or more different portions, such as different components, subprocesses, or the like. In some instances, the techniques may include training the machine-learned model end-to-end such that outputs of a first portion of the machine-learned model are tailored for use as inputs to another portion of the machine-learned model. Additionally, or alternatively, the perception system described herein may utilize temporal data to track objects in the environment of the vehicle and associate tracking data with specific objects in the environment detected by the machine-learned model. That is, the architecture of the machine-learned model may include both a detection portion and a tracking portion in the same loop.Type: ApplicationFiled: December 3, 2021Publication date: June 8, 2023Inventors: Cheng-Hsin Wuu, Subhasis Das, Po-Jen Lai, Qian Song, Benjamin Isaac Zwiebel
-
Publication number: 20230169777Abstract: Techniques for detecting and tracking objects in an environment are discussed herein. For example, techniques can include detecting a center point of a block of pixels associated with an object. Unimodal (e.g., Gaussian) confidence values may be determined for a group of pixels associated with an object. Proposed detection box center points may be determined based on the Gaussian confidence values of the pixels and an output detection box may be determined using filtering and/or suppression techniques. Further, a machine-learned model can be trained by determining parameters of a center pixel of the detection box and a focal loss based on the unimodal confidence value which can then be backpropagated to the other pixels of the detection.Type: ApplicationFiled: November 30, 2021Publication date: June 1, 2023Inventors: Qian Song, Benjamin Isaac Zwiebel
-
Patent number: 11578361Abstract: A gene detection method, a gene detection kit, and a gene detection device, including the following steps: providing a plurality of separation cavities on a kit, using a plunger to separate adjacent separation cavities, and respectively providing a lysate solution, a washing solution and a reaction solution in the separation cavities; when detecting a sample, pushing each plunger to align a plunger hole of the plunger with the separation cavity, thereby making the separation cavities interconnected; then, controlling magnetic beads in the kit to drive the sample to be tested to pass through the separation cavities in sequence by an electromagnetic control method, carrying out a lysing, a washing and a reaction in sequence; and finally, performing a optical detection on a gene in the reaction solution from outside.Type: GrantFiled: June 6, 2018Date of Patent: February 14, 2023Assignee: HANGZHOU LIFEREAL BIOTECHNOLOGY CO., LTD.Inventors: Qian Song, Wenfei Xu, Xin Wang, Xiangzhao Zheng
-
Publication number: 20220017096Abstract: Disclosed embodiments include apparatuses, systems, and methods for determining a field in a path of travel of a vehicle for detection of objects in the path of travel. In an illustrative embodiment, an apparatus includes a path identifier configured to identify a path of travel for a vehicle. At least one camera is disposed on the vehicle and is configured to capture image data of an area including the path of travel. A region of interest selector is configured to select a region of interest within the image data. A horizon identifier is configured to identify a horizon in the image data. A field determiner is configured to project the horizon onto the region of interest to isolate a field specified by the path of travel and the horizon, the field being evaluatable for the presence of objects in the path of travel of the vehicle.Type: ApplicationFiled: July 16, 2020Publication date: January 20, 2022Inventors: Vikram Appia, Umit Batur, Qian Song
-
Publication number: 20190376121Abstract: A gene detection method, a gene detection kit, and a gene detection device, including the following steps: providing a plurality of separation cavities on a kit, using a plunger to separate adjacent separation cavities, and respectively providing a lysate solution, a washing solution and a reaction solution in the separation cavities; when detecting a sample, pushing each plunger to align a plunger hole of the plunger with the separation cavity, thereby making the separation cavities interconnected; then, controlling magnetic beads in the kit to drive the sample to be tested to pass through the separation cavities in sequence by an electromagnetic control method, carrying out a lysing, a washing and a reaction in sequence; and finally, performing a optical detection on a gene in the reaction solution from outside.Type: ApplicationFiled: June 6, 2018Publication date: December 12, 2019Applicant: HANGZHOU LIFEREAL BIOTECHNOLOGY CO., LTD.Inventors: Qian SONG, Wenfei XU, Xin WANG, Xiangzhao ZHENG
-
Publication number: 20190118711Abstract: A multiple camera control system includes at least two cameras shooting an image outside the vehicle when an ignition of the vehicle is turned on or a shift speed stage of the vehicle is a reverse speed stage, and an image output apparatus receiving the shot image from the cameras and selectively displaying the image received from the cameras according to a traveling direction indication signal of the vehicle and a shift speed stage information of the vehicle.Type: ApplicationFiled: November 10, 2017Publication date: April 25, 2019Inventors: Jeong Hoon Kim, Rui Song, Shao Bo Qu, Ming Xia Xu, Sukku Kong, Qian Qian Song