Patents by Inventor Xiaoying He

Xiaoying He has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20250022144
    Abstract: At least one processor may be configured to receive a first image frame of a sequence of image frames from an image capture device and select a first portion of a first image frame. The at least one processor may also be configured to obtain alignment information and determine a first portion and a second portion of a second image frame based on the alignment information. Further, the at least one processor may be configured to determine a bounding region within the second image frame and fetch image data corresponding to the bounding region of the second image frame from memory. In some examples, the first image frame may comprise a base image and the second image frame may comprise an alternative image frame. Further, the first image frame may comprise any one of the image frames of the sequence of image frames.
    Type: Application
    Filed: October 2, 2024
    Publication date: January 16, 2025
    Inventors: Jia Feng, Damien Kelly, Ignacio Garcia Dorado, Xiaoying He
  • Publication number: 20250008203
    Abstract: Described examples relate to an apparatus comprising a first sensor configured to scan an area of interest during a first time period and a second sensor configured to capture a plurality of images of a field of view. The apparatus may include at least one controller configured to receive the plurality of images captured by the second sensor, compare the timestamp information associated with at least one image of the plurality of images to at least one time period of the first time period, and select a base image from the plurality of images based on the comparison.
    Type: Application
    Filed: September 16, 2024
    Publication date: January 2, 2025
    Inventors: Jia Feng, Damien Kelly, Ignacio Garcia Dorado, Xiaoying He, Benjamin Frevert, Nirav Dharia
  • Patent number: 12136226
    Abstract: Described examples relate to an apparatus comprising a memory for storing a sequence of image frames and at least one processor. The at least one processor may be configured to receive a first image frame of a sequence of image frames from an image capture device and select a first portion of a first image frame. The at least one processor may also be configured to obtain alignment information and determine a first portion and a second portion of a second image frame based on the alignment information. Further, the at least one processor may be configured to determine a bounding region within the second image frame and fetch image data corresponding to the bounding region of the second image frame from memory. In some examples, the first image frame may comprise a base image and the second image frame may comprise an alternative image frame. Further, the first image frame may comprise any one of the image frames of the sequence of image frames.
    Type: Grant
    Filed: December 11, 2023
    Date of Patent: November 5, 2024
    Assignee: Waymo LLC
    Inventors: Jia Feng, Damien Kelly, Ignacio Garcia Dorado, Xiaoying He
  • Patent number: 12126881
    Abstract: Described examples relate to an apparatus comprising a first sensor configured to scan an area of interest during a first time period and a second sensor configured to capture a plurality of images of a field of view. The apparatus may include at least one controller configured to receive the plurality of images captured by the second sensor, compare the timestamp information associated with at least one image of the plurality of images to at least one time period of the first time period, and select a base image from the plurality of images based on the comparison.
    Type: Grant
    Filed: May 25, 2023
    Date of Patent: October 22, 2024
    Assignee: Waymo LLC
    Inventors: Jia Feng, Damien Kelly, Ignacio Garcia Dorado, Xiaoying He, Benjamin Frevert, Nirav Dharia
  • Publication number: 20240320810
    Abstract: A system is provided that includes an image sensor coupled to a vehicle, and control circuitry configured to perform operations including receiving, from the image sensor, an input stream comprising high dynamic range (HDR) image data associated with an environment of the vehicle, and processing the input stream at the vehicle by applying a global tone mapping, followed by offline image processing that can include applying a local tone mapping to the globally tone mapped images of the same input stream.
    Type: Application
    Filed: May 30, 2024
    Publication date: September 26, 2024
    Inventors: Xiaoying He, Ryan Geiss, Pieter Kapsenberg, Carl Warren Craddock, Zhinan Xu, Lucian Ion, Ajay Chandra Venkata Gummalla
  • Patent number: 12020412
    Abstract: A system is provided that includes an image sensor coupled to a vehicle, and control circuitry configured to perform operations including receiving, from the image sensor, an input stream comprising high dynamic range (HDR) image data associated with an environment of the vehicle, and processing the input stream at the vehicle by applying a global tone mapping, followed by offline image processing that can include applying a local tone mapping to the globally tone mapped images of the same input stream.
    Type: Grant
    Filed: December 15, 2021
    Date of Patent: June 25, 2024
    Assignee: Waymo LLC
    Inventors: Xiaoying He, Ryan Geiss, Pieter Kapsenberg, Carl Warren Craddock, Zhinan Xu, Lucian Ion, Ajay Chandra Venkata Gummalla
  • Publication number: 20240135551
    Abstract: Described examples relate to an apparatus comprising a memory for storing a sequence of image frames and at least one processor. The at least one processor may be configured to receive a first image frame of a sequence of image frames from an image capture device and select a first portion of a first image frame. The at least one processor may also be configured to obtain alignment information and determine a first portion and a second portion of a second image frame based on the alignment information. Further, the at least one processor may be configured to determine a bounding region within the second image frame and fetch image data corresponding to the bounding region of the second image frame from memory. In some examples, the first image frame may comprise a base image and the second image frame may comprise an alternative image frame. Further, the first image frame may comprise any one of the image frames of the sequence of image frames.
    Type: Application
    Filed: December 11, 2023
    Publication date: April 25, 2024
    Inventors: Jia Feng, Damien Kelly, Ignacio Garcia Dorado, Xiaoying He
  • Publication number: 20240119560
    Abstract: Described examples relate to an apparatus comprising one or more image sensors coupled to a vehicle and at least one processor. The at least one processor may be configured to capture, in a burst sequence using the one or more image sensors, multiple frames of an image of a scene, the multiple frames having respective, relative offsets of the image across the multiple frames and perform super-resolution computations using the captured, multiple frames of the image of the scene. The at least one processor may also be configured to accumulate, based on the super-resolution computations, color planes and combine, using the one or more processors, the accumulated color planes to create a super-resolution image of the scene.
    Type: Application
    Filed: December 6, 2023
    Publication date: April 11, 2024
    Inventors: Ignacio Garcia Dorado, Damien Kelly, Xiaoying He, Jia Feng, Bartlomiej Wronski, Peyman Milanfar, Lucian Ion
  • Patent number: 11880902
    Abstract: Described examples relate to an apparatus comprising one or more image sensors coupled to a vehicle and at least one processor. The at least one processor may be configured to capture, in a burst sequence using the one or more image sensors, multiple frames of an image of a scene, the multiple frames having respective, relative offsets of the image across the multiple frames and perform super-resolution computations using the captured, multiple frames of the image of the scene. The at least one processor may also be configured to accumulate, based on the super-resolution computations, color planes and combine, using the one or more processors, the accumulated color planes to create a super-resolution image of the scene.
    Type: Grant
    Filed: December 30, 2020
    Date of Patent: January 23, 2024
    Assignee: Waymo LLC
    Inventors: Ignacio Garcia-Dorado, Damien Kelly, Xiaoying He, Jia Feng, Bartlomiej Wronski, Peyman Milanfar, Lucian Ion
  • Patent number: 11875516
    Abstract: Described examples relate to an apparatus comprising a memory for storing a sequence of image frames and at least one processor. The at least one processor may be configured to receive a first image frame of a sequence of image frames from an image capture device and select a first portion of a first image frame. The at least one processor may also be configured to obtain alignment information and determine a first portion and a second portion of a second image frame based on the alignment information. Further, the at least one processor may be configured to determine a bounding region within the second image frame and fetch image data corresponding to the bounding region of the second image frame from memory. In some examples, the first image frame may comprise a base image and the second image frame may comprise an alternative image frame. Further, the first image frame may comprise any one of the image frames of the sequence of image frames.
    Type: Grant
    Filed: December 28, 2020
    Date of Patent: January 16, 2024
    Assignee: Waymo LLC
    Inventors: Jia Feng, Damien Kelly, Ignacio Garcia Dorado, Xiaoying He
  • Publication number: 20230370703
    Abstract: Described examples relate to an apparatus comprising a first sensor configured to scan an area of interest during a first time period and a second sensor configured to capture a plurality of images of a field of view. The apparatus may include at least one controller configured to receive the plurality of images captured by the second sensor, compare the timestamp information associated with at least one image of the plurality of images to at least one time period of the first time period, and select a base image from the plurality of images based on the comparison.
    Type: Application
    Filed: May 25, 2023
    Publication date: November 16, 2023
    Inventors: Jia Feng, Damien Kelly, Ignacio Garcia Dorado, Xiaoying He, Benjamin Frevert, Nirav Dharia
  • Publication number: 20230262358
    Abstract: This disclosure describes devices, systems, and methods that relate to obtaining image frames with variable resolutions in synchronization with a clock source. An example device may include an image sensor, a clock input, and a controller. The controller includes at least one processor and a memory. The at least one processor is operable to execute program instructions stored in the memory so as to carry out operations. The operations include receiving, by the clock input, a clock signal. The clock signal is a periodic signal defining at least one scan interval. The operations also include during the scan interval, causing the image sensor to capture a full resolution image frame. The operations yet further include during the scan interval, causing the image sensor to capture at least one reduced resolution image frame.
    Type: Application
    Filed: April 21, 2023
    Publication date: August 17, 2023
    Inventors: Nirav Dharia, Xiaoying He, Benjamin Frevert
  • Patent number: 11706507
    Abstract: Described examples relate to an apparatus comprising a first sensor configured to scan an area of interest during a first time period and a second sensor configured to capture a plurality of images of a field of view. The apparatus may include at least one controller configured to receive the plurality of images captured by the second sensor, compare the timestamp information associated with at least one image of the plurality of images to at least one time period of the first time period, and select a base image from the plurality of images based on the comparison.
    Type: Grant
    Filed: December 14, 2021
    Date of Patent: July 18, 2023
    Assignee: Waymo LLC
    Inventors: Jia Feng, Damien Kelly, Ignacio Garcia Dorado, Xiaoying He, Benjamin Frevert, Nirav Dharia
  • Patent number: 11665450
    Abstract: This disclosure describes devices, systems, and methods that relate to obtaining image frames with variable resolutions in synchronization with a clock source. An example device may include an image sensor, a clock input, and a controller. The controller includes at least one processor and a memory. The at least one processor is operable to execute program instructions stored in the memory so as to carry out operations. The operations include receiving, by the clock input, a clock signal. The clock signal is a periodic signal defining at least one scan interval. The operations also include during the scan interval, causing the image sensor to capture a full resolution image frame. The operations yet further include during the scan interval, causing the image sensor to capture at least one reduced resolution image frame.
    Type: Grant
    Filed: January 7, 2022
    Date of Patent: May 30, 2023
    Assignee: Waymo LLC
    Inventors: Nirav Dharia, Xiaoying He, Benjamin Frevert
  • Publication number: 20220207652
    Abstract: Described examples relate to an apparatus comprising one or more image sensors coupled to a vehicle and at least one processor. The at least one processor may be configured to capture, in a burst sequence using the one or more image sensors, multiple frames of an image of a scene, the multiple frames having respective, relative offsets of the image across the multiple frames and perform super-resolution computations using the captured, multiple frames of the image of the scene. The at least one processor may also be configured to accumulate, based on the super-resolution computations, color planes and combine, using the one or more processors, the accumulated color planes to create a super-resolution image of the scene.
    Type: Application
    Filed: December 30, 2020
    Publication date: June 30, 2022
    Inventors: Ignacio Garcia-Dorado, Damien Kelly, Xiaoying He, Jia Feng, Bartlomiej Wronski, Peyman Milanfar, Lucian Ion
  • Publication number: 20220210305
    Abstract: Described examples relate to an apparatus comprising a first sensor configured to scan an area of interest during a first time period and a second sensor configured to capture a plurality of images of a field of view. The apparatus may include at least one controller configured to receive the plurality of images captured by the second sensor, compare the timestamp information associated with at least one image of the plurality of images to at least one time period of the first time period, and select a base image from the plurality of images based on the comparison.
    Type: Application
    Filed: December 14, 2021
    Publication date: June 30, 2022
    Inventors: Jia Feng, Damien Kelly, Ignacio Garcia Dorado, Xiaoying He, Benjamin Frevert, Nirav Dharia
  • Patent number: D970759
    Type: Grant
    Filed: June 17, 2022
    Date of Patent: November 22, 2022
    Inventor: Xiaoying He
  • Patent number: D979806
    Type: Grant
    Filed: December 31, 2021
    Date of Patent: February 28, 2023
    Inventor: Xiaoying He
  • Patent number: D986447
    Type: Grant
    Filed: January 5, 2022
    Date of Patent: May 16, 2023
    Inventor: Xiaoying He
  • Patent number: D994199
    Type: Grant
    Filed: December 12, 2022
    Date of Patent: August 1, 2023
    Inventor: Xiaoying He