Patents by Inventor Damien Kelly

Damien Kelly has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 12154280
    Abstract: A media items to be shared with users of a content sharing service are identified. Each of the media items corresponds to a video recording generated by a client device that depicts one or more objects corresponding to a real-world event and/or a geographic location. A location of the client device that generated the video recording corresponding to a respective media item of the media items is determined based on image features depicted in a set of frames of the video recording. A request for content associated with at least one of the real-world event and/or the geographic location is received from another client device connected to the content sharing service. The media items and, for each of the media items, an indication of the location of the client device that generated the corresponding video recording are provided in accordance with the request for content.
    Type: Grant
    Filed: April 24, 2023
    Date of Patent: November 26, 2024
    Assignee: Google LLC
    Inventors: Joan Lasenby, Stuart Bennett, Sasi Inguva, Damien Kelly, Andrew Crawford, Hugh Denman, Anil Kokaram
  • Patent number: 12136226
    Abstract: Described examples relate to an apparatus comprising a memory for storing a sequence of image frames and at least one processor. The at least one processor may be configured to receive a first image frame of a sequence of image frames from an image capture device and select a first portion of a first image frame. The at least one processor may also be configured to obtain alignment information and determine a first portion and a second portion of a second image frame based on the alignment information. Further, the at least one processor may be configured to determine a bounding region within the second image frame and fetch image data corresponding to the bounding region of the second image frame from memory. In some examples, the first image frame may comprise a base image and the second image frame may comprise an alternative image frame. Further, the first image frame may comprise any one of the image frames of the sequence of image frames.
    Type: Grant
    Filed: December 11, 2023
    Date of Patent: November 5, 2024
    Assignee: Waymo LLC
    Inventors: Jia Feng, Damien Kelly, Ignacio Garcia Dorado, Xiaoying He
  • Patent number: 12126881
    Abstract: Described examples relate to an apparatus comprising a first sensor configured to scan an area of interest during a first time period and a second sensor configured to capture a plurality of images of a field of view. The apparatus may include at least one controller configured to receive the plurality of images captured by the second sensor, compare the timestamp information associated with at least one image of the plurality of images to at least one time period of the first time period, and select a base image from the plurality of images based on the comparison.
    Type: Grant
    Filed: May 25, 2023
    Date of Patent: October 22, 2024
    Assignee: Waymo LLC
    Inventors: Jia Feng, Damien Kelly, Ignacio Garcia Dorado, Xiaoying He, Benjamin Frevert, Nirav Dharia
  • Publication number: 20240187715
    Abstract: An example embodiment may involve capturing a sequence of images, wherein there are 4 or more images in the sequence of images, and wherein each of the sequence of images has an exposure length of 4-100 seconds; applying a sliding window over the sequence of images as downsampled, wherein at least 4 images are encompassed within the sliding window’, and wherein for each position of the sliding window the applying involves: (i) aligning a set of images within the sliding window, and (ii) merging the set of images as aligned into a video frame; combining video frames generated by way of the sliding window into a video file; and storing, by the mobile device, the video file in memory of the mobile device.
    Type: Application
    Filed: May 19, 2021
    Publication date: June 6, 2024
    Inventors: Ignacio Garcia Dorado, Shambhavi Punja, Peyman Milanfar, Kiran Murthy, Janne Kontkanen, Isaac Reynolds, Damien Kelly, Alexander Schiffhauer
  • Publication number: 20240135551
    Abstract: Described examples relate to an apparatus comprising a memory for storing a sequence of image frames and at least one processor. The at least one processor may be configured to receive a first image frame of a sequence of image frames from an image capture device and select a first portion of a first image frame. The at least one processor may also be configured to obtain alignment information and determine a first portion and a second portion of a second image frame based on the alignment information. Further, the at least one processor may be configured to determine a bounding region within the second image frame and fetch image data corresponding to the bounding region of the second image frame from memory. In some examples, the first image frame may comprise a base image and the second image frame may comprise an alternative image frame. Further, the first image frame may comprise any one of the image frames of the sequence of image frames.
    Type: Application
    Filed: December 11, 2023
    Publication date: April 25, 2024
    Inventors: Jia Feng, Damien Kelly, Ignacio Garcia Dorado, Xiaoying He
  • Publication number: 20240137566
    Abstract: A video item that is subject to one or more motion stabilization transformations applied to the video item is identified. The one or more motion stabilization transformations pertain to a motion between video frames of a video sequence associated with the video item. One or more operations to modify the one or more motion stabilization transformations applied to the video item are determined. The one or more operations to modify the motion stabilization transformations are performed. The video item is provided for playback via a client device. Playback of the video item depicts at least a portion of the motion between the video frames of the video sequence.
    Type: Application
    Filed: December 29, 2023
    Publication date: April 25, 2024
    Inventors: Damien Kelly, Bartlomiej Wronski
  • Publication number: 20240119560
    Abstract: Described examples relate to an apparatus comprising one or more image sensors coupled to a vehicle and at least one processor. The at least one processor may be configured to capture, in a burst sequence using the one or more image sensors, multiple frames of an image of a scene, the multiple frames having respective, relative offsets of the image across the multiple frames and perform super-resolution computations using the captured, multiple frames of the image of the scene. The at least one processor may also be configured to accumulate, based on the super-resolution computations, color planes and combine, using the one or more processors, the accumulated color planes to create a super-resolution image of the scene.
    Type: Application
    Filed: December 6, 2023
    Publication date: April 11, 2024
    Inventors: Ignacio Garcia Dorado, Damien Kelly, Xiaoying He, Jia Feng, Bartlomiej Wronski, Peyman Milanfar, Lucian Ion
  • Publication number: 20240086041
    Abstract: An interactive multi-view module identifies a plurality of media items associated with an event. Each of the plurality of media items is created by capturing the event. The interactive multi-view module synchronizes the audio portions of the media items according to a common reference timeline. The interactive multi-view module provides the media items for presentation in an interactive multi-view player interface based on the synchronized audio portions and multiple relative geographic locations. The interactive multi-view player interface allows a user of a plurality of users to switch between the plurality of media items, and indicates a video density indicating a quantity of media items available at a given point in time and a popularity indicator of one of the media items at the given point in time. The popularity indicator is determined using factors comprising a number of viewers of the media items at the given point in time.
    Type: Application
    Filed: November 13, 2023
    Publication date: March 14, 2024
    Inventors: Neil Birkbeck, Isasi Inguva, Damien Kelly, Andrew Crawford, Hugh Denman, Perry Tobin, Steve Benting, Anil Kokaram, Jeremy Doig
  • Patent number: 11880902
    Abstract: Described examples relate to an apparatus comprising one or more image sensors coupled to a vehicle and at least one processor. The at least one processor may be configured to capture, in a burst sequence using the one or more image sensors, multiple frames of an image of a scene, the multiple frames having respective, relative offsets of the image across the multiple frames and perform super-resolution computations using the captured, multiple frames of the image of the scene. The at least one processor may also be configured to accumulate, based on the super-resolution computations, color planes and combine, using the one or more processors, the accumulated color planes to create a super-resolution image of the scene.
    Type: Grant
    Filed: December 30, 2020
    Date of Patent: January 23, 2024
    Assignee: Waymo LLC
    Inventors: Ignacio Garcia-Dorado, Damien Kelly, Xiaoying He, Jia Feng, Bartlomiej Wronski, Peyman Milanfar, Lucian Ion
  • Patent number: 11875516
    Abstract: Described examples relate to an apparatus comprising a memory for storing a sequence of image frames and at least one processor. The at least one processor may be configured to receive a first image frame of a sequence of image frames from an image capture device and select a first portion of a first image frame. The at least one processor may also be configured to obtain alignment information and determine a first portion and a second portion of a second image frame based on the alignment information. Further, the at least one processor may be configured to determine a bounding region within the second image frame and fetch image data corresponding to the bounding region of the second image frame from memory. In some examples, the first image frame may comprise a base image and the second image frame may comprise an alternative image frame. Further, the first image frame may comprise any one of the image frames of the sequence of image frames.
    Type: Grant
    Filed: December 28, 2020
    Date of Patent: January 16, 2024
    Assignee: Waymo LLC
    Inventors: Jia Feng, Damien Kelly, Ignacio Garcia Dorado, Xiaoying He
  • Patent number: 11863791
    Abstract: Methods and systems for non-destructive, stabilization-based encoder optimization. A video item to be provided to one or more users of a platform is identified. An indication of a motion is identified between an initial video frame of a video sequence associated with the video item and a subsequent video frame of the video sequence. One or more motion stabilization transformations are applied to the video item to modify the motion between at least the initial frame and the subsequent frame. Upon applying the one or more motion stabilization transformations to the video item, the video item is encoded. The encoded video item and one or more instructions to cause the client device to reverse the one or more motion stabilization transformations applied to the video item after decoding the encoded video item are transmitted to a client device connected to the platform.
    Type: Grant
    Filed: November 17, 2021
    Date of Patent: January 2, 2024
    Assignee: Google LLC
    Inventors: Damien Kelly, Bartlomiej Wronski
  • Patent number: 11854164
    Abstract: Processing a spherical video using denoising is described. Video content comprising the spherical video is received. Whether a camera geometry or a map projection, or both, used to generate the spherical video is available is then determined. The spherical video is denoised using a first technique responsive to a determination that the camera geometry, the map projection, or both is available. Otherwise, the spherical video is denoised using a second technique. At least some steps of the second technique can be different from steps of the first technique. The denoised spherical video can be encoded for transmission or storage using less data than encoding the spherical video without denoising.
    Type: Grant
    Filed: March 30, 2022
    Date of Patent: December 26, 2023
    Assignee: GOOGLE LLC
    Inventors: Damien Kelly, Neil Birkbeck, Balineedu Adsumilli, Mohammad Izadi
  • Patent number: 11843814
    Abstract: Signals of an immersive multimedia item are jointly considered for optimizing the quality of experience for the immersive multimedia item. During encoding, portions of available bitrate are allocated to the signals (e.g., a video signal and an audio signal) according to the overall contribution of those signals to the immersive experience for the immersive multimedia item. For example, in the spatial dimension, multimedia signals are processed to determine spatial regions of the immersive multimedia item to render using greater bitrate allocations, such as based on locations of audio content of interest, video content of interest, or both. In another example, in the temporal dimension, multimedia signals are processed in time intervals to adjust allocations of bitrate between the signals based on the relative importance of such signals during those time intervals. Other techniques for bitrate optimizations for immersive multimedia streaming are also described herein.
    Type: Grant
    Filed: August 31, 2021
    Date of Patent: December 12, 2023
    Assignee: GOOGLE LLC
    Inventors: Neil Birkbeck, Balineedu Adsumilli, Damien Kelly
  • Publication number: 20230370703
    Abstract: Described examples relate to an apparatus comprising a first sensor configured to scan an area of interest during a first time period and a second sensor configured to capture a plurality of images of a field of view. The apparatus may include at least one controller configured to receive the plurality of images captured by the second sensor, compare the timestamp information associated with at least one image of the plurality of images to at least one time period of the first time period, and select a base image from the plurality of images based on the comparison.
    Type: Application
    Filed: May 25, 2023
    Publication date: November 16, 2023
    Inventors: Jia Feng, Damien Kelly, Ignacio Garcia Dorado, Xiaoying He, Benjamin Frevert, Nirav Dharia
  • Patent number: 11816310
    Abstract: An interactive multi-view module identifies a plurality of media items associated with one or more real-world events. Each of the plurality of media items is created by capturing the real-world events from a particular geographic location. The interactive multi-view module determines a geographic position associated with each of the media items and presents the media items in an interactive multi-view player interface based at least on the geographic positions. The interactive multi-view player interface allows a user to switch between of media items, and indicates at least one of a video density indicating a number of media items available at a given point in time or an event highlight indicating a popularity of the media items at a given point in time. The popularity of the respective media items is determined using one or more factors comprising a number of views of the media items at a given point in time.
    Type: Grant
    Filed: August 24, 2020
    Date of Patent: November 14, 2023
    Assignee: Google LLC
    Inventors: Neil Birkbeck, Isasi Inguva, Damien Kelly, Andrew Crawford, Hugh Denman, Perry Tobin, Steve Benting, Anil Kokaram, Jeremy Doig
  • Publication number: 20230267623
    Abstract: A media items to be shared with users of a content sharing service are identified. Each of the media items corresponds to a video recording generated by a client device that depicts one or more objects corresponding to a real-world event and/or a geographic location. A location of the client device that generated the video recording corresponding to a respective media item of the media items is determined based on image features depicted in a set of frames of the video recording. A request for content associated with at least one of the real-world event and/or the geographic location is received from another client device connected to the content sharing service. The media items and, for each of the media items, an indication of the location of the client device that generated the corresponding video recording are provided in accordance with the request for content.
    Type: Application
    Filed: April 24, 2023
    Publication date: August 24, 2023
    Inventors: Joan Lasenby, Stuart Bennett, Sasi Inguva, Damien Kelly, Andrew Crawford, Hugh Denman, Anil Kokaram
  • Patent number: 11706507
    Abstract: Described examples relate to an apparatus comprising a first sensor configured to scan an area of interest during a first time period and a second sensor configured to capture a plurality of images of a field of view. The apparatus may include at least one controller configured to receive the plurality of images captured by the second sensor, compare the timestamp information associated with at least one image of the plurality of images to at least one time period of the first time period, and select a base image from the plurality of images based on the comparison.
    Type: Grant
    Filed: December 14, 2021
    Date of Patent: July 18, 2023
    Assignee: Waymo LLC
    Inventors: Jia Feng, Damien Kelly, Ignacio Garcia Dorado, Xiaoying He, Benjamin Frevert, Nirav Dharia
  • Publication number: 20230156226
    Abstract: Methods and systems for non-destructive, stabilization-based encoder optimization. A video item to be provided to one or more users of a platform is identified. An indication of a motion is identified between an initial video frame of a video sequence associated with the video item and a subsequent video frame of the video sequence. One or more motion stabilization transformations are applied to the video item to modify the motion between at least the initial frame and the subsequent frame. Upon applying the one or more motion stabilization transformations to the video item, the video item is encoded. The encoded video item and one or more instructions to cause the client device to reverse the one or more motion stabilization transformations applied to the video item after decoding the encoded video item are transmitted to a client device connected to the platform.
    Type: Application
    Filed: November 17, 2021
    Publication date: May 18, 2023
    Inventors: Damien Kelly, Bartlomiej Wronski
  • Patent number: 11636610
    Abstract: A set of media items to be shared with users of a content sharing service is identified. Each of the set of media items corresponds to a video recording generated by a client device that depicts one or more objects corresponding to a real-world event at a geographic location. A positioning of the client device that generated the video recording corresponding to a respective media item of the set of media items is determined. The positioning is determined based on image features depicted in a set of frames of the video recording. A request for content associated with at least one of the real-world event or the geographic location is received from another client device connected to the content sharing service. The set of media items and, for each of the set of media items, an indication of the determined positioning of the client device that generated the corresponding video recording is provided in accordance with the request for content.
    Type: Grant
    Filed: June 21, 2021
    Date of Patent: April 25, 2023
    Assignee: Google LLC
    Inventors: Joan Lasenby, Stuart Bennett, Sasi Inguva, Damien Kelly, Andrew Crawford, Hugh Denman, Anil Kokaram
  • Publication number: 20220222784
    Abstract: Processing a spherical video using denoising is described. Video content comprising the spherical video is received. Whether a camera geometry or a map projection, or both, used to generate the spherical video is available is then determined. The spherical video is denoised using a first technique responsive to a determination that the camera geometry, the map projection, or both is available. Otherwise, the spherical video is denoised using a second technique. At least some steps of the second technique can be different from steps of the first technique. The denoised spherical video can be encoded for transmission or storage using less data than encoding the spherical video without denoising.
    Type: Application
    Filed: March 30, 2022
    Publication date: July 14, 2022
    Inventors: Damien Kelly, Neil Birkbeck, Balineedu Adsumilli, Mohammad Izadi