Patents by Inventor Neil Birkbeck

Neil Birkbeck has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240086041
    Abstract: An interactive multi-view module identifies a plurality of media items associated with an event. Each of the plurality of media items is created by capturing the event. The interactive multi-view module synchronizes the audio portions of the media items according to a common reference timeline. The interactive multi-view module provides the media items for presentation in an interactive multi-view player interface based on the synchronized audio portions and multiple relative geographic locations. The interactive multi-view player interface allows a user of a plurality of users to switch between the plurality of media items, and indicates a video density indicating a quantity of media items available at a given point in time and a popularity indicator of one of the media items at the given point in time. The popularity indicator is determined using factors comprising a number of viewers of the media items at the given point in time.
    Type: Application
    Filed: November 13, 2023
    Publication date: March 14, 2024
    Inventors: Neil Birkbeck, Isasi Inguva, Damien Kelly, Andrew Crawford, Hugh Denman, Perry Tobin, Steve Benting, Anil Kokaram, Jeremy Doig
  • Patent number: 11854164
    Abstract: Processing a spherical video using denoising is described. Video content comprising the spherical video is received. Whether a camera geometry or a map projection, or both, used to generate the spherical video is available is then determined. The spherical video is denoised using a first technique responsive to a determination that the camera geometry, the map projection, or both is available. Otherwise, the spherical video is denoised using a second technique. At least some steps of the second technique can be different from steps of the first technique. The denoised spherical video can be encoded for transmission or storage using less data than encoding the spherical video without denoising.
    Type: Grant
    Filed: March 30, 2022
    Date of Patent: December 26, 2023
    Assignee: GOOGLE LLC
    Inventors: Damien Kelly, Neil Birkbeck, Balineedu Adsumilli, Mohammad Izadi
  • Patent number: 11843814
    Abstract: Signals of an immersive multimedia item are jointly considered for optimizing the quality of experience for the immersive multimedia item. During encoding, portions of available bitrate are allocated to the signals (e.g., a video signal and an audio signal) according to the overall contribution of those signals to the immersive experience for the immersive multimedia item. For example, in the spatial dimension, multimedia signals are processed to determine spatial regions of the immersive multimedia item to render using greater bitrate allocations, such as based on locations of audio content of interest, video content of interest, or both. In another example, in the temporal dimension, multimedia signals are processed in time intervals to adjust allocations of bitrate between the signals based on the relative importance of such signals during those time intervals. Other techniques for bitrate optimizations for immersive multimedia streaming are also described herein.
    Type: Grant
    Filed: August 31, 2021
    Date of Patent: December 12, 2023
    Assignee: GOOGLE LLC
    Inventors: Neil Birkbeck, Balineedu Adsumilli, Damien Kelly
  • Patent number: 11816310
    Abstract: An interactive multi-view module identifies a plurality of media items associated with one or more real-world events. Each of the plurality of media items is created by capturing the real-world events from a particular geographic location. The interactive multi-view module determines a geographic position associated with each of the media items and presents the media items in an interactive multi-view player interface based at least on the geographic positions. The interactive multi-view player interface allows a user to switch between of media items, and indicates at least one of a video density indicating a number of media items available at a given point in time or an event highlight indicating a popularity of the media items at a given point in time. The popularity of the respective media items is determined using one or more factors comprising a number of views of the media items at a given point in time.
    Type: Grant
    Filed: August 24, 2020
    Date of Patent: November 14, 2023
    Assignee: Google LLC
    Inventors: Neil Birkbeck, Isasi Inguva, Damien Kelly, Andrew Crawford, Hugh Denman, Perry Tobin, Steve Benting, Anil Kokaram, Jeremy Doig
  • Publication number: 20230319327
    Abstract: Methods, systems, and media for determining perceptual quality indicators of video content items are provided.
    Type: Application
    Filed: June 8, 2022
    Publication date: October 5, 2023
    Inventors: Yilin Wang, Balineedu Adsumilli, Junjie Ke, Hossein Talebi, Joong Yim, Neil Birkbeck, Peyman Milanfar, Feng Yang
  • Patent number: 11748854
    Abstract: Denoising video content includes identifying a three-dimensional flat frame block of multiple frames of the video content, wherein the three-dimensional flat frame block comprises flat frame blocks, each flat frame block is located within a respective frame of the multiple frames, and the flat frame blocks have a spatial and temporal intensity variance that is less than a threshold. Denoising video content also includes determining an average intensity value of the three-dimensional flat frame block, determining a noise model that represents noise characteristics of the three-dimensional flat frame block, generating a denoising function using the average intensity value and the noise model, and denoising the multiple frames using the denoising function.
    Type: Grant
    Filed: April 18, 2022
    Date of Patent: September 5, 2023
    Assignee: GOOGLE LLC
    Inventors: Neil Birkbeck, Balineedu Adsumilli, Mohammad Izadi
  • Publication number: 20220237749
    Abstract: Denoising video content includes identifying a three-dimensional flat frame block of multiple frames of the video content, wherein the three-dimensional flat frame block comprises flat frame blocks, each flat frame block is located within a respective frame of the multiple frames, and the flat frame blocks have a spatial and temporal intensity variance that is less than a threshold. Denoising video content also includes determining an average intensity value of the three-dimensional flat frame block, determining a noise model that represents noise characteristics of the three-dimensional flat frame block, generating a denoising function using the average intensity value and the noise model, and denoising the multiple frames using the denoising function.
    Type: Application
    Filed: April 18, 2022
    Publication date: July 28, 2022
    Inventors: Neil Birkbeck, Balineedu Adsumilli, Mohammad Izadi
  • Publication number: 20220222784
    Abstract: Processing a spherical video using denoising is described. Video content comprising the spherical video is received. Whether a camera geometry or a map projection, or both, used to generate the spherical video is available is then determined. The spherical video is denoised using a first technique responsive to a determination that the camera geometry, the map projection, or both is available. Otherwise, the spherical video is denoised using a second technique. At least some steps of the second technique can be different from steps of the first technique. The denoised spherical video can be encoded for transmission or storage using less data than encoding the spherical video without denoising.
    Type: Application
    Filed: March 30, 2022
    Publication date: July 14, 2022
    Inventors: Damien Kelly, Neil Birkbeck, Balineedu Adsumilli, Mohammad Izadi
  • Patent number: 11308585
    Abstract: A method for denoising video content includes identifying a first frame block of a plurality of frame blocks associated with a first frame of the video content. The method also includes determining an average intensity value for the first frame block. The method also includes determining a first noise model that represents characteristics of the first frame block. The method also includes generating a denoising function using the average intensity value and the first noise model for the first frame block. The method further includes denoising the plurality of frame blocks using the denoising function.
    Type: Grant
    Filed: December 5, 2017
    Date of Patent: April 19, 2022
    Assignee: GOOGLE LLC
    Inventors: Neil Birkbeck, Balineedu Adsumilli, Mohammad Izadi
  • Patent number: 11308584
    Abstract: A method for denoising video content includes identifying a first frame block associated with a first frame of the video content. The method also includes estimating a first noise model that represents characteristics of the first frame block. The method also includes identifying at least one frame block adjacent to the first frame block. The method also includes generating a second noise model that represents characteristics of the at least one frame block adjacent to the first frame block by adjusting the first noise model based on at least one characteristic of the at least one frame block adjacent to the first frame block. The method also includes denoising the at least one frame block adjacent to the first frame block using the second noise model.
    Type: Grant
    Filed: December 4, 2017
    Date of Patent: April 19, 2022
    Assignee: GOOGLE LLC
    Inventors: Damien Kelly, Neil Birkbeck, Balineedu Adsumilli, Mohammad Izadi
  • Publication number: 20210392392
    Abstract: Signals of an immersive multimedia item are jointly considered for optimizing the quality of experience for the immersive multimedia item. During encoding, portions of available bitrate are allocated to the signals (e.g., a video signal and an audio signal) according to the overall contribution of those signals to the immersive experience for the immersive multimedia item. For example, in the spatial dimension, multimedia signals are processed to determine spatial regions of the immersive multimedia item to render using greater bitrate allocations, such as based on locations of audio content of interest, video content of interest, or both. In another example, in the temporal dimension, multimedia signals are processed in time intervals to adjust allocations of bitrate between the signals based on the relative importance of such signals during those time intervals. Other techniques for bitrate optimizations for immersive multimedia streaming are also described herein.
    Type: Application
    Filed: August 31, 2021
    Publication date: December 16, 2021
    Inventors: Neil Birkbeck, Balineedu Adsumilli, Damien Kelly
  • Publication number: 20210287341
    Abstract: A method for denoising video content includes identifying a first frame block of a plurality of frame blocks associated with a first frame of the video content. The method also includes determining an average intensity value for the first frame block. The method also includes determining a first noise model that represents characteristics of the first frame block. The method also includes generating a denoising function using the average intensity value and the first noise model for the first frame block. The method further includes denoising the plurality of frame blocks using the denoising function.
    Type: Application
    Filed: December 5, 2017
    Publication date: September 16, 2021
    Inventors: Neil Birkbeck, Balineedu Adsumilli, Mohammad Izadi
  • Patent number: 11122314
    Abstract: Signals of an immersive multimedia item are jointly considered for optimizing the quality of experience for the immersive multimedia item. During encoding, portions of available bitrate are allocated to the signals (e.g., a video signal and an audio signal) according to the overall contribution of those signals to the immersive experience for the immersive multimedia item. For example, in the spatial dimension, multimedia signals are processed to determine spatial regions of the immersive multimedia item to render using greater bitrate allocations, such as based on locations of audio content of interest, video content of interest, or both. In another example, in the temporal dimension, multimedia signals are processed in time intervals to adjust allocations of bitrate between the signals based on the relative importance of such signals during those time intervals. Other techniques for bitrate optimizations for immersive multimedia streaming are also described herein.
    Type: Grant
    Filed: December 12, 2017
    Date of Patent: September 14, 2021
    Assignee: GOOGLE LLC
    Inventors: Neil Birkbeck, Balineedu Adsumilli, Damien Kelly
  • Publication number: 20210241426
    Abstract: A method for denoising video content includes identifying a first frame block associated with a first frame of the video content. The method also includes estimating a first noise model that represents characteristics of the first frame block. The method also includes identifying at least one frame block adjacent to the first frame block. The method also includes generating a second noise model that represents characteristics of the at least one frame block adjacent to the first frame block by adjusting the first noise model based on at least one characteristic of the at least one frame block adjacent to the first frame block. The method also includes denoising the at least one frame block adjacent to the first frame block using the second noise model.
    Type: Application
    Filed: December 4, 2017
    Publication date: August 5, 2021
    Applicant: Google LLC
    Inventors: Damien Kelly, Neil Birkbeck, Balineedu Adsumilli, Mohammad Izadi
  • Publication number: 20210112295
    Abstract: Signals of an immersive multimedia item are jointly considered for optimizing the quality of experience for the immersive multimedia item. During encoding, portions of available bitrate are allocated to the signals (e.g., a video signal and an audio signal) according to the overall contribution of those signals to the immersive experience for the immersive multimedia item. For example, in the spatial dimension, multimedia signals are processed to determine spatial regions of the immersive multimedia item to render using greater bitrate allocations, such as based on locations of audio content of interest, video content of interest, or both. In another example, in the temporal dimension, multimedia signals are processed in time intervals to adjust allocations of bitrate between the signals based on the relative importance of such signals during those time intervals. Other techniques for bitrate optimizations for immersive multimedia streaming are also described herein.
    Type: Application
    Filed: December 12, 2017
    Publication date: April 15, 2021
    Applicants: Google LLC, Google LLC
    Inventors: Neil Birkbeck, Balineedu Adsumilli, Damien Kelly
  • Patent number: 10754511
    Abstract: An interactive multi-view module identifies a plurality of media items associated with a real-world event, each of the plurality of media items comprising a video portion and an audio portion. The interactive multi-view module synchronizes the audio portions of each of the plurality of media items according to a common reference timeline, determines a relative geographic position associated with each of the plurality of media items and presents the plurality of media items in an interactive multi-view player interface based at least on the synchronized audio portions and the relative geographic positions.
    Type: Grant
    Filed: July 3, 2014
    Date of Patent: August 25, 2020
    Assignee: GOOGLE LLC
    Inventors: Neil Birkbeck, Isasi Inguva, Damien Kelly, Andrew Crawford, Hugh Denman, Perry Tobin, Steve Benting, Anil Kokaram, Jeremy Doig
  • Patent number: 10674045
    Abstract: Implementations disclose mutual noise estimation for videos. A method includes determining an optimal frame noise variance for intensity values of each frame of frames of a video, the optimal frame noise variance based on a determined relationship between spatial variance and temporal variance of the intensity values of homogeneous blocks in the frame, identifying an optimal video noise variance for the video based on optimal frame noise variances of the frames of the video, selecting, for each frame of the video, one or more of the blocks having a spatial variance that is less than the optimal video noise variance, the one or more frames selected as the homogeneous blocks, and utilizing the selected homogeneous blocks to estimate a noise signal of the video.
    Type: Grant
    Filed: May 31, 2017
    Date of Patent: June 2, 2020
    Assignee: Google LLC
    Inventors: Neil Birkbeck, Mohammad Izadi, Anil Kokaram, Balineedu C. Adsumilli, Damien Kelly
  • Publication number: 20180352118
    Abstract: Implementations disclose mutual noise estimation for videos. A method includes determining an optimal frame noise variance for intensity values of each frame of frames of a video, the optimal frame noise variance based on a determined relationship between spatial variance and temporal variance of the intensity values of homogeneous blocks in the frame, identifying an optimal video noise variance for the video based on optimal frame noise variances of the frames of the video, selecting, for each frame of the video, one or more of the blocks having a spatial variance that is less than the optimal video noise variance, the one or more frames selected as the homogeneous blocks, and utilizing the selected homogeneous blocks to estimate a noise signal of the video.
    Type: Application
    Filed: May 31, 2017
    Publication date: December 6, 2018
    Inventors: Neil Birkbeck, Mohammad Izadi, Anil Kokaram, Balineedu C. Adsumilli, Damien Kelly
  • Patent number: 9542741
    Abstract: A method and system for automatic pelvis unfolding from 3D computed tomography (CT) images is disclosed. A 3D medical image, such as a 3D CT image, is received. Pelvis anatomy is segmented in the 3D medical image. The 3D medical image is reformatted to visualize an unfolded pelvis based on the segmented pelvis anatomy.
    Type: Grant
    Filed: February 12, 2014
    Date of Patent: January 10, 2017
    Assignee: Siemens Healthcare GmbH
    Inventors: Neil Birkbeck, Dijia Wu, Michal Sofka, Meizhu Liu, Grzegorz Soza, Shaohua Kevin Zhou, Clifford R. Weiss, Atilla Peter Kiraly
  • Patent number: 9495752
    Abstract: Multiple object segmentation is performed for three-dimensional computed tomography. The adjacent objects are individually segmented. Overlapping regions or locations designated as belonging to both objects may be identified. Confidence maps for the individual segmentations are used to label the locations of the overlap as belonging to one or the other object, not both. This re-segmentation is applied for the overlapping local, and not other locations. Confidence maps in re-segmentation and application just to overlap locations may be used independently of each other or in combination.
    Type: Grant
    Filed: July 30, 2013
    Date of Patent: November 15, 2016
    Assignee: Siemens Product Lifecycle Management Software Inc.
    Inventors: Dijia Wu, Neil Birkbeck, Michal Sofka, Meizhu Liu, Shaohua Kevin Zhou