Patents by Inventor Neil Birkbeck
Neil Birkbeck has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240086041Abstract: An interactive multi-view module identifies a plurality of media items associated with an event. Each of the plurality of media items is created by capturing the event. The interactive multi-view module synchronizes the audio portions of the media items according to a common reference timeline. The interactive multi-view module provides the media items for presentation in an interactive multi-view player interface based on the synchronized audio portions and multiple relative geographic locations. The interactive multi-view player interface allows a user of a plurality of users to switch between the plurality of media items, and indicates a video density indicating a quantity of media items available at a given point in time and a popularity indicator of one of the media items at the given point in time. The popularity indicator is determined using factors comprising a number of viewers of the media items at the given point in time.Type: ApplicationFiled: November 13, 2023Publication date: March 14, 2024Inventors: Neil Birkbeck, Isasi Inguva, Damien Kelly, Andrew Crawford, Hugh Denman, Perry Tobin, Steve Benting, Anil Kokaram, Jeremy Doig
-
Patent number: 11854164Abstract: Processing a spherical video using denoising is described. Video content comprising the spherical video is received. Whether a camera geometry or a map projection, or both, used to generate the spherical video is available is then determined. The spherical video is denoised using a first technique responsive to a determination that the camera geometry, the map projection, or both is available. Otherwise, the spherical video is denoised using a second technique. At least some steps of the second technique can be different from steps of the first technique. The denoised spherical video can be encoded for transmission or storage using less data than encoding the spherical video without denoising.Type: GrantFiled: March 30, 2022Date of Patent: December 26, 2023Assignee: GOOGLE LLCInventors: Damien Kelly, Neil Birkbeck, Balineedu Adsumilli, Mohammad Izadi
-
Patent number: 11843814Abstract: Signals of an immersive multimedia item are jointly considered for optimizing the quality of experience for the immersive multimedia item. During encoding, portions of available bitrate are allocated to the signals (e.g., a video signal and an audio signal) according to the overall contribution of those signals to the immersive experience for the immersive multimedia item. For example, in the spatial dimension, multimedia signals are processed to determine spatial regions of the immersive multimedia item to render using greater bitrate allocations, such as based on locations of audio content of interest, video content of interest, or both. In another example, in the temporal dimension, multimedia signals are processed in time intervals to adjust allocations of bitrate between the signals based on the relative importance of such signals during those time intervals. Other techniques for bitrate optimizations for immersive multimedia streaming are also described herein.Type: GrantFiled: August 31, 2021Date of Patent: December 12, 2023Assignee: GOOGLE LLCInventors: Neil Birkbeck, Balineedu Adsumilli, Damien Kelly
-
Patent number: 11816310Abstract: An interactive multi-view module identifies a plurality of media items associated with one or more real-world events. Each of the plurality of media items is created by capturing the real-world events from a particular geographic location. The interactive multi-view module determines a geographic position associated with each of the media items and presents the media items in an interactive multi-view player interface based at least on the geographic positions. The interactive multi-view player interface allows a user to switch between of media items, and indicates at least one of a video density indicating a number of media items available at a given point in time or an event highlight indicating a popularity of the media items at a given point in time. The popularity of the respective media items is determined using one or more factors comprising a number of views of the media items at a given point in time.Type: GrantFiled: August 24, 2020Date of Patent: November 14, 2023Assignee: Google LLCInventors: Neil Birkbeck, Isasi Inguva, Damien Kelly, Andrew Crawford, Hugh Denman, Perry Tobin, Steve Benting, Anil Kokaram, Jeremy Doig
-
Publication number: 20230319327Abstract: Methods, systems, and media for determining perceptual quality indicators of video content items are provided.Type: ApplicationFiled: June 8, 2022Publication date: October 5, 2023Inventors: Yilin Wang, Balineedu Adsumilli, Junjie Ke, Hossein Talebi, Joong Yim, Neil Birkbeck, Peyman Milanfar, Feng Yang
-
Patent number: 11748854Abstract: Denoising video content includes identifying a three-dimensional flat frame block of multiple frames of the video content, wherein the three-dimensional flat frame block comprises flat frame blocks, each flat frame block is located within a respective frame of the multiple frames, and the flat frame blocks have a spatial and temporal intensity variance that is less than a threshold. Denoising video content also includes determining an average intensity value of the three-dimensional flat frame block, determining a noise model that represents noise characteristics of the three-dimensional flat frame block, generating a denoising function using the average intensity value and the noise model, and denoising the multiple frames using the denoising function.Type: GrantFiled: April 18, 2022Date of Patent: September 5, 2023Assignee: GOOGLE LLCInventors: Neil Birkbeck, Balineedu Adsumilli, Mohammad Izadi
-
Publication number: 20220237749Abstract: Denoising video content includes identifying a three-dimensional flat frame block of multiple frames of the video content, wherein the three-dimensional flat frame block comprises flat frame blocks, each flat frame block is located within a respective frame of the multiple frames, and the flat frame blocks have a spatial and temporal intensity variance that is less than a threshold. Denoising video content also includes determining an average intensity value of the three-dimensional flat frame block, determining a noise model that represents noise characteristics of the three-dimensional flat frame block, generating a denoising function using the average intensity value and the noise model, and denoising the multiple frames using the denoising function.Type: ApplicationFiled: April 18, 2022Publication date: July 28, 2022Inventors: Neil Birkbeck, Balineedu Adsumilli, Mohammad Izadi
-
Publication number: 20220222784Abstract: Processing a spherical video using denoising is described. Video content comprising the spherical video is received. Whether a camera geometry or a map projection, or both, used to generate the spherical video is available is then determined. The spherical video is denoised using a first technique responsive to a determination that the camera geometry, the map projection, or both is available. Otherwise, the spherical video is denoised using a second technique. At least some steps of the second technique can be different from steps of the first technique. The denoised spherical video can be encoded for transmission or storage using less data than encoding the spherical video without denoising.Type: ApplicationFiled: March 30, 2022Publication date: July 14, 2022Inventors: Damien Kelly, Neil Birkbeck, Balineedu Adsumilli, Mohammad Izadi
-
Patent number: 11308585Abstract: A method for denoising video content includes identifying a first frame block of a plurality of frame blocks associated with a first frame of the video content. The method also includes determining an average intensity value for the first frame block. The method also includes determining a first noise model that represents characteristics of the first frame block. The method also includes generating a denoising function using the average intensity value and the first noise model for the first frame block. The method further includes denoising the plurality of frame blocks using the denoising function.Type: GrantFiled: December 5, 2017Date of Patent: April 19, 2022Assignee: GOOGLE LLCInventors: Neil Birkbeck, Balineedu Adsumilli, Mohammad Izadi
-
Patent number: 11308584Abstract: A method for denoising video content includes identifying a first frame block associated with a first frame of the video content. The method also includes estimating a first noise model that represents characteristics of the first frame block. The method also includes identifying at least one frame block adjacent to the first frame block. The method also includes generating a second noise model that represents characteristics of the at least one frame block adjacent to the first frame block by adjusting the first noise model based on at least one characteristic of the at least one frame block adjacent to the first frame block. The method also includes denoising the at least one frame block adjacent to the first frame block using the second noise model.Type: GrantFiled: December 4, 2017Date of Patent: April 19, 2022Assignee: GOOGLE LLCInventors: Damien Kelly, Neil Birkbeck, Balineedu Adsumilli, Mohammad Izadi
-
Publication number: 20210392392Abstract: Signals of an immersive multimedia item are jointly considered for optimizing the quality of experience for the immersive multimedia item. During encoding, portions of available bitrate are allocated to the signals (e.g., a video signal and an audio signal) according to the overall contribution of those signals to the immersive experience for the immersive multimedia item. For example, in the spatial dimension, multimedia signals are processed to determine spatial regions of the immersive multimedia item to render using greater bitrate allocations, such as based on locations of audio content of interest, video content of interest, or both. In another example, in the temporal dimension, multimedia signals are processed in time intervals to adjust allocations of bitrate between the signals based on the relative importance of such signals during those time intervals. Other techniques for bitrate optimizations for immersive multimedia streaming are also described herein.Type: ApplicationFiled: August 31, 2021Publication date: December 16, 2021Inventors: Neil Birkbeck, Balineedu Adsumilli, Damien Kelly
-
Publication number: 20210287341Abstract: A method for denoising video content includes identifying a first frame block of a plurality of frame blocks associated with a first frame of the video content. The method also includes determining an average intensity value for the first frame block. The method also includes determining a first noise model that represents characteristics of the first frame block. The method also includes generating a denoising function using the average intensity value and the first noise model for the first frame block. The method further includes denoising the plurality of frame blocks using the denoising function.Type: ApplicationFiled: December 5, 2017Publication date: September 16, 2021Inventors: Neil Birkbeck, Balineedu Adsumilli, Mohammad Izadi
-
Patent number: 11122314Abstract: Signals of an immersive multimedia item are jointly considered for optimizing the quality of experience for the immersive multimedia item. During encoding, portions of available bitrate are allocated to the signals (e.g., a video signal and an audio signal) according to the overall contribution of those signals to the immersive experience for the immersive multimedia item. For example, in the spatial dimension, multimedia signals are processed to determine spatial regions of the immersive multimedia item to render using greater bitrate allocations, such as based on locations of audio content of interest, video content of interest, or both. In another example, in the temporal dimension, multimedia signals are processed in time intervals to adjust allocations of bitrate between the signals based on the relative importance of such signals during those time intervals. Other techniques for bitrate optimizations for immersive multimedia streaming are also described herein.Type: GrantFiled: December 12, 2017Date of Patent: September 14, 2021Assignee: GOOGLE LLCInventors: Neil Birkbeck, Balineedu Adsumilli, Damien Kelly
-
Publication number: 20210241426Abstract: A method for denoising video content includes identifying a first frame block associated with a first frame of the video content. The method also includes estimating a first noise model that represents characteristics of the first frame block. The method also includes identifying at least one frame block adjacent to the first frame block. The method also includes generating a second noise model that represents characteristics of the at least one frame block adjacent to the first frame block by adjusting the first noise model based on at least one characteristic of the at least one frame block adjacent to the first frame block. The method also includes denoising the at least one frame block adjacent to the first frame block using the second noise model.Type: ApplicationFiled: December 4, 2017Publication date: August 5, 2021Applicant: Google LLCInventors: Damien Kelly, Neil Birkbeck, Balineedu Adsumilli, Mohammad Izadi
-
Publication number: 20210112295Abstract: Signals of an immersive multimedia item are jointly considered for optimizing the quality of experience for the immersive multimedia item. During encoding, portions of available bitrate are allocated to the signals (e.g., a video signal and an audio signal) according to the overall contribution of those signals to the immersive experience for the immersive multimedia item. For example, in the spatial dimension, multimedia signals are processed to determine spatial regions of the immersive multimedia item to render using greater bitrate allocations, such as based on locations of audio content of interest, video content of interest, or both. In another example, in the temporal dimension, multimedia signals are processed in time intervals to adjust allocations of bitrate between the signals based on the relative importance of such signals during those time intervals. Other techniques for bitrate optimizations for immersive multimedia streaming are also described herein.Type: ApplicationFiled: December 12, 2017Publication date: April 15, 2021Applicants: Google LLC, Google LLCInventors: Neil Birkbeck, Balineedu Adsumilli, Damien Kelly
-
Patent number: 10754511Abstract: An interactive multi-view module identifies a plurality of media items associated with a real-world event, each of the plurality of media items comprising a video portion and an audio portion. The interactive multi-view module synchronizes the audio portions of each of the plurality of media items according to a common reference timeline, determines a relative geographic position associated with each of the plurality of media items and presents the plurality of media items in an interactive multi-view player interface based at least on the synchronized audio portions and the relative geographic positions.Type: GrantFiled: July 3, 2014Date of Patent: August 25, 2020Assignee: GOOGLE LLCInventors: Neil Birkbeck, Isasi Inguva, Damien Kelly, Andrew Crawford, Hugh Denman, Perry Tobin, Steve Benting, Anil Kokaram, Jeremy Doig
-
Patent number: 10674045Abstract: Implementations disclose mutual noise estimation for videos. A method includes determining an optimal frame noise variance for intensity values of each frame of frames of a video, the optimal frame noise variance based on a determined relationship between spatial variance and temporal variance of the intensity values of homogeneous blocks in the frame, identifying an optimal video noise variance for the video based on optimal frame noise variances of the frames of the video, selecting, for each frame of the video, one or more of the blocks having a spatial variance that is less than the optimal video noise variance, the one or more frames selected as the homogeneous blocks, and utilizing the selected homogeneous blocks to estimate a noise signal of the video.Type: GrantFiled: May 31, 2017Date of Patent: June 2, 2020Assignee: Google LLCInventors: Neil Birkbeck, Mohammad Izadi, Anil Kokaram, Balineedu C. Adsumilli, Damien Kelly
-
Publication number: 20180352118Abstract: Implementations disclose mutual noise estimation for videos. A method includes determining an optimal frame noise variance for intensity values of each frame of frames of a video, the optimal frame noise variance based on a determined relationship between spatial variance and temporal variance of the intensity values of homogeneous blocks in the frame, identifying an optimal video noise variance for the video based on optimal frame noise variances of the frames of the video, selecting, for each frame of the video, one or more of the blocks having a spatial variance that is less than the optimal video noise variance, the one or more frames selected as the homogeneous blocks, and utilizing the selected homogeneous blocks to estimate a noise signal of the video.Type: ApplicationFiled: May 31, 2017Publication date: December 6, 2018Inventors: Neil Birkbeck, Mohammad Izadi, Anil Kokaram, Balineedu C. Adsumilli, Damien Kelly
-
Patent number: 9542741Abstract: A method and system for automatic pelvis unfolding from 3D computed tomography (CT) images is disclosed. A 3D medical image, such as a 3D CT image, is received. Pelvis anatomy is segmented in the 3D medical image. The 3D medical image is reformatted to visualize an unfolded pelvis based on the segmented pelvis anatomy.Type: GrantFiled: February 12, 2014Date of Patent: January 10, 2017Assignee: Siemens Healthcare GmbHInventors: Neil Birkbeck, Dijia Wu, Michal Sofka, Meizhu Liu, Grzegorz Soza, Shaohua Kevin Zhou, Clifford R. Weiss, Atilla Peter Kiraly
-
Patent number: 9495752Abstract: Multiple object segmentation is performed for three-dimensional computed tomography. The adjacent objects are individually segmented. Overlapping regions or locations designated as belonging to both objects may be identified. Confidence maps for the individual segmentations are used to label the locations of the overlap as belonging to one or the other object, not both. This re-segmentation is applied for the overlapping local, and not other locations. Confidence maps in re-segmentation and application just to overlap locations may be used independently of each other or in combination.Type: GrantFiled: July 30, 2013Date of Patent: November 15, 2016Assignee: Siemens Product Lifecycle Management Software Inc.Inventors: Dijia Wu, Neil Birkbeck, Michal Sofka, Meizhu Liu, Shaohua Kevin Zhou