Patents by Inventor Niklas Blum

Niklas Blum has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240094976
    Abstract: Systems and methods of the present disclosure are directed to automatic control of mute controllers for participants in videoconferences. For example, a method for automatically controlling a mute control associated with a participant during a videoconference includes obtaining communication data associated with the participant participating in the videoconference. The communication data includes audio signals associated with the participant and/or visual signals associated with the participant. The method includes processing the communication data by a gate control model to generate an output. The output is indicative of an intent of the participant to communicate with other participants of the videoconference. The method includes generating a noise gate status based at least in part on the output associated with the gate control model. The method includes automatically controlling the mute control of the participant based at least in part on the noise gate status.
    Type: Application
    Filed: September 16, 2022
    Publication date: March 21, 2024
    Inventors: Huib Victor Kleinhout, Niklas Blum, John Fredric Lindstrom, Tomas Gunnarsson, Christian Schüldt
  • Patent number: 11671557
    Abstract: A method enhances brightness in video frames of a video during streams. The method includes determining, by a processor, that a first video frame has low light. The method further includes applying, by the processor, a linear correction to provide a first brightness enhancement in the first video frame that modifies a first brightness of a predetermined darkest percentage of pixels to be less than a darkness threshold value or a second brightness of a predetermined lightest percentage of the pixels to be greater than a lightness threshold value. The method further includes averaging, by the processor, the first brightness enhancement of the first video frame with a set of brightness enhancements corresponding to previous video frames to generate a modified video.
    Type: Grant
    Filed: December 15, 2021
    Date of Patent: June 6, 2023
    Assignee: Google LLC
    Inventors: Sami Kalliomäki, Niklas Blum, Stefan Ekerfelt, Peter Hanspers, Magnus Jedvert
  • Publication number: 20230160745
    Abstract: A method and a device are provided for determining a global irradiance of solar radiation, and/or at least one of the components thereof, in a plane, wherein the components include direct radiation, diffuse radiation, and radiation reflected on the ground, with a device including at least one radiation sensor unit, a camera, and an evaluation unit which is provided for evaluating measurement data from the radiation sensor unit and/or from the camera. The radiation sensor unit for determining the irradiance of solar radiation is provided in a field of view of 180° over a plane. The camera for detecting a field of view of 180° is provided over a plane. A global irradiance of the solar radiation is measured and converted into the global irradiance and/or into one or more of the components thereof in the horizontal plane and/or in the plane inclined with respect to the horizontal plane.
    Type: Application
    Filed: April 26, 2021
    Publication date: May 25, 2023
    Applicant: DEUTSCHES ZENTRUM FÜR LUFT- UND RAUMFAHRT E.V.
    Inventors: Niklas BLUM, Stefan WILBERT
  • Publication number: 20220131716
    Abstract: A method for context-dependent in-call video codec switching includes receiving an indication that a far-side endpoint includes a capability to switch from an initial video codec to a secondary video codec during a call. During a call with the far-side endpoint, the method includes determining that a performance of an encoder satisfies a codec switching threshold. The codec switching threshold indicates that the performance of the encoder justifies switching from the initial video codec mid-stream of the call. During a call with the far-side endpoint, the method also includes switching from the initial video codec initially negotiated to govern the call to the secondary video codec.
    Type: Application
    Filed: January 7, 2022
    Publication date: April 28, 2022
    Applicant: Google LLC
    Inventors: Niklas Blum, Magnus Flodman, Christoffer Rodbro, Philip Eliasson, Kari Helgason
  • Publication number: 20220109804
    Abstract: A method enhances brightness in video frames of a video during streams. The method includes determining, by a processor, that a first video frame has low light. The method further includes applying, by the processor, a linear correction to provide a first brightness enhancement in the first video frame that modifies a first brightness of a predetermined darkest percentage of pixels to be less than a darkness threshold value or a second brightness of a predetermined lightest percentage of the pixels to be greater than a lightness threshold value. The method further includes averaging, by the processor, the first brightness enhancement of the first video frame with a set of brightness enhancements corresponding to previous video frames to generate a modified video.
    Type: Application
    Filed: December 15, 2021
    Publication date: April 7, 2022
    Applicant: Google LLC
    Inventors: Sami Kalliomaki, Niklas Blum, Stefan Ekerfelt, Peter Hanspers, Magnus Jedvert
  • Patent number: 11233669
    Abstract: A method for context-dependent in-call video codec switching includes receiving an indication that a far-side endpoint includes a capability to switch from an initial video codec to a secondary video codec during a call. During a call with the far-side endpoint, the method includes determining that a performance of an encoder satisfies a codec switching threshold. The codec switching threshold indicates that the performance of the encoder justifies switching from the initial video codec mid-stream of the call. During a call with the far-side endpoint, the method also includes switching from the initial video codec initially negotiated to govern the call to the secondary video codec.
    Type: Grant
    Filed: December 17, 2019
    Date of Patent: January 25, 2022
    Assignee: Google LLC
    Inventors: Niklas Blum, Philip Eliasson, Kari Helgason, Christoffer Rodbro, Magnus Flodman
  • Patent number: 11223792
    Abstract: A method enhances brightness in video frames of a video during streams. The method includes determining, by a processor, that a first video frame has low light. The method further includes applying, by the processor, a linear correction to provide a first brightness enhancement in the first video frame that modifies a first brightness of a predetermined darkest percentage of pixels to be less than a darkness threshold value or a second brightness of a predetermined lightest percentage of the pixels to be greater than a lightness threshold value. The method further includes averaging, by the processor, the first brightness enhancement of the first video frame with a set of brightness enhancements corresponding to previous video frames to generate a modified video.
    Type: Grant
    Filed: December 12, 2019
    Date of Patent: January 11, 2022
    Assignee: Google LLC
    Inventors: Sami Kalliomäki, Niklas Blum, Stefan Ekerfelt, Peter Hanspers, Magnus Jedvert
  • Publication number: 20210184877
    Abstract: A method for context-dependent in-call video codec switching includes receiving an indication that a far-side endpoint includes a capability to switch from an initial video codec to a secondary video codec during a call. During a call with the far-side endpoint, the method includes determining that a performance of an encoder satisfies a codec switching threshold. The codec switching threshold indicates that the performance of the encoder justifies switching from the initial video codec mid-stream of the call. During a call with the far-side endpoint, the method also includes switching from the initial video codec initially negotiated to govern the call to the secondary video codec.
    Type: Application
    Filed: December 17, 2019
    Publication date: June 17, 2021
    Applicant: Google LLC
    Inventors: Niklas Blum, Philip Eliasson, Kari Helgason, Christoffer Rodbro, Magnus Flodman
  • Publication number: 20210185271
    Abstract: A method enhances brightness in video frames of a video during streams. The method includes determining, by a processor, that a first video frame has low light. The method further includes applying, by the processor, a linear correction to provide a first brightness enhancement in the first video frame that modifies a first brightness of a predetermined darkest percentage of pixels to be less than a darkness threshold value or a second brightness of a predetermined lightest percentage of the pixels to be greater than a lightness threshold value. The method further includes averaging, by the processor, the first brightness enhancement of the first video frame with a set of brightness enhancements corresponding to previous video frames to generate a modified video.
    Type: Application
    Filed: December 12, 2019
    Publication date: June 17, 2021
    Applicant: Google LLC
    Inventors: Sami Kalliomaki, Niklas Blum, Stefan Ekerfelt, Peter Hanspers, Magnus Jedvert
  • Patent number: 10367601
    Abstract: Control logic determines when a network condition has changed by evaluating network condition data. Based on a detected network condition change, the control logic reorders an encoder parameter controller execution sequence of a plurality of encoder parameter controllers. The control logic configures the plurality of reordered encoder parameter controllers so that an encoder parameter determination from a prior encoder parameter controller is used as a decision input for a subsequent encoder parameter controller. An encoder encodes data, such as audio data, video data or other type of data using the generated encoder control parameters from the reordered plurality of encoder parameter controllers. A related method is also disclosed.
    Type: Grant
    Filed: August 12, 2016
    Date of Patent: July 30, 2019
    Assignee: Google LLC
    Inventors: Tina le Grand, Niklas Blum, Minyue Li, Henrik Lundin, Michael Tschumi, Alexander Narest
  • Publication number: 20180048420
    Abstract: Control logic determines when a network condition has changed by evaluating network condition data. Based on a detected network condition change, the control logic reorders an encoder parameter controller execution sequence of a plurality of encoder parameter controllers. The control logic configures the plurality of reordered encoder parameter controllers so that an encoder parameter determination from a prior encoder parameter controller is used as a decision input for a subsequent encoder parameter controller. An encoder encodes data, such as audio data, video data or other type of data using the generated encoder control parameters from the reordered plurality of encoder parameter controllers. A related method is also disclosed.
    Type: Application
    Filed: August 12, 2016
    Publication date: February 15, 2018
    Inventors: Tina le Grand, Niklas Blum, Minyue Li, Henrik Lundin, Michael Tschumi, Alexander Narest