Patents by Inventor Sergei Nikiforov

Sergei Nikiforov has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240062552
    Abstract: The invention is concerned with a method for generating encoded training data, wherein a processing unit performs the following steps for generating the encoded training data (11) and for storing them into a data storage during a test drive of a test vehicle that carries a camera that is generating raw image data. It is tested, if a given video encoder is suitable for encoding the raw image data for generating the encoded training data for a training of another, second artificial neural network, by performing a testing procedure.
    Type: Application
    Filed: February 21, 2022
    Publication date: February 22, 2024
    Inventors: Roland MEERTENS, Sergei NIKIFOROV
  • Patent number: 10798141
    Abstract: Multiple data streams are transmitted from a transmitting device via an end-to-end or process-to-process channel to a receiving device. At the transmitting device a media data stream is generated. A maximum packet size for another data stream is determined based on a determined end-to-end or process-to-process bandwidth and using playout information pertaining to the media data, which conveys a desired playout rate of the media data. At the transmitting device, based on the determined maximum packet size, a plurality of data packets of the other data stream is generated, each having a packet size no more than the determined maximum. The media and other data streams are multiplexed onto the channel at the transmitting device, thereby transmitting both of the data streams from the transmitting device to the receiving device via the same channel.
    Type: Grant
    Filed: November 16, 2018
    Date of Patent: October 6, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Sergey Sablin, Sergei Nikiforov, Matthieu Michel Jean-Alexis Moinard, Victor Miguel Barbero, David Yuheng Zhao, Mattias D. Nilsson
  • Patent number: 10595025
    Abstract: A transmitting device for generating a plurality of encoded portions of a video to be transmitted to a receiving device over a network configured to: receive an error message over a feedback channel from the receiving device indicating at least one of said plurality of encoded portions that has been lost at the receiving device; encode a recovery portion responsive to said receiving said error message; and transmit said recovery portion to the receiving device over said network; wherein said error message includes information pertaining to a decoded portion successfully decoded at the receiving device and said recovery portion is encoded relative to said decoded portion.
    Type: Grant
    Filed: September 8, 2015
    Date of Patent: March 17, 2020
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Ming-Chieh Lee, Amy Lu, Pontus Carlsson, Mattias Dan Nilsson, Sergey Sablin, Sergey Silkin, David Yuheng Zhao, Magnus Hemmendorff, Sergei Nikiforov
  • Patent number: 10313685
    Abstract: A transmitting device for generating a plurality of encoded portions of a video to be transmitted to a receiving device over a network configured to: receive an error message over a feedback channel from the receiving device indicating at least one of said plurality of encoded portions that has been lost at the receiving device; encode a recovery portion responsive to said receiving said error message; and transmit said recovery portion to the receiving device over said network; wherein said error message includes information pertaining to a decoded portion successfully decoded at the receiving device and said recovery portion is encoded relative to said decoded portion.
    Type: Grant
    Filed: September 8, 2015
    Date of Patent: June 4, 2019
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Ming-Chieh Lee, Amy Lu, Pontus Carlsson, Mattias Dan Nilsson, Sergey Sablin, Sergey Silkin, David Yuheng Zhao, Magnus Hemmendorff, Sergei Nikiforov
  • Publication number: 20190089755
    Abstract: Multiple data streams are transmitted from a transmitting device via an end-to-end or process-to-process channel to a receiving device. At the transmitting device a media data stream is generated. A maximum packet size for another data stream is determined based on a determined end-to-end or process-to-process bandwidth and using playout information pertaining to the media data, which conveys a desired playout rate of the media data. At the transmitting device, based on the determined maximum packet size, a plurality of data packets of the other data stream is generated, each having a packet size no more than the determined maximum. The media and other data streams are multiplexed onto the channel at the transmitting device, thereby transmitting both of the data streams from the transmitting device to the receiving device via the same channel.
    Type: Application
    Filed: November 16, 2018
    Publication date: March 21, 2019
    Inventors: Sergey Sablin, Sergei Nikiforov, Matthieu Michel Jean-Alexis Moinard, Victor Miguel Barbero, David Yuheng Zhao, Mattias D. Nilsson
  • Patent number: 10165024
    Abstract: Multiple data streams are transmitted from a transmitting device via an end-to-end or process-to-process channel to a receiving device. At the transmitting device a media data stream is generated. A maximum packet size for another data stream is determined based on a determined end-to-end or process-to-process bandwidth and using playout information pertaining to the media data, which conveys a desired playout rate of the media data. At the transmitting device, based on the determined maximum packet size, a plurality of data packets of the other data stream is generated, each having a packet size no more than the determined maximum. The media and other data streams are multiplexed onto the channel at the transmitting device, thereby transmitting both of the data streams from the transmitting device to the receiving device via the same channel.
    Type: Grant
    Filed: April 29, 2016
    Date of Patent: December 25, 2018
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Sergey Sablin, Sergei Nikiforov, Matthieu Michel Jean-Alexis Moinard, Victor Miguel Barbero, David Yuheng Zhao, Mattias D. Nilsson
  • Publication number: 20170126758
    Abstract: Multiple data streams are transmitted from a transmitting device via an end-to-end or process-to-process channel to a receiving device. At the transmitting device a media data stream is generated. A maximum packet size for another data stream is determined based on a determined end-to-end or process-to-process bandwidth and using playout information pertaining to the media data, which conveys a desired playout rate of the media data. At the transmitting device, based on the determined maximum packet size, a plurality of data packets of the other data stream is generated, each having a packet size no more than the determined maximum. The media and other data streams are multiplexed onto the channel at the transmitting device, thereby transmitting both of the data streams from the transmitting device to the receiving device via the same channel.
    Type: Application
    Filed: April 29, 2016
    Publication date: May 4, 2017
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Sergey Sablin, Sergei Nikiforov, Matthieu Michel Jean-Alexis Moinard, Victor Miguel Barbero, David Yuheng Zhao, Mattias D. Nilsson
  • Patent number: 9609321
    Abstract: A receiving apparatus comprises a receiver for receiving a video signal, an output for outputting the video signal to a screen, storage device or further terminal; and a concealment module for applying a concealment algorithm to a lost area of the video signal. The concealment module is configured to determine an estimate of concealment quality selectively directed toward a region of interest within the area in question, and based on this estimate to determine whether or not to apply the concealment algorithm.
    Type: Grant
    Filed: March 14, 2013
    Date of Patent: March 28, 2017
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: David Yuheng Zhao, Sergei Nikiforov, Konrad Hofbauer, Magnus Hemmendorff, Pontus Carlsson
  • Publication number: 20170070739
    Abstract: A transmitting device for generating a plurality of encoded portions of a video to be transmitted to a receiving device over a network configured to: receive an error message over a feedback channel from the receiving device indicating at least one of said plurality of encoded portions that has been lost at the receiving device; encode a recovery portion responsive to said receiving said error message; and transmit said recovery portion to the receiving device over said network; wherein said error message includes information pertaining to a decoded portion successfully decoded at the receiving device and said recovery portion is encoded relative to said decoded portion.
    Type: Application
    Filed: September 8, 2015
    Publication date: March 9, 2017
    Inventors: Ming-Chieh Lee, Amy Lu, Pontus Carlsson, Mattias Dan Nilsson, Sergey Sablin, Sergey Silkin, David Yuheng Zhao, Magnus Hemmendorff, Sergei Nikiforov
  • Publication number: 20170070738
    Abstract: A transmitting device for generating a plurality of encoded portions of a video to be transmitted to a receiving device over a network configured to: receive an error message over a feedback channel from the receiving device indicating at least one of said plurality of encoded portions that has been lost at the receiving device; encode a recovery portion responsive to said receiving said error message; and transmit said recovery portion to the receiving device over said network; wherein said error message includes information pertaining to a decoded portion successfully decoded at the receiving device and said recovery portion is encoded relative to said decoded portion.
    Type: Application
    Filed: September 8, 2015
    Publication date: March 9, 2017
    Inventors: Ming-Chieh Lee, Amy Lu, Pontus Carlsson, Mattias Dan Nilsson, Sergey Sablin, Sergey Silkin, David Yuheng Zhao, Magnus Hemmendorff, Sergei Nikiforov
  • Patent number: 9516325
    Abstract: An encoder comprising an encoding module and an adaptation module. The encoding module is configured to encode video in at least one region-of-interest and outside the region-of-interest. The encoding comprises quantization, and the encoding module is operable to apply a difference in quantization granularity between the encoding inside and outside the region-of-interest. The adaptation module is configured to determine at least one metric representative of a difference in benefit of the quantization inside and outside the region-of-interest, and to adapt the difference in quantization granularity in dependence on this metric.
    Type: Grant
    Filed: October 20, 2015
    Date of Patent: December 6, 2016
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Pontus Carlsson, Magnus Hemmendorff, Konrad Hofbauer, Sergei Nikiforov, David Zhao
  • Patent number: 9307195
    Abstract: A user terminal for participating in video calls comprises: an encoder having a frame size, being the size in pixels at which it encodes frames of video; and a pre-processing stage which supplies a sequence of frames to the encoder at that frame size, each frame comprising at least an image region representing a source video image at a respective moment in time. The pre-processing stage is configured to supply at least some of the frames to the encoder in a modified form, by resizing the source video image to produce the image region of each modified frame with a size smaller than the frame size of the encoder, and combining with a border region such that the modified frame matches the frame size of the encoder. The encoder encodes the frames at the frame size and transmits them to a receiving terminal as part of a live video call.
    Type: Grant
    Filed: February 19, 2014
    Date of Patent: April 5, 2016
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Pontus Carlsson, Magnus Hemmendorff, Konrad Hofbauer, Sergei Nikiforov, David Yuheng Zhao
  • Publication number: 20160044321
    Abstract: An encoder comprising an encoding module and an adaptation module. The encoding module is configured to encode video in at least one region-of-interest and outside the region-of-interest. The encoding comprises quantization, and the encoding module is operable to apply a difference in quantization granularity between the encoding inside and outside the region-of-interest. The adaptation module is configured to determine at least one metric representative of a difference in benefit of the quantization inside and outside the region-of-interest, and to adapt the difference in quantization granularity in dependence on this metric.
    Type: Application
    Filed: October 20, 2015
    Publication date: February 11, 2016
    Inventors: Pontus Carlsson, Magnus Hemmendorff, Konrad Hofbauer, Sergei Nikiforov, David Zhao
  • Patent number: 9167255
    Abstract: An encoder comprising an encoding module and an adaptation module. The encoding module is configured to encode video in at least one region-of-interest and outside the region-of-interest. The encoding comprises quantization, and the encoding module is operable to apply a difference in quantization granularity between the encoding inside and outside the region-of-interest. The adaptation module is configured to determine at least one metric representative of a difference in benefit of the quantization inside and outside the region-of-interest, and to adapt the difference in quantization granularity in dependence on this metric.
    Type: Grant
    Filed: September 26, 2013
    Date of Patent: October 20, 2015
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Pontus Carlsson, Magnus Hemmendorff, Konrad Hofbauer, Sergei Nikiforov, David Zhao
  • Publication number: 20150109406
    Abstract: A user terminal for participating in video calls comprises: an encoder having a frame size, being the size in pixels at which it encodes frames of video; and a pre-processing stage which supplies a sequence of frames to the encoder at that frame size, each frame comprising at least an image region representing a source video image at a respective moment in time. The pre-processing stage is configured to supply at least some of the frames to the encoder in a modified form, by resizing the source video image to produce the image region of each modified frame with a size smaller than the frame size of the encoder, and combining with a border region such that the modified frame matches the frame size of the encoder. The encoder encodes the frames at the frame size and transmits them to a receiving terminal as part of a live video call.
    Type: Application
    Filed: February 19, 2014
    Publication date: April 23, 2015
    Applicant: Microsoft Corporation
    Inventors: Pontus Carlsson, Magnus Hemmendorff, Konrad Hofbauer, Sergei Nikiforov, David Yuheng Zhao
  • Publication number: 20150016510
    Abstract: An encoder comprising an encoding module and an adaptation module. The encoding module is configured to encode video in at least one region-of-interest and outside the region-of-interest. The encoding comprises quantization, and the encoding module is operable to apply a difference in quantization granularity between the encoding inside and outside the region-of-interest. The adaptation module is configured to determine at least one metric representative of a difference in benefit of the quantization inside and outside the region-of-interest, and to adapt the difference in quantization granularity in dependence on this metric.
    Type: Application
    Filed: September 26, 2013
    Publication date: January 15, 2015
    Applicant: Microsoft Corporation
    Inventors: Pontus Carlsson, Magnus Hemmendorff, Konrad Hofbauer, Sergei Nikiforov, David Zhao
  • Publication number: 20140307771
    Abstract: An apparatus for encoding video data, the apparatus comprising a compliance module configured to compare a resource requirement associated with encoding video data to form at least part of an encoded frame using a standard encoding mode with an acceptable resource level and an encoder configured to, responsive to a determination that the resource requirement will exceed the acceptable resource level, form the at least part of an encoded frame by encoding some of the video data using the standard encoding mode and filling a remainder of the at least part of the encoded frame with data that is associated with a lower resource usage than data generated using the standard encoding mode.
    Type: Application
    Filed: June 20, 2013
    Publication date: October 16, 2014
    Inventors: Magnus Hemmendorff, David Zhao, Sergey Sablin, Pontus Carlsson, Konrad Hofbauer, Sergei Nikiforov