Patents by Inventor Sergei Nikiforov
Sergei Nikiforov has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240062552Abstract: The invention is concerned with a method for generating encoded training data, wherein a processing unit performs the following steps for generating the encoded training data (11) and for storing them into a data storage during a test drive of a test vehicle that carries a camera that is generating raw image data. It is tested, if a given video encoder is suitable for encoding the raw image data for generating the encoded training data for a training of another, second artificial neural network, by performing a testing procedure.Type: ApplicationFiled: February 21, 2022Publication date: February 22, 2024Inventors: Roland MEERTENS, Sergei NIKIFOROV
-
Patent number: 10798141Abstract: Multiple data streams are transmitted from a transmitting device via an end-to-end or process-to-process channel to a receiving device. At the transmitting device a media data stream is generated. A maximum packet size for another data stream is determined based on a determined end-to-end or process-to-process bandwidth and using playout information pertaining to the media data, which conveys a desired playout rate of the media data. At the transmitting device, based on the determined maximum packet size, a plurality of data packets of the other data stream is generated, each having a packet size no more than the determined maximum. The media and other data streams are multiplexed onto the channel at the transmitting device, thereby transmitting both of the data streams from the transmitting device to the receiving device via the same channel.Type: GrantFiled: November 16, 2018Date of Patent: October 6, 2020Assignee: Microsoft Technology Licensing, LLCInventors: Sergey Sablin, Sergei Nikiforov, Matthieu Michel Jean-Alexis Moinard, Victor Miguel Barbero, David Yuheng Zhao, Mattias D. Nilsson
-
Patent number: 10595025Abstract: A transmitting device for generating a plurality of encoded portions of a video to be transmitted to a receiving device over a network configured to: receive an error message over a feedback channel from the receiving device indicating at least one of said plurality of encoded portions that has been lost at the receiving device; encode a recovery portion responsive to said receiving said error message; and transmit said recovery portion to the receiving device over said network; wherein said error message includes information pertaining to a decoded portion successfully decoded at the receiving device and said recovery portion is encoded relative to said decoded portion.Type: GrantFiled: September 8, 2015Date of Patent: March 17, 2020Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Ming-Chieh Lee, Amy Lu, Pontus Carlsson, Mattias Dan Nilsson, Sergey Sablin, Sergey Silkin, David Yuheng Zhao, Magnus Hemmendorff, Sergei Nikiforov
-
Patent number: 10313685Abstract: A transmitting device for generating a plurality of encoded portions of a video to be transmitted to a receiving device over a network configured to: receive an error message over a feedback channel from the receiving device indicating at least one of said plurality of encoded portions that has been lost at the receiving device; encode a recovery portion responsive to said receiving said error message; and transmit said recovery portion to the receiving device over said network; wherein said error message includes information pertaining to a decoded portion successfully decoded at the receiving device and said recovery portion is encoded relative to said decoded portion.Type: GrantFiled: September 8, 2015Date of Patent: June 4, 2019Assignee: Microsoft Technology Licensing, LLCInventors: Ming-Chieh Lee, Amy Lu, Pontus Carlsson, Mattias Dan Nilsson, Sergey Sablin, Sergey Silkin, David Yuheng Zhao, Magnus Hemmendorff, Sergei Nikiforov
-
Publication number: 20190089755Abstract: Multiple data streams are transmitted from a transmitting device via an end-to-end or process-to-process channel to a receiving device. At the transmitting device a media data stream is generated. A maximum packet size for another data stream is determined based on a determined end-to-end or process-to-process bandwidth and using playout information pertaining to the media data, which conveys a desired playout rate of the media data. At the transmitting device, based on the determined maximum packet size, a plurality of data packets of the other data stream is generated, each having a packet size no more than the determined maximum. The media and other data streams are multiplexed onto the channel at the transmitting device, thereby transmitting both of the data streams from the transmitting device to the receiving device via the same channel.Type: ApplicationFiled: November 16, 2018Publication date: March 21, 2019Inventors: Sergey Sablin, Sergei Nikiforov, Matthieu Michel Jean-Alexis Moinard, Victor Miguel Barbero, David Yuheng Zhao, Mattias D. Nilsson
-
Patent number: 10165024Abstract: Multiple data streams are transmitted from a transmitting device via an end-to-end or process-to-process channel to a receiving device. At the transmitting device a media data stream is generated. A maximum packet size for another data stream is determined based on a determined end-to-end or process-to-process bandwidth and using playout information pertaining to the media data, which conveys a desired playout rate of the media data. At the transmitting device, based on the determined maximum packet size, a plurality of data packets of the other data stream is generated, each having a packet size no more than the determined maximum. The media and other data streams are multiplexed onto the channel at the transmitting device, thereby transmitting both of the data streams from the transmitting device to the receiving device via the same channel.Type: GrantFiled: April 29, 2016Date of Patent: December 25, 2018Assignee: Microsoft Technology Licensing, LLCInventors: Sergey Sablin, Sergei Nikiforov, Matthieu Michel Jean-Alexis Moinard, Victor Miguel Barbero, David Yuheng Zhao, Mattias D. Nilsson
-
Publication number: 20170126758Abstract: Multiple data streams are transmitted from a transmitting device via an end-to-end or process-to-process channel to a receiving device. At the transmitting device a media data stream is generated. A maximum packet size for another data stream is determined based on a determined end-to-end or process-to-process bandwidth and using playout information pertaining to the media data, which conveys a desired playout rate of the media data. At the transmitting device, based on the determined maximum packet size, a plurality of data packets of the other data stream is generated, each having a packet size no more than the determined maximum. The media and other data streams are multiplexed onto the channel at the transmitting device, thereby transmitting both of the data streams from the transmitting device to the receiving device via the same channel.Type: ApplicationFiled: April 29, 2016Publication date: May 4, 2017Applicant: Microsoft Technology Licensing, LLCInventors: Sergey Sablin, Sergei Nikiforov, Matthieu Michel Jean-Alexis Moinard, Victor Miguel Barbero, David Yuheng Zhao, Mattias D. Nilsson
-
Patent number: 9609321Abstract: A receiving apparatus comprises a receiver for receiving a video signal, an output for outputting the video signal to a screen, storage device or further terminal; and a concealment module for applying a concealment algorithm to a lost area of the video signal. The concealment module is configured to determine an estimate of concealment quality selectively directed toward a region of interest within the area in question, and based on this estimate to determine whether or not to apply the concealment algorithm.Type: GrantFiled: March 14, 2013Date of Patent: March 28, 2017Assignee: Microsoft Technology Licensing, LLCInventors: David Yuheng Zhao, Sergei Nikiforov, Konrad Hofbauer, Magnus Hemmendorff, Pontus Carlsson
-
Publication number: 20170070739Abstract: A transmitting device for generating a plurality of encoded portions of a video to be transmitted to a receiving device over a network configured to: receive an error message over a feedback channel from the receiving device indicating at least one of said plurality of encoded portions that has been lost at the receiving device; encode a recovery portion responsive to said receiving said error message; and transmit said recovery portion to the receiving device over said network; wherein said error message includes information pertaining to a decoded portion successfully decoded at the receiving device and said recovery portion is encoded relative to said decoded portion.Type: ApplicationFiled: September 8, 2015Publication date: March 9, 2017Inventors: Ming-Chieh Lee, Amy Lu, Pontus Carlsson, Mattias Dan Nilsson, Sergey Sablin, Sergey Silkin, David Yuheng Zhao, Magnus Hemmendorff, Sergei Nikiforov
-
Publication number: 20170070738Abstract: A transmitting device for generating a plurality of encoded portions of a video to be transmitted to a receiving device over a network configured to: receive an error message over a feedback channel from the receiving device indicating at least one of said plurality of encoded portions that has been lost at the receiving device; encode a recovery portion responsive to said receiving said error message; and transmit said recovery portion to the receiving device over said network; wherein said error message includes information pertaining to a decoded portion successfully decoded at the receiving device and said recovery portion is encoded relative to said decoded portion.Type: ApplicationFiled: September 8, 2015Publication date: March 9, 2017Inventors: Ming-Chieh Lee, Amy Lu, Pontus Carlsson, Mattias Dan Nilsson, Sergey Sablin, Sergey Silkin, David Yuheng Zhao, Magnus Hemmendorff, Sergei Nikiforov
-
Patent number: 9516325Abstract: An encoder comprising an encoding module and an adaptation module. The encoding module is configured to encode video in at least one region-of-interest and outside the region-of-interest. The encoding comprises quantization, and the encoding module is operable to apply a difference in quantization granularity between the encoding inside and outside the region-of-interest. The adaptation module is configured to determine at least one metric representative of a difference in benefit of the quantization inside and outside the region-of-interest, and to adapt the difference in quantization granularity in dependence on this metric.Type: GrantFiled: October 20, 2015Date of Patent: December 6, 2016Assignee: Microsoft Technology Licensing, LLCInventors: Pontus Carlsson, Magnus Hemmendorff, Konrad Hofbauer, Sergei Nikiforov, David Zhao
-
Patent number: 9307195Abstract: A user terminal for participating in video calls comprises: an encoder having a frame size, being the size in pixels at which it encodes frames of video; and a pre-processing stage which supplies a sequence of frames to the encoder at that frame size, each frame comprising at least an image region representing a source video image at a respective moment in time. The pre-processing stage is configured to supply at least some of the frames to the encoder in a modified form, by resizing the source video image to produce the image region of each modified frame with a size smaller than the frame size of the encoder, and combining with a border region such that the modified frame matches the frame size of the encoder. The encoder encodes the frames at the frame size and transmits them to a receiving terminal as part of a live video call.Type: GrantFiled: February 19, 2014Date of Patent: April 5, 2016Assignee: Microsoft Technology Licensing, LLCInventors: Pontus Carlsson, Magnus Hemmendorff, Konrad Hofbauer, Sergei Nikiforov, David Yuheng Zhao
-
Publication number: 20160044321Abstract: An encoder comprising an encoding module and an adaptation module. The encoding module is configured to encode video in at least one region-of-interest and outside the region-of-interest. The encoding comprises quantization, and the encoding module is operable to apply a difference in quantization granularity between the encoding inside and outside the region-of-interest. The adaptation module is configured to determine at least one metric representative of a difference in benefit of the quantization inside and outside the region-of-interest, and to adapt the difference in quantization granularity in dependence on this metric.Type: ApplicationFiled: October 20, 2015Publication date: February 11, 2016Inventors: Pontus Carlsson, Magnus Hemmendorff, Konrad Hofbauer, Sergei Nikiforov, David Zhao
-
Patent number: 9167255Abstract: An encoder comprising an encoding module and an adaptation module. The encoding module is configured to encode video in at least one region-of-interest and outside the region-of-interest. The encoding comprises quantization, and the encoding module is operable to apply a difference in quantization granularity between the encoding inside and outside the region-of-interest. The adaptation module is configured to determine at least one metric representative of a difference in benefit of the quantization inside and outside the region-of-interest, and to adapt the difference in quantization granularity in dependence on this metric.Type: GrantFiled: September 26, 2013Date of Patent: October 20, 2015Assignee: Microsoft Technology Licensing, LLCInventors: Pontus Carlsson, Magnus Hemmendorff, Konrad Hofbauer, Sergei Nikiforov, David Zhao
-
Publication number: 20150109406Abstract: A user terminal for participating in video calls comprises: an encoder having a frame size, being the size in pixels at which it encodes frames of video; and a pre-processing stage which supplies a sequence of frames to the encoder at that frame size, each frame comprising at least an image region representing a source video image at a respective moment in time. The pre-processing stage is configured to supply at least some of the frames to the encoder in a modified form, by resizing the source video image to produce the image region of each modified frame with a size smaller than the frame size of the encoder, and combining with a border region such that the modified frame matches the frame size of the encoder. The encoder encodes the frames at the frame size and transmits them to a receiving terminal as part of a live video call.Type: ApplicationFiled: February 19, 2014Publication date: April 23, 2015Applicant: Microsoft CorporationInventors: Pontus Carlsson, Magnus Hemmendorff, Konrad Hofbauer, Sergei Nikiforov, David Yuheng Zhao
-
Publication number: 20150016510Abstract: An encoder comprising an encoding module and an adaptation module. The encoding module is configured to encode video in at least one region-of-interest and outside the region-of-interest. The encoding comprises quantization, and the encoding module is operable to apply a difference in quantization granularity between the encoding inside and outside the region-of-interest. The adaptation module is configured to determine at least one metric representative of a difference in benefit of the quantization inside and outside the region-of-interest, and to adapt the difference in quantization granularity in dependence on this metric.Type: ApplicationFiled: September 26, 2013Publication date: January 15, 2015Applicant: Microsoft CorporationInventors: Pontus Carlsson, Magnus Hemmendorff, Konrad Hofbauer, Sergei Nikiforov, David Zhao
-
Publication number: 20140307771Abstract: An apparatus for encoding video data, the apparatus comprising a compliance module configured to compare a resource requirement associated with encoding video data to form at least part of an encoded frame using a standard encoding mode with an acceptable resource level and an encoder configured to, responsive to a determination that the resource requirement will exceed the acceptable resource level, form the at least part of an encoded frame by encoding some of the video data using the standard encoding mode and filling a remainder of the at least part of the encoded frame with data that is associated with a lower resource usage than data generated using the standard encoding mode.Type: ApplicationFiled: June 20, 2013Publication date: October 16, 2014Inventors: Magnus Hemmendorff, David Zhao, Sergey Sablin, Pontus Carlsson, Konrad Hofbauer, Sergei Nikiforov