Patents by Inventor Sergey Sablin
Sergey Sablin has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20230086944Abstract: A format for use in encoding moving image data, comprising: a sequence of frames including plurality of the frames in which at least a region is encoded using motion estimation; a respective set of motion vector values representing motion vectors of the motion estimation for each respective one of these frames or each respective one of one or more regions within each of such frames; and at least one respective indicator associated with each of the respective frames or regions, indicating whether the respective motion vector values of the respective frame or region are encoded at a first resolution or a second resolution.Type: ApplicationFiled: November 28, 2022Publication date: March 23, 2023Applicant: Microsoft Technology Licensing, LLCInventors: You Zhou, Sergey Silkin, Sergey Sablin, Chih-Lung Lin, Ming-Chieh Lee, Gary J. Sullivan
-
Patent number: 11546629Abstract: A format for use in encoding moving image data, comprising: a sequence of frames including plurality of the frames in which at least a region is encoded using motion estimation; a respective set of motion vector values representing motion vectors of the motion estimation for each respective one of these frames or each respective one of one or more regions within each of such frames; and at least one respective indicator associated with each of the respective frames or regions, indicating whether the respective motion vector values of the respective frame or region are encoded at a first resolution or a second resolution.Type: GrantFiled: January 31, 2020Date of Patent: January 3, 2023Assignee: Microsoft Technology Licensing, LLCInventors: You Zhou, Sergey Silkin, Sergey Sablin, Chih-Lung Lin, Ming-Chieh Lee, Gary J. Sullivan
-
Publication number: 20220327797Abstract: A method includes optimizing a video quality of a video data stream received by a user in a video conference. A region of at least one frame of the video data stream may be sampled. The sampling rate may be variable based on the rate of change of objects in the video data stream. A video quality metric corresponding to the video quality of the video data stream may be calculated. The video quality of the video data stream may be adjusted based on the video quality metric. Another method includes retrieving a video and detecting one or more moving regions of interest (ROIs). Each of the ROIs is tagged with metadata configured to allow users to interact with the ROI, and the detected ROIs and their corresponding metadata are stored in a file. Based on the file, playback of the video and movement of the ROIs may be synchronized.Type: ApplicationFiled: April 5, 2022Publication date: October 13, 2022Inventors: Iulian Doroftei Calinov, Marek F. Latuskiewicz, Mayank Singh Chaudhary, Meng Zhang, Sergey Sablin, Xingze He, Yu-Chen Sun, Yun Zhang, Addie Louise Marino, Miguel Angel Perez
-
Patent number: 11445223Abstract: Video data is received at a decoding device. An encoded first frame of the video data is received with a current frame description for the first frame comprising: an identifier of the first frame, and an indicator of a storage location at the receiving device for the first frame and its frame identifier. An encoded second frame of the video data is also received with at least one reference frame description for the second frame comprising: a reference frame identifier, and an indicator of said storage location. This allows the decoding device to check that the correct reference frame for decoding the second frame is stored thereat. Corresponding encoding operations are also disclosed.Type: GrantFiled: December 13, 2016Date of Patent: September 13, 2022Assignee: Microsoft Technology Licensing, LLCInventors: Sergey Sablin, Adriana Dumitras, Gary J. Sullivan
-
Patent number: 10798141Abstract: Multiple data streams are transmitted from a transmitting device via an end-to-end or process-to-process channel to a receiving device. At the transmitting device a media data stream is generated. A maximum packet size for another data stream is determined based on a determined end-to-end or process-to-process bandwidth and using playout information pertaining to the media data, which conveys a desired playout rate of the media data. At the transmitting device, based on the determined maximum packet size, a plurality of data packets of the other data stream is generated, each having a packet size no more than the determined maximum. The media and other data streams are multiplexed onto the channel at the transmitting device, thereby transmitting both of the data streams from the transmitting device to the receiving device via the same channel.Type: GrantFiled: November 16, 2018Date of Patent: October 6, 2020Assignee: Microsoft Technology Licensing, LLCInventors: Sergey Sablin, Sergei Nikiforov, Matthieu Michel Jean-Alexis Moinard, Victor Miguel Barbero, David Yuheng Zhao, Mattias D. Nilsson
-
Patent number: 10708594Abstract: Disclosed herein are exemplary embodiments of innovations in the area of encoding pictures or portions of pictures and determining whether and how certain encoding operations should be performed and flagged for performance by the decoder in the bitstream. In particular examples, various implementations for selectively encoding picture portions (e.g., blocks) in a skip mode (e.g., as in the skip mode of the H.265/HEVC standard) are disclosed. Embodiments of the disclosed techniques can be used to improve encoder efficiency, decrease overall encoder resource usage, and/or improve encoder speed. Such embodiments can be used in encoder modes in which efficient, fast encoder performance is desired (e.g., during encoding of live events, such as video conferencing).Type: GrantFiled: November 19, 2018Date of Patent: July 7, 2020Assignee: Microsoft Technology Licensing, LLCInventors: You Zhou, Sergey Sablin, Chih-Lung Lin, Ming-Chieh Lee
-
Publication number: 20200169750Abstract: A format for use in encoding moving image data, comprising: a sequence of frames including plurality of the frames in which at least a region is encoded using motion estimation; a respective set of motion vector values representing motion vectors of the motion estimation for each respective one of these frames or each respective one of one or more regions within each of such frames; and at least one respective indicator associated with each of the respective frames or regions, indicating whether the respective motion vector values of the respective frame or region are encoded at a first resolution or a second resolution.Type: ApplicationFiled: January 31, 2020Publication date: May 28, 2020Applicant: Microsoft Technology Licensing, LLCInventors: You Zhou, Sergey Silkin, Sergey Sablin, Chih-Lung Lin, Ming-Chieh Lee, Gary J. Sullivan
-
Patent number: 10595025Abstract: A transmitting device for generating a plurality of encoded portions of a video to be transmitted to a receiving device over a network configured to: receive an error message over a feedback channel from the receiving device indicating at least one of said plurality of encoded portions that has been lost at the receiving device; encode a recovery portion responsive to said receiving said error message; and transmit said recovery portion to the receiving device over said network; wherein said error message includes information pertaining to a decoded portion successfully decoded at the receiving device and said recovery portion is encoded relative to said decoded portion.Type: GrantFiled: September 8, 2015Date of Patent: March 17, 2020Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Ming-Chieh Lee, Amy Lu, Pontus Carlsson, Mattias Dan Nilsson, Sergey Sablin, Sergey Silkin, David Yuheng Zhao, Magnus Hemmendorff, Sergei Nikiforov
-
Patent number: 10587891Abstract: A format for use in encoding moving image data, comprising: a sequence of frames including plurality of the frames in which at least a region is encoded using motion estimation; a respective set of motion vector values representing motion vectors of the motion estimation for each respective one of these frames or each respective one of one or more regions within each of such frames; and at least one respective indicator associated with each of the respective frames or regions, indicating whether the respective motion vector values of the respective frame or region are encoded at a first resolution or a second resolution.Type: GrantFiled: September 21, 2017Date of Patent: March 10, 2020Assignee: Microsoft Technology Licensing, LLCInventors: You Zhou, Sergey Silkin, Sergey Sablin, Chih-Lung Lin, Ming-Chieh Lee, Gary J. Sullivan
-
Patent number: 10313685Abstract: A transmitting device for generating a plurality of encoded portions of a video to be transmitted to a receiving device over a network configured to: receive an error message over a feedback channel from the receiving device indicating at least one of said plurality of encoded portions that has been lost at the receiving device; encode a recovery portion responsive to said receiving said error message; and transmit said recovery portion to the receiving device over said network; wherein said error message includes information pertaining to a decoded portion successfully decoded at the receiving device and said recovery portion is encoded relative to said decoded portion.Type: GrantFiled: September 8, 2015Date of Patent: June 4, 2019Assignee: Microsoft Technology Licensing, LLCInventors: Ming-Chieh Lee, Amy Lu, Pontus Carlsson, Mattias Dan Nilsson, Sergey Sablin, Sergey Silkin, David Yuheng Zhao, Magnus Hemmendorff, Sergei Nikiforov
-
Publication number: 20190098310Abstract: Disclosed herein are exemplary embodiments of innovations in the area of encoding pictures or portions of pictures and determining whether and how certain encoding operations should be performed and flagged for performance by the decoder in the bitstream. In particular examples, various implementations for selectively encoding picture portions (e.g., blocks) in a skip mode (e.g., as in the skip mode of the H.265/HEVC standard) are disclosed. Embodiments of the disclosed techniques can be used to improve encoder efficiency, decrease overall encoder resource usage, and/or improve encoder speed. Such embodiments can be used in encoder modes in which efficient, fast encoder performance is desired (e.g., during encoding of live events, such as video conferencing).Type: ApplicationFiled: November 19, 2018Publication date: March 28, 2019Applicant: Microsoft Technology Licensing, LLCInventors: You Zhou, Sergey Sablin, Chih-Lung Lin, Ming-Chieh Lee
-
Publication number: 20190089755Abstract: Multiple data streams are transmitted from a transmitting device via an end-to-end or process-to-process channel to a receiving device. At the transmitting device a media data stream is generated. A maximum packet size for another data stream is determined based on a determined end-to-end or process-to-process bandwidth and using playout information pertaining to the media data, which conveys a desired playout rate of the media data. At the transmitting device, based on the determined maximum packet size, a plurality of data packets of the other data stream is generated, each having a packet size no more than the determined maximum. The media and other data streams are multiplexed onto the channel at the transmitting device, thereby transmitting both of the data streams from the transmitting device to the receiving device via the same channel.Type: ApplicationFiled: November 16, 2018Publication date: March 21, 2019Inventors: Sergey Sablin, Sergei Nikiforov, Matthieu Michel Jean-Alexis Moinard, Victor Miguel Barbero, David Yuheng Zhao, Mattias D. Nilsson
-
Patent number: 10165024Abstract: Multiple data streams are transmitted from a transmitting device via an end-to-end or process-to-process channel to a receiving device. At the transmitting device a media data stream is generated. A maximum packet size for another data stream is determined based on a determined end-to-end or process-to-process bandwidth and using playout information pertaining to the media data, which conveys a desired playout rate of the media data. At the transmitting device, based on the determined maximum packet size, a plurality of data packets of the other data stream is generated, each having a packet size no more than the determined maximum. The media and other data streams are multiplexed onto the channel at the transmitting device, thereby transmitting both of the data streams from the transmitting device to the receiving device via the same channel.Type: GrantFiled: April 29, 2016Date of Patent: December 25, 2018Assignee: Microsoft Technology Licensing, LLCInventors: Sergey Sablin, Sergei Nikiforov, Matthieu Michel Jean-Alexis Moinard, Victor Miguel Barbero, David Yuheng Zhao, Mattias D. Nilsson
-
Patent number: 10136132Abstract: Disclosed herein are exemplary embodiments of innovations in the area of encoding pictures or portions of pictures and determining whether and how certain encoding operations should be performed and flagged for performance by the decoder in the bitstream. In particular examples, various implementations for selectively encoding picture portions (e.g., blocks) in a skip mode (e.g., as in the skip mode of the H.265/HEVC standard) are disclosed. Embodiments of the disclosed techniques can be used to improve encoder efficiency, decrease overall encoder resource usage, and/or improve encoder speed. Such embodiments can be used in encoder modes in which efficient, fast encoder performance is desired (e.g., during encoding of live events, such as video conferencing).Type: GrantFiled: July 21, 2015Date of Patent: November 20, 2018Assignee: Microsoft Technology Licensing, LLCInventors: You Zhou, Sergey Sablin, Chih-Lung Lin, Ming-Chieh Lee
-
Publication number: 20180109806Abstract: A format for use in encoding moving image data, comprising: a sequence of frames including plurality of the frames in which at least a region is encoded using motion estimation; a respective set of motion vector values representing motion vectors of the motion estimation for each respective one of these frames or each respective one of one or more regions within each of such frames; and at least one respective indicator associated with each of the respective frames or regions, indicating whether the respective motion vector values of the respective frame or region are encoded at a first resolution or a second resolution.Type: ApplicationFiled: September 21, 2017Publication date: April 19, 2018Applicant: Microsoft Technology Licensing, LLCInventors: You Zhou, Sergey Silkin, Sergey Sablin, Chih-Lung Lin, Ming-Chieh Lee, Gary J. Sullivan
-
Patent number: 9942560Abstract: An input of an encoder receives moving image data comprising a sequence of frames to be encoded, each frame comprising a plurality of blocks in two dimensions with each block comprising a plurality of pixels in those two dimensions. A motion prediction module performs encoding by, for at least part of each of a plurality of said frames, coding each block relative to a respective reference portion of another frame of the sequence, with the respective reference portion being offset from the block by a respective motion vector. According to the present disclosure, the moving image data of this plurality of frames comprises a screen capture stream, and the motion prediction module is configured to restrict each of the motion vectors of the screen capture stream to an integer number of pixels in at least one of said dimensions.Type: GrantFiled: October 31, 2014Date of Patent: April 10, 2018Assignee: Microsoft Technology Licensing, LLCInventors: Sergey Silkin, Sergey Sablin, You Zhou, Chih-Lung Lin, Ming-Chieh Lee
-
Publication number: 20180077421Abstract: Video data is received at a decoding device. An encoded first frame of the video data is received with a current frame description for the first frame comprising: an identifier of the first frame, and an indicator of a storage location at the receiving device for the first frame and its frame identifier. An encoded second frame of the video data is also received with at least one reference frame description for the second frame comprising: a reference frame identifier, and an indicator of said storage location. This allows the decoding device to check that the correct reference frame for decoding the second frame is stored thereat. Corresponding encoding operations are also disclosed.Type: ApplicationFiled: December 13, 2016Publication date: March 15, 2018Applicant: Microsoft Technology Licensing, LLCInventors: Sergey Sablin, Adriana Dumitras, Gary J. Sullivan
-
Patent number: 9774881Abstract: A format for use in encoding moving image data, comprising: a sequence of frames including plurality of the frames in which at least a region is encoded using motion estimation; a respective set of motion vector values representing motion vectors of the motion estimation for each respective one of these frames or each respective one of one or more regions within each of such frames; and at least one respective indicator associated with each of the respective frames or regions, indicating whether the respective motion vector values of the respective frame or region are encoded at a first resolution or a second resolution.Type: GrantFiled: October 31, 2014Date of Patent: September 26, 2017Assignee: Microsoft Technology Licensing, LLCInventors: You Zhou, Sergey Silkin, Sergey Sablin, Chih-Lung Lin, Ming-Chieh Lee, Gary J. Sullivan
-
Patent number: 9762799Abstract: Method, device and computer program product for stabilizing a received video signal. A plurality of frames of the video signal is captured using a camera. The video signal is transmitted as an encoded bit stream. Displacement of the camera between successive frames is determined from a motion indication in the bit stream. The determined displacement is used to compensate for motion in the video signal between successive frames caused by the motion of the camera, to thereby stabilize the video signal.Type: GrantFiled: December 29, 2011Date of Patent: September 12, 2017Assignee: SkypeInventors: Pontus Carlsson, Andrei Jefremov, Sergey Sablin, David Zhao
-
Publication number: 20170126758Abstract: Multiple data streams are transmitted from a transmitting device via an end-to-end or process-to-process channel to a receiving device. At the transmitting device a media data stream is generated. A maximum packet size for another data stream is determined based on a determined end-to-end or process-to-process bandwidth and using playout information pertaining to the media data, which conveys a desired playout rate of the media data. At the transmitting device, based on the determined maximum packet size, a plurality of data packets of the other data stream is generated, each having a packet size no more than the determined maximum. The media and other data streams are multiplexed onto the channel at the transmitting device, thereby transmitting both of the data streams from the transmitting device to the receiving device via the same channel.Type: ApplicationFiled: April 29, 2016Publication date: May 4, 2017Applicant: Microsoft Technology Licensing, LLCInventors: Sergey Sablin, Sergei Nikiforov, Matthieu Michel Jean-Alexis Moinard, Victor Miguel Barbero, David Yuheng Zhao, Mattias D. Nilsson