Patents by Inventor Yueshi Shen
Yueshi Shen has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11765418Abstract: A video streaming service may include a segmentation component that provides segment metadata that indicates starting locations for a plurality of segments of video content that are produced during transcoding of the video content. The segment metadata may be sent to a first transcode server and a second transcode server to allow alignment of segmentations between the first transcode server and the second transcode server. This may allow transcoding of the video content to be seamlessly switched from the first transcode server to the second transcode server, during transmission of the video content, without causing interruption of playback. The first transcode server and the second transcode server may also operate in parallel to produce different versions of the video content, such as versions encoded using different codecs. A video player may seamlessly switch between these different codec versions without causing interruption of playback.Type: GrantFiled: June 29, 2021Date of Patent: September 19, 2023Assignee: Twitch Interactive, Inc.Inventors: Selvanayagam Sendurpandian, Xiangbo Li, Benjamin Hirsch, Nagendra Akula Suresh Babu, Alex Converse, Alex Battaglia, Sangmook Jung, Luke Curley, Rohit Puri, Yueshi Shen, Tarek Amara
-
Patent number: 11425178Abstract: Techniques for low latency streaming, for example in a broadcasting environment, are described herein. In some examples, a playlist may include both currently encoded segments, which are segments that are fully encoded at or before playlist generation, and also future encoded segments, which are segments that have not yet been fully encoded at playlist generation. In some cases, the inclusion of future encoded segments in a playlist may result in a player requesting a segment that has not yet been fully encoded at the time that the request is received by the server. In some examples, even though the segment is not yet fully encoded, the server may nevertheless save and process the request, for example by transmitting encoded portions of the requested segment as those portions are made available by the encoder.Type: GrantFiled: June 30, 2020Date of Patent: August 23, 2022Assignee: Twitch Interactive, Inc.Inventors: Yueshi Shen, Martin Hess, Shawn Hsu, Eran Ambar, Abhinav Kapoor, Jorge Arturo Villatoro, Spencer Nelson, Jeffrey Garneau, Cyrus Hall, Jyotindra Vasudeo, Andrew Francis, Yuechuan Li, Chih-Chiang Lu
-
Patent number: 11146834Abstract: Techniques for low latency streaming, for example in a broadcasting environment, are described herein. In some examples, one or more individual renditions may be encoded into multiple rendition versions associated with different respective latencies. Also, in some examples, one or more individual renditions may be encoded into multiple rendition versions having different respective amounts of forward error correction (FEC), for example by an edge node of a video streaming service. Also, in some examples, video may be broadcast using a protocol that does not require retransmission of lost packets, such as Web Real-Time Communication (WebRTC), which is commonly used for point-to-point transmissions. Also, in some examples, one or more servers may receive quality of service feedback information from each player to which video content is transmitted. The one or more servers may use this feedback information to select and switch between appropriate renditions and rendition versions for each player.Type: GrantFiled: September 28, 2017Date of Patent: October 12, 2021Assignee: Twitch Interactive, Inc.Inventors: Yueshi Shen, Martin Hess, Shawn Hsu, Eran Ambar, Abhinav Kapoor, Jorge Arturo Villatoro, Spencer Nelson, Jeffrey Garneau, Cyrus Hall, Jyotindra Vasudeo, Andrew Francis, Yuechuan Li, Chih-Chiang Lu
-
Patent number: 10944982Abstract: Methods to switch between renditions of a video stream are generally described. In some examples, the methods may include encoding a video stream at a first image quality in a first rendition and a second, lower image quality in a second rendition. The methods may further include sending the first rendition to a recipient computing device. The methods may include receiving a request to switch from the first rendition to the second rendition. The methods may include determining that first indicator data of a first inter-coded frame indicates that the video stream can be switched to a lower image quality rendition at the first inter-coded frame. In some examples, the methods may further include sending the second rendition to the recipient computing device.Type: GrantFiled: November 15, 2019Date of Patent: March 9, 2021Assignee: AMAZON TECHNOLOGIES, INC.Inventors: Qi Keith Wang, Yueshi Shen, Yongjun Wu, Tarek Amara, Naushirwan Navroze Patuck, Ilya Vladimirovich Brailovskiy
-
Patent number: 10869032Abstract: Methods of video streaming are generally described. In some examples, the methods may be performed by a server device and may include generating first intra-coded frame (I-frame) data and a plurality of enhancement layer data corresponding to the first I-frame data. The methods may further include sending the first I-frame data to a client device. The methods may further include transmitting first enhancement layer data to the client device. The methods may include sending first inter-coded frame data to the client device. In some examples, the first inter-coded frame data can be decoded by referencing first reference frame data generated by combining the first I-frame data and the first enhancement layer data.Type: GrantFiled: November 4, 2016Date of Patent: December 15, 2020Assignee: AMAZON TECHNOLOGIES, INC.Inventors: Yueshi Shen, Qi Keith Wang, Ilya Vladimirovich Brailovskiy, Renganathan Veerasubramanian, Yongjun Wu
-
Patent number: 10742699Abstract: Techniques for low latency streaming, for example in a broadcasting environment, are described herein. In some examples, a playlist may include both currently encoded segments, which are segments that are fully encoded at or before playlist generation, and also future encoded segments, which are segments that have not yet been fully encoded at playlist generation. In some cases, the inclusion of future encoded segments in a playlist may result in a player requesting a segment that has not yet been fully encoded at the time that the request is received by the server. In some examples, even though the segment is not yet fully encoded, the server may nevertheless save and process the request, for example by transmitting encoded portions of the requested segment as those portions are made available by the encoder.Type: GrantFiled: September 29, 2017Date of Patent: August 11, 2020Assignee: Twitch Interactive, Inc.Inventors: Yueshi Shen, Martin Hess, Shawn Hsu, Eran Ambar, Abhinav Kapoor, Jorge Arturo Villatoro, Spencer Nelson, Jeffrey Garneau, Cyrus Hall, Jyotindra Vasudeo, Andrew Francis, Yuechuan Li, Chih-Chiang Lu
-
Patent number: 10735783Abstract: Techniques for low latency streaming, for example in a broadcasting environment, are described herein. In some examples, one or more individual renditions may be encoded into multiple rendition versions associated with different respective latencies. Also, in some examples, one or more individual renditions may be encoded into multiple rendition versions having different respective amounts of forward error correction (FEC), for example by an edge node of a video streaming service. Also, in some examples, video may be broadcast using a protocol that does not require retransmission of lost packets, such as Web Real-Time Communication (WebRTC), which is commonly used for point-to-point transmissions. Also, in some examples, one or more servers may receive quality of service feedback information from each player to which video content is transmitted. The one or more servers may use this feedback information to select and switch between appropriate renditions and rendition versions for each player.Type: GrantFiled: September 28, 2017Date of Patent: August 4, 2020Assignee: Twitch Interactive, Inc.Inventors: Yueshi Shen, Martin Hess, Shawn Hsu, Eran Ambar, Abhinav Kapoor, Jorge Arturo Villatoro, Spencer Nelson, Jeffrey Garneau, Cyrus Hall, Jyotindra Vasudeo, Andrew Francis, Yuechuan Li, Chih-Chiang Lu
-
Patent number: 10630746Abstract: Techniques for low latency streaming, for example in a broadcasting environment, are described herein. In some examples, a playlist may include both currently encoded segments, which are segments that are fully encoded at or before playlist generation, and also future encoded segments, which are segments that have not yet been fully encoded at playlist generation. In some cases, the inclusion of future encoded segments in a playlist may result in a player requesting a segment that has not yet been fully encoded at the time that the request is received by the server. In some examples, even though the segment is not yet fully encoded, the server may nevertheless save and process the request, for example by transmitting encoded portions of the requested segment as those portions are made available by the encoder.Type: GrantFiled: September 29, 2017Date of Patent: April 21, 2020Assignee: Twitch Interactive, Inc.Inventors: Yueshi Shen, Martin Hess, Shawn Hsu, Eran Ambar, Abhinav Kapoor, Jorge Arturo Villatoro, Spencer Nelson, Jeffrey Garneau, Cyrus Hall, Jyotindra Vasudeo, Andrew Francis, Yuechuan Li, Chih-Chiang Lu
-
Patent number: 10484730Abstract: Techniques for estimation of bandwidth for transfer of video content in chunked transfer mode are described herein. A number of chunk samples may be collected during video content transmission. For each chunk sample, its respective delivery speed may be compared to its respective encoding bitrate. If the delivery speed is greater than or equal to the encoding bitrate, then the chunk sample may be included in a primary set of chunk samples. The primary set of chunk samples may be clustered into a lower speed cluster and a higher speed cluster. A representative speed, such as an average or weighted average speed, of the delivery speeds of the chunk samples in the lower speed cluster may be determined, and the bandwidth may be estimated based on the representative speed.Type: GrantFiled: January 24, 2018Date of Patent: November 19, 2019Assignee: Twitch Interactive, Inc.Inventors: Yuechuan Li, Yueshi Shen, Graham Keefe Tremper, Abhinav Kapoor, Matthew Szatmary, Nikhil Purushe, Eran Ambar
-
Patent number: 10484701Abstract: Methods to switch between renditions of a video stream are generally described. In some examples, the methods may include encoding a video stream at a first image quality in a first rendition and a second, lower image quality in a second rendition. The methods may further include sending the first rendition to a recipient computing device. The methods may include receiving a request to switch from the first rendition to the second rendition. The methods may include determining that first indicator data of a first inter-coded frame indicates that the video stream can be switched to a lower image quality rendition at the first inter-coded frame. In some examples, the methods may further include sending the second rendition to the recipient computing device.Type: GrantFiled: November 8, 2016Date of Patent: November 19, 2019Assignee: AMAZON TECHNOLOGIES, INC.Inventors: Qi Keith Wang, Yueshi Shen, Yongjun Wu, Tarek Amara, Naushirwan Navroze Patuck, Ilya Vladimirovich Brailovskiy
-
Patent number: 10327040Abstract: Techniques for low latency streaming, for example in a broadcasting environment, are described herein. In some examples, one or more individual renditions may be encoded into multiple rendition versions associated with different respective latencies. Also, in some examples, one or more individual renditions may be encoded into multiple rendition versions having different respective amounts of forward error correction (FEC), for example by an edge node of a video streaming service. Also, in some examples, video may be broadcast using a protocol that does not require retransmission of lost packets, such as Web Real-Time Communication (WebRTC), which is commonly used for point-to-point transmissions. Also, in some examples, one or more servers may receive quality of service feedback information from each player to which video content is transmitted. The one or more servers may use this feedback information to select and switch between appropriate renditions and rendition versions for each player.Type: GrantFiled: September 28, 2017Date of Patent: June 18, 2019Assignee: Twitch Interactive, Inc.Inventors: Yueshi Shen, Martin Hess, Shawn Hsu, Eran Ambar, Abhinav Kapoor, Jorge Arturo Villatoro, Spencer Nelson, Jeffrey Garneau, Cyrus Hall, Jyotindra Vasudeo, Andrew Francis, Yuechuan Li, Chih-Chiang Lu
-
Patent number: 10243694Abstract: Techniques for output frame correction for unstable video streams are described herein. A video item may be transmitted via an input video stream from a first entity to a second entity over one or more electronic communications networks. The incoming frames from the input video stream may then be used, by the second entity, to generate an output video stream for presentation to one or more viewers. The transmission of the input video stream may temporarily become unstable and may be interrupted such that one or more frames of the input video stream are delayed and/or lost. When a transmission interruption is detected, the output video stream may be adjusted by inserting one or more correction frames into the output video stream. The inserted correction frames may include one or more repetitions of one or more prior frames in the output video stream and/or one or more interpolated frames.Type: GrantFiled: March 19, 2018Date of Patent: March 26, 2019Assignee: Twitch Interactive, Inc.Inventors: Ivan Marcin, Yueshi Shen
-
Patent number: 10116989Abstract: The techniques described herein may, for example, allow a quantity of buffered video frames to be reduced, for example for use in adaptive bitrate (ABR) streaming and other streaming transmissions. The quantity of buffered video frames may be reduced by dropping certain selected buffered frames from a resulting video output that is displayed to the viewer. This may reduce end-to-end latency without requiring a change in frame rate or fast forwarding of the video output, which may sometimes not be available or permitted by a resulting video player. These buffer reduction techniques may sometimes be employed upon a determination that transmission conditions have stabilized and that holding large quantities of buffered video may be unnecessary. In some examples, the disclosed techniques may be particularly advantageous for live streaming scenarios, in which end-to-end latency may be particularly problematic for the viewer.Type: GrantFiled: September 12, 2016Date of Patent: October 30, 2018Assignee: Twitch Interactive, Inc.Inventors: Yueshi Shen, Ivan Marcin, Josh Tabak, Abhinav Kapoor, Jorge Arturo Villatoro, Jeff Li
-
Patent number: 10015224Abstract: The techniques described herein may, for example, allow a quantity of buffered video frames to be reduced, for example for use in adaptive bitrate (ABR) streaming and other streaming transmissions. The quantity of buffered video frames may be reduced by dropping certain selected buffered frames from a resulting video output that is displayed to the viewer. This may reduce end-to-end latency without requiring a change in frame rate or fast forwarding of the video output, which may sometimes not be available or permitted by a resulting video player. These buffer reduction techniques may sometimes be employed upon a determination that transmission conditions have stabilized and that holding large quantities of buffered video may be unnecessary. In some examples, the disclosed techniques may be particularly advantageous for live streaming scenarios, in which end-to-end latency may be particularly problematic for the viewer.Type: GrantFiled: September 12, 2016Date of Patent: July 3, 2018Assignee: Twitch Interactive, Inc.Inventors: Yueshi Shen, Ivan Marcin, Josh Tabak, Abhinav Kapoor, Jorge Arturo Villatoro, Jeff Li
-
Patent number: 9954646Abstract: Techniques for output frame correction for unstable video streams are described herein. A video item may be transmitted via an input video stream from a first entity to a second entity over one or more electronic communications networks. The incoming frames from the input video stream may then be used, by the second entity, to generate an output video stream for presentation to one or more viewers. The transmission of the input video stream may temporarily become unstable and may be interrupted such that one or more frames of the input video stream are delayed and/or lost. When a transmission interruption is detected, the output video stream may be adjusted by inserting one or more correction frames into the output video stream. The inserted correction frames may include one or more repetitions of one or more prior frames in the output video stream and/or one or more interpolated frames.Type: GrantFiled: June 29, 2016Date of Patent: April 24, 2018Assignee: Twitch Interactive, Inc.Inventors: Ivan Marcin, Yueshi Shen
-
Patent number: 9788077Abstract: Techniques for improved rendition switching in association with adaptive bitrate streaming are described herein. The disclosed techniques may allow switching between segments at P-frames in addition to IDR-frames. By allowing switching at P-frames, the disclosed techniques may improve efficiency by, for example, reducing end-to-end latency without causing an undesirable decrease in image quality and image fidelity. In some examples, switching to a lower image quality rendition (e.g., lower bitrate, lower resolution, etc.) may be accomplished using P-frame switching, IDR-frame switching or both. Also, in some examples, switching to a higher image quality rendition (e.g., higher bitrate, higher resolution, etc.) may be accomplished using only IDR-frame switching.Type: GrantFiled: March 18, 2016Date of Patent: October 10, 2017Assignee: Amazon Technologies, Inc.Inventors: Yueshi Shen, Jorge Arturo Villatoro, Matthew Louis Szatmary