Patents by Inventor Yuechuan Li
Yuechuan Li has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11425178Abstract: Techniques for low latency streaming, for example in a broadcasting environment, are described herein. In some examples, a playlist may include both currently encoded segments, which are segments that are fully encoded at or before playlist generation, and also future encoded segments, which are segments that have not yet been fully encoded at playlist generation. In some cases, the inclusion of future encoded segments in a playlist may result in a player requesting a segment that has not yet been fully encoded at the time that the request is received by the server. In some examples, even though the segment is not yet fully encoded, the server may nevertheless save and process the request, for example by transmitting encoded portions of the requested segment as those portions are made available by the encoder.Type: GrantFiled: June 30, 2020Date of Patent: August 23, 2022Assignee: Twitch Interactive, Inc.Inventors: Yueshi Shen, Martin Hess, Shawn Hsu, Eran Ambar, Abhinav Kapoor, Jorge Arturo Villatoro, Spencer Nelson, Jeffrey Garneau, Cyrus Hall, Jyotindra Vasudeo, Andrew Francis, Yuechuan Li, Chih-Chiang Lu
-
Publication number: 20220207840Abstract: The subject technology sends captured image data and metadata to a first set of computing processes for processing. The subject technology receives, asynchronously from a second set of computing processes, second metadata. The subject technology detects a signal indicating a command to stop image data capturing. The subject technology, in response to the detected signal, generating a composite AR content item based on the metadata and the captured image data. The subject technology provides the composite AR content item for rendering for display on an eyewear device.Type: ApplicationFiled: December 29, 2021Publication date: June 30, 2022Inventors: Omer Cansizoglu, Chintan Doshi, Yuechuan Li, Stanislav Minakov, Fedir Poliakov, Justin Wilder
-
Patent number: 11146834Abstract: Techniques for low latency streaming, for example in a broadcasting environment, are described herein. In some examples, one or more individual renditions may be encoded into multiple rendition versions associated with different respective latencies. Also, in some examples, one or more individual renditions may be encoded into multiple rendition versions having different respective amounts of forward error correction (FEC), for example by an edge node of a video streaming service. Also, in some examples, video may be broadcast using a protocol that does not require retransmission of lost packets, such as Web Real-Time Communication (WebRTC), which is commonly used for point-to-point transmissions. Also, in some examples, one or more servers may receive quality of service feedback information from each player to which video content is transmitted. The one or more servers may use this feedback information to select and switch between appropriate renditions and rendition versions for each player.Type: GrantFiled: September 28, 2017Date of Patent: October 12, 2021Assignee: Twitch Interactive, Inc.Inventors: Yueshi Shen, Martin Hess, Shawn Hsu, Eran Ambar, Abhinav Kapoor, Jorge Arturo Villatoro, Spencer Nelson, Jeffrey Garneau, Cyrus Hall, Jyotindra Vasudeo, Andrew Francis, Yuechuan Li, Chih-Chiang Lu
-
Patent number: 10742699Abstract: Techniques for low latency streaming, for example in a broadcasting environment, are described herein. In some examples, a playlist may include both currently encoded segments, which are segments that are fully encoded at or before playlist generation, and also future encoded segments, which are segments that have not yet been fully encoded at playlist generation. In some cases, the inclusion of future encoded segments in a playlist may result in a player requesting a segment that has not yet been fully encoded at the time that the request is received by the server. In some examples, even though the segment is not yet fully encoded, the server may nevertheless save and process the request, for example by transmitting encoded portions of the requested segment as those portions are made available by the encoder.Type: GrantFiled: September 29, 2017Date of Patent: August 11, 2020Assignee: Twitch Interactive, Inc.Inventors: Yueshi Shen, Martin Hess, Shawn Hsu, Eran Ambar, Abhinav Kapoor, Jorge Arturo Villatoro, Spencer Nelson, Jeffrey Garneau, Cyrus Hall, Jyotindra Vasudeo, Andrew Francis, Yuechuan Li, Chih-Chiang Lu
-
Patent number: 10735783Abstract: Techniques for low latency streaming, for example in a broadcasting environment, are described herein. In some examples, one or more individual renditions may be encoded into multiple rendition versions associated with different respective latencies. Also, in some examples, one or more individual renditions may be encoded into multiple rendition versions having different respective amounts of forward error correction (FEC), for example by an edge node of a video streaming service. Also, in some examples, video may be broadcast using a protocol that does not require retransmission of lost packets, such as Web Real-Time Communication (WebRTC), which is commonly used for point-to-point transmissions. Also, in some examples, one or more servers may receive quality of service feedback information from each player to which video content is transmitted. The one or more servers may use this feedback information to select and switch between appropriate renditions and rendition versions for each player.Type: GrantFiled: September 28, 2017Date of Patent: August 4, 2020Assignee: Twitch Interactive, Inc.Inventors: Yueshi Shen, Martin Hess, Shawn Hsu, Eran Ambar, Abhinav Kapoor, Jorge Arturo Villatoro, Spencer Nelson, Jeffrey Garneau, Cyrus Hall, Jyotindra Vasudeo, Andrew Francis, Yuechuan Li, Chih-Chiang Lu
-
Patent number: 10630746Abstract: Techniques for low latency streaming, for example in a broadcasting environment, are described herein. In some examples, a playlist may include both currently encoded segments, which are segments that are fully encoded at or before playlist generation, and also future encoded segments, which are segments that have not yet been fully encoded at playlist generation. In some cases, the inclusion of future encoded segments in a playlist may result in a player requesting a segment that has not yet been fully encoded at the time that the request is received by the server. In some examples, even though the segment is not yet fully encoded, the server may nevertheless save and process the request, for example by transmitting encoded portions of the requested segment as those portions are made available by the encoder.Type: GrantFiled: September 29, 2017Date of Patent: April 21, 2020Assignee: Twitch Interactive, Inc.Inventors: Yueshi Shen, Martin Hess, Shawn Hsu, Eran Ambar, Abhinav Kapoor, Jorge Arturo Villatoro, Spencer Nelson, Jeffrey Garneau, Cyrus Hall, Jyotindra Vasudeo, Andrew Francis, Yuechuan Li, Chih-Chiang Lu
-
Patent number: 10484730Abstract: Techniques for estimation of bandwidth for transfer of video content in chunked transfer mode are described herein. A number of chunk samples may be collected during video content transmission. For each chunk sample, its respective delivery speed may be compared to its respective encoding bitrate. If the delivery speed is greater than or equal to the encoding bitrate, then the chunk sample may be included in a primary set of chunk samples. The primary set of chunk samples may be clustered into a lower speed cluster and a higher speed cluster. A representative speed, such as an average or weighted average speed, of the delivery speeds of the chunk samples in the lower speed cluster may be determined, and the bandwidth may be estimated based on the representative speed.Type: GrantFiled: January 24, 2018Date of Patent: November 19, 2019Assignee: Twitch Interactive, Inc.Inventors: Yuechuan Li, Yueshi Shen, Graham Keefe Tremper, Abhinav Kapoor, Matthew Szatmary, Nikhil Purushe, Eran Ambar
-
Patent number: 10327040Abstract: Techniques for low latency streaming, for example in a broadcasting environment, are described herein. In some examples, one or more individual renditions may be encoded into multiple rendition versions associated with different respective latencies. Also, in some examples, one or more individual renditions may be encoded into multiple rendition versions having different respective amounts of forward error correction (FEC), for example by an edge node of a video streaming service. Also, in some examples, video may be broadcast using a protocol that does not require retransmission of lost packets, such as Web Real-Time Communication (WebRTC), which is commonly used for point-to-point transmissions. Also, in some examples, one or more servers may receive quality of service feedback information from each player to which video content is transmitted. The one or more servers may use this feedback information to select and switch between appropriate renditions and rendition versions for each player.Type: GrantFiled: September 28, 2017Date of Patent: June 18, 2019Assignee: Twitch Interactive, Inc.Inventors: Yueshi Shen, Martin Hess, Shawn Hsu, Eran Ambar, Abhinav Kapoor, Jorge Arturo Villatoro, Spencer Nelson, Jeffrey Garneau, Cyrus Hall, Jyotindra Vasudeo, Andrew Francis, Yuechuan Li, Chih-Chiang Lu
-
Patent number: 9998745Abstract: Aspects extend to methods, systems, and computer program products for transforming video bit streams for parallel decoding. Aspects of the invention can be used to break segment coding structure limitations in video bit streams. Aspects can be used to maximize parallelization of video decoding tasks, including motion compensation processing, to more efficiently utilize multi-core and multi-processor computer systems. Multiple portions of intra-segment data can be processed in parallel to speed up single frame processing. Video communication latency and memory requirements are also reduced.Type: GrantFiled: October 29, 2015Date of Patent: June 12, 2018Assignee: Microsoft Technology Licensing, LLCInventors: Yuechuan Li, Yongjun Wu, Shyam Sadhwani, Bakkama Srinath Reddy, Matthew R. Wozniak, Victor V. Cherepanov
-
Patent number: 9674540Abstract: To decode encoded video using a computer with a central processing unit and a graphics processing unit as a coprocessor, parameters applied to blocks of intermediate image data are transferred from the central processing unit to the graphics processing unit. When the operation being performed applies to a small portion of the blocks of intermediate image data, then the central processing unit can transfer to the graphics processing unit the parameters for only those blocks to which the operation applies. In particular, the central processing unit can transfer a set of parameters for a limited number of blocks of intermediate image data, with an indication of the block to which each set of parameters applies, which both can improve speed of operation and can reduce power consumption.Type: GrantFiled: September 25, 2014Date of Patent: June 6, 2017Assignee: Microsoft Technology Licensing, LLCInventors: Matthew Wozniak, Yongjun Wu, Yuechuan Li, Shyam Sadhwani
-
Publication number: 20170127072Abstract: Aspects extend to methods, systems, and computer program products for transforming video bit streams for parallel decoding. Aspects of the invention can be used to break segment coding structure limitations in video bit streams. Aspects can be used to maximize parallelization of video decoding tasks, including motion compensation processing, to more efficiently utilize multi-core and multi-processor computer systems. Multiple portions of intra-segment data can be processed in parallel to speed up single frame processing. Video communication latency and memory requirements are also reduced.Type: ApplicationFiled: October 29, 2015Publication date: May 4, 2017Inventors: Yuechuan Li, Yongjun Wu, Shyam Sadhwani, Bakkama Srinath Reddy, Matthew R. Wozniak, Victor V. Cherepanov
-
Publication number: 20170034530Abstract: Innovations are provided for encoding and/or decoding video and/or image content using reduced size inverse transforms. For example, a reduced size inverse transform can be performed during encoding or decoding of video or image content using a subset of coefficients (e.g., primarily non-zero coefficients) of a given block. For example, a bounding area can be determined for a block that encompasses the non-zero coefficients of the block. Meta-data for the block can then be generated, including a shortcut code that indicates whether a reduced size inverse transform will be performed. The inverse transform can then be performed using a subset of coefficients for the block (e.g., identified by the bounding area) and the meta-data, which results in decreased utilization of computing resources. The subset of coefficients and the meta-data can be transferred to a graphics processing unit (GPU), which also results in savings in terms of data transfer.Type: ApplicationFiled: July 28, 2015Publication date: February 2, 2017Applicant: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Victor Cherepanov, Yongjun Wu, Srinath Reddy, Yuechuan Li, Shyam Sadhwani, Chihlung Lin, Binlong Li
-
Publication number: 20160345018Abstract: A video encoding system balances memory usage to store interpolated image data with processing resource usage to interpolate image data without encoding quality degradation or with better encoding quality. This balance can be achieved by identifying and interpolating subregions of a reference image. Each subregion is less than the whole reference image, but larger than a search region for any single block of an image for which motion vectors are to be computed. Each interpolated subregion of the reference image is used to compute motion vectors for multiple blocks of an image being encoded. A video encoding system can identify portions of an image being encoded for which sub-pixel resolution motion vectors are not computed. Motion vectors for such portions of the image can be computed using a reference image without interpolation.Type: ApplicationFiled: May 19, 2015Publication date: November 24, 2016Inventors: Shyam Sadhwani, Srinath Reddy, Yongjun Wu, Victor Cherepanov, Yuechuan Li, Chihlung Lin
-
Publication number: 20160094854Abstract: To decode encoded video using a computer with a central processing unit and a graphics processing unit as a coprocessor, parameters applied to blocks of intermediate image data are transferred from the central processing unit to the graphics processing unit. When the operation being performed applies to a small portion of the blocks of intermediate image data, then the central processing unit can transfer to the graphics processing unit the parameters for only those blocks to which the operation applies. In particular, the central processing unit can transfer a set of parameters for a limited number of blocks of intermediate image data, with an indication of the block to which each set of parameters applies, which both can improve speed of operation and can reduce power consumption.Type: ApplicationFiled: September 25, 2014Publication date: March 31, 2016Inventors: Matthew Wozniak, Yongjun Wu, Yuechuan Li, Shyam Sadhwani
-
Publication number: 20150288965Abstract: According to a first aspect of the innovations described herein video encoding, such as game video encoding, is improved with a goal to generate substantially constant video quality and the average target bitrate within a desired tolerance, which improves an overall user experience on video playback. An adaptive solution uses intelligent bias on bit allocation and quantization decisions, locally within a frame and globally across different frames, based on a current quality level and within an allowed bitrate variable tolerance. Bit allocation is increased on high complexity frames and redundant bits are avoided, which might have been wasted for static scenes and low complexity aspects. Statistics can be used from the encoding process. The solution can address similar video coding quality problems for video game recording on a variety of gaming platforms.Type: ApplicationFiled: September 24, 2014Publication date: October 8, 2015Inventors: Yuechuan Li, Yongjun Wu, Sudhakar V. Prabhu, Haoyun Wu