Patents Assigned to Twitch Interactive, Inc.
  • Patent number: 11870830
    Abstract: A live streaming service and on-demand streaming service are provided to live stream content from the live streaming service into an on-demand content application associated with the on-demand streaming service. Content producers may produce or otherwise be associated with pre-generated content (e.g., pre-recorded audio, video, etc.) that is available to content consumers on demand, through the on-demand content application. The content producers may also produce live content (e.g., live audio, video, etc.) that is available to content consumers in substantially real time as the live content is being generated, through a live content application associated with a live streaming service.
    Type: Grant
    Filed: December 10, 2020
    Date of Patent: January 9, 2024
    Assignee: Twitch Interactive, Inc.
    Inventors: Randeep S. Bhatia, Adam Zabarsky, Tracy Chan, Michael Jeremy Temkin, Skji Conklin, Sean P. McMullan, Justin Lewis Martinez
  • Patent number: 11838562
    Abstract: An input video stream may include primary video content, such as output from a first video game. An indication of a decrease in player activity in the first video game may be detected. A determination may be made, based at least in part on the indication of the decrease in player activity, to replace a portion of the primary video content with secondary video content. The decrease in player activity in the first video game may coincide with an increase in player activity in a second video game. An indication of this increase in player activity may be detected. The second video game may be selected, based at least in part on the indication of the increase in player activity, to provide the secondary video content. An output video stream is provided in which the selected portion of the primary video content is replaced by the secondary video content.
    Type: Grant
    Filed: March 30, 2020
    Date of Patent: December 5, 2023
    Assignee: Twitch Interactive, Inc.
    Inventor: Josiah Eatedali
  • Patent number: 11765418
    Abstract: A video streaming service may include a segmentation component that provides segment metadata that indicates starting locations for a plurality of segments of video content that are produced during transcoding of the video content. The segment metadata may be sent to a first transcode server and a second transcode server to allow alignment of segmentations between the first transcode server and the second transcode server. This may allow transcoding of the video content to be seamlessly switched from the first transcode server to the second transcode server, during transmission of the video content, without causing interruption of playback. The first transcode server and the second transcode server may also operate in parallel to produce different versions of the video content, such as versions encoded using different codecs. A video player may seamlessly switch between these different codec versions without causing interruption of playback.
    Type: Grant
    Filed: June 29, 2021
    Date of Patent: September 19, 2023
    Assignee: Twitch Interactive, Inc.
    Inventors: Selvanayagam Sendurpandian, Xiangbo Li, Benjamin Hirsch, Nagendra Akula Suresh Babu, Alex Converse, Alex Battaglia, Sangmook Jung, Luke Curley, Rohit Puri, Yueshi Shen, Tarek Amara
  • Patent number: 11658822
    Abstract: Example methods and system for providing content are disclosed. One or more cryptographic keys may be generated. At least a portion of the one or more cryptographic keys may be used to generate a token associated with a user interface service. The token may indicate a valid origin domain. The token may be provided to a user device, which may use the token to request content from a content service. The content service may authorize the request based on a comparison of the valid origin domain and an origin identifier associated with the request.
    Type: Grant
    Filed: February 19, 2020
    Date of Patent: May 23, 2023
    Assignee: Twitch Interactive, Inc.
    Inventors: Ross Engers, Kai Hayashi
  • Patent number: 11533543
    Abstract: It may be determined when at least one boost achievement condition is satisfied for temporarily boosting visibility of a video streaming channel within one or more interfaces of a video streaming service. The boosting of the visibility of the video streaming channel may be initiated based on satisfaction of the at least one boost achievement condition. It may be determined when at least one boost reward condition is satisfied. The boosting of the visibility of the video streaming channel may be terminated based on satisfaction of the at least one boost reward condition. The at least one boost achievement condition and the at least one boost reward condition may differ for different video streaming channels and may be determined based at least in part on viewership of the different video streaming channels.
    Type: Grant
    Filed: March 18, 2021
    Date of Patent: December 20, 2022
    Assignee: TWITCH INTERACTIVE, INC.
    Inventors: Jeanette Suh, Wali Ansary, Mandy Han, Bianca Speichermann, Kevin Lawrence Talampas Pamplona, Augustus Charles Yuan, Ashley Sun, Austin Nicole Jacobs, Jiachuan He, Andrew K. Wang
  • Patent number: 11457245
    Abstract: A content production system and content management system are provided to produce and manage content with multiple components, such as multi-track content with any number or combination of video tracks, audio tracks, and the like. Individual tracks of the content are selectively included in, or excluded from, different versions of the content such that different versions of the multi-track content may be generated from different subsets of the individual tracks. For example, one version of content may be generated for real-time streaming and may include a first subset or combination of the multiple tracks. Another version of the content may be generated for storage and future on-demand access, and may include a second subset or combination of the multiple tracks. Selection of the particular tracks of the multi-track content to be included in each version may be based on varying types of authorization associated with the individual tracks.
    Type: Grant
    Filed: December 11, 2020
    Date of Patent: September 27, 2022
    Assignee: Twitch Interactive, Inc.
    Inventors: Randeep S. Bhatia, Christopher Renshaw Fortier, Rohit Puri
  • Patent number: 11445246
    Abstract: An input video stream may include primary video content, such as output from a first video game. An indication of a decrease in player activity in the first video game may be detected. A determination may be made, based at least in part on the indication of the decrease in player activity, to replace a portion of the primary video content with secondary video content. The decrease in player activity in the first video game may coincide with an increase in player activity in a second video game. An indication of this increase in player activity may be detected. The second video game may be selected, based at least in part on the indication of the increase in player activity, to provide the secondary video content. An output video stream is provided in which the selected portion of the primary video content is replaced by the secondary video content.
    Type: Grant
    Filed: March 30, 2020
    Date of Patent: September 13, 2022
    Assignee: Twitch Interactive, Inc.
    Inventor: Josiah Eatedali
  • Patent number: 11425178
    Abstract: Techniques for low latency streaming, for example in a broadcasting environment, are described herein. In some examples, a playlist may include both currently encoded segments, which are segments that are fully encoded at or before playlist generation, and also future encoded segments, which are segments that have not yet been fully encoded at playlist generation. In some cases, the inclusion of future encoded segments in a playlist may result in a player requesting a segment that has not yet been fully encoded at the time that the request is received by the server. In some examples, even though the segment is not yet fully encoded, the server may nevertheless save and process the request, for example by transmitting encoded portions of the requested segment as those portions are made available by the encoder.
    Type: Grant
    Filed: June 30, 2020
    Date of Patent: August 23, 2022
    Assignee: Twitch Interactive, Inc.
    Inventors: Yueshi Shen, Martin Hess, Shawn Hsu, Eran Ambar, Abhinav Kapoor, Jorge Arturo Villatoro, Spencer Nelson, Jeffrey Garneau, Cyrus Hall, Jyotindra Vasudeo, Andrew Francis, Yuechuan Li, Chih-Chiang Lu
  • Patent number: 11425219
    Abstract: A plurality of image sources that are open on a first computing device may be determined. A plurality of visual representations of the plurality of image sources may be displayed. A selection of a first image source of the plurality of image sources for which to transmit first image data corresponding to the first image source to one or more other computing devices may be received via the plurality of visual representations. A first image capture component to capture the first image data may be automatically selected, by one or more software components, from a plurality of image capture components. The first image data may be captured using the first image capture component, and the first image data may be transmitted to the one or more other computing devices.
    Type: Grant
    Filed: September 30, 2019
    Date of Patent: August 23, 2022
    Assignee: Twitch Interactive, Inc.
    Inventors: Sang Jin Lee, Maxime Boulin, Jackson Gardner, Phillip Carter, Charles Bradford, Ross Alan Cameron Gardner, Tyler McDowall, RayAna Min Stanek, Kevin M. Ni
  • Patent number: 11178447
    Abstract: A computing device may receive video content along with first audio content that is synchronized with the video content. The computing device may also receive second audio content that is not synchronized with the video content. The computing device may, in turn, transmit output content that includes the video content and the second audio content. A second portion of the second audio content may be identified that has second audio characteristics that are within a selected range of similarity to first audio characteristics of a first portion of the first audio content. A temporal offset may be calculated between the first portion and the second portion. The video content and the second audio content may be synchronized within the output content by delaying, by an amount of the temporal offset, a transmission of the second audio content relative to a transmission of video content.
    Type: Grant
    Filed: May 5, 2020
    Date of Patent: November 16, 2021
    Assignee: Twitch Interactive, Inc.
    Inventors: James Panter, Daniel Campanile, Alexander Tyler, Sang Jin Lee
  • Patent number: 11157233
    Abstract: Techniques for selective audio capturing are described herein. In some cases, a user, such as a content provider, may select one or more computing processes from which to capture audio data. The audio data may be captured for transmission to at least one other computing device. Code may be injected into at least the one or more computing processes. In some cases, upon execution of the code, storage locations of the audio data are obtained. Thus, the audio data may be captured from the storage locations, and the captured audio data may be transmitted to one or more other computing devices. Additionally, based, at least in part, on a user selection, other audio data from other computing processes executing on the computing device may not be transmitted to the one or more other computing devices.
    Type: Grant
    Filed: September 23, 2019
    Date of Patent: October 26, 2021
    Assignee: Twitch Interactive, Inc.
    Inventors: Sean Stanek, Tyler McDowall
  • Patent number: 11153581
    Abstract: During downloading and decoding of a lower-quality video version of a video segment, an up-switch condition may be detected. An intra-segment up-switch to a higher-quality version of the segment may then be made. In particular, the higher quality version may be downloaded and decoded at least partially concurrently with the lower-quality version, for example using a dual decoder arrangement. A first portion of the lower-quality version may be displayed. The first portion of the lower-quality may extend from a start of the segment to an intermediate position of the segment. At the intermediate position, playing may be switched from the lower-quality version to the higher-quality version. A second portion of the higher-quality version may be displayed. The second portion of the higher-quality version may extend from the intermediate position to an end of the segment.
    Type: Grant
    Filed: May 19, 2020
    Date of Patent: October 19, 2021
    Assignee: Twitch Interactive, Inc.
    Inventor: Nikhil Purushe
  • Patent number: 11146834
    Abstract: Techniques for low latency streaming, for example in a broadcasting environment, are described herein. In some examples, one or more individual renditions may be encoded into multiple rendition versions associated with different respective latencies. Also, in some examples, one or more individual renditions may be encoded into multiple rendition versions having different respective amounts of forward error correction (FEC), for example by an edge node of a video streaming service. Also, in some examples, video may be broadcast using a protocol that does not require retransmission of lost packets, such as Web Real-Time Communication (WebRTC), which is commonly used for point-to-point transmissions. Also, in some examples, one or more servers may receive quality of service feedback information from each player to which video content is transmitted. The one or more servers may use this feedback information to select and switch between appropriate renditions and rendition versions for each player.
    Type: Grant
    Filed: September 28, 2017
    Date of Patent: October 12, 2021
    Assignee: Twitch Interactive, Inc.
    Inventors: Yueshi Shen, Martin Hess, Shawn Hsu, Eran Ambar, Abhinav Kapoor, Jorge Arturo Villatoro, Spencer Nelson, Jeffrey Garneau, Cyrus Hall, Jyotindra Vasudeo, Andrew Francis, Yuechuan Li, Chih-Chiang Lu
  • Patent number: 11076188
    Abstract: During download of a first video segment, a buffer empty condition may be detected that interrupts playing of the first video segment. A remaining data size may be determined corresponding to a remaining portion of the first video segment that has not been downloaded when the buffer empty condition occurs. A total data size may be determined corresponding to a second video segment in its entirety, and it may be determined that the remaining data size exceeds the total data size. The download of the first video segment may then be canceled, and the second video segment may be downloaded. A start of a replacement portion of the second video segment may be identified that corresponds to a start of the remaining portion of the first video segment. Playing of the second video segment may be initiated from the start of the replacement portion of the second video segment.
    Type: Grant
    Filed: December 9, 2019
    Date of Patent: July 27, 2021
    Assignee: Twitch Interactive, Inc.
    Inventor: Nikhil Purushe
  • Patent number: 11076111
    Abstract: A streaming application setup assistant may receive an image captured by a camera, the image capturing a physical environment that is to be part of a live video stream. A plurality of pixels may be selected from the image. The plurality of pixels may be grouped, based on a pixel color value for each pixel, into a plurality of pixel groups. A key pixel color value may be calculated that is associated with an average pixel color value of pixels in a largest pixel group of the plurality of pixel groups. A similarity color range that encompasses a threshold percentage of the pixels in the largest pixel group may be identified based on the key pixel color value. The similarity color range may be utilized to configure settings for replacement of the background in the live video stream.
    Type: Grant
    Filed: November 13, 2019
    Date of Patent: July 27, 2021
    Assignee: Twitch Interactive, Inc.
    Inventors: Kevin M. Ni, Jackson Gardner, Charles Bradford, Sean Stanek, Ross Alan Cameron Gardner, Tyler McDowall, Phillip Carter, Furqan Rydhan, Florian Patrick Nierhaus, Sang Jin Lee
  • Patent number: 11039102
    Abstract: Various techniques for providing video feed redundancy are described herein. Instructions may be provided for switching input to an output video feed between two or more redundant input video feeds. In some examples, the redundant input video feeds may not be duplicates, may not be frame synchronized, may not be transmitted from the same location, may not be transmitted using the same network types or transmission protocols, and/or may not be initiated at the same time. In some examples, the instructions for video feed redundancy may be associated with respective authorization keys for the redundant input video feeds.
    Type: Grant
    Filed: December 12, 2017
    Date of Patent: June 15, 2021
    Assignee: Twitch Interactive, Inc.
    Inventors: Ivan Marcin, Jonas Bengtson, Tarek Amara, Shawn Hsu, Abhinav Kapoor, Jorge Arturo Villatoro, Eran Ambar
  • Patent number: 10970904
    Abstract: A declarative cross-platform framework for interactive user interfaces is described herein. Commands may define a virtual surface for display in a plurality of streaming applications executing across a plurality of computing platforms. The commands may be expressed in a declarative format that allows the virtual surface to be defined without injecting code into the plurality of streaming applications. The commands may indicate a first position within the virtual surface for display of a display item, and the first position may be expressed based on relative amounts of positional attributes that are relative to total amounts of the positional attributes for the virtual surface in its entirety. The streaming applications may host framework runtime components for respective computing platforms on which the streaming applications execute. The framework runtime components may use the commands to generate respective rendering instructions for rendering the virtual surface on their respective computing platforms.
    Type: Grant
    Filed: June 21, 2019
    Date of Patent: April 6, 2021
    Assignee: Twitch Interactive, Inc.
    Inventor: Mario Kosmiskas
  • Patent number: 10742699
    Abstract: Techniques for low latency streaming, for example in a broadcasting environment, are described herein. In some examples, a playlist may include both currently encoded segments, which are segments that are fully encoded at or before playlist generation, and also future encoded segments, which are segments that have not yet been fully encoded at playlist generation. In some cases, the inclusion of future encoded segments in a playlist may result in a player requesting a segment that has not yet been fully encoded at the time that the request is received by the server. In some examples, even though the segment is not yet fully encoded, the server may nevertheless save and process the request, for example by transmitting encoded portions of the requested segment as those portions are made available by the encoder.
    Type: Grant
    Filed: September 29, 2017
    Date of Patent: August 11, 2020
    Assignee: Twitch Interactive, Inc.
    Inventors: Yueshi Shen, Martin Hess, Shawn Hsu, Eran Ambar, Abhinav Kapoor, Jorge Arturo Villatoro, Spencer Nelson, Jeffrey Garneau, Cyrus Hall, Jyotindra Vasudeo, Andrew Francis, Yuechuan Li, Chih-Chiang Lu
  • Patent number: 10735783
    Abstract: Techniques for low latency streaming, for example in a broadcasting environment, are described herein. In some examples, one or more individual renditions may be encoded into multiple rendition versions associated with different respective latencies. Also, in some examples, one or more individual renditions may be encoded into multiple rendition versions having different respective amounts of forward error correction (FEC), for example by an edge node of a video streaming service. Also, in some examples, video may be broadcast using a protocol that does not require retransmission of lost packets, such as Web Real-Time Communication (WebRTC), which is commonly used for point-to-point transmissions. Also, in some examples, one or more servers may receive quality of service feedback information from each player to which video content is transmitted. The one or more servers may use this feedback information to select and switch between appropriate renditions and rendition versions for each player.
    Type: Grant
    Filed: September 28, 2017
    Date of Patent: August 4, 2020
    Assignee: Twitch Interactive, Inc.
    Inventors: Yueshi Shen, Martin Hess, Shawn Hsu, Eran Ambar, Abhinav Kapoor, Jorge Arturo Villatoro, Spencer Nelson, Jeffrey Garneau, Cyrus Hall, Jyotindra Vasudeo, Andrew Francis, Yuechuan Li, Chih-Chiang Lu
  • Patent number: 10715860
    Abstract: In combination with video content transmitted by a video streaming service, additional content may also be displayed to viewers. The video streaming service may provide a framework that allows the additional content to be provided by third parties. By allowing third parties to develop and provide additional content, the range of interactions and experiences made available through such content may, in some cases, be significantly expanded. The additional content may be displayed inside a respective assigned area, such as an inline frame (Iframe), embedded within a web page or other interface in which the video content is displayed. Additionally, techniques may be provided for controlling focus between a video player that displays the video content and the embedded area that displays the additional content, for example to help ensure that user input is provided to its intended target.
    Type: Grant
    Filed: November 29, 2017
    Date of Patent: July 14, 2020
    Assignee: Twitch Interactive, Inc.
    Inventors: Robert Bartlett, Joshua Madewell, Ke Zhang, Karl Patrick, Matthew Rudder, Ryan Lubinski, Greg Humphreys, Yoh Suzuki, Matthew Herbert Earl Walsh, David Cusatis, Patrick Sanchez