Abstract: A method is executed by an electronic device in a video streaming system including a macroblock detector. The method includes receiving a video stream from a video source, selecting a frame from the video stream, detecting edges in the frame of the video stream, generating straight lines from detected edges in the frame of the video stream, identifying squares in the straight lines in the frame with polygon approximation, and outputting an indication of a detected macroblock in the image in response to identifying at least one square with characteristics of a macroblock in the frame.
Abstract: A method for detect and mitigate anomaly in video streaming platforms is disclosed. In one embodiment, performance data from a set of workers is received at a central telemetry system (CTS), where the performance data is indicative of operational status of the set of workers. The CTS processes the performance data, including generating task-specific monitoring data based on the performance data, and it identifies whether the performance data or the task-specific monitoring data contains any anomaly. Upon an anomaly being identified, the CTS mitigates the anomaly by interacting with the set of workers.
Type:
Grant
Filed:
May 29, 2015
Date of Patent:
December 25, 2018
Assignee:
iStreamPlanet Co., LLC
Inventors:
Mark Daniel VanAntwerp, Weimin Mark Wang
Abstract: A method implemented in an electronic device serving as a stream distributor distributing unicast video and audio streams of a streaming platform system is disclosed. The stream distributor receives a unicast data flow containing data of a video and audio stream from a load balancer, the unicast data flow being transmitted in user datagram protocol (UDP) packets. The method includes the electronic device detecting initiation of a maintenance activity on a virtual machine or its host associated with the stream distributor. The method includes the electronic device indicating a failure mode of the stream distributor, where the failure mode indication is to cause the load balancer to switch the unicast data flow to an alternate stream distributor. The method also includes the electronic device detecting a completion of the load balancer switching the unicast data flow to the alternate stream distributor, and halting the distribution of the unicast data flow.
Abstract: A method implemented in an electronic device serving as a worker processing video and audio streams of a streaming platform system is disclosed. The method includes the electronic device requesting a task group from an orchestrator of the streaming platform system, where the orchestrator manages video and audio stream processing of the streaming platform system. The method also includes the electronic device receiving the task group allocated for the worker from the orchestrator, where the task group is allocated based at least partially on characteristics of the worker. The method also includes the electronic device initiating one or more task running processes to execute the allocated task group, and where each task running process performs at least one of processing one or more inputs corresponding to an incoming edge to the node, and producing one or more outputs corresponding to one or more outgoing edges from the node.
Abstract: A method to coordinate video stream timing is disclosed. In one embodiment, a request is received at a streaming platform coordinator (SPC) to create a plurality of synchronized media workflows for video sources. Using the plurality of video sources as input, the SPC transmits a request from the SPC to at least one video streaming platform to create the plurality of media workflows, which are assigned to a plurality of workers. The SPC causes the plurality of videos to be routed to the plurality of workers upon receiving the request to route them. The SPC then determines a set of timing offsets to synchronize the plurality of media workflows, and makes the set of timing offsets available to the plurality of workers so that the workers publish synchronized media outputs. A system to perform the method and a storage medium storing instructions to perform the method are disclosed too.
Abstract: A method implemented in an electronic device serving as an orchestrator managing video and audio stream processing of a streaming platform system is disclosed. The method includes the electronic device receiving a request to process a video source and creating a task graph based on the request, where the task graph is a directed acyclic graph of tasks for processing the video source, where each node of the task graph represents a processing task, and where each edge of the task graph represents a data flow across two processing tasks and corresponding input and output of each processing task. The method also includes the electronic device estimating resource requirements of each processing tasks, and splitting the task graph into a plurality of subsets, wherein each subset corresponds to a task group to be executed by one or more workers of a plurality of processing units of the streaming platform system.
Abstract: A method executed by an electronic device to optimize resource utilization while processing media workflows by a video streaming platform is disclosed. In one embodiment, a request to initiate a set of training sessions is received, and for each training session, a set of training workflows to be processed is initiated and a task graph for each training workflow is created. Then a worker of the video streaming platform is assigned to each training session. The raw performance data from each assigned worker is then collected, and a platform performance profile is generated based on the raw performance data from the each assigned worker. The platform performance profile is used to predict resource requirements of media workflows to be processed by the video streaming platform. A system to perform the method and a storage medium storing instructions to perform the method are disclosed too.
Type:
Grant
Filed:
May 8, 2015
Date of Patent:
August 2, 2016
Assignee:
iStreamPlanet Co.
Inventors:
Alessio Galdy, Eric Juteau, Jeffrey Alan Davis, Mark Daniel VanAntwerp
Abstract: A method to coordinate redundant video processing in video streaming platforms is disclosed. In one embodiment, a request is received at a streaming platform coordinator (SPC) to create a redundant media workflow for a video source. The SPC transmits two requests to create the media workflow, one each to a first and a second video streaming platforms, each creating one instance of the media workflow. The SPC then receives requests to route the video source to a first and a second workers respectively and causes the video source to be routed so. The SPC then communicates with the first and the second workers so that only one worker out of the first and second workers publishes output of one instance of the media workflow to a CDN at a given moment. A system to perform the method and a storage medium storing instructions to perform the method are disclosed too.
Type:
Grant
Filed:
May 8, 2015
Date of Patent:
May 17, 2016
Assignee:
iStreamPlanet Co.
Inventors:
Robert William Ream, Mark Daniel VanAntwerp