Patents by Inventor Ioannis Katsavounidis

Ioannis Katsavounidis has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240089530
    Abstract: A method includes receiving, with a computing system, data representing a video item into a buffer. The method further includes outputting the video item from the buffer to a display system. The method further includes determining that utilization of the buffer falls below a predetermined threshold. The method further includes, in response to determining that the utilization of the buffer falls below the predetermined threshold, determining that there is a specified rebuffering point within a predetermined time frame. The method further includes pausing with the computing system, the video item at the specified rebuffering point in response to determining that there is the specified rebuffering point within the predetermined time frame.
    Type: Application
    Filed: November 22, 2023
    Publication date: March 14, 2024
    Inventors: Ioannis Katsavounidis, Mark Watson, Aaron Hipple, Will Wolcott
  • Patent number: 11910039
    Abstract: An encoding engine encodes a video sequence to provide optimal quality for a given bitrate. The encoding engine cuts the video sequence into a collection of shot sequences. Each shot sequence includes video frames captured from a particular capture point. The encoding engine resamples each shot sequence across a range of different resolutions, encodes each resampled sequence with a range of quality parameters, and then upsamples each encoded sequence to the original resolution of the video sequence. For each upsampled sequence, the encoding engine computes a quality metric and generates a data point that includes the quality metric and the resample resolution. The encoding engine collects all such data points and then computes the convex hull of the resultant data set. Based on all convex hulls across all shot sequences, the encoding engine determines an optimal collection of shot sequences for a range of bitrates.
    Type: Grant
    Filed: May 22, 2020
    Date of Patent: February 20, 2024
    Assignee: NETFLIX, INC.
    Inventor: Ioannis Katsavounidis
  • Publication number: 20240054607
    Abstract: A first component image quality metric included in a plurality of eligible component image quality metrics is computed. A reference version of a video frame is decomposed into a first set of decomposed levels in different scales. A distorted version is decomposed into a second set of decomposed levels in different scales. Detail loss is determined based on the first set and second set of decomposed levels in different scales. A second component image quality metric included in the eligible component image quality metrics is computed. The first set and second set of decomposed levels in different scales are reused for computing the second component image quality metric. Natural scene statistics are evaluated based on the first set and second set of decomposed levels in different scales. A video quality metric for the distorted version is determined based on at least a portion of the eligible component image quality metrics.
    Type: Application
    Filed: September 20, 2021
    Publication date: February 15, 2024
    Inventors: Ioannis Katsavounidis, Cosmin Vasile Stejerean
  • Patent number: 11871002
    Abstract: In various embodiments, an iterative encoding application encodes a source video sequence. The encoding optimization application generates a set of shot encode points based on a set of encoding points and a first shot sequence included in the source video sequence. Each shot encode point is associated with a different encoded shot sequence. The encoding optimization application performs convex hull operation(s) across the set of shot encode points to generate a first convex hull associated with the first shot sequence. Subsequently, the encoding optimization application generates encoded video sequences based on the first convex hull and a second convex hull associated with a second shot sequence included in the source video sequence. The encoding optimization application computes a new encoding point based on the encoded video sequences and a target value for a first video metric and then generates an optimized encoded video sequence based on the new encoding point.
    Type: Grant
    Filed: February 8, 2021
    Date of Patent: January 9, 2024
    Assignee: NETFLIX, INC.
    Inventor: Ioannis Katsavounidis
  • Patent number: 11870945
    Abstract: In various embodiments, an encoder comparison application compares the performance of different configured encoders. In operation, the encoder comparison application generates a first global convex hull of video encode points based on a first configured encoder and a set of subsequences included in a source video sequence. Each video encode point is associated with a different encoded version of the source video sequence. The encoder comparison application also generates a second global convex hull of video encode points based on a second configured encoder and the subsequences. Subsequently, the encoder configuration application computes a performance value for an encoding comparison metric based on the first global convex hull and the second global convex hull. Notably, the first performance value estimates a difference in performance between the first configured encoder and the second configured encoder.
    Type: Grant
    Filed: November 1, 2021
    Date of Patent: January 9, 2024
    Assignee: NETFLIX, INC.
    Inventors: Ioannis Katsavounidis, Liwei Guo
  • Patent number: 11863814
    Abstract: A method includes receiving, with a computing system, data representing a video item into a buffer. The method further includes outputting the video item from the buffer to a display system. The method further includes determining that utilization of the buffer falls below a predetermined threshold. The method further includes, in response to determining that the utilization of the buffer falls below the predetermined threshold, determining that there is a specified rebuffering point within a predetermined time frame. The method further includes pausing with the computing system, the video item at the specified rebuffering point in response to determining that there is the specified rebuffering point within the predetermined time frame.
    Type: Grant
    Filed: July 8, 2022
    Date of Patent: January 2, 2024
    Assignee: Netflix, Inc.
    Inventors: Ioannis Katsavounidis, Mark Watson, Aaron Hipple, Will Wolcott
  • Patent number: 11825029
    Abstract: In various embodiments, an encoder comparison application compares the performance of different configured encoders. In operation, the encoder comparison application generates a first global convex hull of video encode points based on a first configured encoder and a set of subsequences included in a source video sequence. Each video encode point is associated with a different encoded version of the source video sequence. The encoder comparison application also generates a second global convex hull of video encode points based on a second configured encoder and the subsequences. Subsequently, the encoder configuration application computes a performance value for an encoding comparison metric based on the first global convex hull and the second global convex hull. Notably, the first performance value estimates a difference in performance between the first configured encoder and the second configured encoder.
    Type: Grant
    Filed: November 1, 2021
    Date of Patent: November 21, 2023
    Assignee: NETFLIX, INC.
    Inventors: Ioannis Katsavounidis, Liwei Guo
  • Patent number: 11818375
    Abstract: In various embodiments, a sequence-based encoding application partitions a set of shot sequences associated with a media title into multiple clusters based on at least one feature that characterizes media content and/or encoded media content associated with the media title. The clusters include at least a first cluster and a second cluster. The sequence-based encoding application encodes a first shot sequence using a first operating point to generate a first encoded shot sequence. The first shot sequence and the first operating point are associated with the first cluster. By contrast, the sequence-based encoding application encodes a second shot sequence using a second operating point to generate a second encoded shot sequence. The second shot sequence and the second operating point are associated with the second cluster. Subsequently, the sequence-based encoding application generates an encoded media sequence based on the first encoded shot sequence and the second encoded shot sequence.
    Type: Grant
    Filed: October 18, 2021
    Date of Patent: November 14, 2023
    Assignee: NETFLIX, INC.
    Inventors: Ioannis Katsavounidis, Anne Aaron, Jan De Cock
  • Patent number: 11758146
    Abstract: In various embodiments, an encoding optimization application positions key frames within encoded video sequences based on shot changes. The encoding optimization application determines key frame location(s) based on shot change(s) included in a source video sequence associated with a media title. Each key frame location is associated with a different frame included in the source video sequence. For each of the key frame location(s), the encoding optimization application configures an encoding application to encode a frame of video content located at the key frame location as a key frame when performing encoding operations. Subsequently, the encoding optimization application causes the encoding application to perform encoding operation(s) on the source video sequence to generate a first encoded video sequence. During playback, the media title is switchable between a decoded version of the first encoded video sequence and a decoded version of a second encoded video sequence at the key frame location(s).
    Type: Grant
    Filed: January 15, 2021
    Date of Patent: September 12, 2023
    Assignee: NETFLIX, INC.
    Inventor: Ioannis Katsavounidis
  • Patent number: 11743474
    Abstract: The disclosed computer-implemented method may include, for a current frame of a sequence of video frames, determining a frame type label of the current frame. The method may include, in response to determining that the current frame is labeled as an intra frame (I-frame), decoding the current frame and comparing the decoded frame to historical I-frame data. The method may also include, in response to the comparison satisfying a shot-change threshold, flagging the current frame as a shot-change frame, and in response to flagging the current frame as the shot-change frame, storing the current frame for a subsequent shot-change detection. The method may further include updating, based on flagged shot-change frames, shot boundaries for the sequence of video frames. Various other methods, systems, and computer-readable media are also disclosed.
    Type: Grant
    Filed: August 27, 2021
    Date of Patent: August 29, 2023
    Assignee: Meta Platforms, Inc.
    Inventors: Maxim Bykov, Ioannis Katsavounidis
  • Patent number: 11722720
    Abstract: In various embodiments, a subsequence-based encoding application generates subsequences based on a source sequence associated with a media title. The subsequence-based encoding application then encodes both a first subsequence and a second subsequence across each of multiple configured encoders and at least one rate control value to generate, respectively, a first set of encoded subsequences and a second set of encoded subsequences. Notably, each configured encoder is associated with a combination of an encoder and a configuration, and at least two configured encoders are different from one another. Subsequently, the subsequence-based encoding application generates encoded media sequences based on the first set of encoded subsequences and the second set of encoded subsequences. Finally, the application selects a first encoded media sequence from the encoded media sequences based on a first target value for a media metric to subsequently stream to a first endpoint device during playback of the media title.
    Type: Grant
    Filed: January 21, 2022
    Date of Patent: August 8, 2023
    Assignee: NETFLIX, INC.
    Inventor: Ioannis Katsavounidis
  • Patent number: 11677797
    Abstract: In various embodiments, a subsequence-based encoding application generates a convex hull of subsequence encode points based on multiple encoding points and a first subsequence included in a set of subsequences that are associated with a media title. The subsequence-based encoding application then generates a first encode list that includes multiple subsequence encode points based on the first convex hull. Notably, each subsequence encode point included in the first encode list is associated with a different subsequence. The subsequence-based encoding application selects a first subsequence encode point included in the first encode list based on a first variability constraint that is associated with a media metric. The subsequence-based encoding application then replaces the first subsequence encode point included in the first encode list with a second subsequence encode point to generate a second encode list.
    Type: Grant
    Filed: December 6, 2021
    Date of Patent: June 13, 2023
    Assignee: NETFLIX, INC.
    Inventor: Ioannis Katsavounidis
  • Publication number: 20230060780
    Abstract: The disclosed computer-implemented method may include, for a current frame of a sequence of video frames, determining a frame type label of the current frame. The method may include, in response to determining that the current frame is labeled as an intra frame (I-frame), decoding the current frame and comparing the decoded frame to historical I-frame data. The method may also include, in response to the comparison satisfying a shot-change threshold, flagging the current frame as a shot-change frame, and in response to flagging the current frame as the shot-change frame, storing the current frame for a subsequent shot-change detection. The method may further include updating, based on flagged shot-change frames, shot boundaries for the sequence of video frames. Various other methods, systems, and computer-readable media are also disclosed.
    Type: Application
    Filed: August 27, 2021
    Publication date: March 2, 2023
    Inventors: Maxim Bykov, Ioannis Katsavounidis
  • Publication number: 20230037152
    Abstract: The disclosed computer-implemented method may include combining a first video sequence with a second video sequence to generate a combined video sequence. A video complexity of the first video sequence may differ from that of the second video sequence. The method may also include performing, using a baseline encoder, encoding parameter optimization on the combined video sequence to generate a baseline performance curve and performing, using a target encoder, encoding parameter optimization on the combined video sequence to generate a target performance curve. The method may further include analyzing the target encoder by comparing the target performance curve with the baseline performance curve, and generating a bitrate ladder for the target encoder based on the analysis, wherein the bitrate ladder includes desired bitrate-resolution pairs for encoding. Various other methods, systems, and computer-readable media are also disclosed.
    Type: Application
    Filed: February 4, 2022
    Publication date: February 2, 2023
    Inventors: Ping-Hao Wu, Ioannis Katsavounidis, Zhijun Lei
  • Publication number: 20220345776
    Abstract: A method includes receiving, with a computing system, data representing a video item into a buffer. The method further includes outputting the video item from the buffer to a display system. The method further includes determining that utilization of the buffer falls below a predetermined threshold. The method further includes, in response to determining that the utilization of the buffer falls below the predetermined threshold, determining that there is a specified rebuffering point within a predetermined time frame. The method further includes pausing with the computing system, the video item at the specified rebuffering point in response to determining that there is the specified rebuffering point within the predetermined time frame.
    Type: Application
    Filed: July 8, 2022
    Publication date: October 27, 2022
    Inventors: Ioannis Katsavounidis, Mark Watson, Aaron Hipple, Will Wolcott
  • Patent number: 11444999
    Abstract: In various embodiments, an iterative encoding application generates shot encode points based on a first set of encoding points and a first shot sequence associated with a media title. The iterative encoding application performs convex hull operations across the shot encode points to generate a first convex hull. Subsequently, the iterative encoding application generates encoded media sequences based on the first convex hull and a second convex hull that is associated with both a second shot sequence associated with the media title and a second set of encoding points. The iterative encoding application determines a first optimized encoded media and a second optimized encoded media sequence from the encoded media sequences based on, respectively, a first target metric value and a second target metric value for a media metric. Portions of the optimized encoded media sequences are subsequently streamed to endpoint devices during playback of the media title.
    Type: Grant
    Filed: August 6, 2020
    Date of Patent: September 13, 2022
    Assignee: NETFLIX, INC.
    Inventors: Ioannis Katsavounidis, Anne Aaron, Jan De Cock
  • Patent number: 11436699
    Abstract: The disclosed computer-implemented method may include downsampling and encoding one or more video segments into a plurality of encoded segments with an analysis encoder using a plurality of encoding parameter value sets and decoding and upsampling the plurality of encoded segments to a plurality of decoded segments at an original resolution of the one or more video segments. The method may further include determining, based on analyzing the plurality of decoded segments, an analysis encoding parameter value set for the analysis encoder for the one or more video segments and predicting, based on the analysis encoding parameter value set, a target encoding parameter value set for a target encoder for the one or more video segments. The method may also include encoding the one or more video segments with the target encoder using the target encoding parameter value set. Various other methods, systems, and computer-readable media are also disclosed.
    Type: Grant
    Filed: June 22, 2021
    Date of Patent: September 6, 2022
    Assignee: Meta Platforms, Inc.
    Inventors: Ping-Hao Wu, Volodymyr Kondratenko, Gaurang Chaudhari, Ioannis Katsavounidis
  • Publication number: 20220248074
    Abstract: The disclosed computer-implemented method may include a process for monitoring and improving end-to-end video quality based on scaled and/or interpolated perceptual quality scores across various video views. The method may also include a process for improving search experience for user expectations. Additionally, the method may include a process for providing hardware virtualization and simulation for server hosting. Furthermore, the method may include a process for filtering network traffic in a hosting environment. The method may additionally include a process for testing applications in a hosting environment. The method may further include a process for supporting multi-touch applications. The method may also include a process for optimized graphics rendering. Various other related methods and systems are also disclosed.
    Type: Application
    Filed: April 22, 2022
    Publication date: August 4, 2022
    Inventors: Shankar Lakshmi Regunathan, Haixiong Wang, Yun Zhang, Yu Liu, David Wolstencroft, Bakkama Srinath Reddy, Cosmin Vasile Stejerean, Sonal Gandhi, Minchuan Chen, Pankaj Sethi, Amit Puntambekar, Michael Hamilton Coward, David Ronca, Ioannis Katsavounidis, Zhen Liao, Wenting Wang, Bi Xue, Hong Yan, Guangdeng Liao, Yinzhe Yu, Qunshu Zhang, Xiaoxing Zhu, Yangpeng Ou, Jacob Matthew Okamoto, Francisco Javier Merino Guardiola, Carlos Lopez Menendez, Christopher Wickersham Clark, Puttaswamy Rahul Gowda, Yi Liu, Qi Ding, Junjin Pu, Sakphong Chanbai, Ming Cao
  • Patent number: 11388413
    Abstract: The disclosed computer-implemented method may include downsampling and encoding one or more video segments into a plurality of encoded segments with a first encoder using a plurality of encoding parameter value sets and decoding and upsampling the plurality of encoded segments to a plurality of decoded segments at an original resolution of the one or more video segments. The method may also include determining, based on analyzing the plurality of decoded segments, an optimal encoding parameter value set for the one or more video segments. The method may further include encoding the one or more video segments with a second encoder using the optimal encoding parameter value set. Various other methods, systems, and computer-readable media are also disclosed.
    Type: Grant
    Filed: October 29, 2020
    Date of Patent: July 12, 2022
    Assignee: Meta Platforms, Inc.
    Inventors: Ping-Hao Wu, Ioannis Katsavounidis
  • Patent number: 11388472
    Abstract: A method includes receiving, with a computing system, data representing a video item into a buffer. The method further includes outputting the video item from the buffer to a display system. The method further includes determining that utilization of the buffer falls below a predetermined threshold. The method further includes, in response to determining that the utilization of the buffer falls below the predetermined threshold, determining that there is a specified rebuffering point within a predetermined time frame. The method further includes pausing with the computing system, the video item at the specified rebuffering point in response to determining that there is the specified rebuffering point within the predetermined time frame.
    Type: Grant
    Filed: April 28, 2021
    Date of Patent: July 12, 2022
    Assignee: Netflix, Inc.
    Inventors: Ioannis Katsavounidis, Mark Watson, Aaron Hipple, Will Wolcott