Patents Assigned to Scale Inc.
  • Patent number: 10616597
    Abstract: Systems, methods, and instrumentalities are disclosed for reference picture set mapping for scalable video coding. A device may receive an encoded scalable video stream comprising a base layer video stream and an enhancement layer video stream. The base layer video stream and the enhancement layer video streams may be encoded according to different video codecs. For example, the base layer video stream may be encoded according to H.264/AVC and the enhancement layer may be encoded according to HEVC. The enhancement layer video stream may include inter-layer prediction information. The inter-layer prediction information may include information relating to the base layer coding structure. The inter-layer prediction information may identify one or more reference pictures available in a base layer decoded picture buffer (DPB). A decoder may use the inter-layer prediction information to decode the enhancement layer video stream.
    Type: Grant
    Filed: February 20, 2018
    Date of Patent: April 7, 2020
    Assignee: VID SCALE, Inc.
    Inventors: Yong He, Yan Ye, Yuwen He
  • Publication number: 20200107027
    Abstract: A video coding device may identify a network abstraction layer (NAL) unit. The video coding device may determine whether the NAL unit includes an active parameter set for a current layer. When the NAL unit includes the active parameter set for the current layer, the video coding device may set an NAL unit header layer identifier associated with the NAL unit to at least one of: zero, a value indicative of the current layer, or a value indicative of a reference layer of the current layer. The NAL unit may be a picture parameter set (PPS) NAL unit. The NAL unit may be a sequence parameter set (SPS) NAL unit.
    Type: Application
    Filed: December 5, 2019
    Publication date: April 2, 2020
    Applicant: VID SCALE, INC.
    Inventors: Yong He, Yan Ye, Xiaoyu Xiu, Yuwen He
  • Patent number: 10609395
    Abstract: A high dynamic range (HDR) signal processing device may receive a video signal and an operating mode indication. The operating mode indication may indicate a format of the video signal, for example, an HDR format or a non-DR format. Whether to perform adaptive reshaping on the video signal may be determined based on the operating mode indication. For example, it may be determined to perform the adaptive reshaping if the operating mode indicates that the video signal is in an HDR format. It may be determined to bypass the adaptive reshaping if the operating mode indicates that the video signal is in the non-HDR format. Multiple types of HDR reconstruction metadata may be received via a network abstraction layer (NAL) unit.
    Type: Grant
    Filed: July 28, 2016
    Date of Patent: March 31, 2020
    Assignee: VID SCALE, Inc.
    Inventors: Louis Kerofsky, Yuwen He, Yan Ye
  • Publication number: 20200099943
    Abstract: Methods and systems are disclosed for a mobile device to decode video based on available power and/or energy. For example, the mobile device may receive a media description file (MDF) from for a video stream from a video server. The MDF may include complexity information associated with a plurality of video segments. The complexity information may be related to the amount of processing power to be utilized for decoding the segment at the mobile device. The mobile device may determine at least one power metric for the mobile device. The mobile device may determine a first complexity level to be requested for a first video segment based on the complexity information from the MDF and the power metric. The mobile device may dynamically alter the decoding process to save energy based on the detected power/energy level.
    Type: Application
    Filed: November 27, 2019
    Publication date: March 26, 2020
    Applicant: VID SCALE, Inc.
    Inventors: Yuwen He, Yan Ye, Yong He, George W. McClellan, Eun Seok Ryu
  • Publication number: 20200099946
    Abstract: Systems, methods, and instrumentalities are disclosed for encoder and/or decoder optimization using a multi-threaded parallel processing framework. An encoding and/or decoding device may receive a video sequence that includes a plurality of first-temporal level pictures associated with a first temporal level and a plurality of second-temporal level pictures associated with a second temporal level. The encoding and/or decoding device may allocate a first number of parallel processing threads for encoding and/or decoding the first-temporal level pictures and a second number of parallel processing threads for encoding and/or decoding the second-temporal level pictures. The device may perform this allocation based on temporal level priority, for example. The encoding and/or decoding device may encode and/or decode the first-temporal level pictures and the second-temporal level pictures.
    Type: Application
    Filed: November 26, 2019
    Publication date: March 26, 2020
    Applicant: VID SCALE, INC.
    Inventors: Srinivas Gudumasu, Yuwen He, Yan Ye, Ralph Neff
  • Publication number: 20200092582
    Abstract: A system, method, and/or instrumentality may be provided for coding a 360-degree video. A picture of the 360-degree video may be received. The picture may include one or more faces associated with one or more projection formats. A first projection format indication may be received that indicates a first projection format may be associated with a first face. A second projection format indication may be received that indicates a second projection format may be associated with a second face. Based on the first projection format, a first transform function associated with the first face may be determined. Based on the second projection format, a second transform function associated with the second face may be determined. At least one decoding process may be performed on the first face using the first transform function and/or at least one decoding process may be performed on the second face using the second transform function.
    Type: Application
    Filed: May 24, 2018
    Publication date: March 19, 2020
    Applicant: VID SCALE, INC.
    Inventors: Xiaoyu Xiu, Yuwen He, Yan Ye
  • Patent number: 10587630
    Abstract: Systems and methods for adaptively streaming video content to a wireless transmit/receive unit (WTRU) or wired transmit/receive unit may comprise obtaining a media presentation description that comprises a content authenticity, requesting a key for a hash-based message authentication code; receiving the key for the hash-based message authentication code, determining a determined hash for a segment of the media presentation description, requesting a reference hash for the segment from a server, receiving the reference hash for the segment from the server, and comparing the reference hash to the determined hash to determine whether the requested hash matches the determined hash.
    Type: Grant
    Filed: April 22, 2016
    Date of Patent: March 10, 2020
    Assignee: VID SCALE, INC
    Inventor: Alexander Giladi
  • Publication number: 20200077087
    Abstract: A video coding device may encode a video signal using intra-block copy prediction. A first picture prediction unit of a first picture may be identified. A second picture may be coded and identified. The second picture may be temporally related to the first picture, and the second picture may include second picture prediction units. A second picture prediction unit that is collocated with the first picture prediction unit may be identified. Prediction information for the first picture prediction unit may be generated. The prediction information may be based on a block vector of the second picture prediction unit that is collocated with the first picture prediction unit.
    Type: Application
    Filed: November 7, 2019
    Publication date: March 5, 2020
    Applicant: VID SCALE, INC.
    Inventors: Yuwen He, Xiaoyu Xiu, Yan Ye
  • Patent number: 10582227
    Abstract: Media content coded using scalable coding techniques may be cached among a group of cache devices. Layered segments of the media content may be pre-loaded onto the cache devices, which may be located throughout a content distribution network, including a home network. The caching location of the media content may be determined based on multiple factors including a content preference associated with the group of cache devices and device capabilities. A cache controller may manage the caching of the media content.
    Type: Grant
    Filed: January 17, 2017
    Date of Patent: March 3, 2020
    Assignee: VID SCALE, Inc.
    Inventors: Yong He, Yuwen He, Yan Ye, Ralph Neff
  • Publication number: 20200059671
    Abstract: Systems, methods, and instrumentalities are provided to implement video coding system (VCS). The VCS may be configured to receive a video signal, which may include one or more layers (e.g., a base layer (BL) and/or one or more enhancement layers (ELs)). The VCS may be configured to process a BL picture into an inter-layer reference (ILR) picture, e.g., using picture level inter-layer prediction process. The VCS may be configured to select one or both of the processed ILR picture or an enhancement layer (EL) reference picture. The selected reference picture(s) may comprise one of the EL reference picture, or the ILR picture. The VCS may be configured to predict a current EL picture using one or more of the selected ILR picture or the EL reference picture. The VCS may be configured to store the processed ILR picture in an EL decoded picture buffer (DPB).
    Type: Application
    Filed: October 24, 2019
    Publication date: February 20, 2020
    Applicant: Vid Scale, Inc.
    Inventors: Yan Ye, George W. McClellan, Yong He, Xiaoyu Xiu, Yuwen He, Jie Dong, Can Bal, Eun Seok Ryu
  • Patent number: 10565504
    Abstract: A computer-implementable method for managing a cognitive graph comprising: receiving data from a plurality of data sources; processing the data from the plurality of data sources, the processing the data from the plurality of data sources identifying a plurality of knowledge elements; and, storing the knowledge elements within the cognitive graph as a collection of knowledge elements, the storing universally representing knowledge obtained from the data, each knowledge element being structurally defined within the cognitive graph.
    Type: Grant
    Filed: October 11, 2016
    Date of Patent: February 18, 2020
    Assignee: Cognitive Scale, Inc.
    Inventor: Hannah R. Lindsley
  • Publication number: 20200053005
    Abstract: Systems, methods, and instrumentalities are disclosed for enhancing performance of multi-path communications. Multi-path communication performance may be enhanced by determining whether multipath communications share a congested router. A multi-path real-time communication protocol may provide techniques to prevent, detect, communicate and respond to a shared congested router. A shared congested router may be prevented, and/or detected using one or more detection techniques.
    Type: Application
    Filed: October 9, 2019
    Publication date: February 13, 2020
    Applicant: VID SCALE, INC.
    Inventors: Anantharaman Balasubramanian, Liangping Ma, Dirk Trossen
  • Patent number: 10558708
    Abstract: A method, system and computer-usable medium for providing composite cognitive insights comprising receiving streams of data from a plurality of data sources; processing the streams of data from the plurality of data sources, the processing the streams of data from the plurality of data sources performing data enriching and generating a sub-graph for incorporation into a cognitive graph; processing the cognitive graph, the processing the cognitive graph providing a plurality of individual cognitive insights; generating a composite cognitive insight, the composite cognitive insight being composed of the plurality of individual cognitive insights; and, providing the composite cognitive insight to a user via a set of cognitive media content.
    Type: Grant
    Filed: December 14, 2018
    Date of Patent: February 11, 2020
    Assignee: Cognitive Scale, Inc.
    Inventors: Neeraj Chawla, Joshua L. Segars
  • Publication number: 20200045336
    Abstract: A video coding system (e.g., an encoder and/or a decoder) may perform face-based sub-block motion compensation for 360-degree video to predict samples (e.g., of a sub-block). The video coding system may receive a 360-degree video content. The 360-degree video content may include a current block. The current block may include a plurality of sub-blocks. The system may determine whether a sub-block mode is used for the current block. The system may predict a sample in the current block based on the sub-block level face association. For a first sub-block in the current block, the system may identify a first location of the first sub-block. The system may associate the first sub-block with a first face based on the identified first location of the first sub-block. The system may predict a first sample in the first sub-block based on the first face that is associated with the first sub-block.
    Type: Application
    Filed: March 3, 2018
    Publication date: February 6, 2020
    Applicant: VID SCALE, INC.
    Inventors: Xiaoyu Xiu, Yuwen He, Yan Ye
  • Publication number: 20200037029
    Abstract: A method for receiving and displaying media content may be provided. The method may include requesting a set of DASH video segments that are associated with various viewports and qualities. The method may include displaying the DASH video segments. The method may indue determining a latency metric based on a time difference between the display of a DASH video segment and one of: a device beginning to move, the device ceasing to move, the device determining that the device has begun to move, the device determining that the device has stopped moving, or the display of a different DASH video segment. The different DASH video segment may be associated with one or more of a different quality or a different viewport.
    Type: Application
    Filed: March 23, 2018
    Publication date: January 30, 2020
    Applicant: VID SCALE, INC.
    Inventors: Yong He, Yan Ye, Ali C. Begen
  • Patent number: 10547853
    Abstract: A video coding device may identify a network abstraction layer (NAL) unit. The video coding device may determine whether the NAL unit includes an active parameter set for a current layer. When the NAL unit includes the active parameter set for the current layer, the video coding device may set an NAL unit header layer identifier associated with the NAL unit to at least one of: zero, a value indicative of the current layer, or a value indicative of a reference layer of the current layer. The NAL unit may be a picture parameter set (PPS) NAL unit. The NAL unit may be a sequence parameter set (SPS) NAL unit.
    Type: Grant
    Filed: April 6, 2017
    Date of Patent: January 28, 2020
    Assignee: VID SCALE, Inc.
    Inventors: Yong He, Yan Ye, Xiaoyu Xiu, Yuwen He
  • Patent number: 10536707
    Abstract: Methods and systems are disclosed for a mobile device to decode video based on available power and/or energy. For example, the mobile device may receive a media description file (MDF) from for a video stream from a video server. The MDF may include complexity information associated with a plurality of video segments. The complexity information may be related to the amount of processing power to be utilized for decoding the segment at the mobile device. The mobile device may determine at least one power metric for the mobile device. The mobile device may determine a first complexity level to be requested for a first video segment based on the complexity information from the MDF and the power metric. The mobile device may dynamically alter the decoding process to save energy based on the detected power/energy level.
    Type: Grant
    Filed: November 20, 2018
    Date of Patent: January 14, 2020
    Assignee: VID Scale, Inc.
    Inventors: Yuwen He, Yan Ye, Yong He, George W. McClellan, Eun Seok Ryu
  • Patent number: 10528870
    Abstract: A computer-implementable method for managing a cognitive graph comprising: receiving data a data source, the data comprising a query and information relating to an answer to the query; processing the query, the processing the query identifying a plurality of query related knowledge elements; processing the information relating to the answer to the query, the processing the information relating to the answer to the query identifying a plurality of answer related knowledge elements; and, storing the plurality of query related knowledge elements and the plurality of answer related knowledge elements within the cognitive graph as a collection of knowledge elements.
    Type: Grant
    Filed: October 11, 2016
    Date of Patent: January 7, 2020
    Assignee: Cognitive Scale, Inc.
    Inventor: Hannah R. Lindsley
  • Patent number: 10528873
    Abstract: A method for providing travel optimized cognitive insights comprising: receiving data from a plurality of data sources, at least some of the plurality of data sources comprising travel relevant data sources; processing the data from the plurality of data sources to provide cognitively processed insights; performing a learning operation to iteratively improve the cognitively processed insights over time; and, providing the cognitively processed travel relevant insights to a destination.
    Type: Grant
    Filed: February 24, 2015
    Date of Patent: January 7, 2020
    Assignee: Cognitive Scale, Inc.
    Inventors: Matthew Sanchez, Manoj Saxena, Akshay Sabhikhi
  • Patent number: 10523957
    Abstract: Systems, methods, and instrumentalities are disclosed for encoder and/or decoder optimization using a multi-threaded parallel processing framework. An encoding and/or decoding device may receive a video sequence that includes a plurality of first-temporal level pictures associated with a first temporal level and a plurality of second-temporal level pictures associated with a second temporal level. The encoding and/or decoding device may allocate a first number of parallel processing threads for encoding and/or decoding the first-temporal level pictures and a second number of parallel processing threads for encoding and/or decoding the second-temporal level pictures. The device may perform this allocation based on temporal level priority, for example. The encoding and/or decoding device may encode and/or decode the first-temporal level pictures and the second-temporal level pictures.
    Type: Grant
    Filed: August 10, 2015
    Date of Patent: December 31, 2019
    Assignee: VID SCALE, Inc.
    Inventors: Srinivas Gudumasu, Yuwen He, Yan Ye, Ralph Neff