Patents Assigned to Scale Inc.
  • Patent number: 11284089
    Abstract: Coding techniques for 360-degree video. An encoder selects a projection format and maps the 360-degree video to a 2D planar video using the selected projection format. The encoder encodes the 2D planar video in a bitstream and further signals, in the bitstream, parameters identifying the projection format. The parameters identifying the projection format may be signaled in a video parameter set, sequence parameter set, and/or picture parameter set of the bitstream. Different projection formats that may be signaled include formats using geometries such as equirectangular, cubemap, equal-area, octahedron, icosahedron, cylinder, and user-specified polygon. Other parameters that may be signaled include different arrangements of geometric faces or different encoding quality for different faces. Corresponding decoders. Projection parameters may further include relative geometry rotation parameters that define an orientation of the projection geometry.
    Type: Grant
    Filed: August 30, 2017
    Date of Patent: March 22, 2022
    Assignee: VID SCALE, INC.
    Inventors: Philippe Hanhart, Yuwen He, Yan Ye
  • Patent number: 11277635
    Abstract: A video coding system (e.g., an encoder and/or a decoder) may perform face-based sub-block motion compensation for 360-degree video to predict samples (e.g., of a sub-block). The video coding system may receive a 360-degree video content. The 360-degree video content may include a current block. The current block may include a plurality of sub-blocks. The system may determine whether a sub-block mode is used for the current block. The system may predict a sample in the current block based on the sub-block level face association. For a first sub-block in the current block, the system may identify a first location of the first sub-block. The system may associate the first sub-block with a first face based on the identified first location of the first sub-block. The system may predict a first sample in the first sub-block based on the first face that is associated with the first sub-block.
    Type: Grant
    Filed: March 15, 2018
    Date of Patent: March 15, 2022
    Assignee: VID SCALE, Inc.
    Inventors: Xiaoyu Xiu, Yuwen He, Yan Ye
  • Publication number: 20220078406
    Abstract: Systems, methods, and instrumentalities are disclosed for processing history-based motion vector prediction (HMVP). A video coding device may generate a history-based motion vector prediction (HMVP) list for a current block. The video coding device derive an HMVP candidate from a previously coded block. The HMVP candidate may include motion information associated with a neighboring block of the current block, one or more reference indices, and a bi-prediction weight index. The video coding device may add the HMVP candidate to the HMVP list for motion compensated prediction of a motion vector associated with the current block. The video coding device use one HMVP selected from the HMVP list to perform motion compensated prediction of the current block. The motion compensated prediction may be performed using the motion information associated with the neighboring block of the current block, the one or more reference indices, and the bi-prediction weight index.
    Type: Application
    Filed: December 19, 2019
    Publication date: March 10, 2022
    Applicant: VID SCALE, INC.
    Inventors: Xiaoyu Xiu, Yuwen He, Jiancong Luo
  • Publication number: 20220070441
    Abstract: Systems, methods, and instrumentalities are disclosed for a combined inter and intra prediction, A video coding device may receive a motion vector difference (MMVD) mode indication that indicates whether MMVD mode is used to generate inter prediction of a coding unit (CU). The video coding device may receive a combined inter merge/intra prediction (CUP) indication, for example, when the MMVD mode indication indicates that MMVD mode is not used to generate the inter prediction of the CU, The video coding device may determine whether to use triangle merge mode for the CU, for example, based on the MMVD mode indication and/or the CUP indication. On a condition that the CUP indication indicates that CUP is applied for the CU or the MMVD mode indication indicates that MMVD mode is used to generate the inter prediction, the video coding device may disable the triangle merge mode for the CU.
    Type: Application
    Filed: December 20, 2019
    Publication date: March 3, 2022
    Applicant: VID SCALE, INC.
    Inventors: Xiaoyu Xiu, Yuwen He, Jiancong Luo
  • Patent number: 11250333
    Abstract: A method, system and computer-usable medium for performing cognitive computing operations comprising receiving streams of data from a plurality of data sources; processing the streams of data from the plurality of data sources, the processing the streams of data from the plurality of data sources performing data enriching for incorporation into a cognitive graph; defining a cognitive persona within the cognitive graph, the cognitive persona corresponding to an archetype user model, the cognitive persona comprising a set of nodes in the cognitive graph; associating a user with the cognitive persona; and, performing a cognitive computing operation based upon the cognitive persona associated with the user.
    Type: Grant
    Filed: June 7, 2019
    Date of Patent: February 15, 2022
    Assignee: Cognitive Scale, Inc.
    Inventors: John N. Faith, Kyle W. Kothe, Matthew Sanchez, Neeraj Chawla
  • Publication number: 20220046320
    Abstract: A method for receiving and displaying media content may be provided. The method may include requesting a set of DASH video segments that are associated with various viewports and qualities. The method may include displaying the DASH video segments. The method may include determining a latency metric based on a time difference between the display of a DASH video segment and one of: a device beginning to move, the device ceasing to move, the device determining that the device has begun to move, the device determining that the device has stopped moving, or the display of a different DASH video segment. The different DASH video segment may be associated with one or more of a different quality or a different viewport.
    Type: Application
    Filed: October 20, 2021
    Publication date: February 10, 2022
    Applicant: VID SCALE, INC.
    Inventors: Yong He, Yan Ye, Ali C. Begen
  • Patent number: 11244229
    Abstract: A computer-implementable method for managing a cognitive graph comprising: receiving data a data source, the data comprising a query and information relating to an answer to the query; processing the query, the processing the query identifying a plurality of query related knowledge elements; processing the information relating to the answer to the query, the processing the information relating to the answer to the query identifying a plurality of answer related knowledge elements; and, storing the plurality of query related knowledge elements and the plurality of answer related knowledge elements within the cognitive graph as a collection of knowledge elements.
    Type: Grant
    Filed: January 3, 2020
    Date of Patent: February 8, 2022
    Assignee: Cognitive Scale, Inc.
    Inventor: Hannah R. Lindsley
  • Patent number: 11222269
    Abstract: A method, system and computer-usable medium for providing composite cognitive insights comprising receiving streams of data from a plurality of data sources; processing the streams of data from the plurality of data sources, the processing the streams of data from the plurality of data sources performing data enriching and generating a sub-graph for incorporation into a cognitive graph; processing the cognitive graph, the processing the cognitive graph providing a plurality of individual cognitive insights; generating a composite cognitive insight, the composite cognitive insight being composed of the plurality of individual cognitive insights; and, providing the composite cognitive insight to a user via a set of cognitive media content.
    Type: Grant
    Filed: February 4, 2020
    Date of Patent: January 11, 2022
    Assignee: Cognitive Scale, Inc.
    Inventors: Neeraj Chawla, Joshua L. Segars
  • Patent number: 11223848
    Abstract: 360-degree video content may be coded. A sampling position in a projection format may be determined to code 360-degree video content. For example, a sampling position in a target projection format and a sampling position in a reference projection format may be identified. The sample position in the target projection format may be related to the corresponding sample position in the reference projection format via a transform function. A parameter weight (e.g., a reference parameter weight) for the sampling position in the reference projection format may be identified. An adjustment factor associated with the parameter weight for the sampling position in the reference projection format may be determined. The parameter weight (e.g., adjusted parameter weight) for the sampling position in the target projection format may be calculated. The calculated adjusted parameter weight may be applied to the sampling position in the target projection format when coding the 360-degree video content.
    Type: Grant
    Filed: June 29, 2018
    Date of Patent: January 11, 2022
    Assignee: VID SCALE, Inc.
    Inventors: Xiaoyu Xiu, Yuwen He, Yan Ye
  • Publication number: 20220007053
    Abstract: Systems, methods, and instrumentalities are disclosed for performing horizontal geometry padding on a current sample based on receiving a wraparound enabled indication that indicates whether a horizontal wraparound motion compensation is enabled. If the horizontal wraparound motion compensation is enabled based on the wraparound enabled indication, a video coding device may determine a reference sample wraparound offset of a current sample in a picture. The reference sample wraparound offset may indicate a face width of the picture. The video coding device may determine a reference sample location for the current sample based on the reference sample wraparound offset, a picture width of the picture, and a current sample location. The video coding device may predict the current sample based on the reference sample location in a horizontal direction. Repetitive padding or clipping may be used in the vertical direction.
    Type: Application
    Filed: September 25, 2019
    Publication date: January 6, 2022
    Applicant: Vid Scale, Inc.
    Inventors: Philippe Hanhart, Yuwen He, Yan Ye
  • Publication number: 20220007019
    Abstract: A system may identify a defined rectangular picture area and render video corresponding to the defined rectangular picture area. The system may receive a video bitstream comprising a picture having a header and may receive data specifying a structure of the picture. The system may parse the data specifying the structure of the picture for an identifier corresponding to a defined rectangular area in the first picture and for a tile index of a top left tile in the defined rectangular area. The system may determine one or more tiles comprised in the defined rectangular area based on the identifier corresponding to the defined rectangular area and the tile index of the top left tile. The system may reconstruct the picture including a sub-picture that comprises the defined rectangular area based upon the identifier corresponding to the defined rectangular area. The computing system may render the sub-picture in the defined rectangular area.
    Type: Application
    Filed: December 4, 2019
    Publication date: January 6, 2022
    Applicant: VID SCALE, INC.
    Inventor: Yong He
  • Publication number: 20220007048
    Abstract: Systems, methods, and instrumentalities may be provided for determining whether to bypass bi-directional optical flow (BDOF) if BDOF is used in combination with bi-prediction with coding unit (CU) weights (e.g., generalized bi-prediction (GBi)). A coding system may combine coding modes, coding techniques, and/or coding tools. The coding system may include a wireless transmit/receive unit (WTRU). For example, the coding system may combine BDOF and bi-prediction with GU weights (BCW). BDOF may include refining a motion vector associated with a current CU based at least in part on gradients associated with a location in the current CU. The coding system may determine that BDOF is enabled, and/or that bi-prediction with CU weights is enabled for the current CU. The coding system's determination that bi-prediction with CU weights is enabled and/or that BDOF is enabled may be based on one or more indications.
    Type: Application
    Filed: September 26, 2019
    Publication date: January 6, 2022
    Applicant: VID SCALE, INC.
    Inventors: Yuwen He, Jiancong Luo, Xiaoyu Xiu, Yan Ye
  • Patent number: 11216738
    Abstract: A method, system and computer readable medium for generating a cognitive insight comprising: receiving content element data, the content element data representing a content element, the content element comprising an element of a corpus of content; performing a cognitive learning operation on the content element data, the cognitive learning operation identifying descriptive information associated with the content element; associating a cognitive attribute with the content element using the descriptive information associated with the content element.
    Type: Grant
    Filed: April 22, 2020
    Date of Patent: January 4, 2022
    Assignee: Cognitive Scale, Inc.
    Inventors: Neeraj Chawla, Matthew Sanchez, Andrea M. Ricaurte, Dilum Ranatunga, Ayan Acharya, Hannah R. Lindsley
  • Patent number: 11216736
    Abstract: A method, system and computer readable medium for performing a cognitive search operation comprising: receiving training data, the training data comprising information based upon user interaction with cognitive attributes; performing a machine learning operation on the training data; generating a cognitive profile based upon the information generated by performing the machine learning operation; and, performing a cognitive search operation on a corpus of content based upon the cognitive profile, the cognitive search operation returning cognitive results specific to the cognitive profile of the user.
    Type: Grant
    Filed: September 25, 2017
    Date of Patent: January 4, 2022
    Assignee: Cognitive Scale, Inc.
    Inventors: Neeraj Chawla, Matthew Sanchez, Andrea M. Ricaurte, Dilum Ranatunga, Ayan Acharya, Hannah R. Lindsley
  • Patent number: 11212496
    Abstract: Conversion between different projection formats of a 360-degree video may be performed in a uniform way. The geometric characteristics of the different projection formats may be considered when applying 3D-to-2D and 2D-to-3D mapping. Parameters reflective of the geometric characteristics of the different projection formats may be determined and used in the mapping and/or conversion. The parameters may include a normal vector that is perpendicular to a projection plane, a reference point in the projection plane, and/or unit vectors defined in the projection plane. An architecture with consolidated modules for handling the various projection formats may be provided.
    Type: Grant
    Filed: October 6, 2017
    Date of Patent: December 28, 2021
    Assignee: VID SCALE, Inc.
    Inventors: Xiaoyu Xiu, Yuwen He, Yan Ye, Philippe Hanhart
  • Publication number: 20210400300
    Abstract: Golf club heads (102) are releasably engaged with shafts (106) so that the club heads and shafts can be readily interchanged and/or so that the shaft position with respect to the club head can be readily changed. Assemblies for connecting the club head and shaft include: a shaft adapter (200), a hosel adapter (300), a hosel ring (500), a securing system (408) and a club head having an interior chamber. The club head and shaft may be changed by releasing the securing system and exchanging the original parts with different parts.
    Type: Application
    Filed: September 20, 2019
    Publication date: December 23, 2021
    Applicant: VID SCALE, INC.
    Inventors: Raymond SANDER, Robert BOYD, Matthew P. RUBAL, Joshua Michael BOGGS
  • Publication number: 20210376965
    Abstract: A video encoding device (e.g., a wireless transmit/receive unit (WTRU)) may transmit an encoded frame with a frame sequence number using a transmission protocol. The video encoding device, an application on the video encoding device, and/or a protocol layer on the encoding device may detect a packet loss by receiving an error notification. The packet loss may be detected at the MAC layer. The packet loss may be signaled using spoofed packets, such as a spoofed NAM packet, a spoofed XR packet, or a spoofed ACK packet. A lost packet may be retransmitted at the MAC layer (e.g., by the encoding device or another device on the wireless path). Packet loss detection may be performed in uplink operations and/or downlink operations, and/or may be performed in video gaining applications via the cloud. The video encoding device may generate and send a second encoded frame based on the error notification.
    Type: Application
    Filed: August 5, 2021
    Publication date: December 2, 2021
    Applicant: VID SCALE, INC.
    Inventors: Weimin Liu, Rahul Vanam, Liangping Ma, Yuriy Reznik, Gregory S. Sternberg, Wei Chen, Dharm Veer
  • Patent number: 11166072
    Abstract: A method for receiving and displaying media content may be provided. The method may include requesting a set of DASH video segments that are associated with various viewports and qualities. The method may include displaying the DASH video segments. The method may indue determining a latency metric based on a time difference between the display of a DASH video segment and one of: a device beginning to move, the device ceasing to move, the device determining that the device has begun to move, the device determining that the device has stopped moving, or the display of a different DASH video segment. The different DASH video segment may be associated with one or more of a different quality or a different viewport.
    Type: Grant
    Filed: March 23, 2018
    Date of Patent: November 2, 2021
    Assignee: VID SCALE, Inc.
    Inventors: Yong He, Yan Ye, Ali C. Begen
  • Publication number: 20210337202
    Abstract: Systems, procedures, and instrumentalities may be provided for adaptively adjusting quantization parameters (QPs) for 360-degree video coding. For example, a first luma QP for a first region may be identified. Based on the first luma QP, a first chroma QP for the first region may be determined. A QP offset for a second region may be identified. A second luma QP for the second region may be determined based on the first luma QP and/or the QP offset for the second region. A second chroma QP of the second region may be determined based on the first chroma QP and/or the QP offset for the second region. An inverse quantization may be performed for the second region based on the second luma QP for the second region and/or the second chroma QP for the second region. The QP offset may be adapted based on a spherical sampling density.
    Type: Application
    Filed: June 21, 2018
    Publication date: October 28, 2021
    Applicant: VID SCALE, INC.
    Inventors: Xiaoyu Xiu, Yuwen He, Yan Ye
  • Patent number: 11153602
    Abstract: Exemplary embodiments include systems and methods for coding a video comprising a plurality of pictures including a current picture, a first reference picture, and a second reference picture, where each picture includes a plurality of blocks. In one method, for at least a current block in the current picture, a number of available bi-prediction weights is determined based at least in part on a temporal layer and/or a quantization parameter of the current picture. From among available bi-prediction weights a pair of weights are identified. Using the identified weights, the current block is then predicted as a weighted sum of a first reference block in the first reference picture and a second reference block in the second reference picture. Encoding techniques are also described for efficient searching and selection of a pair of bi-prediction weights to use for prediction of a block.
    Type: Grant
    Filed: January 23, 2019
    Date of Patent: October 19, 2021
    Assignee: Vid Scale, Inc.
    Inventors: Yan Zhang, Xiaoyu Xiu, Yuwen He, Yan Ye