Patents by Inventor Renxiang Li

Renxiang Li has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11812073
    Abstract: Disclosed is a method of associating, at a secondary device, secondary media content with primary media content being output at a primary device. The method includes receiving, at the secondary device, first information based upon the primary content being output at the primary device, wherein the first information includes at least one of an audio and a visual signal, determining at the secondary device second information corresponding to the first information, receiving at the secondary device one or more portions of secondary media content that have been made available by a third device, determining at the secondary device whether one or more of the portions of the secondary media content match one or more portions of the second information, and taking at least one further action upon determining that there is a match.
    Type: Grant
    Filed: October 4, 2021
    Date of Patent: November 7, 2023
    Assignee: Google Technology Holdings LLC
    Inventors: Renxiang Li, Kevin L. Baum, Faisal Ishtiaq, Michael L. Needham
  • Patent number: 11783585
    Abstract: A method of detecting frames in a video that demarcate a pre-determined type of video segment within the video is provided. The method includes identifying visually distinctive candidate marker frames within the video, grouping the candidate marker frames into a plurality of groups based on visual similarity, computing a collective score for each of the groups based on temporal proximity of each of the candidate marker frames within the group to related events occurring within the video, and selecting at least one of the groups based on the collective proximity scores as marker frames that demarcate the pre-determined type of video segment. A video processing electronic device and at least one non-transitory computer readable storage medium having computer program instructions stored thereon for performing the method are also provided.
    Type: Grant
    Filed: July 29, 2022
    Date of Patent: October 10, 2023
    Assignee: ARRIS Enterprises LLC
    Inventors: Renxiang Li, Faisal Ishtiaq, Stephen P. Emeott, Anthony J. Braskich
  • Publication number: 20230071845
    Abstract: Systems, methods, and devices for an interactive viewing experience by detecting on-screen data are disclosed. One or more frames of video data are analyzed to detect regions in the visual video content that contain text. A character recognition operation can be performed on the regions to generate textual data. Based on the textual data and the regions, a graphical user interface (GUI) definition to can be generated. The GUI definition can be used to generate a corresponding GUI superimposed onto the visual video content to present users with controls and functionality with which to interact with the text or enhance the video content. Context metadata can be determined from external sources or by analyzing the continuity of audio and visual aspects of the video data. The context metadata can then be used to improve the character recognition or inform the generation of the GUI.
    Type: Application
    Filed: November 15, 2022
    Publication date: March 9, 2023
    Inventors: Isselmou Ould Dellahy, Shivajit Mohapatra, Anthony J. Braskich, Faisal Ishtiaq, Renxiang Li
  • Publication number: 20220366693
    Abstract: A method of detecting frames in a video that demarcate a pre-determined type of video segment within the video is provided. The method includes identifying visually distinctive candidate marker frames within the video, grouping the candidate marker frames into a plurality of groups based on visual similarity, computing a collective score for each of the groups based on temporal proximity of each of the candidate marker frames within the group to related events occurring within the video, and selecting at least one of the groups based on the collective proximity scores as marker frames that demarcate the pre-determined type of video segment. A video processing electronic device and at least one non-transitory computer readable storage medium having computer program instructions stored thereon for performing the method are also provided.
    Type: Application
    Filed: July 29, 2022
    Publication date: November 17, 2022
    Applicant: ARRIS Enterprises LLC
    Inventors: Renxiang Li, Faisal Ishtiaq, Stephen P. Emeott, Anthony J. Braskich
  • Publication number: 20220337761
    Abstract: Methods and systems are described for managing content. A content stream may be generated based on source content. Scenes identified in the content stream may be compared with scenes in the source content. An iterative matching process may be used to modify scene boundaries that may be compared to the scene boundaries of the content stream.
    Type: Application
    Filed: April 15, 2021
    Publication date: October 20, 2022
    Inventors: Ehsan Younessian, Renxiang Li
  • Publication number: 20220321944
    Abstract: Systems, apparatuses, and methods are described for adding visual and/or sound effects to a content item to improve user experience. Addition of the visual and/or sound effects may be based on metadata associated with the content item.
    Type: Application
    Filed: April 2, 2021
    Publication date: October 6, 2022
    Inventors: Mohammad Hosseini, Renxiang Li, Isselmou Maloum, Ronald Lenk
  • Patent number: 11436834
    Abstract: A method of detecting frames in a video that demarcate a pre-determined type of video segment within the video is provided. The method includes identifying visually distinctive candidate marker frames within the video, grouping the candidate marker frames into a plurality of groups based on visual similarity, computing a collective score for each of the groups based on temporal proximity of each of the candidate marker frames within the group to related events occurring within the video, and selecting at least one of the groups based on the collective proximity scores as marker frames that demarcate the pre-determined type of video segment. A video processing electronic device and at least one non-transitory computer readable storage medium having computer program instructions stored thereon for performing the method are also provided.
    Type: Grant
    Filed: June 1, 2021
    Date of Patent: September 6, 2022
    Assignee: ARRIS Enterprises LLC
    Inventors: Renxiang Li, Faisal Ishtiaq, Stephen P. Emeott, Anthony J. Braskich
  • Publication number: 20220103878
    Abstract: Disclosed is a method of associating, at a secondary device, secondary media content with primary media content being output at a primary device. The method includes receiving, at the secondary device, first information based upon the primary content being output at the primary device, wherein the first information includes at least one of an audio and a visual signal, determining at the secondary device second information corresponding to the first information, receiving at the secondary device one or more portions of secondary media content that have been made available by a third device, determining at the secondary device whether one or more of the portions of the secondary media content match one or more portions of the second information, and taking at least one further action upon determining that there is a match.
    Type: Application
    Filed: October 4, 2021
    Publication date: March 31, 2022
    Inventors: Renxiang Li, Kevin L. Baum, Faisal Ishtiaq, Michael L. Needham
  • Patent number: 11256923
    Abstract: Particular embodiments extract features for frames from a video. Then, a sequence of frames is identified based on a pattern analysis of frames based on the features. This pattern may be used to select sentinel features from the sequence of frames. For example, a pattern may include a first sentinel sequence followed by a transitional frame and then a second sentinel sequence. The transitional frame may be a black frame that is used to identify back-to-back sentinel sequences. Then, a sentinel frame that demarks a transition from a first content type to a second content type is identified. For example, the frames on either side of the black frame may be very similar and be identified as sentinel frames that mark a transition from program content to advertisement content. The above process may allow automated detection of sentinel frames that can run without user supervision.
    Type: Grant
    Filed: May 12, 2016
    Date of Patent: February 22, 2022
    Assignee: ARRIS Enterprises LLC
    Inventors: Stephen P. Emeott, Renxiang Li
  • Patent number: 11140424
    Abstract: Disclosed is a method of associating, at a secondary device, secondary media content with primary media content being output at a primary device. The method includes receiving, at the secondary device, first information based upon the primary content being output at the primary device, wherein the first information includes at least one of an audio and a visual signal, determining at the secondary device second information corresponding to the first information, receiving at the secondary device one or more portions of secondary media content that have been made available by a third device, determining at the secondary device whether one or more of the portions of the secondary media content match one or more portions of the second information, and taking at least one further action upon determining that there is a match.
    Type: Grant
    Filed: September 21, 2020
    Date of Patent: October 5, 2021
    Assignee: Google Technology Holdings LLC
    Inventors: Renxiang Li, Kevin L. Baum, Faisal Ishtiaq, Michael L. Needham
  • Publication number: 20210287012
    Abstract: A method of detecting frames in a video that demarcate a pre-determined type of video segment within the video is provided. The method includes identifying visually distinctive candidate marker frames within the video, grouping the candidate marker frames into a plurality of groups based on visual similarity, computing a collective score for each of the groups based on temporal proximity of each of the candidate marker frames within the group to related events occurring within the video, and selecting at least one of the groups based on the collective proximity scores as marker frames that demarcate the pre-determined type of video segment. A video processing electronic device and at least one non-transitory computer readable storage medium having computer program instructions stored thereon for performing the method are also provided.
    Type: Application
    Filed: June 1, 2021
    Publication date: September 16, 2021
    Inventors: Renxiang Li, Faisal Ishtiaq, Stephen P. Emeott, Anthony J. Braskich
  • Patent number: 11093978
    Abstract: A method for creating derivative advertisements is provided. The method includes identifying a visual element based on an analysis of a primary advertisement asset such that the visual element is representative of a branding message provided within the primary advertisement. The method also includes identifying a call-to-action (CTA) data element based on the analysis and creating a derivative advertisement asset having the visual element and CTA data element. A system and a non-transitory computer-readable storage medium containing software for executing the method are also provided.
    Type: Grant
    Filed: September 10, 2014
    Date of Patent: August 17, 2021
    Assignee: ARRIS Enterprises LLC
    Inventors: Venugopal Vasudevan, Anthony J. Braskich, Renxiang Li, Jehan Wickramasuriya, Faisal Ishtiaq, Stephen P. Emeott, Benedito J. Fonseca, Jr., Alfonso Martinez Smith
  • Patent number: 11023737
    Abstract: A method of detecting frames in a video that demarcate a pre-determined type of video segment within the video is provided. The method includes identifying visually distinctive candidate marker frames within the video, grouping the candidate marker frames into a plurality of groups based on visual similarity, computing a collective score for each of the groups based on temporal proximity of each of the candidate marker frames within the group to related events occurring within the video, and selecting at least one of the groups based on the collective proximity scores as marker frames that demarcate the pre-determined type of video segment. A video processing electronic device and at least one non-transitory computer readable storage medium having computer program instructions stored thereon for performing the method are also provided.
    Type: Grant
    Filed: June 11, 2014
    Date of Patent: June 1, 2021
    Assignee: ARRIS Enterprises LLC
    Inventors: Renxiang Li, Faisal Ishtiaq, Stephen P. Emeott, Anthony J. Braskich
  • Patent number: 10965965
    Abstract: Particular embodiments analyze logos found in a video program to determine video demarcations in the video program. For example, a video demarcation may be content that marks (“marker content”) a transition from a first video content type to a second video content type. Marker content may be used so the user knows that a transition is occurring. Particular embodiments analyze the logos found in a video program to determine the video demarcations in the video. The video is first analyzed to determine logos in the video program. Once these logos are determined, particular embodiments may re-analyze the video program to identify marker frames that include the marker content that signal the transitions to a different video content types. The marker frames may be determined without any prior knowledge of the marker content. Then, particular embodiments may use the marker frames to determine video segments.
    Type: Grant
    Filed: March 6, 2015
    Date of Patent: March 30, 2021
    Assignee: ARRIS Enterprises LLC
    Inventors: Renxiang Li, Faisal Ishtiaq
  • Publication number: 20210006847
    Abstract: Disclosed is a method of associating, at a secondary device, secondary media content with primary media content being output at a primary device. The method includes receiving, at the secondary device, first information based upon the primary content being output at the primary device, wherein the first information includes at least one of an audio and a visual signal, determining at the secondary device second information corresponding to the first information, receiving at the secondary device one or more portions of secondary media content that have been made available by a third device, determining at the secondary device whether one or more of the portions of the secondary media content match one or more portions of the second information, and taking at least one further action upon determining that there is a match.
    Type: Application
    Filed: September 21, 2020
    Publication date: January 7, 2021
    Inventors: Renxiang Li, Kevin L. Baum, Faisal Ishtiaq, Michael L. Needham
  • Patent number: 10785506
    Abstract: Disclosed is a method of associating, at a secondary device, secondary media content with primary media content being output at a primary device. The method includes receiving, at the secondary device, first information based upon the primary content being output at the primary device, wherein the first information includes at least one of an audio and a visual signal, determining at the secondary device second information corresponding to the first information, receiving at the secondary device one or more portions of secondary media content that have been made available by a third device, determining at the secondary device whether one or more of the portions of the secondary media content match one or more portions of the second information, and taking at least one further action upon determining that there is a match.
    Type: Grant
    Filed: August 13, 2018
    Date of Patent: September 22, 2020
    Assignee: Google Technology Holdings LLC
    Inventors: Renxiang Li, Kevin L. Baum, Faisal Ishtiaq, Michael L. Needham
  • Patent number: 10169655
    Abstract: A method is provided for detecting static graphical elements in a sequence of video frames that compares a selected frame in the sequence to each of a plurality of previous frames in the sequence to identify a graphical element that can be a logo. For each pair of frames compared, an absolute difference frame is determined by acquiring an absolute difference value between pixel values for corresponding pixels over at least a portion of the frames in the frame pair. A metric associated with each absolute difference frame is generated, which reflects a degree of dissimilarity. At least some of the absolute difference frames weighted in accordance with the metric associated therewith are summed to generate an accumulation difference frame such that pairs of frames that are more dissimilar have a greater weight. A static graphical element is then identified over a region of the accumulation difference frame in which pixel values satisfy specified criteria.
    Type: Grant
    Filed: November 30, 2016
    Date of Patent: January 1, 2019
    Assignee: ARRIS Enterprises LLC
    Inventors: Renxiang Li, Faisal Ishtiaq
  • Publication number: 20180352271
    Abstract: Disclosed is a method of associating, at a secondary device, secondary media content with primary media content being output at a primary device. The method includes receiving, at the secondary device, first information based upon the primary content being output at the primary device, wherein the first information includes at least one of an audio and a visual signal, determining at the secondary device second information corresponding to the first information, receiving at the secondary device one or more portions of secondary media content that have been made available by a third device, determining at the secondary device whether one or more of the portions of the secondary media content match one or more portions of the second information, and taking at least one further action upon determining that there is a match.
    Type: Application
    Filed: August 13, 2018
    Publication date: December 6, 2018
    Inventors: Renxiang Li, Kevin L. Baum, Faisal Ishtiaq, Michael L. Needham
  • Patent number: 10097865
    Abstract: Particular embodiments can refine a seed sentinel frame signature for a seed sentinel frame. The seed sentinel frame may be predictable or partially predictable content that demarks a beginning and/or end of certain content in a video program. The seed sentinel frame may be first used to detect other sentinel frames in the video program. However, other sentinel frames throughout the video program, or in other video programs, may be slightly different from the given sentinel frame due to different reasons. The seed sentinel frame signature may not detect the sentinel frames of a video program with a desired accuracy. Accordingly, particular embodiments may refine the sentinel frame signature to a synthetic sentinel frame signature. The synthetic sentinel frame signature may then be used to analyze the current video program or other video programs. The synthetic sentinel frame signature may more accurately detect the sentinel frames within the video program.
    Type: Grant
    Filed: May 12, 2016
    Date of Patent: October 9, 2018
    Assignee: ARRIS Enterprises LLC
    Inventors: Renxiang Li, Stephen P. Emeott, Faisal Ishtiaq
  • Patent number: 10051295
    Abstract: Disclosed is a method of associating, at a secondary device, secondary media content with primary media content being output at a primary device. The method includes receiving, at the secondary device, first information based upon the primary content being output at the primary device, wherein the first information includes at least one of an audio and a visual signal, determining at the secondary device second information corresponding to the first information, receiving at the secondary device one or more portions of secondary media content that have been made available by a third device, determining at the secondary device whether one or more of the portions of the secondary media content match one or more portions of the second information, and taking at least one further action upon determining that there is a match.
    Type: Grant
    Filed: March 10, 2017
    Date of Patent: August 14, 2018
    Assignee: Google Technology Holdings LLC
    Inventors: Renxiang Li, Kevin L. Baum, Faisal Ishtiaq, Michael L. Needham