Patents by Inventor Renxiang Li
Renxiang Li has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11812073Abstract: Disclosed is a method of associating, at a secondary device, secondary media content with primary media content being output at a primary device. The method includes receiving, at the secondary device, first information based upon the primary content being output at the primary device, wherein the first information includes at least one of an audio and a visual signal, determining at the secondary device second information corresponding to the first information, receiving at the secondary device one or more portions of secondary media content that have been made available by a third device, determining at the secondary device whether one or more of the portions of the secondary media content match one or more portions of the second information, and taking at least one further action upon determining that there is a match.Type: GrantFiled: October 4, 2021Date of Patent: November 7, 2023Assignee: Google Technology Holdings LLCInventors: Renxiang Li, Kevin L. Baum, Faisal Ishtiaq, Michael L. Needham
-
Patent number: 11783585Abstract: A method of detecting frames in a video that demarcate a pre-determined type of video segment within the video is provided. The method includes identifying visually distinctive candidate marker frames within the video, grouping the candidate marker frames into a plurality of groups based on visual similarity, computing a collective score for each of the groups based on temporal proximity of each of the candidate marker frames within the group to related events occurring within the video, and selecting at least one of the groups based on the collective proximity scores as marker frames that demarcate the pre-determined type of video segment. A video processing electronic device and at least one non-transitory computer readable storage medium having computer program instructions stored thereon for performing the method are also provided.Type: GrantFiled: July 29, 2022Date of Patent: October 10, 2023Assignee: ARRIS Enterprises LLCInventors: Renxiang Li, Faisal Ishtiaq, Stephen P. Emeott, Anthony J. Braskich
-
Publication number: 20230071845Abstract: Systems, methods, and devices for an interactive viewing experience by detecting on-screen data are disclosed. One or more frames of video data are analyzed to detect regions in the visual video content that contain text. A character recognition operation can be performed on the regions to generate textual data. Based on the textual data and the regions, a graphical user interface (GUI) definition to can be generated. The GUI definition can be used to generate a corresponding GUI superimposed onto the visual video content to present users with controls and functionality with which to interact with the text or enhance the video content. Context metadata can be determined from external sources or by analyzing the continuity of audio and visual aspects of the video data. The context metadata can then be used to improve the character recognition or inform the generation of the GUI.Type: ApplicationFiled: November 15, 2022Publication date: March 9, 2023Inventors: Isselmou Ould Dellahy, Shivajit Mohapatra, Anthony J. Braskich, Faisal Ishtiaq, Renxiang Li
-
Publication number: 20220366693Abstract: A method of detecting frames in a video that demarcate a pre-determined type of video segment within the video is provided. The method includes identifying visually distinctive candidate marker frames within the video, grouping the candidate marker frames into a plurality of groups based on visual similarity, computing a collective score for each of the groups based on temporal proximity of each of the candidate marker frames within the group to related events occurring within the video, and selecting at least one of the groups based on the collective proximity scores as marker frames that demarcate the pre-determined type of video segment. A video processing electronic device and at least one non-transitory computer readable storage medium having computer program instructions stored thereon for performing the method are also provided.Type: ApplicationFiled: July 29, 2022Publication date: November 17, 2022Applicant: ARRIS Enterprises LLCInventors: Renxiang Li, Faisal Ishtiaq, Stephen P. Emeott, Anthony J. Braskich
-
Publication number: 20220337761Abstract: Methods and systems are described for managing content. A content stream may be generated based on source content. Scenes identified in the content stream may be compared with scenes in the source content. An iterative matching process may be used to modify scene boundaries that may be compared to the scene boundaries of the content stream.Type: ApplicationFiled: April 15, 2021Publication date: October 20, 2022Inventors: Ehsan Younessian, Renxiang Li
-
Publication number: 20220321944Abstract: Systems, apparatuses, and methods are described for adding visual and/or sound effects to a content item to improve user experience. Addition of the visual and/or sound effects may be based on metadata associated with the content item.Type: ApplicationFiled: April 2, 2021Publication date: October 6, 2022Inventors: Mohammad Hosseini, Renxiang Li, Isselmou Maloum, Ronald Lenk
-
Patent number: 11436834Abstract: A method of detecting frames in a video that demarcate a pre-determined type of video segment within the video is provided. The method includes identifying visually distinctive candidate marker frames within the video, grouping the candidate marker frames into a plurality of groups based on visual similarity, computing a collective score for each of the groups based on temporal proximity of each of the candidate marker frames within the group to related events occurring within the video, and selecting at least one of the groups based on the collective proximity scores as marker frames that demarcate the pre-determined type of video segment. A video processing electronic device and at least one non-transitory computer readable storage medium having computer program instructions stored thereon for performing the method are also provided.Type: GrantFiled: June 1, 2021Date of Patent: September 6, 2022Assignee: ARRIS Enterprises LLCInventors: Renxiang Li, Faisal Ishtiaq, Stephen P. Emeott, Anthony J. Braskich
-
Publication number: 20220103878Abstract: Disclosed is a method of associating, at a secondary device, secondary media content with primary media content being output at a primary device. The method includes receiving, at the secondary device, first information based upon the primary content being output at the primary device, wherein the first information includes at least one of an audio and a visual signal, determining at the secondary device second information corresponding to the first information, receiving at the secondary device one or more portions of secondary media content that have been made available by a third device, determining at the secondary device whether one or more of the portions of the secondary media content match one or more portions of the second information, and taking at least one further action upon determining that there is a match.Type: ApplicationFiled: October 4, 2021Publication date: March 31, 2022Inventors: Renxiang Li, Kevin L. Baum, Faisal Ishtiaq, Michael L. Needham
-
Patent number: 11256923Abstract: Particular embodiments extract features for frames from a video. Then, a sequence of frames is identified based on a pattern analysis of frames based on the features. This pattern may be used to select sentinel features from the sequence of frames. For example, a pattern may include a first sentinel sequence followed by a transitional frame and then a second sentinel sequence. The transitional frame may be a black frame that is used to identify back-to-back sentinel sequences. Then, a sentinel frame that demarks a transition from a first content type to a second content type is identified. For example, the frames on either side of the black frame may be very similar and be identified as sentinel frames that mark a transition from program content to advertisement content. The above process may allow automated detection of sentinel frames that can run without user supervision.Type: GrantFiled: May 12, 2016Date of Patent: February 22, 2022Assignee: ARRIS Enterprises LLCInventors: Stephen P. Emeott, Renxiang Li
-
Patent number: 11140424Abstract: Disclosed is a method of associating, at a secondary device, secondary media content with primary media content being output at a primary device. The method includes receiving, at the secondary device, first information based upon the primary content being output at the primary device, wherein the first information includes at least one of an audio and a visual signal, determining at the secondary device second information corresponding to the first information, receiving at the secondary device one or more portions of secondary media content that have been made available by a third device, determining at the secondary device whether one or more of the portions of the secondary media content match one or more portions of the second information, and taking at least one further action upon determining that there is a match.Type: GrantFiled: September 21, 2020Date of Patent: October 5, 2021Assignee: Google Technology Holdings LLCInventors: Renxiang Li, Kevin L. Baum, Faisal Ishtiaq, Michael L. Needham
-
Publication number: 20210287012Abstract: A method of detecting frames in a video that demarcate a pre-determined type of video segment within the video is provided. The method includes identifying visually distinctive candidate marker frames within the video, grouping the candidate marker frames into a plurality of groups based on visual similarity, computing a collective score for each of the groups based on temporal proximity of each of the candidate marker frames within the group to related events occurring within the video, and selecting at least one of the groups based on the collective proximity scores as marker frames that demarcate the pre-determined type of video segment. A video processing electronic device and at least one non-transitory computer readable storage medium having computer program instructions stored thereon for performing the method are also provided.Type: ApplicationFiled: June 1, 2021Publication date: September 16, 2021Inventors: Renxiang Li, Faisal Ishtiaq, Stephen P. Emeott, Anthony J. Braskich
-
Patent number: 11093978Abstract: A method for creating derivative advertisements is provided. The method includes identifying a visual element based on an analysis of a primary advertisement asset such that the visual element is representative of a branding message provided within the primary advertisement. The method also includes identifying a call-to-action (CTA) data element based on the analysis and creating a derivative advertisement asset having the visual element and CTA data element. A system and a non-transitory computer-readable storage medium containing software for executing the method are also provided.Type: GrantFiled: September 10, 2014Date of Patent: August 17, 2021Assignee: ARRIS Enterprises LLCInventors: Venugopal Vasudevan, Anthony J. Braskich, Renxiang Li, Jehan Wickramasuriya, Faisal Ishtiaq, Stephen P. Emeott, Benedito J. Fonseca, Jr., Alfonso Martinez Smith
-
Patent number: 11023737Abstract: A method of detecting frames in a video that demarcate a pre-determined type of video segment within the video is provided. The method includes identifying visually distinctive candidate marker frames within the video, grouping the candidate marker frames into a plurality of groups based on visual similarity, computing a collective score for each of the groups based on temporal proximity of each of the candidate marker frames within the group to related events occurring within the video, and selecting at least one of the groups based on the collective proximity scores as marker frames that demarcate the pre-determined type of video segment. A video processing electronic device and at least one non-transitory computer readable storage medium having computer program instructions stored thereon for performing the method are also provided.Type: GrantFiled: June 11, 2014Date of Patent: June 1, 2021Assignee: ARRIS Enterprises LLCInventors: Renxiang Li, Faisal Ishtiaq, Stephen P. Emeott, Anthony J. Braskich
-
Patent number: 10965965Abstract: Particular embodiments analyze logos found in a video program to determine video demarcations in the video program. For example, a video demarcation may be content that marks (“marker content”) a transition from a first video content type to a second video content type. Marker content may be used so the user knows that a transition is occurring. Particular embodiments analyze the logos found in a video program to determine the video demarcations in the video. The video is first analyzed to determine logos in the video program. Once these logos are determined, particular embodiments may re-analyze the video program to identify marker frames that include the marker content that signal the transitions to a different video content types. The marker frames may be determined without any prior knowledge of the marker content. Then, particular embodiments may use the marker frames to determine video segments.Type: GrantFiled: March 6, 2015Date of Patent: March 30, 2021Assignee: ARRIS Enterprises LLCInventors: Renxiang Li, Faisal Ishtiaq
-
Publication number: 20210006847Abstract: Disclosed is a method of associating, at a secondary device, secondary media content with primary media content being output at a primary device. The method includes receiving, at the secondary device, first information based upon the primary content being output at the primary device, wherein the first information includes at least one of an audio and a visual signal, determining at the secondary device second information corresponding to the first information, receiving at the secondary device one or more portions of secondary media content that have been made available by a third device, determining at the secondary device whether one or more of the portions of the secondary media content match one or more portions of the second information, and taking at least one further action upon determining that there is a match.Type: ApplicationFiled: September 21, 2020Publication date: January 7, 2021Inventors: Renxiang Li, Kevin L. Baum, Faisal Ishtiaq, Michael L. Needham
-
Patent number: 10785506Abstract: Disclosed is a method of associating, at a secondary device, secondary media content with primary media content being output at a primary device. The method includes receiving, at the secondary device, first information based upon the primary content being output at the primary device, wherein the first information includes at least one of an audio and a visual signal, determining at the secondary device second information corresponding to the first information, receiving at the secondary device one or more portions of secondary media content that have been made available by a third device, determining at the secondary device whether one or more of the portions of the secondary media content match one or more portions of the second information, and taking at least one further action upon determining that there is a match.Type: GrantFiled: August 13, 2018Date of Patent: September 22, 2020Assignee: Google Technology Holdings LLCInventors: Renxiang Li, Kevin L. Baum, Faisal Ishtiaq, Michael L. Needham
-
Patent number: 10169655Abstract: A method is provided for detecting static graphical elements in a sequence of video frames that compares a selected frame in the sequence to each of a plurality of previous frames in the sequence to identify a graphical element that can be a logo. For each pair of frames compared, an absolute difference frame is determined by acquiring an absolute difference value between pixel values for corresponding pixels over at least a portion of the frames in the frame pair. A metric associated with each absolute difference frame is generated, which reflects a degree of dissimilarity. At least some of the absolute difference frames weighted in accordance with the metric associated therewith are summed to generate an accumulation difference frame such that pairs of frames that are more dissimilar have a greater weight. A static graphical element is then identified over a region of the accumulation difference frame in which pixel values satisfy specified criteria.Type: GrantFiled: November 30, 2016Date of Patent: January 1, 2019Assignee: ARRIS Enterprises LLCInventors: Renxiang Li, Faisal Ishtiaq
-
Publication number: 20180352271Abstract: Disclosed is a method of associating, at a secondary device, secondary media content with primary media content being output at a primary device. The method includes receiving, at the secondary device, first information based upon the primary content being output at the primary device, wherein the first information includes at least one of an audio and a visual signal, determining at the secondary device second information corresponding to the first information, receiving at the secondary device one or more portions of secondary media content that have been made available by a third device, determining at the secondary device whether one or more of the portions of the secondary media content match one or more portions of the second information, and taking at least one further action upon determining that there is a match.Type: ApplicationFiled: August 13, 2018Publication date: December 6, 2018Inventors: Renxiang Li, Kevin L. Baum, Faisal Ishtiaq, Michael L. Needham
-
Patent number: 10097865Abstract: Particular embodiments can refine a seed sentinel frame signature for a seed sentinel frame. The seed sentinel frame may be predictable or partially predictable content that demarks a beginning and/or end of certain content in a video program. The seed sentinel frame may be first used to detect other sentinel frames in the video program. However, other sentinel frames throughout the video program, or in other video programs, may be slightly different from the given sentinel frame due to different reasons. The seed sentinel frame signature may not detect the sentinel frames of a video program with a desired accuracy. Accordingly, particular embodiments may refine the sentinel frame signature to a synthetic sentinel frame signature. The synthetic sentinel frame signature may then be used to analyze the current video program or other video programs. The synthetic sentinel frame signature may more accurately detect the sentinel frames within the video program.Type: GrantFiled: May 12, 2016Date of Patent: October 9, 2018Assignee: ARRIS Enterprises LLCInventors: Renxiang Li, Stephen P. Emeott, Faisal Ishtiaq
-
Patent number: 10051295Abstract: Disclosed is a method of associating, at a secondary device, secondary media content with primary media content being output at a primary device. The method includes receiving, at the secondary device, first information based upon the primary content being output at the primary device, wherein the first information includes at least one of an audio and a visual signal, determining at the secondary device second information corresponding to the first information, receiving at the secondary device one or more portions of secondary media content that have been made available by a third device, determining at the secondary device whether one or more of the portions of the secondary media content match one or more portions of the second information, and taking at least one further action upon determining that there is a match.Type: GrantFiled: March 10, 2017Date of Patent: August 14, 2018Assignee: Google Technology Holdings LLCInventors: Renxiang Li, Kevin L. Baum, Faisal Ishtiaq, Michael L. Needham