Patents by Inventor Shashank C. Merchant

Shashank C. Merchant has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240107115
    Abstract: A method and system for controlling implementation of dynamic content modification. The disclosure provides for using at least one steganographically-encoded timestamp in a media stream transmitted to a media client as a basis to determine a transmission delay for media-stream transmission to the media client, and for providing the determined transmission delay as a basis to facilitate control over whether to have the media client implement dynamic content modification. In addition, the disclosure provides for receiving respectively from each of various media clients a report indicating transmission delay determined for the media client based on such steganographically-encoded timestamp data, and using the transmission delays for the media clients to establish a dynamic-content-modification footprint that could be used to control whether, where, and to what extent dynamic content modification will be applied.
    Type: Application
    Filed: November 20, 2023
    Publication date: March 28, 2024
    Inventors: Benjamin J. Ropke, Shashank C. Merchant, John S. Stavropoulos
  • Patent number: 11936467
    Abstract: A computing system obtains a fingerprint of video content being rendered by a video presentation device, including a first portion representing a pre-established video segment and a second portion representing a dynamically-defined video segment. While obtaining the query fingerprint, the computing system (a) detects a match between the first portion of the query fingerprint and a reference fingerprint that represents the pre-established video segment, (b) based on the detecting of the match, identifies the video content being rendered, (c) after identifying the video content being rendered, applies a trained neural network to at least the second portion of the query fingerprint, and (d) detects, based on the applying of the neural network, that rendering of the identified video content continues. And responsive to at least the detecting that rendering of the identified video content continues, the computing system then takes associated action.
    Type: Grant
    Filed: February 26, 2021
    Date of Patent: March 19, 2024
    Assignee: Roku, Inc.
    Inventors: Dewey Ho Lee, Shashank C. Merchant, Markus K. Cremer
  • Patent number: 11882321
    Abstract: A media client ascertains a plurality of matching points between (i) query fingerprints representing a media stream being received by the client and (ii) reference fingerprints, each identified matching point defining a respective match between a query fingerprint that is timestamped with client time defined according to a clock of the client and a reference fingerprint that is timestamped with true time defined according to a timeline within a known media stream. Further, the client performs linear regression based on the timestamps of the ascertained plurality of matching points, to establish a mapping between true time and client time. The client then uses the established mapping as a basis to determine a client-time point at which the client should perform an action with respect to media stream being received by the client. And the client performs the action at the determined client-time point.
    Type: Grant
    Filed: March 2, 2022
    Date of Patent: January 23, 2024
    Assignee: Roku, Inc.
    Inventors: Peter Dunker, Markus K. Cremer, Shashank C. Merchant, Kurt R. Thielen
  • Patent number: 11863817
    Abstract: A method and system for controlling implementation of dynamic content modification. The disclosure provides for using at least one steganographically-encoded timestamp in a media stream transmitted to a media client as a basis to determine a transmission delay for media-stream transmission to the media client, and for providing the determined transmission delay as a basis to facilitate control over whether to have the media client implement dynamic content modification. In addition, the disclosure provides for receiving respectively from each of various media clients a report indicating transmission delay determined for the media client based on such steganographically-encoded timestamp data, and using the transmission delays for the media clients to establish a dynamic-content-modification footprint that could be used to control whether, where, and to what extent dynamic content modification will be applied.
    Type: Grant
    Filed: January 25, 2023
    Date of Patent: January 2, 2024
    Assignee: The Nielsen Company (US), LLC
    Inventors: Benjamin J. Ropke, Shashank C. Merchant, John S. Stavropoulos
  • Publication number: 20230336796
    Abstract: A method and system for using steganographically-encoded time information as a basis to control when a client carries out a content-related action. The client processes for presentation one or more linear media streams, each defining a respective time sequence of frames of media content, and at least one of the streams being steganographically encoded with at least one watermark at a respective time-point within the linear media stream, the watermark encoding a timestamp of the respective time-point within the linear media stream according to a server clock. The client extracts the timestamp from the watermark and computes a time offset based on a difference between the extracted timestamp and a current time according to a client clock. And the client uses the computed time offset as a basis to determine when to carry out a content-related action in a given one of the one or more linear media streams.
    Type: Application
    Filed: June 16, 2023
    Publication date: October 19, 2023
    Inventors: Benjamin J. Ropke, John S. Stavropoulos, Shashank C. Merchant
  • Publication number: 20230276086
    Abstract: The disclosure provides for use of steganographically-encoded data as a basis to disambiguated a fingerprint-based channel-multimatch. A fingerprint-matching server or other entity could detect a channel-multi-match scenario by determining that query fingerprints representing media content being rendered by a content presentation device match reference fingerprints respectively representing multiple channels. In view of that detected channel-multi-match scenario, the content presentation device could then provide channel-identification information that the content presentation device extracts from a watermark that is steganographically encoded in the media content of the channel that the content presentation device is rendering, for use of the extracted channel-identification information to determine which channel the content presentation device is rendering.
    Type: Application
    Filed: May 8, 2023
    Publication date: August 31, 2023
    Inventors: Shashank C. Merchant, Andrew L. Ashbacher
  • Patent number: 11736746
    Abstract: A method and system for using steganographically-encoded time information as a basis to control when a client carries out a content-related action. The client processes for presentation one or more linear media streams, each defining a respective time sequence of frames of media content, and at least one of the streams being steganographically encoded with at least one watermark at a respective time-point within the linear media stream, the watermark encoding a timestamp of the respective time-point within the linear media stream according to a server clock. The client extracts the timestamp from the watermark and computes a time offset based on a difference between the extracted timestamp and a current time according to a client clock. And the client uses the computed time offset as a basis to determine when the client should carry out a content-related action in a given one of the one or more linear media streams.
    Type: Grant
    Filed: September 7, 2022
    Date of Patent: August 22, 2023
    Assignee: The Nielsen Company (US), LLC
    Inventors: Benjamin J. Ropke, John S. Stavropoulos, Shashank C. Merchant
  • Publication number: 20230247240
    Abstract: A method and system for dynamically watermarking media content based on transport-stream metadata, to facilitate action by a downstream entity. An intermediary in a media-distribution path could receive a transport stream carrying media content and carrying metadata that is not watermarked in the media content. The intermediary could then obtain from the transport stream the metadata that is not watermarked in the media content and could modify the media content at least by encoding into the media content a watermark that represents the obtained metadata. And the intermediary could then output at least the modified media content for transmission to a downstream entity. The downstream entity could thus obtain from the watermark in the media content the metadata and could use the metadata to facilitate carrying out one or more useful actions.
    Type: Application
    Filed: April 6, 2023
    Publication date: August 3, 2023
    Inventors: Shashank C. Merchant, Benjamin J. Ropke, John S. Stavropoulos
  • Patent number: 11695972
    Abstract: A method and system to help control when to monitor for presence of replaceable advertisements in a media stream. An example method includes determining a time offset based at least on a difference between (i) a time of occurrence of a content event in a media stream as indicated by data carried in-band with the media stream and (ii) a time of occurrence of the content event in the media stream as indicated by schedule data that is not carried in-band with the media stream. Further, the method includes applying the determined time offset as a basis to adjust a scheduled time of an advertisement in the media stream, and using the adjusted scheduled time of the advertisement in the media stream as a basis to control when to monitor for presence of a replacement advertisement in the media stream.
    Type: Grant
    Filed: July 12, 2021
    Date of Patent: July 4, 2023
    Assignee: Roku, Inc.
    Inventors: Alejandro Gutierrez, John E. Sormark, Shashank C. Merchant, Brian P. Jentz, John L. Haynes, III
  • Patent number: 11689753
    Abstract: The disclosure provides for use of steganographically-encoded data as a basis to disambiguated a fingerprint-based channel-multimatch. A fingerprint-matching server or other entity could detect a channel-multi-match scenario by determining that query fingerprints representing media content being rendered by a content presentation device match reference fingerprints respectively representing multiple channels. In view of that detected channel-multi-match scenario, the content presentation device could then provide channel-identification information that the content presentation device extracts from a watermark that is steganographically encoded in the media content of the channel that the content presentation device is rendering, for use of the extracted channel-identification information to determine which channel the content presentation device is rendering.
    Type: Grant
    Filed: February 6, 2020
    Date of Patent: June 27, 2023
    Assignee: The Nielsen Company (US), LLC
    Inventors: Shashank C. Merchant, Andrew L. Ashbacher
  • Publication number: 20230171463
    Abstract: A method and system for controlling implementation of dynamic content modification. The disclosure provides for using at least one steganographically-encoded timestamp in a media stream transmitted to a media client as a basis to determine a transmission delay for media-stream transmission to the media client, and for providing the determined transmission delay as a basis to facilitate control over whether to have the media client implement dynamic content modification. In addition, the disclosure provides for receiving respectively from each of various media clients a report indicating transmission delay determined for the media client based on such steganographically-encoded timestamp data, and using the transmission delays for the media clients to establish a dynamic-content-modification footprint that could be used to control whether, where, and to what extent dynamic content modification will be applied.
    Type: Application
    Filed: January 25, 2023
    Publication date: June 1, 2023
    Inventors: Benjamin J. Ropke, Shashank C. Merchant, John S. Stavropoulos
  • Patent number: 11665378
    Abstract: A computing system identifies multiple matching points between (i) query fingerprints representing a media stream being received by a client and (ii) reference fingerprints, each identified matching point defining a respective match between a query fingerprint timestamped with client time defined according to a clock of the client and a reference fingerprint timestamped with true time defined according to a timeline within a known media stream. Further, the computing system performs linear regression based on the timestamps of the matching points, to establish a mapping between true time and client time. The computing system then uses the mapping to determine a client-time point at which the client should perform a content revision or other action with respect to the media stream being received by the client. And the computing system causes the client to perform the content revision or other action at the determined client-time point.
    Type: Grant
    Filed: February 9, 2022
    Date of Patent: May 30, 2023
    Assignee: ROKU, INC.
    Inventors: Peter Dunker, Markus K. Cremer, Shashank C. Merchant, Kurt R. Thielen
  • Patent number: 11653044
    Abstract: A method and system for dynamically watermarking media content based on transport-stream metadata, to facilitate action by a downstream entity. An intermediary in a media-distribution path could receive a transport stream carrying media content and carrying metadata that is not watermarked in the media content. The intermediary could then obtain from the transport stream the metadata that is not watermarked in the media content and could modify the media content at least by encoding into the media content a watermark that represents the obtained metadata. And the intermediary could then output at least the modified media content for transmission to a downstream entity. The downstream entity could thus obtain from the watermark in the media content the metadata and could use the metadata to facilitate carrying out one or more useful actions.
    Type: Grant
    Filed: August 30, 2022
    Date of Patent: May 16, 2023
    Assignee: The Nielsen Company (US), LLC
    Inventors: Shashank C. Merchant, Benjamin J. Ropke, John S. Stavropoulos
  • Patent number: 11641495
    Abstract: A computing system that identifies a media stream that a media client is processing for presentation determines which frame format of the media stream the media client is processing for presentation. And the computing system uses that determined frame format as a basis to facilitate dynamic content modification. For instance, based on then determined frame format, the computing system could work to ensure that replacement or overlay content that the media client obtains to facilitate dynamic content modification of the media stream is of that determined frame format. Further or alternatively, based on the determined frame format, the computing system could work to ensure that the media client gets provisioned with reference fingerprints of that particular frame format of the media stream, for use to facilitate client-side fingerprint matching to confirm that the media stream continues to be identified media stream.
    Type: Grant
    Filed: March 22, 2021
    Date of Patent: May 2, 2023
    Assignee: Roku, Inc.
    Inventors: Chung Won Seo, Shashank C. Merchant, Yong-joo Hong, Yoan Magniez
  • Patent number: 11589109
    Abstract: A method and system for controlling implementation of dynamic content modification. The disclosure provides for using at least one steganographically-encoded timestamp in a media stream transmitted to a media client as a basis to determine a transmission delay for media-stream transmission to the media client, and for providing the determined transmission delay as a basis to facilitate control over whether to have the media client implement dynamic content modification. In addition, the disclosure provides for receiving respectively from each of various media clients a report indicating transmission delay determined for the media client based on such steganographically-encoded timestamp data, and using the transmission delays for the media clients to establish a dynamic-content-modification footprint that could be used to control whether, where, and to what extent dynamic content modification will be applied.
    Type: Grant
    Filed: December 13, 2021
    Date of Patent: February 21, 2023
    Assignee: The Nielsen Company (US), LLC
    Inventors: Benjamin J. Ropke, Shashank C. Merchant, John S. Stavropoulos
  • Publication number: 20230007320
    Abstract: A method and system for using steganographically-encoded time information as a basis to control when a client carries out a content-related action. The client processes for presentation one or more linear media streams, each defining a respective time sequence of frames of media content, and at least one of the streams being steganographically encoded with at least one watermark at a respective time-point within the linear media stream, the watermark encoding a timestamp of the respective time-point within the linear media stream according to a server clock. The client extracts the timestamp from the watermark and computes a time offset based on a difference between the extracted timestamp and a current time according to a client clock. And the client uses the computed time offset as a basis to determine when the client should carry out a content-related action in a given one of the one or more linear media streams.
    Type: Application
    Filed: September 7, 2022
    Publication date: January 5, 2023
    Inventors: Benjamin J. Ropke, John S. Stavropoulos, Shashank C. Merchant
  • Publication number: 20220417572
    Abstract: A method and system for dynamically watermarking media content based on transport-stream metadata, to facilitate action by a downstream entity. An intermediary in a media-distribution path could receive a transport stream carrying media content and carrying metadata that is not watermarked in the media content. The intermediary could then obtain from the transport stream the metadata that is not watermarked in the media content and could modify the media content at least by encoding into the media content a watermark that represents the obtained metadata. And the intermediary could then output at least the modified media content for transmission to a downstream entity. The downstream entity could thus obtain from the watermark in the media content the metadata and could use the metadata to facilitate carrying out one or more useful actions.
    Type: Application
    Filed: August 30, 2022
    Publication date: December 29, 2022
    Inventors: Shashank C. Merchant, Benjamin J. Ropke, John S. Stavropoulos
  • Patent number: 11503362
    Abstract: A computing system identifies a media stream being received by a client, based on fingerprint matching conducted with query fingerprints generated by the client at a frame rate. The computing system then causes the client to increase the frame rate, in order to facilitate establishment by the computing system of synchronous lock between true time within the media stream and client time according to a clock of the client. The computing system then uses the established synchronous lock as a basis to map a true-time point at which a content revision should be performed in the media stream to a client-time point at which the client should perform the content revision. And the computing system causes the client to perform the content revision at the determined client-time point.
    Type: Grant
    Filed: March 26, 2021
    Date of Patent: November 15, 2022
    Assignee: ROKU, INC.
    Inventors: Kurt R. Thielen, Shashank C. Merchant, Peter Dunker, Markus K. Cremer, Steven D. Scherf
  • Patent number: 11496781
    Abstract: When a media client is receiving a media stream, the media client determines an upcoming time point at which the media client is to perform a content revision involving insertion (e.g., substitution or overlaying) of new content. The media client further determines an advanced time point when the media client should initiate a process of acquiring the new content, setting the advanced time point sufficiently in advance of the upcoming content-revision time point to enable the media client to obtain at least enough of the new content to be able to start the content revision on time. In an example implementation, the media client could determine the advanced time point by predicting how long the content-acquisition process will take, based on consideration of past instances of content acquisition, possibly correlated with operational factors such as content source, processor load, memory load, network speed, and time of day.
    Type: Grant
    Filed: October 15, 2021
    Date of Patent: November 8, 2022
    Assignee: ROKU, INC.
    Inventors: Peter Dunker, Markus K. Cremer, Shashank C. Merchant, Kurt R. Thielen
  • Patent number: 11470364
    Abstract: A method and system for using steganographically-encoded time information as a basis to control when a client carries out a content-related action. The client processes for presentation one or more linear media streams, each defining a respective time sequence of frames of media content, and at least one of the streams being steganographically encoded with at least one watermark at a respective time-point within the linear media stream, the watermark encoding a timestamp of the respective time-point within the linear media stream according to a server clock. The client extracts the timestamp from the watermark and computes a time offset based on a difference between the extracted timestamp and a current time according to a client clock. And the client uses the computed time offset as a basis to determine when the client should carry out a content-related action in a given one of the one or more linear media streams.
    Type: Grant
    Filed: May 13, 2021
    Date of Patent: October 11, 2022
    Assignee: The Nielsen Company (US), LLC
    Inventors: Benjamin J. Ropke, John S. Stavropoulos, Shashank C. Merchant