Patents by Inventor Shashank C. Merchant

Shashank C. Merchant has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20220167029
    Abstract: A computing system identifies multiple matching points between (i) query fingerprints representing a media stream being received by a client and (ii) reference fingerprints, each identified matching point defining a respective match between a query fingerprint timestamped with client time defined according to a clock of the client and a reference fingerprint timestamped with true time defined according to a timeline within a known media stream. Further, the computing system performs linear regression based on the timestamps of the matching points, to establish a mapping between true time and client time. The computing system then uses the mapping to determine a client-time point at which the client should perform a content revision or other action with respect to the media stream being received by the client. And the computing system causes the client to perform the content revision or other action at the determined client-time point.
    Type: Application
    Filed: February 9, 2022
    Publication date: May 26, 2022
    Inventors: Peter Dunker, Markus K. Cremer, Shashank C. Merchant, Kurt R. Thielen
  • Publication number: 20220150601
    Abstract: Use of watermarking in a media stream as a trigger for carrying out a fingerprint-related action, such as starting to generate fingerprints of the media stream, increasing a rate of generation of fingerprints of the media stream, starting to report fingerprints of the media stream, requesting fingerprints, or engaging in a fingerprint comparison. In an implementation, a media client that is processing the media stream could detect the watermark in the media stream and could responsively carry out or cause to be carried out a fingerprint-related action. Or an entity in a media-distribution path along which the media stream flows to a media client could detect the watermark in the media stream and could responsively carry out or cause to be carried out a fingerprint-related action. Further, the watermark could be inserted into the media stream in the first place based on transport-stream carried metadata, among other possibilities.
    Type: Application
    Filed: January 21, 2022
    Publication date: May 12, 2022
    Inventors: Shashank C. Merchant, John S. Stavropoulos, Benjamin J. Ropke, Steven M. Cormie
  • Patent number: 11303939
    Abstract: A media client ascertains a plurality of matching points between (i) query fingerprints representing a media stream being received by the client and (ii) reference fingerprints, each identified matching point defining a respective match between a query fingerprint that is timestamped with client time defined according to a clock of the client and a reference fingerprint that is timestamped with true time defined according to a timeline within a known media stream. Further, the client performs linear regression based on the timestamps of the ascertained plurality of matching points, to establish a mapping between true time and client time. The client then uses the established mapping as a basis to determine a client-time point at which the client should perform an action with respect to media stream being received by the client. And the client performs the action at the determined client-time point.
    Type: Grant
    Filed: May 11, 2021
    Date of Patent: April 12, 2022
    Assignee: Roku, Inc.
    Inventors: Peter Dunker, Markus K. Cremer, Shashank C. Merchant, Kurt R. Thielen
  • Publication number: 20220103895
    Abstract: A method and system for controlling implementation of dynamic content modification. The disclosure provides for using at least one steganographically-encoded timestamp in a media stream transmitted to a media client as a basis to determine a transmission delay for media-stream transmission to the media client, and for providing the determined transmission delay as a basis to facilitate control over whether to have the media client implement dynamic content modification. In addition, the disclosure provides for receiving respectively from each of various media clients a report indicating transmission delay determined for the media client based on such steganographically-encoded timestamp data, and using the transmission delays for the media clients to establish a dynamic-content-modification footprint that could be used to control whether, where, and to what extent dynamic content modification will be applied.
    Type: Application
    Filed: December 13, 2021
    Publication date: March 31, 2022
    Inventors: Benjamin J. Ropke, Shashank C. Merchant, John S. Stavropoulos
  • Patent number: 11290770
    Abstract: A computing system identifies a media stream being received by a client, based on fingerprint matching conducted with query fingerprints generated by the client at a frame rate. The computing system then causes the client to increase the frame rate, in order to facilitate establishment by the computing system of synchronous lock between true time within the media stream and client time according to an clock of the client. The computing system then uses the established synchronous lock as a basis to map a true-time point at which a content revision should be performed in the media stream to a client-time point at which the client should perform the content revision. And the computing system causes the client to perform the content revision at the determined client-time point.
    Type: Grant
    Filed: March 9, 2021
    Date of Patent: March 29, 2022
    Assignee: Roku, Inc.
    Inventors: Kurt R. Thielen, Shashank C. Merchant, Peter Dunker, Markus K. Cremer, Steven D. Scherf
  • Patent number: 11284131
    Abstract: A computing system identifies multiple matching points between (i) query fingerprints representing a media stream being received by a client and (ii) reference fingerprints, each identified matching point defining a respective match between a query fingerprint timestamped with client time defined according to a clock of the client and a reference fingerprint timestamped with true time defined according to a timeline within a known media stream. Further, the computing system performs linear regression based on the timestamps of the matching points, to establish a mapping between true time and client time. The computing system then uses the mapping to determine a client-time point at which the client should perform a content revision or other action with respect to the media stream being received by the client. And the computing system causes the client to perform the content revision or other action at the determined client-time point.
    Type: Grant
    Filed: December 15, 2020
    Date of Patent: March 22, 2022
    Assignee: Roku, Inc.
    Inventors: Peter Dunker, Markus K. Cremer, Shashank C. Merchant, Kurt R. Thielen
  • Publication number: 20220038758
    Abstract: When a media client is receiving a media stream, the media client determines an upcoming time point at which the media client is to perform a content revision involving insertion (e.g., substitution or overlaying) of new content. The media client further determines an advanced time point when the media client should initiate a process of acquiring the new content, setting the advanced time point sufficiently in advance of the upcoming content-revision time point to enable the media client to obtain at least enough of the new content to be able to start the content revision on time. In an example implementation, the media client could determine the advanced time point by predicting how long the content-acquisition process will take, based on consideration of past instances of content acquisition, possibly correlated with operational factors such as content source, processor load, memory load, network speed, and time of day.
    Type: Application
    Filed: October 15, 2021
    Publication date: February 3, 2022
    Inventors: Peter Dunker, Markus K. Cremer, Shashank C. Merchant, Kurt R. Thielen
  • Patent number: 11234049
    Abstract: A method and system for controlling implementation of dynamic content modification. The disclosure provides for using at least one steganographically-encoded timestamp in a media stream transmitted to a media client as a basis to determine a transmission delay for media-stream transmission to the media client, and for providing the determined transmission delay as a basis to facilitate control over whether to have the media client implement dynamic content modification. In addition, the disclosure provides for receiving respectively from each of various media clients a report indicating transmission delay determined for the media client based on such steganographically-encoded timestamp data, and using the transmission delays for the media clients to establish a dynamic-content-modification footprint that could be used to control whether, where, and to what extent dynamic content modification will be applied.
    Type: Grant
    Filed: March 31, 2020
    Date of Patent: January 25, 2022
    Assignee: The Nielsen Company (US), LLC
    Inventors: Benjamin J. Ropke, Shashank C. Merchant, John S. Stavropoulos
  • Patent number: 11212560
    Abstract: A method and system for using steganographically-encoded time information as a basis to control when a client carries out a content-related action. The client processes for presentation one or more linear media streams, each defining a respective time sequence of frames of media content, and at least one of the streams being steganographically encoded with at least one watermark at a respective time-point within the stream, the watermark encoding a timestamp of the respective time-point within the stream according to a server clock. The client extracts the timestamp from the watermark and computes a time offset based on a difference between the extracted timestamp and a current time according to a client clock. And the client uses the computed time offset as a basis to determine when the client should carry out a content-related action in a given one of the one or more linear media streams.
    Type: Grant
    Filed: February 6, 2020
    Date of Patent: December 28, 2021
    Assignee: The Nielsen Company (US), LLC
    Inventors: Benjamin J. Ropke, John S. Stavropoulos, Shashank C. Merchant
  • Patent number: 11184649
    Abstract: When a media client is receiving a media stream, the media client determines an upcoming time point at which the media client is to perform a content revision involving insertion (e.g., substitution or overlaying) of new content. The media client further determines an advanced time point when the media client should initiate a process of acquiring the new content, setting the advanced time point sufficiently in advance of the upcoming content-revision time point to enable the media client to obtain at least enough of the new content to be able to start the content revision on time. In an example implementation, the media client could determine the advanced time point by predicting how long the content-acquisition process will take, based on consideration of past instances of content acquisition, possibly correlated with operational factors such as content source, processor load, memory load, network speed, and time of day.
    Type: Grant
    Filed: July 9, 2020
    Date of Patent: November 23, 2021
    Assignee: Roku, Inc.
    Inventors: Peter Dunker, Markus K. Cremer, Shashank C. Merchant, Kurt R. Thielen
  • Publication number: 20210344981
    Abstract: A method and system for dynamically watermarking media content based on transport-stream metadata, to facilitate action by a downstream entity. An intermediary in a media-distribution path could receive a transport stream carrying media content and carrying metadata that is not watermarked in the media content. The intermediary could then obtain from the transport stream the metadata that is not watermarked in the media content and could modify the media content at least by encoding into the media content a watermark that represents the obtained metadata. And the intermediary could then output at least the modified media content for transmission to a downstream entity. The downstream entity could thus obtain from the watermark in the media content the metadata and could use the metadata to facilitate carrying out one or more useful actions.
    Type: Application
    Filed: July 14, 2021
    Publication date: November 4, 2021
    Inventors: Shashank C. Merchant, Benjamin J. Ropke, John S. Stavropoulos
  • Publication number: 20210266616
    Abstract: A media client ascertains a plurality of matching points between (i) query fingerprints representing a media stream being received by the client and (ii) reference fingerprints, each identified matching point defining a respective match between a query fingerprint that is timestamped with client time defined according to a clock of the client and a reference fingerprint that is timestamped with true time defined according to a timeline within a known media stream. Further, the client performs linear regression based on the timestamps of the ascertained plurality of matching points, to establish a mapping between true time and client time. The client then uses the established mapping as a basis to determine a client-time point at which the client should perform an action with respect to media stream being received by the client. And the client performs the action at the determined client-time point.
    Type: Application
    Filed: May 11, 2021
    Publication date: August 26, 2021
    Inventors: Peter Dunker, Markus K. Cremer, Shashank C. Merchant, Kurt R. Thielen
  • Publication number: 20210266617
    Abstract: A method and system for using steganographically-encoded time information as a basis to control when a client carries out a content-related action. The client processes for presentation one or more linear media streams, each defining a respective time sequence of frames of media content, and at least one of the streams being steganographically encoded with at least one watermark at a respective time-point within the linear media stream, the watermark encoding a timestamp of the respective time-point within the linear media stream according to a server clock. The client extracts the timestamp from the watermark and computes a time offset based on a difference between the extracted timestamp and a current time according to a client clock. And the client uses the computed time offset as a basis to determine when the client should carry out a content-related action in a given one of the one or more linear media streams.
    Type: Application
    Filed: May 13, 2021
    Publication date: August 26, 2021
    Inventors: Benjamin J. Ropke, John S. Stavropoulos, Shashank C. Merchant
  • Patent number: 11095927
    Abstract: A method and system for dynamically watermarking media content based on transport-stream metadata, to facilitate action by a downstream entity. An intermediary in a media-distribution path could receive a transport stream carrying media content and carrying metadata that is not watermarked in the media content. The intermediary could then obtain from the transport stream the metadata that is not watermarked in the media content and could modify the media content at least by encoding into the media content a watermark that represents the obtained metadata. And the intermediary could then output at least the modified media content for transmission to a downstream entity. The downstream entity could thus obtain from the watermark in the media content the metadata and could use the metadata to facilitate carrying out one or more useful actions.
    Type: Grant
    Filed: February 6, 2020
    Date of Patent: August 17, 2021
    Assignee: The Nielsen Company (US), LLC
    Inventors: Shashank C. Merchant, Benjamin J. Ropke, John S. Stavropoulos
  • Publication number: 20210219011
    Abstract: A computing system identifies a media stream being received by a client, based on fingerprint matching conducted with query fingerprints generated by the client at a frame rate. The computing system then causes the client to increase the frame rate, in order to facilitate establishment by the computing system of synchronous lock between true time within the media stream and client time according to a clock of the client. The computing system then uses the established synchronous lock as a basis to map a true-time point at which a content revision should be performed in the media stream to a client-time point at which the client should perform the content revision. And the computing system causes the client to perform the content revision at the determined client-time point.
    Type: Application
    Filed: March 26, 2021
    Publication date: July 15, 2021
    Inventors: Kurt R. Thielen, Shashank C. Merchant, Peter Dunker, Markus K. Cremer, Steven D. Scherf
  • Patent number: 11051057
    Abstract: A method and system for using steganographically-encoded time information as a basis to control when a client carries out a content-related action. The client processes for presentation one or more linear media streams, each defining a respective time sequence of frames of media content, and at least one of the streams being steganographically encoded with at least one watermark at a respective time-point within the stream, the watermark encoding a timestamp of the respective time-point within the stream according to a server clock. The client extracts the timestamp from the watermark and computes a time offset based on a difference between the extracted timestamp and a current time according to a client clock. And the client uses the computed time offset as a basis to determine when the client should carry out a content-related action in a given one of the one or more linear media streams.
    Type: Grant
    Filed: February 6, 2020
    Date of Patent: June 29, 2021
    Assignee: The Nielsen Company (US), LLC
    Inventors: Benjamin J. Ropke, John S. Stavropoulos, Shashank C. Merchant
  • Publication number: 20210195276
    Abstract: A computing system identifies a media stream being received by a client, based on fingerprint matching conducted with query fingerprints generated by the client at a frame rate. The computing system then causes the client to increase the frame rate, in order to facilitate establishment by the computing system of synchronous lock between true time within the media stream and client time according to an clock of the client. The computing system then uses the established synchronous lock as a basis to map a true-time point at which a content revision should be performed in the media stream to a client-time point at which the client should perform the content revision. And the computing system causes the client to perform the content revision at the determined client-time point.
    Type: Application
    Filed: March 9, 2021
    Publication date: June 24, 2021
    Inventors: Kurt R. Thielen, Shashank C. Merchant, Peter Dunker, Markus K. Cremer, Steven D. Scherf
  • Patent number: 11044499
    Abstract: A media client ascertains a plurality of matching points between (i) query fingerprints representing a media stream being received by the client and (ii) reference fingerprints, each identified matching point defining a respective match between a query fingerprint that is timestamped with client time defined according to a clock of the client and a reference fingerprint that is timestamped with true time defined according to a timeline within a known media stream. Further, the client performs linear regression based on the timestamps of the ascertained plurality of matching points, to establish a mapping between true time and client time. The client then uses the established mapping as a basis to determine a client-time point at which the client should perform an action with respect to media stream being received by the client. And the client performs the action at the determined client-time point.
    Type: Grant
    Filed: June 2, 2020
    Date of Patent: June 22, 2021
    Assignee: Roku, Inc.
    Inventors: Peter Dunker, Markus K. Cremer, Shashank C. Merchant, Kurt R. Thielen
  • Publication number: 20210184779
    Abstract: A computing system obtains a fingerprint of video content being rendered by a video presentation device, including a first portion representing a pre-established video segment and a second portion representing a dynamically-defined video segment. While obtaining the query fingerprint, the computing system (a) detects a match between the first portion of the query fingerprint and a reference fingerprint that represents the pre-established video segment, (b) based on the detecting of the match, identifies the video content being rendered, (c) after identifying the video content being rendered, applies a trained neural network to at least the second portion of the query fingerprint, and (d) detects, based on the applying of the neural network, that rendering of the identified video content continues. And responsive to at least the detecting that rendering of the identified video content continues, the computing system then takes associated action.
    Type: Application
    Filed: February 26, 2021
    Publication date: June 17, 2021
    Inventors: Dewey Ho Lee, Shashank C. Merchant, Markus K. Cremer
  • Patent number: 10992981
    Abstract: A computing system identifies a media stream being received by a client, based on fingerprint matching conducted with query fingerprints generated by the client at a frame rate. The computing system then causes the client to increase the frame rate, in order to facilitate establishment by the computing system of synchronous lock between true time within the media stream and client time according to a clock of the client. The computing system then uses the established synchronous lock as a basis to map a true-time point at which a content revision should be performed in the media stream to a client-time point at which the client should perform the content revision. And the computing system causes the client to perform the content revision at the determined client-time point.
    Type: Grant
    Filed: February 13, 2020
    Date of Patent: April 27, 2021
    Assignee: Gracenote, Inc.
    Inventors: Kurt R. Thielen, Shashank C. Merchant, Peter Dunker, Markus K. Cremer, Steven D. Scherf