Patents by Inventor Shashank Merchant

Shashank Merchant has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11363321
    Abstract: In one aspect, a method includes an input buffer receiving content; accessing the content from the input buffer and extracting from the accessed content, in-band message data that indicates a start time associated with a content-modification opportunity for a content-presentation device; the input buffer transmitting the content to a delay buffer; the delay buffer receiving the content from the input buffer and, after a delay time-period, transmitting the content to an output buffer; the output buffer receiving the content from the delay buffer and outputting for presentation a portion of the content; and after outputting for presentation the portion of the content and proximate a time-point associated with the indicated start-time, starting to perform a content-modification operation in connection with the content-modification opportunity.
    Type: Grant
    Filed: October 30, 2020
    Date of Patent: June 14, 2022
    Assignee: Roku, Inc.
    Inventors: Shashank Merchant, Benjamin John Ropke, John Steven Stavropoulos
  • Patent number: 11361017
    Abstract: Techniques are described that exclude use of “stop-fingerprints” from media database formation and search query to an automatic content recognition (ACR) systems based on media content fingerprints updated by stop-fingerprint analysis. A classification process is presented which takes in fingerprints from reference media files as an input and produces a modified set of fingerprints as an output by applying a novel stop-fingerprint classification algorithm. Architecture for the distributed stop-fingerprint generation is presented. Various cases, as stop-fingerprints generation for the entire reference database, stop-fingerprints generation for the individual reference fingerprint files, and temporal fingerprint classification obtained through intermediate steps of the temporal fingerprint classification algorithm are presented. A hash-based signature classification algorithm is also described.
    Type: Grant
    Filed: July 15, 2020
    Date of Patent: June 14, 2022
    Assignee: Roku, Inc.
    Inventors: Sunil Suresh Kulkarni, Pradipkumar Dineshbhai Gajjar, Jose Pio Pereira, Preshant Ramanathan, Mihailo M. Stojancic, Shashank Merchant
  • Patent number: 11347470
    Abstract: In one aspect, an example method includes (i) presenting first media content from a first source; (ii) encountering a trigger to switch from presenting the first media content from the first source to presenting second media content from a second source; (iii) determining a first loudness level of the first media content; (iv) determining a second loudness level of the second media content; (v) based on a difference between the first loudness level and the second loudness level, adjusting a loudness level of the second media content so as to generate modified media content having a third loudness level that is different from the second loudness level; and (vi) responsive to encountering the trigger, presenting the modified media content having the third loudness level.
    Type: Grant
    Filed: November 4, 2019
    Date of Patent: May 31, 2022
    Assignee: Roku, Inc.
    Inventors: Markus K. Cremer, Shashank Merchant, Aneesh Vartakavi
  • Patent number: 11334615
    Abstract: The overall architecture and details of a scalable video fingerprinting and identification system that is robust with respect to many classes of video distortions is described. In this system, a fingerprint for a piece of multimedia content is composed of a number of compact signatures, along with traversal hash signatures and associated metadata. Numerical descriptors are generated for features found in a multimedia clip, signatures are generated from these descriptors, and a reference signature database is constructed from these signatures. Query signatures are also generated for a query multimedia clip. These query signatures are searched against the reference database using a fast similarity search procedure, to produce a candidate list of matching signatures. This candidate list is further analyzed to find the most likely reference matches. Signature correlation is performed between the likely reference matches and the query clip to improve detection accuracy.
    Type: Grant
    Filed: August 28, 2019
    Date of Patent: May 17, 2022
    Assignee: Roku, Inc.
    Inventors: Prashant Ramanathan, Jose Pio Pereira, Shashank Merchant, Mihailo M. Stojancic
  • Patent number: 11336952
    Abstract: A mobile device responds in real time to media content presented on a media device, such as a television. The mobile device captures temporal fragments of audio-video content on its microphone, camera, or both and generates corresponding audio-video query fingerprints. The query fingerprints are transmitted to a search server located remotely or used with a search function on the mobile device for content search and identification. Audio features are extracted and audio signal global onset detection is used for input audio frame alignment. Additional audio feature signatures are generated from local audio frame onsets, audio frame frequency domain entropy, and maximum change in the spectral coefficients. Video frames are analyzed to find a television screen in the frames, and a detected active television quadrilateral is used to generate video fingerprints to be combined with audio fingerprints for more reliable content identification.
    Type: Grant
    Filed: February 25, 2016
    Date of Patent: May 17, 2022
    Assignee: Roku, Inc.
    Inventors: Mihailo M. Stojancic, Jose Pio Pereira, Peter Wendt, Shashank Merchant, Sunil Suresh Kulkarni
  • Publication number: 20220150588
    Abstract: In one aspect, an example method includes (i) identifying, by a playback device, a media device based on a control message received from the media device by way of an audio and/or video interface, where the media device provides media content to the playback device; (ii) providing, by the playback device, replacement media content for display; (iii) determining, by the playback device, that while the playback device is displaying the replacement media content a remote control transmitted an instruction to the identified media device; (iv) determining, by the playback device, a playback-modification action corresponding to the instruction and the identified media device; and (v) modifying, by the playback device, playback of the replacement media content in accordance with the playback-modification action.
    Type: Application
    Filed: January 26, 2022
    Publication date: May 12, 2022
    Inventors: Kurt R. Thielen, Peter Dunker, Markus K. Cremer, Steven D. Scherf, Shashank Merchant
  • Patent number: 11323777
    Abstract: In one aspect, an example method includes (i) providing, by a playback device, replacement media content for display; (ii) determining, by the playback device that while the playback device is displaying the replacement media content a remote control transmitted an instruction to a media device that provides media content to the playback device; (iii) determining, by the playback device, a playback-modification action corresponding to the instruction and the media device; and (iv) modifying, by the playback device, playback of the replacement media content in accordance with the playback-modification action.
    Type: Grant
    Filed: August 26, 2020
    Date of Patent: May 3, 2022
    Assignee: Roku, Inc.
    Inventors: Kurt R. Thielen, Shashank Merchant, Peter Dunker, Markus K. Cremer, Chungwon Seo, Seunghyeong Lee, Steven D. Scherf
  • Patent number: 11317144
    Abstract: In one aspect, an example method includes (i) presenting, by a playback device, first media content from a first source; (ii) encountering, by the playback device, a trigger to switch from presenting the first media content from the first source to presenting second media content from a second source; (iii) determining, by the playback device, that the playback device is presenting the first media content from the first source in a muted state; and (iv) responsive to encountering the trigger, and based on the determining that the playback device is presenting the first media content from the first source in a muted state, presenting, by the playback device, the second media content from the second source in the muted state.
    Type: Grant
    Filed: April 13, 2020
    Date of Patent: April 26, 2022
    Assignee: Roku, Inc.
    Inventors: Markus K. Cremer, Shashank Merchant
  • Publication number: 20220124404
    Abstract: In one aspect, an example method includes (i) presenting, by a playback device, first media content from a first source; (ii) encountering, by the playback device, a trigger to switch from presenting the first media content from the first source to presenting second media content from a second source; (iii) determining, by the playback device, that the playback device is presenting the first media content from the first source in a muted state; and (iv) responsive to encountering the trigger, and based on the determining that the playback device is presenting the first media content from the first source in a muted state, presenting, by the playback device, the second media content from the second source in the muted state.
    Type: Application
    Filed: December 28, 2021
    Publication date: April 21, 2022
    Inventors: Markus K. Cremer, Shashank Merchant
  • Patent number: 11303870
    Abstract: In one aspect, an example method includes (i) providing, by a playback device, replacement media content for display; (ii) determining, by the playback device, that a remote control transmitted to the playback device an instruction configured to cause a modification to operation of the playback device while the playback device displays the replacement media content; (iii) determining, by the playback device based on the instruction, an overlay that the playback device is configured to provide for display in conjunction with the modification; (iv) determining, by the playback device, a region within a display of the playback device corresponding to the overlay; and (v) modifying, by the playback device, a transparency of the region such that the overlay is visible through the replacement media content when the playback device provides the overlay for display.
    Type: Grant
    Filed: August 26, 2020
    Date of Patent: April 12, 2022
    Assignee: Roku, Inc.
    Inventors: Kurt R. Thielen, Shashank Merchant, Peter Dunker, Markus K. Cremer, Chungwon Seo, Seunghyeong Lee, Steven D. Scherf
  • Publication number: 20220109912
    Abstract: The disclosure provides for use of steganographically-encoded data as a basis to control content modification. A server could determine through a fingerprint comparison that a portion of media content on a channel being rendered by a content presentation device matches at least one modifiable-content segment, such as at least one replaceable ad. The server could then use watermark data encoded in the media content of the channel as a basis to determine an actual identity of a modifiable-content segment present on the channel, so as to then control content modification.
    Type: Application
    Filed: December 14, 2021
    Publication date: April 7, 2022
    Inventors: Shashank Merchant, Do Phuoc Hoang Tuong Lan
  • Patent number: 11288312
    Abstract: A multi-dimensional database and indexes and operations on the multi-dimensional database are described which include video search applications or other similar sequence or structure searches. Traversal indexes utilize highly discriminative information about images and video sequences or about object shapes. Global and local signatures around keypoints are used for compact and robust retrieval and discriminative information content of images or video sequences of interest. For other objects or structures relevant signature of pattern or structure are used for traversal indexes. Traversal indexes are stored in leaf nodes along with distance measures and occurrence of similar images in the database. During a sequence query, correlation scores are calculated for single frame, for frame sequence, and video clips, or for other objects or structures.
    Type: Grant
    Filed: June 14, 2019
    Date of Patent: March 29, 2022
    Assignee: ROKU, INC.
    Inventors: Jose Pio Pereira, Mihailo M. Stojancic, Shashank Merchant
  • Patent number: 11288313
    Abstract: A multi-dimensional database and indexes and operations on the multi-dimensional database are described which include video search applications or other similar sequence or structure searches. Traversal indexes utilize highly discriminative information about images and video sequences or about object shapes. Global and local signatures around keypoints are used for compact and robust retrieval and discriminative information content of images or video sequences of interest. For other objects or structures relevant signature of pattern or structure are used for traversal indexes. Traversal indexes are stored in leaf nodes along with distance measures and occurrence of similar images in the database. During a sequence query, correlation scores are calculated for single frame, for frame sequence, and video clips, or for other objects or structures.
    Type: Grant
    Filed: June 14, 2019
    Date of Patent: March 29, 2022
    Assignee: Roku, Inc.
    Inventors: Jose Pio Pereira, Mihailo M. Stojancic, Shashank Merchant
  • Patent number: 11288314
    Abstract: A multi-dimensional database and indexes and operations on the multi-dimensional database are described which include video search applications or other similar sequence or structure searches. Traversal indexes utilize highly discriminative information about images and video sequences or about object shapes. Global and local signatures around keypoints are used for compact and robust retrieval and discriminative information content of images or video sequences of interest. For other objects or structures relevant signature of pattern or structure are used for traversal indexes. Traversal indexes are stored in leaf nodes along with distance measures and occurrence of similar images in the database. During a sequence query, correlation scores are calculated for single frame, for frame sequence, and video clips, or for other objects or structures.
    Type: Grant
    Filed: June 14, 2019
    Date of Patent: March 29, 2022
    Assignee: ROKU, INC.
    Inventors: Jose Pio Pereira, Mihailo M. Stojancic, Shashank Merchant
  • Patent number: 11281718
    Abstract: A multi-dimensional database and indexes and operations on the multi-dimensional database are described which include video search applications or other similar sequence or structure searches. Traversal indexes utilize highly discriminative information about images and video sequences or about object shapes. Global and local signatures around keypoints are used for compact and robust retrieval and discriminative information content of images or video sequences of interest. For other objects or structures relevant signature of pattern or structure are used for traversal indexes. Traversal indexes are stored in leaf nodes along with distance measures and occurrence of similar images in the database. During a sequence query, correlation scores are calculated for single frame, for frame sequence, and video clips, or for other objects or structures.
    Type: Grant
    Filed: June 14, 2019
    Date of Patent: March 22, 2022
    Assignee: Roku, Inc.
    Inventors: Jose Pio Pereira, Mihailo M. Stojancic, Shashank Merchant
  • Patent number: 11272252
    Abstract: In one aspect, an example method includes (i) identifying, by a playback device, a media device based on a control message received from the media device by way of an audio and/or video interface, where the media device provides media content to the playback device; (ii) providing, by the playback device, replacement media content for display; (iii) determining, by the playback device, that while the playback device is displaying the replacement media content a remote control transmitted an instruction to the identified media device; (iv) determining, by the playback device, a playback-modification action corresponding to the instruction and the identified media device; and (v) modifying, by the playback device, playback of the replacement media content in accordance with the playback-modification action.
    Type: Grant
    Filed: November 6, 2018
    Date of Patent: March 8, 2022
    Assignee: Roku, Inc.
    Inventors: Kurt R. Thielen, Peter Dunker, Markus K. Cremer, Steven D. Scherf, Shashank Merchant
  • Patent number: 11245958
    Abstract: In one aspect, an example method includes (i) presenting, by a playback device, first media content from a first source; (ii) encountering, by the playback device, a trigger to switch from presenting the first media content from the first source to presenting second media content from a second source; (iii) determining, by the playback device, that the playback device is presenting the first media content from the first source in a muted state; and (iv) responsive to encountering the trigger, and based on the determining that the playback device is presenting the first media content from the first source in a muted state, presenting, by the playback device, the second media content from the second source in the muted state.
    Type: Grant
    Filed: June 6, 2019
    Date of Patent: February 8, 2022
    Assignee: Roku, Inc.
    Inventors: Markus K. Cremer, Shashank Merchant
  • Patent number: 11245870
    Abstract: In one aspect, a method for use in connection with a content-presentation device including a first input buffer, a second input buffer, and an output buffer, wherein the content-presentation device is configured such that content from either the first input buffer or the second input buffer can be communicated to the output buffer, includes: (i) receiving, from the content-presentation device, an identifier associated with the content-presentation device; (ii) using mapping data to map the received identifier to a baseline input-to-output delay, which represents a time-period between when content is input into the first input buffer and output by the output buffer; and (iii) transmitting, to the content-presentation device, the mapped baseline input-to-output delay to the content-presentation device to facilitate the content-presentation device (a) determining an input-buffer switching delay, and (b) using the determined input-buffer switching delay to facilitate performing a content-modification operation.
    Type: Grant
    Filed: June 18, 2020
    Date of Patent: February 8, 2022
    Assignee: Roku, Inc.
    Inventors: Chungwon Seo, Seunghyeong Lee, Shashank Merchant
  • Patent number: 11234050
    Abstract: The disclosure provides for use of steganographically-encoded data as a basis to control content modification. A server could determine through a fingerprint comparison that a portion of media content on a channel being rendered by a content presentation device matches at least one modifiable-content segment, such as at least one replaceable ad. The server could then use watermark data encoded in the media content of the channel as a basis to determine an actual identity of a modifiable-content segment present on the channel, so as to then control content modification.
    Type: Grant
    Filed: February 14, 2020
    Date of Patent: January 25, 2022
    Assignee: Roku, Inc.
    Inventors: Shashank Merchant, Do Phuoc Hoang Tuong Lan
  • Patent number: 11228798
    Abstract: One high-level aspect of a content-modification system and related methods may involve facilitating content modification by a content-presentation device of received broadcast content in a controlled manner, while under circumstances in which some events that can impact timing may be unpredictable. In particular, certain operations by a content-presentation device may involve matching received content with specific expected content as determined by one or another component of the content-modification system, in order to confirm proper conditions are met for the content-presentation device to proceed with, or continue, content-modification operations. It can happen the matching procedure becomes subject or susceptible to timing irregularities, or jitter. In some instances, jitter may impact the ability to derive the benefits of content modification. Accordingly, example embodiments herein are directed to systems and method for compensation and/or mitigating the effects of jitter.
    Type: Grant
    Filed: February 19, 2021
    Date of Patent: January 18, 2022
    Assignee: Roku, Inc.
    Inventors: Shashank Merchant, Bruce William Randall, Brian Johnson, Chungwon Seo, Seunghyeong Lee, Paul Jeffrey Holmquist