Patents by Inventor Amit Puntambekar

Amit Puntambekar has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20190215542
    Abstract: In one embodiment, a method includes receiving a series of a series of audio-and-video segment pairs in a live video feed. The series of audio-and-video segment pairs is traversed, comparing the end-time of a current audio-and-video segment with the start-time of the next audio-and-video segment pair, in the sequence, and identifying any time gap between consecutive audio-and-video segment pairs. When a time gap is identified, the end-time of a current segment pair is subtracted from the start time of the next segment-pair to define an offset time, and subsequent start times of segment pairs in the sequence are adjusted based on this offset time. If after adjusting a start time of the next segment-pair by the offset time, a gap in the audio segment remains, then the gap is filled with an encoded silence sequence.
    Type: Application
    Filed: January 5, 2018
    Publication date: July 11, 2019
    Inventors: Sonal Gandhi, Mathieu R. Henaire, Amit Puntambekar
  • Patent number: 10341561
    Abstract: In a distributed video encoding system, a video is encoded by splitting into video segments and encoding the segments using multiple encoders. Prior to segmenting the video for distributed video encoding, image stabilization is performed on the video. For each frame in the video, a corresponding transform operation is first computed based on an estimated camera movement. Next, the video is segmented into multiple video segments and the corresponding per-frame transform information for the multiple video segments. The video segments are then distributed to multiple processing nodes that perform the image stabilization of the corresponding video segment by applying the corresponding transform. The results from all the stabilized video segments are then stitched back together for further video encoding operation.
    Type: Grant
    Filed: September 11, 2015
    Date of Patent: July 2, 2019
    Assignee: Facebook, Inc.
    Inventors: Amit Puntambekar, Michael Hamilton Coward
  • Publication number: 20190200079
    Abstract: In one embodiment, a method includes receiving a video; predicting attributes of an audience for the video; identifying one or more encoding formats for the video based on the attributes of the audience; generating encodings for the video in one or more of the encoding formats; and storing the encodings in a data store.
    Type: Application
    Filed: December 21, 2017
    Publication date: June 27, 2019
    Inventors: Abhishek Mathur, Amit Puntambekar, Peter Knowles
  • Publication number: 20190190976
    Abstract: In one embodiment, a method includes receiving multimedia content information associated with at least one segment of a multimedia content, receiving a request to view the at least one segment of the multimedia content from a client device, logging playback information associated with the viewing of the at least one segment of the multimedia content, determining a multimedia quality metric associated with the at least one segment of multimedia content based in part upon a portion of the received multimedia content information and a portion of the logged playback information, and classifying the at least one segment of the multimedia content with the multimedia quality metric.
    Type: Application
    Filed: December 20, 2017
    Publication date: June 20, 2019
    Inventors: Minchuan Chen, Shankar Lakshmi Regunathan, Sonal Gandhi, Yaming He, Amit Puntambekar, Michael Hamilton Coward
  • Patent number: 10271074
    Abstract: An online system receives live stream content to be provided to one or more client devices as the live stream is ongoing. The online system generates a variety of transcoded live stream content to ensure that client devices can readily playback the appropriately encoded content. Once the live stream ends, the online system determines whether to use a transcoded live stream content or to use the original content received by the online system in order to generate a video on demand. To do so, the online system considers the quality of the original content and issues associated with the original content such as missing video frames or missing audio excerpts. The online system can choose to normalize the original content by eliminating the issues to improve the quality of the normalized original content and subsequently generate the video on demand from the normalized original content.
    Type: Grant
    Filed: December 30, 2016
    Date of Patent: April 23, 2019
    Assignee: Facebook, Inc.
    Inventors: Mathieu R. Henaire, Amit Puntambekar
  • Patent number: 10237608
    Abstract: Systems, methods, and non-transitory computer-readable media can generate a first set of fingerprints that correspond to at least one media stream of a content item. A second set of fingerprints that correspond to at least one media stream of an encoded version of the content item are generated. A first curve is generated based at least in part on the first set of fingerprints. A second curve is generated based at least in part on the second set of fingerprints. A determination is made whether the encoded version of the content item is synchronized based at least in part on the first curve and the second curve.
    Type: Grant
    Filed: September 13, 2016
    Date of Patent: March 19, 2019
    Assignee: Facebook, Inc.
    Inventors: Amit Puntambekar, Michael Hamilton Coward
  • Patent number: 10237581
    Abstract: An online system receives a media stream from a host of a live broadcasting stream and a second media stream from a guest of the host, and generates a single composite stream that includes the multiple live streams. The online system decodes and aligns the video and audio frames of each live stream to ensure that the composite stream displays the multiple live streams in a synchronized fashion. Additionally, the composite stream can display the multiple live streams in a particular format (e.g. side-by-side, or picture-in-picture), and therefore, the online system adjusts the video and audio frames of each live stream to fit that format. For each composite stream, the online system employs a decision engine that identifies the optimal set of encoded composite streams based on a variety of characteristics. The online system encodes the composite stream and distributes the appropriately encoded composite stream to client devices for display to viewers.
    Type: Grant
    Filed: December 30, 2016
    Date of Patent: March 19, 2019
    Assignee: Facebook, Inc.
    Inventors: Mathieu R. Henaire, Amit Puntambekar
  • Patent number: 10063872
    Abstract: A distributed video encoding system splits an input video into video segments. The video segments are encoded using multiple video encoding nodes. Prior to the process of splitting the sequence into video segments, the video is analyzed to generate a dependency map. Intelligent segmentation is performed using the dependency map so that each video segment includes all the video frames from which other video frames within that segment have been encoded in the input video. For example, picture headers are inspected to determine the temporal distance of the farthest past and future reference frames used for encoding frames of a video.
    Type: Grant
    Filed: September 11, 2015
    Date of Patent: August 28, 2018
    Assignee: Facebook, Inc.
    Inventors: Michael Hamilton Coward, Amit Puntambekar, Thomas George
  • Publication number: 20180191800
    Abstract: An online system receives content (e.g. video content and/or audio content) from a content provider device to be appropriately transcoded and distributed to client devices for consumption. During the transcoding process, the online system decodes the content into an intermediate format, and. considers a variety of characteristics to decide the optimal set of content encodings for encoding the decoded content. Characteristics include source characteristics associated with the content provider device, social graph characteristics of the user of the online system that is using the content provider device, viewer characteristics associated with the client devices that request to access the content, and content characteristics. The online system encodes the content for each client device with appropriate encoders selected based on the optimal set of content encodings.
    Type: Application
    Filed: December 30, 2016
    Publication date: July 5, 2018
    Inventors: Mathieu R. Henaire, Amit Puntambekar, Minchuan Chen
  • Publication number: 20180192080
    Abstract: An online system receives a media stream from a host of a live broadcasting stream and a second media stream from a guest of the host, and generates a single composite stream that includes the multiple live streams. The online system decodes and aligns the video and audio frames of each live stream to ensure that the composite stream displays the multiple live streams in a synchronized fashion. Additionally, the composite stream can display the multiple live streams in a particular format (e.g. side-by-side, or picture-in-picture), and therefore, the online system adjusts the video and audio frames of each live stream to fit that format. For each composite stream, the online system employs a decision engine that identifies the optimal set of encoded composite streams based on a variety of characteristics. The online system encodes the composite stream and distributes the appropriately encoded composite stream to client devices for display to viewers.
    Type: Application
    Filed: December 30, 2016
    Publication date: July 5, 2018
    Inventors: Mathieu R. Henaire, Amit Puntambekar
  • Publication number: 20180191586
    Abstract: An online system more efficiently streams multimedia content over the Internet for play back on client devices with varying computing power and network bandwidths by generating enhanced manifest files that more efficiently identify suitable media representations of the multimedia content. Each media representation has multiple media segments according to predefined byte ranges and a manifest file, which identifies location of the media file, bitrates, resolution, byte range, total duration, and other metadata. The online system customizes a manifest file for a user based on various factors including device capacity, network connectivity type and geolocation of the user. The online system also generates manifest fetch commands, which more efficiently fetch media segments for streaming. In response to changes of streaming server and media file (e.g., increased popularity), the online system dynamically updates corresponding manifest files.
    Type: Application
    Filed: December 30, 2016
    Publication date: July 5, 2018
    Inventors: Minchuan Chen, Amit Puntambekar, Michael Hamilton Coward
  • Publication number: 20180191587
    Abstract: An online system more efficiently streams multimedia content over the Internet for play back on client devices with varying computing power and network bandwidths by generating enhanced manifest files that more efficiently identify suitable media representations of the multimedia content. Each media representation has multiple media segments according to predefined byte ranges and a manifest file, which identifies location of the media file, bitrates, resolution, byte range, total duration, and other metadata. The online system customizes a manifest file for a user based on various factors including device capacity, network connectivity type and geolocation of the user. The online system also generates manifest fetch commands, which more efficiently fetch media segments for streaming. In response to changes of streaming server and media file (e.g., increased popularity), the online system dynamically updates corresponding manifest files.
    Type: Application
    Filed: December 30, 2016
    Publication date: July 5, 2018
    Inventors: Minchuan Chen, Amit Puntambekar, Michael Hamilton Coward
  • Publication number: 20180191799
    Abstract: An online system more efficiently streams multimedia content over the Internet for play back on client devices with varying computing power and network bandwidths by generating enhanced manifest files that more efficiently identify suitable media representations of the multimedia content. Each media representation has multiple media segments according to predefined byte ranges and a manifest file, which identifies location of the media file, bitrates, resolution, byte range, total duration, and other metadata. The online system customizes a manifest file for a user based on various factors including device capacity, network connectivity type and geolocation of the user. The online system also generates manifest fetch commands, which more efficiently fetch media segments for streaming. In response to changes of streaming server and media file (e.g., increased popularity), the online system dynamically updates corresponding manifest files.
    Type: Application
    Filed: December 30, 2016
    Publication date: July 5, 2018
    Inventors: Minchuan Chen, Amit Puntambekar, Michael Hamilton Coward
  • Publication number: 20180191801
    Abstract: An online system more efficiently streams multimedia content over the Internet for play back on client devices with varying computing power and network bandwidths by generating enhanced manifest files that more efficiently identify suitable media representations of the multimedia content. Each media representation has multiple media segments according to predefined byte ranges and a manifest file, which identifies location of the media file, bitrates, resolution, byte range, total duration, and other metadata. The online system customizes a manifest file for a user based on various factors including device capacity, network connectivity type and geolocation of the user. The online system also generates manifest fetch commands, which more efficiently fetch media segments for streaming. In response to changes of streaming server and media file (e.g., increased popularity), the online system dynamically updates corresponding manifest files.
    Type: Application
    Filed: December 30, 2016
    Publication date: July 5, 2018
    Inventors: Minchuan Chen, Amit Puntambekar, Michael Hamilton Coward
  • Publication number: 20180190327
    Abstract: Systems, methods, and non-transitory computer-readable media can present one or more base segments of a first stream of a content item in a viewport interface, the content item being composed using a set of streams that each capture at least one scene from a particular direction, wherein the viewport interface is provided through a display screen of the computing device. A determination is made that a direction of the viewport interface has changed to a different direction during playback of a first base segment of the first stream. One or more offset segments of a second stream that correspond to the different direction are presented in the viewport interface, the offset segments being offset from the set of base segments of the first stream.
    Type: Application
    Filed: December 30, 2016
    Publication date: July 5, 2018
    Inventors: Michael Hamilton Coward, Amit Puntambekar, David Young Joon Pio, Evgeny V. Kuzyakov
  • Publication number: 20180192086
    Abstract: An online system receives live stream content to be provided to one or more client devices as the live stream is ongoing. The online system generates a variety of transcoded live stream content to ensure that client devices can readily playback the appropriately encoded content. Once the live stream ends, the online system determines whether to use a transcoded live stream content or to use the original content received by the online system in order to generate a video on demand. To do so, the online system considers the quality of the original content and issues associated with the original content such as missing video frames or missing audio excerpts. The online system can choose to normalize the original content by eliminating the issues to improve the quality of the normalized original content and subsequently generate the video on demand from the normalized original content.
    Type: Application
    Filed: December 30, 2016
    Publication date: July 5, 2018
    Inventors: Mathieu R. Henaire, Amit Puntambekar
  • Publication number: 20180183845
    Abstract: Systems, methods, and non-transitory computer-readable media can determine that a content item is being accessed by a computing device, the content item being associated with a set of streams that are each encoded at a different bit rate, each stream in the set of streams having been partitioned into at least a first set of segments and a second set of segments that span the entirety of the stream. A segment from a first set of segments of a first stream in the set of streams is provided to the computing device. One or more segments from a second set of segments of the first stream are provided to the computing device.
    Type: Application
    Filed: December 22, 2016
    Publication date: June 28, 2018
    Inventors: Michael Hamilton Coward, Amit Puntambekar
  • Publication number: 20180176276
    Abstract: In one embodiment, a computer server machine generates a time map associated with the video stream. The video stream comprises one or more time slices. The computer server machine identifies a non-relevant time frame. The computer machine receives a comment and a localized comment time stamp, and associates the comment with one or more time slices. One or more client devices communicates a request for one or more time slices to the computer server machine, and the computer server machine determines whether the localized comment time stamp is within the requested one or more time slices. When the localized comment time stamp is within the requested one or more time slices, computer server machine transforms the localized time stamp to a synchronized comment time stamp. Computer server machine sends information regarding the synchronized comment time stamp to the one or more client devices.
    Type: Application
    Filed: December 19, 2016
    Publication date: June 21, 2018
    Inventors: Sonal Gandhi, Sabyasachi Roy, Amit Puntambekar, Michael Hamilton Coward, Mathieu R. Henaire
  • Publication number: 20180077445
    Abstract: Systems, methods, and non-transitory computer-readable media can generate a first set of fingerprints that correspond to at least one media stream of a content item. A second set of fingerprints that correspond to at least one media stream of an encoded version of the content item are generated. A first curve is generated based at least in part on the first set of fingerprints. A second curve is generated based at least in part on the second set of fingerprints. A determination is made whether the encoded version of the content item is synchronized based at least in part on the first curve and the second curve.
    Type: Application
    Filed: September 13, 2016
    Publication date: March 15, 2018
    Inventors: Amit Puntambekar, Michael Hamilton Coward
  • Publication number: 20180007269
    Abstract: A neural network learning algorithm obtains a fingerprint of a video sequence. Using the fingerprint, selection of an appropriate video stabilization algorithm, and its parameter settings, is performed. The video thus stabilized is made more appealing for viewing and easier for subsequent video compression. The neural network may be trained during a training phase to select a correct fingerprint of each video sequence based on the effectiveness of resulting video stabilization and/or compression.
    Type: Application
    Filed: December 30, 2016
    Publication date: January 4, 2018
    Inventors: Melanie Sclar, Amit Puntambekar, Michael Hamilton Coward, Wurzel David Parsons-Keir