Patents by Inventor Amit Puntambekar

Amit Puntambekar has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10681105
    Abstract: An online system receives content (e.g. video content and/or audio content) from a content provider device to be appropriately transcoded and distributed to client devices for consumption. During the transcoding process, the online system decodes the content into an intermediate format, and. considers a variety of characteristics to decide the optimal set of content encodings for encoding the decoded content. Characteristics include source characteristics associated with the content provider device, social graph characteristics of the user of the online system that is using the content provider device, viewer characteristics associated with the client devices that request to access the content, and content characteristics. The online system encodes the content for each client device with appropriate encoders selected based on the optimal set of content encodings.
    Type: Grant
    Filed: December 30, 2016
    Date of Patent: June 9, 2020
    Assignee: Facebook, Inc.
    Inventors: Mathieu R. Henaire, Amit Puntambekar, Minchuan Chen
  • Publication number: 20200099962
    Abstract: In one embodiment, a method includes streaming digital content for presentation by at least two user computing devices (e.g., phones, laptops, virtual reality headsets, TVs, etc.). Audio content, generated by a user of one of the user computing devices, is recorded and mixed with the native audio content from the streamed digital content, generating remixed digital content. The recorded and native audio content are mixed based on a predetermined ratio of recorded audio content and native audio content. The remixed digital content is then streamed for presentation for each other user of the user computing devices.
    Type: Application
    Filed: September 20, 2018
    Publication date: March 26, 2020
    Inventors: Maher Afif Saba, Amit Puntambekar
  • Patent number: 10602153
    Abstract: Various of the disclosed embodiments relate to multiple video encoders that are used to simultaneously encode a video using encoders configured using different encoding parameters. A segment selector selects an encoded version of the encoded video segment using operational criteria such as video quality and bandwidth. A configuration determination module may analyze the video segment to make a decision about which encoding parameter configurations may be suitable for encoding the video segment. The configuration determination module may be trainable, based on past encoding results.
    Type: Grant
    Filed: September 11, 2015
    Date of Patent: March 24, 2020
    Assignee: Facebook, Inc.
    Inventors: Michael Hamilton Coward, Amit Puntambekar, Wurzel David Parsons-Keir
  • Patent number: 10602157
    Abstract: A method and system for allocating a variable number of bits per frame in a distributed video encoding using a complexity analyzer is disclosed. The method includes receiving an input video for allocating the number of bits for each segment based on the complexity of the segment. Further, the method includes splitting the input video into plurality of segments. Further, the method includes determining the number of bits to be allocated to the plurality of segments based on the complexity measurement of the input video. In an embodiment, single complexity analyzer can be used to determine the complexity of the plurality of segments. In another embodiment, separate complexity analyzer can be used for each segment to determine the complexity. Further, the method includes allocating the bits to the plurality of segments of the input video. Further, the method includes combining the plurality of segments to form a single output video; thereby, obtaining the encoded output video.
    Type: Grant
    Filed: September 11, 2015
    Date of Patent: March 24, 2020
    Assignee: Facebook, Inc.
    Inventors: Michael Hamilton Coward, Amit Puntambekar
  • Patent number: 10587669
    Abstract: In one embodiment, a method includes receiving multimedia content information associated with at least one segment of a multimedia content, receiving a request to view the at least one segment of the multimedia content from a client device, logging playback information associated with the viewing of the at least one segment of the multimedia content, determining a multimedia quality metric associated with the at least one segment of multimedia content based in part upon a portion of the received multimedia content information and a portion of the logged playback information, and classifying the at least one segment of the multimedia content with the multimedia quality metric.
    Type: Grant
    Filed: December 20, 2017
    Date of Patent: March 10, 2020
    Assignee: Facebook, Inc.
    Inventors: Minchuan Chen, Shankar Lakshmi Regunathan, Sonal Gandhi, Yaming He, Amit Puntambekar, Michael Hamilton Coward
  • Patent number: 10582211
    Abstract: A neural network learning algorithm obtains a fingerprint of a video sequence. Using the fingerprint, selection of an appropriate video stabilization algorithm, and its parameter settings, is performed. The video thus stabilized is made more appealing for viewing and easier for subsequent video compression. The neural network may be trained during a training phase to select a correct fingerprint of each video sequence based on the effectiveness of resulting video stabilization and/or compression.
    Type: Grant
    Filed: December 30, 2016
    Date of Patent: March 3, 2020
    Assignee: Facebook, Inc.
    Inventors: Melanie Sclar, Amit Puntambekar, Michael Hamilton Coward, Wurzel David Parsons-Keir
  • Patent number: 10542328
    Abstract: Systems, methods, and non-transitory computer-readable media can present one or more base segments of a first stream of a content item in a viewport interface, the content item being composed using a set of streams that each capture at least one scene from a particular direction, wherein the viewport interface is provided through a display screen of the computing device. A determination is made that a direction of the viewport interface has changed to a different direction during playback of a first base segment of the first stream. One or more offset segments of a second stream that correspond to the different direction are presented in the viewport interface, the offset segments being offset from the set of base segments of the first stream.
    Type: Grant
    Filed: December 30, 2016
    Date of Patent: January 21, 2020
    Assignee: Facebook, Inc.
    Inventors: Michael Hamilton Coward, Amit Puntambekar, David Young Joon Pio, Evgeny V. Kuzyakov
  • Patent number: 10506235
    Abstract: Video encoding operation is performed in a distributed video encoding system to meet a service layer agreement such as a target time for completion of the video encoding operation. Each of multiple videos being encoded is split into smaller jobs corresponding to video segments of the videos. The jobs are processed according to a job queue. The sequence of jobs in the job queue is periodically updated such that jobs corresponding to each video are processed within the corresponding target encoding time.
    Type: Grant
    Filed: September 11, 2015
    Date of Patent: December 10, 2019
    Assignee: Facebook, Inc.
    Inventors: Michael Hamilton Coward, Amit Puntambekar, Randall Eugene Rizun
  • Patent number: 10506248
    Abstract: Video foreground and background detection is performed on a received video sequence on a macroblock by macroblock basis using motion vector encoding information associated with each macroblock. Some of the macroblocks in each frame, for example, edge or corner macroblocks, may be exempt from the foreground and background detection. The detection information, along with the video data, is passed to an image stabilization algorithm that prepares the video for subsequent video compression.
    Type: Grant
    Filed: December 30, 2016
    Date of Patent: December 10, 2019
    Assignee: Facebook, Inc.
    Inventors: Melanie Sclar, Amit Puntambekar, Michael Hamilton Coward, Wurzel David Parsons-Keir
  • Patent number: 10499070
    Abstract: A method and system for encoding a segment of an input video with accurate placement of key frames, e.g., I-Frames, using Group of Pictures (GOPs) length for output in a distributed video encoding system with two or more encoders is disclosed. The method includes creating overlapping segments in order to allow precise key frame placement. Further, the method includes using desired segment length and the desired key frame placement to create the overlapping segments. Further, the method includes skipping a certain number of frames at the beginning of the segment, and a certain number of frames at the end of the segment, thereby achieving accurate placement of key frames.
    Type: Grant
    Filed: September 11, 2015
    Date of Patent: December 3, 2019
    Assignee: Facebook, Inc.
    Inventors: Michael Hamilton Coward, Amit Puntambekar
  • Patent number: 10476943
    Abstract: An online system more efficiently streams multimedia content over the Internet for play back on client devices with varying computing power and network bandwidths by generating enhanced manifest files that more efficiently identify suitable media representations of the multimedia content. Each media representation has multiple media segments according to predefined byte ranges and a manifest file, which identifies location of the media file, bitrates, resolution, byte range, total duration, and other metadata. The online system customizes a manifest file for a user based on various factors including device capacity, network connectivity type and geolocation of the user. The online system also generates manifest fetch commands, which more efficiently fetch media segments for streaming. In response to changes of streaming server and media file (e.g., increased popularity), the online system dynamically updates corresponding manifest files.
    Type: Grant
    Filed: December 30, 2016
    Date of Patent: November 12, 2019
    Assignee: Facebook, Inc.
    Inventors: Minchuan Chen, Amit Puntambekar, Michael Hamilton Coward
  • Patent number: 10440085
    Abstract: An online system more efficiently streams multimedia content over the Internet for play back on client devices with varying computing power and network bandwidths by generating enhanced manifest files that more efficiently identify suitable media representations of the multimedia content. Each media representation has multiple media segments according to predefined byte ranges and a manifest file, which identifies location of the media file, bitrates, resolution, byte range, total duration, and other metadata. The online system customizes a manifest file for a user based on various factors including device capacity, network connectivity type and geolocation of the user. The online system also generates manifest fetch commands, which more efficiently fetch media segments for streaming. In response to changes of streaming server and media file (e.g., increased popularity), the online system dynamically updates corresponding manifest files.
    Type: Grant
    Filed: December 30, 2016
    Date of Patent: October 8, 2019
    Assignee: Facebook, Inc.
    Inventors: Minchuan Chen, Amit Puntambekar, Michael Hamilton Coward
  • Patent number: 10425378
    Abstract: In one embodiment, a computer server machine generates a time map associated with the video stream. The video stream comprises one or more time slices. The computer server machine identifies a non-relevant time frame. The computer machine receives a comment and a localized comment time stamp, and associates the comment with one or more time slices. One or more client devices communicates a request for one or more time slices to the computer server machine, and the computer server machine determines whether the localized comment time stamp is within the requested one or more time slices. When the localized comment time stamp is within the requested one or more time slices, computer server machine transforms the localized time stamp to a synchronized comment time stamp. Computer server machine sends information regarding the synchronized comment time stamp to the one or more client devices.
    Type: Grant
    Filed: December 19, 2016
    Date of Patent: September 24, 2019
    Assignee: Facebook, Inc.
    Inventors: Sonal Gandhi, Sabyasachi Roy, Amit Puntambekar, Michael Hamilton Coward, Mathieu R. Henaire
  • Patent number: 10412425
    Abstract: In one embodiment, a method includes receiving a series of a series of audio-and-video segment pairs in a live video feed. The series of audio-and-video segment pairs is traversed, comparing the end-time of a current audio-and-video segment with the start-time of the next audio-and-video segment pair, in the sequence, and identifying any time gap between consecutive audio-and-video segment pairs. When a time gap is identified, the end-time of a current segment pair is subtracted from the start time of the next segment-pair to define an offset time, and subsequent start times of segment pairs in the sequence are adjusted based on this offset time. If after adjusting a start time of the next segment-pair by the offset time, a gap in the audio segment remains, then the gap is filled with an encoded silence sequence.
    Type: Grant
    Filed: January 5, 2018
    Date of Patent: September 10, 2019
    Assignee: Facebook, Inc.
    Inventors: Sonal Gandhi, Mathieu R. Henaire, Amit Puntambekar
  • Patent number: 10375156
    Abstract: Various of the disclosed embodiments relate to a distributed video encoding or transcoding system may utilize multiple encoding nodes to encode a video sequence by splitting the video into multiple smaller video segments. The assignment of video segments to the encoding nodes is performed to balance the use of the encoding nodes by selecting a node based on its encoding capabilities, e.g., whether the node employed a central processing unit (CPU) based encoding or a graphics processor unit (GPU) based encoding.
    Type: Grant
    Filed: September 11, 2015
    Date of Patent: August 6, 2019
    Assignee: Facebook, Inc.
    Inventors: Michael Hamilton Coward, Amit Puntambekar
  • Publication number: 20190215542
    Abstract: In one embodiment, a method includes receiving a series of a series of audio-and-video segment pairs in a live video feed. The series of audio-and-video segment pairs is traversed, comparing the end-time of a current audio-and-video segment with the start-time of the next audio-and-video segment pair, in the sequence, and identifying any time gap between consecutive audio-and-video segment pairs. When a time gap is identified, the end-time of a current segment pair is subtracted from the start time of the next segment-pair to define an offset time, and subsequent start times of segment pairs in the sequence are adjusted based on this offset time. If after adjusting a start time of the next segment-pair by the offset time, a gap in the audio segment remains, then the gap is filled with an encoded silence sequence.
    Type: Application
    Filed: January 5, 2018
    Publication date: July 11, 2019
    Inventors: Sonal Gandhi, Mathieu R. Henaire, Amit Puntambekar
  • Patent number: 10341561
    Abstract: In a distributed video encoding system, a video is encoded by splitting into video segments and encoding the segments using multiple encoders. Prior to segmenting the video for distributed video encoding, image stabilization is performed on the video. For each frame in the video, a corresponding transform operation is first computed based on an estimated camera movement. Next, the video is segmented into multiple video segments and the corresponding per-frame transform information for the multiple video segments. The video segments are then distributed to multiple processing nodes that perform the image stabilization of the corresponding video segment by applying the corresponding transform. The results from all the stabilized video segments are then stitched back together for further video encoding operation.
    Type: Grant
    Filed: September 11, 2015
    Date of Patent: July 2, 2019
    Assignee: Facebook, Inc.
    Inventors: Amit Puntambekar, Michael Hamilton Coward
  • Publication number: 20190200079
    Abstract: In one embodiment, a method includes receiving a video; predicting attributes of an audience for the video; identifying one or more encoding formats for the video based on the attributes of the audience; generating encodings for the video in one or more of the encoding formats; and storing the encodings in a data store.
    Type: Application
    Filed: December 21, 2017
    Publication date: June 27, 2019
    Inventors: Abhishek Mathur, Amit Puntambekar, Peter Knowles
  • Publication number: 20190190976
    Abstract: In one embodiment, a method includes receiving multimedia content information associated with at least one segment of a multimedia content, receiving a request to view the at least one segment of the multimedia content from a client device, logging playback information associated with the viewing of the at least one segment of the multimedia content, determining a multimedia quality metric associated with the at least one segment of multimedia content based in part upon a portion of the received multimedia content information and a portion of the logged playback information, and classifying the at least one segment of the multimedia content with the multimedia quality metric.
    Type: Application
    Filed: December 20, 2017
    Publication date: June 20, 2019
    Inventors: Minchuan Chen, Shankar Lakshmi Regunathan, Sonal Gandhi, Yaming He, Amit Puntambekar, Michael Hamilton Coward
  • Patent number: 10271074
    Abstract: An online system receives live stream content to be provided to one or more client devices as the live stream is ongoing. The online system generates a variety of transcoded live stream content to ensure that client devices can readily playback the appropriately encoded content. Once the live stream ends, the online system determines whether to use a transcoded live stream content or to use the original content received by the online system in order to generate a video on demand. To do so, the online system considers the quality of the original content and issues associated with the original content such as missing video frames or missing audio excerpts. The online system can choose to normalize the original content by eliminating the issues to improve the quality of the normalized original content and subsequently generate the video on demand from the normalized original content.
    Type: Grant
    Filed: December 30, 2016
    Date of Patent: April 23, 2019
    Assignee: Facebook, Inc.
    Inventors: Mathieu R. Henaire, Amit Puntambekar