Video Editing Patents (Class 386/278)
  • Patent number: 11386931
    Abstract: The present disclosure relates generally to content delivery techniques in audio-visual streaming systems. The techniques include altering video or audio portions of media content based on user input or interaction. The techniques further include altering text or messaging distributed to multiple users based on user input.
    Type: Grant
    Filed: June 9, 2017
    Date of Patent: July 12, 2022
    Assignee: Verizon Patent and Licensing Inc.
    Inventors: Jason A. Kilar, Richard W. Tom, Lonn Lee, Bao Lei, Zachary Pinter, Lindsay Monroe, Yilli Aiwazian
  • Patent number: 11380364
    Abstract: A method for determining edits of a subject video reel, comprising steps of opening an original EDL, reading every line of the original EDL, identifying event names representing each shot and identifying a source file. Each event includes at least a camera time code for the shot length, and a location time code indicating location of the shot in the source file. Locating events and picking up the in and out camera time codes from the shot names, noting shot names and camera times for shots found to have common in and out times, identifying every VFX shot and storing VFX names. Next, the software compares camera times for the shots in the first temporary file with camera times for the same shots in the second temporary file; preparing a result EDL file listing exclusively all VFX shots in which changes were found, and detailing the changes.
    Type: Grant
    Filed: September 18, 2020
    Date of Patent: July 5, 2022
    Inventor: Steve Rhee
  • Patent number: 11361418
    Abstract: The present invention provides a transfer learning based capsule endoscopic images classification system. The system removes the capsule endoscopic images with an average brightness value beyond the preset threshold, and removes the capsule endoscopic images without details based on image brightness standard deviation and image brightness gradient. The system also removes similar images from the capsule endoscopic images using optical flow method, classifies the capsule endoscopic images according to the corresponding anatomical structure, and obtains the classified capsule endoscopic images list arranged in chronological order. The system further determines and labels the position of the first image of each specific anatomical structure in the classified capsule endoscopic images list arranged in chronological order.
    Type: Grant
    Filed: March 5, 2020
    Date of Patent: June 14, 2022
    Assignee: ANKON TECHNOLOGIES CO., LTD
    Inventors: Wenjin Yuan, Hao Zhang, Hang Zhang
  • Patent number: 11348616
    Abstract: The subject matter of this specification can be implemented in, among other things, a method that includes causing presentation of a collaborative video project to a first user account that includes a set of one or more shared video clips and a set of one or more personal video clips. The method includes receiving from the first user account a first selection of a video clip in the set of personal video clips and, in response, adding the video clip to the set of shared video clips. The method includes causing presentation of the collaborative video project to a second user account, including presentation of the set of shared video clips. The method includes receiving from the second user account a second selection of the video clip and, in response, adding the video clip to a collaborative video for the collaborative video project.
    Type: Grant
    Filed: November 26, 2013
    Date of Patent: May 31, 2022
    Assignee: Google LLC
    Inventors: Jason Toff, John Gregg, Rushabh Ashok Doshi, Robert Steven Glickstein, Molly Castle Nix
  • Patent number: 11328487
    Abstract: Embodiments of the inventive concept described herein relate to a method and a program for providing augmented reality image using depth data. According to an embodiment of the inventive concept, a method for providing an AR image using depth data includes a step S120 (a virtual image data receiving step) of receiving, by a client, virtual image data from a server, a step S140 (a display location determining step) of determining, by the client, a location, at which each pixel is to be displayed in a reality space, based on the depth data, and a step S160 (a virtual image data displaying step) of displaying the virtual image data in the reality space based on the determined location.
    Type: Grant
    Filed: May 29, 2020
    Date of Patent: May 10, 2022
    Assignee: CLICKED, INC.
    Inventors: Tae Wook Kim, Ha Ram Lee, Duk Young Jung
  • Patent number: 11305771
    Abstract: The present application discloses a method for controlling cruise of a vehicle. The method includes: acquiring a pre-established three-dimensional trajectory map of the vehicle from a starting point to a destination; acquiring current positioning information of the vehicle; intercepting a target trajectory at a preset distance currently ahead of the vehicle from the three-dimensional trajectory map according to the current positioning information; acquiring a target point from the target trajectory according to the current positioning information; acquiring a wheelbase and a current speed of the vehicle, and calculating an angle that front wheels of the vehicle are required to rotate, according to the target point, the current positioning information, the wheelbase, and the current speed; controlling a movement of the vehicle according to the angle.
    Type: Grant
    Filed: June 3, 2021
    Date of Patent: April 19, 2022
    Assignee: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
    Inventor: Lianchuan Zhang
  • Patent number: 11275948
    Abstract: A device may receive video data associated with a video, and may identify image data associated with the video data and that corresponds to a frame of the video. The device may process the image data, with an image analysis model, to determine an image compliance score associated with a policy and with context of the image data, and may identify text data associated with the video data. The device may process the text data, with a text analysis model, to determine a text compliance score associated with the policy and with context of the text data, and may determine, based on the image compliance score and the text compliance score, an aggregate compliance score associated with the frame. The device may determine whether the aggregate compliance score satisfies a threshold associated with the policy, and may perform actions based on whether the aggregate compliance score satisfies the threshold.
    Type: Grant
    Filed: December 10, 2019
    Date of Patent: March 15, 2022
    Assignee: Accenture Global Solutions Limited
    Inventors: Srikanth G. Rao, Tarun Singhal, Mathangi Sandilya, Vipin Anilkumar Bhasin, Bolaka Mukherjee, J. Nooji Shekar, Manish Phukan, Swati Dubey, Mamta Kanad Bhagwat, T Siva Rama Sarma
  • Patent number: 11264058
    Abstract: Coordinated audio and video filter pairs are applied to enhance artistic and emotional content of audiovisual performances. Such filter pairs, when applied in audio and video processing pipelines of an audiovisual application hosted on a portable computing device (such as a mobile phone or media player, a computing pad or tablet, a game controller or a personal digital assistant or book reader) can allow user selection of effects that enhance both audio and video coordinated therewith. Coordinated audio and video are captured, filtered and rendered at the portable computing device using camera and microphone interfaces, using digital signal processing software executable on a processor and using storage, speaker and display devices of, or interoperable with, the device. By providing audiovisual capture and personalization on an intimate handheld device, social interactions and postings of a type made popular by modern social networking platforms can now be extended to audiovisual content.
    Type: Grant
    Filed: March 30, 2020
    Date of Patent: March 1, 2022
    Assignee: Smule, Inc.
    Inventors: Parag P. Chordia, Perry R. Cook, Mark T. Godfrey, Prerna Gupta, Nicholas M. Kruge, Randal J. Leistikow, Alexander M. D. Rae, Ian S. Simon
  • Patent number: 11257521
    Abstract: Video content may be captured by an image capture device during a capture duration. The video content may include video frames that define visual content viewable as a function of progress through a progress length of the video content. Rotational position information may characterize rotational positions of the image capture device during the capture duration. Time-lapse video frames may be determined from the video frames of the video content based on a spatiotemporal metric. The spatiotemporal metric may characterize spatial smoothness and temporal regularity of the time-lapse video frames. The spatial smoothness may be determined based on the rotational positions of the image capture device corresponding to the time-lapse video frames, and the temporal regularity may be determined based on moments corresponding to the time-lapse video frames. Time-lapse video content may be generated based on the time-lapse video frames.
    Type: Grant
    Filed: December 10, 2020
    Date of Patent: February 22, 2022
    Assignee: GoPro, Inc.
    Inventors: Thomas Derbanne, César Douady, Maxim Karpushin
  • Patent number: 11252375
    Abstract: An electronic apparatus including: a display; a signal receiver including circuitry configured to receive a broadcast signal; a processor configured to control the electronic apparatus to: obtain first information about a broadcasting schedule corresponding to a plurality of channels provided through the broadcast signal, determine a recommendation level of a program corresponding to a time unit section having a predetermined time length with regard to a plurality of programs of the plurality of channels based on the obtained first information, obtain second information about a broadcasting schedule of the programs selected based on the determined recommendation level among the plurality of programs, and process the broadcasting schedule of the selected programs to be displayed on the display based on the obtained second information.
    Type: Grant
    Filed: January 3, 2020
    Date of Patent: February 15, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Daewon Yoon, Gohwoon Jeong, Daeeun Hyun, Sangshin Park, Kwansik Yang
  • Patent number: 11240541
    Abstract: The present invention provides: a virtual processing server with which comments are randomly posted to the content which has a small number of viewers and comment posts, thereby liven up the content, a control method for a virtual processing server, a content delivery system, and an application program for a terminal device.
    Type: Grant
    Filed: March 16, 2018
    Date of Patent: February 1, 2022
    Assignee: DWANGO Co., Ltd.
    Inventor: Hiroaki Saito
  • Patent number: 11234088
    Abstract: One example may include a method that includes receiving, at a server, a data set from one or more mobile devices located in a presentation space, combining the received data set with additional data to create a combined data set, creating a presentation signal based on the combined data set, subtracting a portion of one or more of the data set and the additional data set from the combined data set to create a modified presentation signal, forwarding the modified presentation signal to one or more of a display and a loudspeaker located in the presentation space, and playing the modified presentation signal via one or more of the loudspeaker and the display device.
    Type: Grant
    Filed: March 13, 2020
    Date of Patent: January 25, 2022
    Assignee: Biamp Systems, LLC
    Inventors: Nicholas William Metzar, Richard S. Juszkiewicz, Matthew V. Kotvis, Jason E. Damori
  • Patent number: 11224804
    Abstract: A system has a network-connected game platform for a specific player, executing first software on a first processor from a non-transitory medium, a game server connected to the network, streaming game data for a specific game to the network-connected game platform, the game server executing second software on a second processor from a non-transitory medium, and an interactive interface presented on a display screen of the first mobile device, the interactive interface displaying progress of the specific game, and comprising in addition a specific command input function. Through the command input function, the player is enabled to command the system to prepare a video clip, prepared using saved game updates, displaying activity in the game, over a period of time beginning and ending at times either preprogrammed, or set by selection through specific input functions provided to the player.
    Type: Grant
    Filed: July 17, 2018
    Date of Patent: January 18, 2022
    Assignee: Roblox Corporation
    Inventor: Pavel Pavlov
  • Patent number: 11204956
    Abstract: The present disclosure is directed toward systems and methods for ranking media effects. For example, systems and methods described herein enable a user to select and apply one or more media effects to a media communication such as a digital photograph or video. Systems and methods described herein identify and rank media effects based on characteristics associated with the user and the user's client-computing device. Furthermore, systems and methods described herein automatically present the top-ranked media effects to the user such that the user can easily select and apply one or more media effects that are tailored specifically to the user.
    Type: Grant
    Filed: April 20, 2020
    Date of Patent: December 21, 2021
    Assignee: FACEBOOK, INC.
    Inventors: Laura Ling Javier, Sachin Monga, Kristina Varshavskaya, Daniil Burdakov, Ittai Sean Barzilay, Volodymyr Giginiak, Harshdeep Singh, Connor C Hayes
  • Patent number: 11206433
    Abstract: One or more computing devices, systems, and/or methods for generating augmented videos are provided. First coordinates, of a first video frame of a video, may be determined for projection of a graphical object. A first plurality of keypoints on the first video frame may be determined based upon a set of objects. A second plurality of keypoints on a second video frame may be determined. A keypoint of the second plurality of keypoints may correspond to a keypoint of the first plurality of keypoints. A relationship between the first video frame and the second video frame may be determined based upon the first plurality of keypoints and the second plurality of keypoints. Second coordinates of the second video frame may be determined based upon the first coordinates and the relationship. The graphical object may be projected onto the second video frame based upon the second coordinates.
    Type: Grant
    Filed: May 8, 2019
    Date of Patent: December 21, 2021
    Assignee: VERIZON MEDIA INC.
    Inventors: Xingyue Zhou, Andrew Edward Kae, Guy Dassa
  • Patent number: 11183202
    Abstract: Methods for detecting whether a rendered version of a specified seamless connection (“SSC”) at a connection point between two audio segment sequences results in an audible discontinuity, and methods for analyzing at least one SSC between audio segment sequences to determine whether a renderable version of each SSC would have an audible discontinuity at the connection point when rendered, and in appropriate cases, for a SSC having a renderable version which is determined to have an audible discontinuity when rendered, correcting at least one audio segment of at least one segment sequence to be connected in accordance with the SSC in an effort to ensure that rendering of the SSC will result in seamless connection without an audible discontinuity. Other aspects are editing systems configured to implement any of the methods, and storage media and rendering systems which store audio data generated in accordance with any of the methods.
    Type: Grant
    Filed: July 26, 2016
    Date of Patent: November 23, 2021
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Roy M. Fejgin, Freddie Sanchez, Vinay Melkote, Michael Ward
  • Patent number: 11178090
    Abstract: A method for facilitating document review includes obtaining data indicative of an ordered relationship among electronic communication documents in a conversation thread group and one or more missing electronic communication documents. The method also includes causing a visualization of the conversation thread group to be presented to a user via a graphical user interface of a client device, in part by causing one or more graphic elements, corresponding to the missing electronic communication document(s), to be displayed at respective positions along axes of the visualization with a particular visual coding that is reserved for missing electronic communication documents.
    Type: Grant
    Filed: January 25, 2021
    Date of Patent: November 16, 2021
    Assignee: RELATIVITY ODA LLC
    Inventors: Andrea Beckman, Elise Tropiano, David Bishop, Benjamin George Cabot, Brandon Gauthier
  • Patent number: 11164604
    Abstract: Disclosed are a video editing method and apparatus, a device and a readable-storage medium. The method includes: acquiring a first video, separating a first video signal of the first video and an audio signal of the first video, collecting a second video signal, and synthesizing the collected second video signal with the audio signal to obtain a second video, clipping the first video and the second video to obtain a plurality of first short videos and a plurality of second short videos respectively; and selecting, according to the audio signal, a first target short video and a second target short video from the multiple first short videos and the multiple second short videos, and stitching the first target short video and the second target short video.
    Type: Grant
    Filed: September 11, 2020
    Date of Patent: November 2, 2021
    Assignee: BEIJING MICROLIVE VISION TECHNOLOGY CO., LTD.
    Inventor: Hao Cui
  • Patent number: 11166067
    Abstract: An approach for streaming a coded virtual reality (VR) video stream including receiving a segments of the coded VR video stream; storing the segments in a playback buffer; based on determining that a current playback time is within a threshold time of a playback time of a buffered segment, that a current duration of the playback buffer is larger than a threshold duration, and that a current bandwidth is larger than a threshold bandwidth, and that a current viewport is different from a previous viewport, storing at least one refined tile corresponding to the current viewport in the playback buffer; constructing a frame based on the buffered segment and the at least one refined tile corresponding to the current viewport; and decoding the coded VR video stream based on the constructed frame.
    Type: Grant
    Filed: November 13, 2020
    Date of Patent: November 2, 2021
    Assignee: TENCENT AMERICA LLC
    Inventors: Shalin Mahendra, Fai Yeung, Shan Liu, Meng Xu, Weiwei Feng
  • Patent number: 11153658
    Abstract: This application discloses an image display method performed at a terminal device. While playing a multimedia resource and after detecting that a target operation is performed on a playback progress bar of the multimedia resource, the terminal device obtains a target playback time point at which a target operation is to be performed on the playback progress bar in the multimedia resource. The terminal device determines a target region corresponding to the target playback time point in a target image, the target image comprising a plurality of regions, each region having a correspondence with a respective one of a plurality of playback time points of the multimedia resource, and displays a portion of the target image corresponding to the target region adjacent the playback progress bar. This application resolves the technical problem of relatively low image display efficiency in related art.
    Type: Grant
    Filed: August 6, 2020
    Date of Patent: October 19, 2021
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Chaowei Li, Xiuming Zhu
  • Patent number: 11108715
    Abstract: Systems and methods provide for capturing a media content item at a first time period and detecting and storing context data for the media content item. The systems and methods further provide for receiving, at a second time period, an indication from a user to access the media content item, retrieving the media content item and the context data for the media content item, analyzing the context data for the media content item to determine that creative tools not available during the second time period were available during the first time period based on the context data for the media content item, and providing creative tools to the user comprising the creative tools that were available during the first time period. The systems and methods further provide for storing recorded user actions and creative tools applied to the media content item separately from the media content item.
    Type: Grant
    Filed: June 24, 2019
    Date of Patent: August 31, 2021
    Assignee: Snap Inc.
    Inventors: Ken Chung, Rong Yan
  • Patent number: 11089259
    Abstract: Provided in the present disclosure are a video recording method and a video recording terminal, the method including: recording a video in response to receipt of a record instruction, pausing the recording in response to receipt of a pause instruction, so as to generate a first video file; continuing to display a dynamic image which is being captured by an image sensor in real time, and displaying a last frame image of the first video file subjected to transparency processing on the dynamic image in a superimposition manner; continuing to record the video in response to receipt of a continue-to-record instruction, stopping the recording in response to receipt of a stop instruction, so as to generate a second video file; and splicing the first video file and the second video file into a target video file.
    Type: Grant
    Filed: November 30, 2018
    Date of Patent: August 10, 2021
    Assignee: Bigo Technology Pte. Ltd.
    Inventor: Yutao Zhou
  • Patent number: 11087738
    Abstract: Implementations of the disclosure describe systems and methods that leverage machine learning to automate the process of creating music and effects mixes from original sound mixes including domestic dialogue. In some implementations, a method includes: receiving a sound mix including human dialogue; extracting metadata from the sound mix, where the extracted metadata categorizes the sound mix; extracting content feature data from the sound mix, the extracted content feature data including an identification of the human dialogue and instances or times the human dialogue occurs within the sound mix; automatically calculating, with a trained model, content feature data of a music and effects (M&E) sound mix using at least the extracted metadata and the extracted content feature data of the sound mix; and deriving the M&E sound mix using at least the calculated content feature data.
    Type: Grant
    Filed: June 11, 2019
    Date of Patent: August 10, 2021
    Assignee: Lucasfilm Entertainment Company Ltd. LLC
    Inventors: Scott Levine, Stephen Morris
  • Patent number: 11080531
    Abstract: Disclosed are a content editing apparatus and method capable of editing a video filmed by a personal terminal in a 5G communication environment. The content editing apparatus of the present disclosure includes a processor, a memory operatively connected to the processor and which stores at least one code configured to be executed by the processor, and an interface for receiving a video. The memory stores codes that, when executed by the processor, cause the processor to recognize a set wake-up word from the video, and edit the video based on an editing command recognized within an interval of a preset time from a portion where the wake-up word of the video is located.
    Type: Grant
    Filed: March 5, 2020
    Date of Patent: August 3, 2021
    Assignee: LG ELECTRONICS INC.
    Inventor: Seunghyun Kim
  • Patent number: 11064268
    Abstract: According to one implementation, a media content annotation system includes a computing platform having a hardware processor and a system memory storing a software code. The hardware processor executes the software code to receive a first version of media content and a second version of the media content altered with respect to the first version, and to map each of multiple segments of the first version of the media content to a corresponding one segment of the second version of the media content. The software code further aligns each of the segments of the first version of the media content with its corresponding one segment of the second version of the media content, and utilizes metadata associated with each of at least some of the segments of the first version of the media content to annotate its corresponding one segment of the second version of the media content.
    Type: Grant
    Filed: March 23, 2018
    Date of Patent: July 13, 2021
    Assignee: Disney Enterprises, Inc.
    Inventors: Miquel Angel Farre Guiu, Matthew C. Petrillo, Monica Alfaro Vendrell, Marc Junyent Martin, Katharine S. Ettinger, Evan A. Binder, Anthony M. Accardo, Avner Swerdlow
  • Patent number: 11037275
    Abstract: A system allows for editing images. The system accepts a first image including multiple pixels with corresponding pixel information as an input. The system divides the first image into multiple segmented regions based on the pixel information. The system identifies a segmented image from a first segmented region of the segmented regions. The system accepts a template image comprising an image rendering parameter as another input. The system generates a second image corresponding to the first image based on the template image and the segmented image.
    Type: Grant
    Filed: May 29, 2018
    Date of Patent: June 15, 2021
    Assignee: Tencent Technology (Shenzhen) Company Limited
    Inventor: Lei Wu
  • Patent number: 11023738
    Abstract: An apparatus that connects frames included in one video to make a highlight video shorter than the video evaluates whether each of the frames included in the video is appropriate as a component of the highlight video, identifies one or more candidate sections including continuous frames that are evaluated higher than a reference, and makes the highlight video by preferentially using the frames included in a longer candidate section, among the one or more candidate sections.
    Type: Grant
    Filed: May 31, 2019
    Date of Patent: June 1, 2021
    Assignee: Canon Kabushiki Kaisha
    Inventor: Tatsuya Yamamoto
  • Patent number: 11006076
    Abstract: Exemplary embodiments relate to techniques for providing modifiable views when capturing an image of a video call. When a user takes a picture of a video call (e.g., a screen shot), associated applications may scrape the phone of the call participants to acquire a better-quality image than what might be displayed in the call interface, which may be of reduced quality due to compression and/or bandwidth limitations. Problematically, the layout of the call interface is different on each user's device, which can cause the resulting screenshot to not look as expected. Exemplary embodiments therefore place the data scraped from each device into movable elements, which can be rearranged on the screen to alter the layout (even post-capture). Moreover, new layouts are possible, potentially with additional graphical elements. In some embodiments, information gathered from a user's social networking information can determine the layout parameters.
    Type: Grant
    Filed: December 31, 2019
    Date of Patent: May 11, 2021
    Assignee: FACEBOOK, INC.
    Inventor: Anne Raynor
  • Patent number: 10999480
    Abstract: A method, system, apparatus, and/or device for adjusting or removing frames in a set of frames. The method, system, apparatus, and/or device may include: associating a first frame of a set of frames with motion data that is captured approximately contemporaneously with the first frame; when a sampling rate of the motion data is greater than a frame rate of the set of frames, aggregating a first sample of the motion data captured at the first frame and a second sample of the motion data captured between the first frame and a second frame of the set of frames to obtain a movement value; when the movement value does not exceed a first threshold value, accepting the first frame from the set of frames; and when the movement value exceeds the first threshold value, rejecting the first frame from the set of frames.
    Type: Grant
    Filed: July 16, 2019
    Date of Patent: May 4, 2021
    Assignee: Atheer, Inc.
    Inventors: Ryan Fink, Gary Peck, Bryan Ransil
  • Patent number: 10999530
    Abstract: A computer system creates time lapse video of a live subject to help assess effects of skin treatments, use of cosmetics, or personal care routines over time. In one aspect, the computer system obtains a set of digital source images (e.g., from video or a series of still images) of a region of interest of a live subject (e.g., the face of the live subject or a portion thereof) captured in a first time period; normalizes the set of digital source images; obtains a first representative image that includes the region of interest by synthesizing or selecting it from the set of digital source images; and combines the first representative image with additional representative images from other time periods to form a time lapse video of the region of interest of the live subject.
    Type: Grant
    Filed: November 26, 2019
    Date of Patent: May 4, 2021
    Assignee: L'Oreal
    Inventors: Ozgur Emek Yildirim, Mehdi Doumi, Geoffrey F. Deane
  • Patent number: 10991396
    Abstract: Video information defining video content may be accessed. Music information defining a music track providing an accompaniment for video content may be accessed. The music track may have pulses and one or more music events. Individual music events may correspond to different moments within the music track. One or more music events may be individually classified into one or more categories based on intensities of one or pulses occurring within the music event. One or more visual effects may be selected for different moments within the music track based on the categories of the music events. One or more visual effects may be applied to the video content. One or more visual effects may be applied to one or more moments within the video content aligned to one or more different moments within the music track.
    Type: Grant
    Filed: May 27, 2020
    Date of Patent: April 27, 2021
    Assignee: GoPro, Inc.
    Inventors: Jean Patry, Guillaume Oulès
  • Patent number: 10956490
    Abstract: Provided are computer-implemented methods and systems for implementing and utilizing an audio and visual asset matching platform. The audio and visual asset matching platform may include a first interface, a digital asset creation platform, an asset matching engine, and a user feedback engine. The first interface may be configured to select at least one master digital asset. The digital asset creation platform may be configured to create digital assets, the digital assets comprising at least one of text, audio, image, video, 3D/4D virtual environments, and animation files and metadata. The asset matching engine may be configured to match digital assets and generate at least one output digital asset. The user feedback engine may be configured to monitor and analyze behavior in response to receipt of at least one output digital asset and generate feedback metrics to improve the matching of the asset matching engine.
    Type: Grant
    Filed: August 19, 2019
    Date of Patent: March 23, 2021
    Assignee: Audiobyte LLC
    Inventors: Omar Aguirre-Suarez, John vanSuchtelen, Andrew Lawrence Blacker
  • Patent number: 10950272
    Abstract: A method for obtaining audio-visual information includes: obtaining original video information and original audio information corresponding to respective speakers during a conversation; extracting a video frame sequence of a speaker who is speaking in each of the original video information based on the original audio information; stitching each of the extracted video frame sequences in a chronological order to obtain stitched video information; and matching the stitched video information with the original audio information to obtain the audio-visual information. The obtained stitched video information can be made to include a video frame sequence corresponding to each of speakers who are speaking, automatic editing of the original video information during a multi-speaker conversation can be realized, requirement for the user's capability to obtain audio-visual information is lowered, and intelligent level of audio-visual information acquisition is improved, thereby user experience is improved.
    Type: Grant
    Filed: November 30, 2019
    Date of Patent: March 16, 2021
    Assignee: BEIJING XIAOMI MOBILE SOFTWARE CO., LTD.
    Inventor: Xiaochuang Lu
  • Patent number: 10944806
    Abstract: Aspects of the subject disclosure may include, for example, a system for indicating a program boundary in an adaptive bitrate media stream, where the system includes a memory and a processor that performs operations including generating multiple transcoded media output streams of different bit rates from an input linear media stream, fragmenting the multiple transcoded media output streams into chunks, detecting a program boundary in the input linear media stream, and supplying a program change indicator in a manifest file for implementing program change features in mobile communication devices. Other embodiments are disclosed.
    Type: Grant
    Filed: June 22, 2016
    Date of Patent: March 9, 2021
    Assignee: The DIRECTV Group, Inc.
    Inventors: Binny Asarikuniyil, Kiran Vokkarne
  • Patent number: 10932656
    Abstract: A method executed by a system for selecting images from a plurality of image groups originating from a plurality of imagers of an in-vivo device includes calculating, or otherwise associating, a general score (GS) for images of each image group, to indicate the probability that each image includes at least one pathology, dividing each image group into image subgroups, identifying a set Set(i) of maximum general scores (MGSs), a MGS for each image subgroup of each image group; and selecting images for processing by identifying a MGS|max in each set S(i) of MGSs; identifying the greatest MGS|max and selecting the image related to the greatest MGS|max. The method further includes modifying the set Set(i) of MGSs related to the selected image, and repeating the steps described above until a predetermined criterion selected from a group consisting of a number N of images and a score threshold is met.
    Type: Grant
    Filed: May 18, 2017
    Date of Patent: March 2, 2021
    Assignee: GIVEN IMAGING LTD.
    Inventor: Dori Peleg
  • Patent number: 10936873
    Abstract: An information processing apparatus includes an obtainer that obtains video picture data designated by a terminal apparatus from a storage apparatus storing video picture data of a video picture shot by a wearable camera attached to or owned by a police officer or by an on-vehicle camera mounted on a police vehicle, a generator that analyzes a video picture in the obtained video picture data to generate information associated with a case and generates summary video picture data that is a video picture portion as a report target of the case extracted from the video picture data based on the generated information, and a transmitter that transmits the summary video picture data to the terminal apparatus.
    Type: Grant
    Filed: January 17, 2019
    Date of Patent: March 2, 2021
    Assignee: Panasonic I-PRO Sensing Solutions Co., Ltd.
    Inventors: Minoru Hagio, Keiichi Miyazaki, Takae Oguchi
  • Patent number: 10931914
    Abstract: The system includes a display device causing a display unit to display video; a data transmission unit that transmits, to the display device, video data generated in a predetermined format based on information decoded from encoded information, and interpolation data for interpolating differences between the predetermined format and a format when decoding from the encoded information; an interpolation data selection unit that selects a kind of interpolation data to be transmitted to the display device, on the basis of priorities for a plurality of kinds of the interpolation data capable of being generated based on the encoded information; and a display processing unit that acquires the video data and the selected kind of the interpolation data in the display device, and causes the display unit to display video resulting from interpolation of the video data based on the interpolation data.
    Type: Grant
    Filed: November 13, 2018
    Date of Patent: February 23, 2021
    Assignee: MAXELL, LTD.
    Inventor: Kyohei Unno
  • Patent number: 10929648
    Abstract: An apparatus and a method for data processing are provided. The apparatus for data processing includes a modeler configured to build an occlusion object model for an image containing an occlusion object; a renderer configured to render the occlusion object model according to a geometric relationship between the occlusion object and a face image containing no occlusion object, such that the rendered occlusion object image and the face image containing no occlusion object have same scale and attitude; and a merger configured to merge the face image containing no occlusion object and the rendered occlusion object image into an occluded face image. With the data processing apparatus and the data processing method face data enhancement, face data in the case of having an occlusion object is generated, so that the number of face training data sets can be effectively increased, thereby improving performance of a face-related module.
    Type: Grant
    Filed: December 5, 2018
    Date of Patent: February 23, 2021
    Assignee: FUJITSU LIMITED
    Inventors: Pingping Lu, Rujie Liu
  • Patent number: 10916272
    Abstract: Video content may be captured by an image capture device during a capture duration. The video content may include video frames that define visual content viewable as a function of progress through a progress length of the video content. Rotational position information may characterize rotational positions of the image capture device during the capture duration. Time-lapse video frames may be determined from the video frames of the video content based on a spatiotemporal metric. The spatiotemporal metric may characterize spatial smoothness and temporal regularity of the time-lapse video frames. The spatial smoothness may be determined based on the rotational positions of the image capture device corresponding to the time-lapse video frames, and the temporal regularity may be determined based on moments corresponding to the time-lapse video frames. Time-lapse video content may be generated based on the time-lapse video frames.
    Type: Grant
    Filed: February 10, 2020
    Date of Patent: February 9, 2021
    Assignee: GoPro, Inc.
    Inventors: Thomas Derbanne, César Douady, Maxim Karpushin
  • Patent number: 10911386
    Abstract: A method for facilitating document review includes determining an ordered relationship among electronic communication documents in a conversation thread group. The ordered relationship specifies a time sequence of documents in each of one or more conversation threads within the thread group. Each conversation thread begins with the same root document and ends with a different end document. The method also includes causing a visualization of the thread group to be presented to a user via a GUI. The visualization includes graphic elements corresponding to different electronic communication documents, and each element is at a respective position along first and second axes of the visualization in accordance with the ordered relationship. The first axis is indicative of how many electronic communications were sent, within a given conversation thread, after the root document was sent, and the second axis is generally indicative of how many conversation threads are in the thread group.
    Type: Grant
    Filed: February 2, 2017
    Date of Patent: February 2, 2021
    Assignee: RELATIVITY ODA LLC
    Inventors: Andrea Beckman, Elise Tropiano, David Bishop, Benjamin George Cabot, Brandon Gauthier
  • Patent number: 10902609
    Abstract: A method for image processing includes a graphics processing unit (GPU) of a mobile device obtaining a first set of image data having a first pixel size and a first color format. The first set of image data is generated by an image sensor of the mobile device. The method further includes the GPU resampling the first set of image data to generate a second set of image data having a second pixel size, and reformatting the second set of image data to generate a third set of image data having a second color format. The third set of image data is used for tracking an object by the mobile device.
    Type: Grant
    Filed: December 5, 2018
    Date of Patent: January 26, 2021
    Assignee: SZ DJI OSMO TECHNOLOGY CO., LTD.
    Inventors: Yan Wang, Bo Zang, Chenyu Xiang, Dicong Qiu
  • Patent number: 10891032
    Abstract: An image reproduction method and apparatus are provided for simultaneously displaying multiple moving-image thumbnails. A controller of the image reproduction apparatus generates a moving-image contents list including moving-image thumbnails corresponding to one or more moving-image contents, when a request for displaying the moving-image contents list is input. A multi-image reproducer of the image reproduction apparatus simultaneously reproduces the moving-image thumbnails. The moving-image contents list including the simultaneously reproduced moving-image thumbnails is displayed at a display unit of the image reproduction apparatus.
    Type: Grant
    Filed: April 11, 2018
    Date of Patent: January 12, 2021
    Inventors: Joo-Young Son, Tae-Hwa Hong
  • Patent number: 10887543
    Abstract: Methods, systems and computer program products for automatic adjustment of video orientation are provided. A computer-implemented method may include receiving a video comprising a plurality of image frames, receiving, via a user interface, a user request to initiate an automatic correction of the video that was recorded by the video recording device of the mobile device that was shaken during the recording, performing the automatic correction of the video, comprising automatically adjusting one or more of the plurality of image frames in the video to correct shaking, presenting the user interface providing a playback of a preview of the adjusted video, and presenting, in the user interface, alongside the playback of the preview of the adjusted video, a concurrent playback of the video originally recorded by the video recording device of the mobile device.
    Type: Grant
    Filed: November 4, 2019
    Date of Patent: January 5, 2021
    Assignee: GOOGLE LLC
    Inventors: Maciek S. Nowakowski, Balazs Szabo
  • Patent number: 10887542
    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and a method for receiving, by one or more processors, a video comprising one or more shots in a first aspect ratio; detecting a first shot of the one or more shots, the first shot comprising a sequence of frames; and identifying an object that appears throughout a continuous portion of frames of the sequence of frames in the first shot. A visual presentation of the object in the first shot is automatically modified and a modified video comprising the one or more shots in a second aspect ratio is generated based on the automatically modified visual presentation of the object in the first shot.
    Type: Grant
    Filed: December 27, 2018
    Date of Patent: January 5, 2021
    Assignee: Snap Inc.
    Inventors: Joel Brandt, Giles Goodwin, Jared Iwata, Ian Wehrman
  • Patent number: 10878246
    Abstract: A method for performing client-side content inference may include (1) receiving a request to upload, from a client-side device to a server-side device, a content item that includes a first sequence of bytes and a second sequence of bytes, (2) identifying a model configured to output a classification for sequences of bytes, (3) using, at the client-side device, the model to derive a first classification for the first sequence, (4) using, at the client-side device, the model to derive a second classification for the second sequence, and (5) uploading, in response to the request, the content item to the server-side device by (a) uploading the first sequence, (b) uploading the first classification substantially contemporaneous with uploading the first sequence, (c) uploading the second sequence, and (d) uploading the second classification substantially contemporaneous with uploading the second sequence. Various other methods, systems, and computer-readable media are also disclosed.
    Type: Grant
    Filed: August 13, 2018
    Date of Patent: December 29, 2020
    Assignee: Facebook, Inc.
    Inventors: Narsing Krishna Vijayrao, Jason M. Taylor
  • Patent number: 10832730
    Abstract: One variation of a method for serving interactive content to a user includes, at a visual element inserted into a document accessed by a computing device: loading a first frame from a digital video; in response to a scroll-down event that moves the visual element upward from a bottom of a window rendered on the computing device toward a top of the window, seeking from the first frame through a subset of frames in the digital video in a first direction at a rate corresponding to a scroll rate of the scroll-down event, the subset of frames spanning a duration of the digital video corresponding to a length of the scroll-down event; and, in response to termination of the scroll-down event with the visual element remaining in view within the window, playing the digital video forward from a last frame in the subset of frames in the digital video.
    Type: Grant
    Filed: October 31, 2018
    Date of Patent: November 10, 2020
    Assignee: Yielmo, Inc.
    Inventors: Connor Francis Doherty, David Michael Goligorsky, Shawn Sprockett, Eric (Ge) Wu, Yiming Bao, Firecrow Silvernight, David Sebag
  • Patent number: 10832729
    Abstract: One variation of a method for serving interactive content to a user includes, at a visual element inserted into a document accessed by a computing device: loading a first frame from a digital video; in response to a scroll-down event that moves the visual element upward from a bottom of a window rendered on the computing device toward a top of the window, seeking from the first frame through a subset of frames in the digital video in a first direction at a rate corresponding to a scroll rate of the scroll-down event, the subset of frames spanning a duration of the digital video corresponding to a length of the scroll-down event; and, in response to termination of the scroll-down event with the visual element remaining in view within the window, playing the digital video forward from a last frame in the subset of frames in the digital video.
    Type: Grant
    Filed: March 27, 2018
    Date of Patent: November 10, 2020
    Assignee: Yieldmo, Inc.
    Inventors: Connor Francis Doherty, David Michael Goligorsky, Shawn Sprockett, Eric (Ge) Wu, Yiming Bao, Firecrow Silvernight, David Sebag
  • Patent number: 10831516
    Abstract: In implementations of proficiency based tutorial modification, a computing device implements a tutorial system to receive a user modification of a digital image. A difference between the user modification and an application modification of the digital image is determined. The tutorial system generates a proficiency score for an editing tool based on the difference between the user modification and the application modification, and the proficiency score indicates the user's proficiency in using the editing tool. The tutorial system generates a pre-modified input image for a tutorial depicting a modification applied to an input image to be modified in the tutorial using the editing tool based on the proficiency score for the editing tool being greater than a proficiency threshold.
    Type: Grant
    Filed: March 9, 2020
    Date of Patent: November 10, 2020
    Assignee: Adobe Inc.
    Inventors: Subham Gupta, Somya Jain
  • Patent number: 10812948
    Abstract: A wireless communication device includes a processor, a display device coupled to the processor, and a memory accessible to the processor. The memory includes instructions executable by the processor to perform operations. The operations include receiving a user input to play a media content item. The operations include sending a request for a summary of the media content item to a network device in response to the user input in lieu of sending a particular request for the media content item. The operations also include, in response to the reply including media content, sending the media content to the display device for display.
    Type: Grant
    Filed: December 4, 2018
    Date of Patent: October 20, 2020
    Assignee: AT&T INTELLECTUAL PROPERTY I, L.P.
    Inventor: Raghuraman Gopalan
  • Patent number: 10803836
    Abstract: A switch device includes a first connection interface, a second connection interface, an video output interface, a control module and a processing module. The first connection interface receives a first video and the second connection interface receives a second video. The video output interface outputs an integrated video. The control module receives a control signals including a position data. The processing module generates the integrated video based on the first video and the second video. The integrated video includes a first sub-image having a first depth and a second sub-image having a second depth respectively corresponding to the first video and the second video. When the position data falls within an overlapping area of the first sub-image and the second sub-image, the processing module outputs the control signal to one of the first connection interface and the second connection interface based on the first depth and the second depth.
    Type: Grant
    Filed: September 27, 2019
    Date of Patent: October 13, 2020
    Assignee: ATEN International Co., Ltd.
    Inventor: Chun-Chi Liao