Patents by Inventor Nathan Frey

Nathan Frey has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20260148754
    Abstract: An automated video editing system facilitates the creation of non-linear editing (NLE) timelines using a single prompt from a user. The system automatically ingests digital media, including video, audio, text, and images, and processes them to generate a proxy version with extracted features such as speech transcription, shot detection, facial recognition, and text recognition. A prompt-driven editing engine interprets user input and generates an edit decision list (EDL) using a large language model, which guides the assembly of an edited video timeline. The system also applies advanced editing features-such as captioning, animated title cards, font and color styling, sound effects, and transitions-based on learned user preferences. Additionally, it enables contextual overlays, chapter cards, and hierarchical timelines, while continuously learning user preferences to personalize editing results.
    Type: Application
    Filed: November 20, 2025
    Publication date: May 28, 2026
    Inventors: Nathan Frey, Christopher Stauffer, Shivam Kotak
  • Patent number: 12567225
    Abstract: Described herein are systems and methods of converting media dimensions. A device may identify a set of frames from a video in a first orientation as belonging to a scene. The device may receive a selected coordinate on a frame of the set of frames for the scene. The device may identify a first region within the frame including a first feature corresponding to the selected coordinate and a second region within the frame including a second feature. The device may generate a first score for the first feature and a second score for the second feature. The first score may be greater than the second score based on the first feature corresponding to the selected coordinate. The device may crop the frame to include the first region and the second region within a predetermined display area comprising a subset of regions of the frame in a second orientation.
    Type: Grant
    Filed: April 4, 2024
    Date of Patent: March 3, 2026
    Assignee: GOOGLE LLC
    Inventors: Brian Mulford, Nathan Frey, Alexandros Panagopoulos, Yinquan Hao, Yuan Zhang
  • Patent number: 12437782
    Abstract: The present disclosure provides systems, methods, and computer program products for performing automated non-linear editing style transfer. A computer-implemented method may include determining one or more shot boundaries in a video, analyzing identified content in each of one or more shots in the video based on performing object detection, determining an editing style for each of the one or more shots in the video based at least in part on measuring motion across frames within the respective shots, determining a content segment to adjust from a set of target content based on analyzing the set of target content in view of the identified content and the determined editing style of a shot from the video, and automatically adjusting the content segment from the set of target content based at least in part on modifying the content segment with the determined editing style of the shot from the video.
    Type: Grant
    Filed: November 13, 2020
    Date of Patent: October 7, 2025
    Assignee: GOOGLE LLC
    Inventors: Nathan Frey, Weilong Yang
  • Publication number: 20250191613
    Abstract: The present disclosure provides systems, methods, and computer program products for performing automated non-linear editing style transfer. A computer-implemented method may include determining one or more shot boundaries in a video, analyzing identified content in each of one or more shots in the video based on performing object detection, determining an editing style for each of the one or more shots in the video based at least in part on measuring motion across frames within the respective shots, determining a content segment to adjust from a set of target content based on analyzing the set of target content in view of the identified content and the determined editing style of a shot from the video, and automatically adjusting the content segment from the set of target content based at least in part on modifying the content segment with the determined editing style of the shot from the video.
    Type: Application
    Filed: February 14, 2025
    Publication date: June 12, 2025
    Inventors: Nathan Frey, Weilong Yang
  • Publication number: 20250166337
    Abstract: Described herein are systems and methods of converting media dimensions. A device may identify a set of frames from a video in a first orientation as belonging to a scene. The device may receive a selected coordinate on a frame of the set of frames for the scene. The device may identify a first region within the frame including a first feature corresponding to the selected coordinate and a second region within the frame including a second feature. The device may generate a first score for the first feature and a second score for the second feature. The first score may be greater than the second score based on the first feature corresponding to the selected coordinate. The device may crop the frame to include the first region and the second region within a predetermined display area comprising a subset of regions of the frame in a second orientation.
    Type: Application
    Filed: January 17, 2025
    Publication date: May 22, 2025
    Inventors: Brian Mulford, Nathan Frey, Alexandros Panagopoulos, Yinquan Hao, Yuan Zhang
  • Publication number: 20240249497
    Abstract: Described herein are systems and methods of converting media dimensions. A device may identify a set of frames from a video in a first orientation as belonging to a scene. The device may receive a selected coordinate on a frame of the set of frames for the scene. The device may identify a first region within the frame including a first feature corresponding to the selected coordinate and a second region within the frame including a second feature. The device may generate a first score for the first feature and a second score for the second feature. The first score may be greater than the second score based on the first feature corresponding to the selected coordinate. The device may crop the frame to include the first region and the second region within a predetermined display area comprising a subset of regions of the frame in a second orientation.
    Type: Application
    Filed: April 4, 2024
    Publication date: July 25, 2024
    Inventors: Brian Mulford, Nathan Frey, Alexandros Panagopoulos, Yinquan Hao, Yuan Zhang
  • Patent number: 11978238
    Abstract: Described herein are systems and methods of converting media dimensions. A device may identify a set of frames from a video in a first orientation as belonging to a scene. The device may receive a selected coordinate on a frame of the set of frames for the scene. The device may identify a first region within the frame including a first feature corresponding to the selected coordinate and a second region within the frame including a second feature. The device may generate a first score for the first feature and a second score for the second feature. The first score may be greater than the second score based on the first feature corresponding to the selected coordinate. The device may crop the frame to include the first region and the second region within a predetermined display area comprising a subset of regions of the frame in a second orientation.
    Type: Grant
    Filed: March 13, 2023
    Date of Patent: May 7, 2024
    Assignee: GOOGLE LLC
    Inventors: Brian Mulford, Nathan Frey, Alexandros Panagopoulos, Yinquan Hao, Yuan Zhang
  • Publication number: 20230419997
    Abstract: The present disclosure provides systems, methods, and computer program products for performing automated non-linear editing style transfer. A computer-implemented method may include determining one or more shot boundaries in a video, analyzing identified content in each of one or more shots in the video based on performing object detection, determining an editing style for each of the one or more shots in the video based at least in part on measuring motion across frames within the respective shots, determining a content segment to adjust from a set of target content based on analyzing the set of target content in view of the identified content and the determined editing style of a shot from the video, and automatically adjusting the content segment from the set of target content based at least in part on modifying the content segment with the determined editing style of the shot from the video.
    Type: Application
    Filed: November 13, 2020
    Publication date: December 28, 2023
    Inventors: Nathan Frey, Weilong Yang
  • Publication number: 20230237760
    Abstract: Described herein are systems and methods of converting media dimensions. A device may identify a set of frames from a video in a first orientation as belonging to a scene. The device may receive a selected coordinate on a frame of the set of frames for the scene. The device may identify a first region within the frame including a first feature corresponding to the selected coordinate and a second region within the frame including a second feature. The device may generate a first score for the first feature and a second score for the second feature. The first score may be greater than the second score based on the first feature corresponding to the selected coordinate. The device may crop the frame to include the first region and the second region within a predetermined display area comprising a subset of regions of the frame in a second orientation.
    Type: Application
    Filed: March 13, 2023
    Publication date: July 27, 2023
    Inventors: Brian Mulford, Nathan Frey, Alexandros Panagopoulos, Yinquan Hao, Yuan Zhang
  • Patent number: 11605150
    Abstract: Described herein are systems and methods of converting media dimensions. A device may identify a set of frames from a video in a first orientation as belonging to a scene. The device may receive a selected coordinate on a frame of the set of frames for the scene. The device may identify a first region within the frame including a first feature corresponding to the selected coordinate and a second region within the frame including a second feature. The device may generate a first score for the first feature and a second score for the second feature. The first score may be greater than the second score based on the first feature corresponding to the selected coordinate. The device may crop the frame to include the first region and the second region within a predetermined display area comprising a subset of regions of the frame in a second orientation.
    Type: Grant
    Filed: February 28, 2022
    Date of Patent: March 14, 2023
    Assignee: GOOGLE LLC
    Inventors: Brian Mulford, Nathan Frey, Alexandros Panagopoulos, Yinquan Hao, Yuan Zhang
  • Publication number: 20220245756
    Abstract: Described herein are systems and methods of converting media dimensions. A device may identify a set of frames from a video in a first orientation as belonging to a scene. The device may receive a selected coordinate on a frame of the set of frames for the scene. The device may identify a first region within the frame including a first feature corresponding to the selected coordinate and a second region within the frame including a second feature. The device may generate a first score for the first feature and a second score for the second feature. The first score may be greater than the second score based on the first feature corresponding to the selected coordinate. The device may crop the frame to include the first region and the second region within a predetermined display area comprising a subset of regions of the frame in a second orientation.
    Type: Application
    Filed: February 28, 2022
    Publication date: August 4, 2022
    Inventors: Brian Mulford, Nathan Frey, Alexandros Panagopoulos, Yinquan Hao, Yuan Zhang
  • Patent number: 11282163
    Abstract: Described herein are systems and methods of converting media dimensions. A device may identify a set of frames from a video in a first orientation as belonging to a scene. The device may receive a selected coordinate on a frame of the set of frames for the scene. The device may identify a first region within the frame including a first feature corresponding to the selected coordinate and a second region within the frame including a second feature. The device may generate a first score for the first feature and a second score for the second feature. The first score may be greater than the second score based on the first feature corresponding to the selected coordinate. The device may crop the frame to include the first region and the second region within a predetermined display area comprising a subset of regions of the frame in a second orientation.
    Type: Grant
    Filed: May 24, 2018
    Date of Patent: March 22, 2022
    Assignee: GOOGLE LLC
    Inventors: Brian Mulford, Nathan Frey, Alexandros Panagopoulos, Yinquan Hao, Yuan Zhang
  • Publication number: 20210012502
    Abstract: Described herein are systems and methods of converting media dimensions. A device may identify a set of frames from a video in a first orientation as belonging to a scene. The device may receive a selected coordinate on a frame of the set of frames for the scene. The device may identify a first region within the frame including a first feature corresponding to the selected coordinate and a second region within the frame including a second feature. The device may generate a first score for the first feature and a second score for the second feature. The first score may be greater than the second score based on the first feature corresponding to the selected coordinate. The device may crop the frame to include the first region and the second region within a predetermined display area comprising a subset of regions of the frame in a second orientation.
    Type: Application
    Filed: May 24, 2018
    Publication date: January 14, 2021
    Applicant: Google LLC
    Inventors: Brian Mulford, Nathan Frey, Alexandros Panagopoulos, Yinquan Hao, Yuan Zhang
  • Publication number: 20200020071
    Abstract: Systems and methods for cropping media for a particular orientation using a computing device are described. A method may first comprise receiving by a video preprocessor of the device, a first frame of media in a first orientation. A first region comprising a first feature within the first frame may be identified, by an image analyzer. A cropping calculator of the device may generate a score for the first region based on a characteristic of the first feature and determine that the score for the first region exceeds a threshold. An image processor of the device may then crop the first frame of the video, responsive to the determination that the score for the first region exceeds the threshold, to include the first region within a predetermined display area comprising a subset of the first frame in a second orientation.
    Type: Application
    Filed: December 4, 2017
    Publication date: January 16, 2020
    Applicant: GOOGLE LLC
    Inventors: Nathan Frey, Alexandros Panagopoulos