Patents by Inventor Nathan Frey
Nathan Frey has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20260148754Abstract: An automated video editing system facilitates the creation of non-linear editing (NLE) timelines using a single prompt from a user. The system automatically ingests digital media, including video, audio, text, and images, and processes them to generate a proxy version with extracted features such as speech transcription, shot detection, facial recognition, and text recognition. A prompt-driven editing engine interprets user input and generates an edit decision list (EDL) using a large language model, which guides the assembly of an edited video timeline. The system also applies advanced editing features-such as captioning, animated title cards, font and color styling, sound effects, and transitions-based on learned user preferences. Additionally, it enables contextual overlays, chapter cards, and hierarchical timelines, while continuously learning user preferences to personalize editing results.Type: ApplicationFiled: November 20, 2025Publication date: May 28, 2026Inventors: Nathan Frey, Christopher Stauffer, Shivam Kotak
-
Patent number: 12567225Abstract: Described herein are systems and methods of converting media dimensions. A device may identify a set of frames from a video in a first orientation as belonging to a scene. The device may receive a selected coordinate on a frame of the set of frames for the scene. The device may identify a first region within the frame including a first feature corresponding to the selected coordinate and a second region within the frame including a second feature. The device may generate a first score for the first feature and a second score for the second feature. The first score may be greater than the second score based on the first feature corresponding to the selected coordinate. The device may crop the frame to include the first region and the second region within a predetermined display area comprising a subset of regions of the frame in a second orientation.Type: GrantFiled: April 4, 2024Date of Patent: March 3, 2026Assignee: GOOGLE LLCInventors: Brian Mulford, Nathan Frey, Alexandros Panagopoulos, Yinquan Hao, Yuan Zhang
-
Patent number: 12437782Abstract: The present disclosure provides systems, methods, and computer program products for performing automated non-linear editing style transfer. A computer-implemented method may include determining one or more shot boundaries in a video, analyzing identified content in each of one or more shots in the video based on performing object detection, determining an editing style for each of the one or more shots in the video based at least in part on measuring motion across frames within the respective shots, determining a content segment to adjust from a set of target content based on analyzing the set of target content in view of the identified content and the determined editing style of a shot from the video, and automatically adjusting the content segment from the set of target content based at least in part on modifying the content segment with the determined editing style of the shot from the video.Type: GrantFiled: November 13, 2020Date of Patent: October 7, 2025Assignee: GOOGLE LLCInventors: Nathan Frey, Weilong Yang
-
Publication number: 20250191613Abstract: The present disclosure provides systems, methods, and computer program products for performing automated non-linear editing style transfer. A computer-implemented method may include determining one or more shot boundaries in a video, analyzing identified content in each of one or more shots in the video based on performing object detection, determining an editing style for each of the one or more shots in the video based at least in part on measuring motion across frames within the respective shots, determining a content segment to adjust from a set of target content based on analyzing the set of target content in view of the identified content and the determined editing style of a shot from the video, and automatically adjusting the content segment from the set of target content based at least in part on modifying the content segment with the determined editing style of the shot from the video.Type: ApplicationFiled: February 14, 2025Publication date: June 12, 2025Inventors: Nathan Frey, Weilong Yang
-
Publication number: 20250166337Abstract: Described herein are systems and methods of converting media dimensions. A device may identify a set of frames from a video in a first orientation as belonging to a scene. The device may receive a selected coordinate on a frame of the set of frames for the scene. The device may identify a first region within the frame including a first feature corresponding to the selected coordinate and a second region within the frame including a second feature. The device may generate a first score for the first feature and a second score for the second feature. The first score may be greater than the second score based on the first feature corresponding to the selected coordinate. The device may crop the frame to include the first region and the second region within a predetermined display area comprising a subset of regions of the frame in a second orientation.Type: ApplicationFiled: January 17, 2025Publication date: May 22, 2025Inventors: Brian Mulford, Nathan Frey, Alexandros Panagopoulos, Yinquan Hao, Yuan Zhang
-
Publication number: 20240249497Abstract: Described herein are systems and methods of converting media dimensions. A device may identify a set of frames from a video in a first orientation as belonging to a scene. The device may receive a selected coordinate on a frame of the set of frames for the scene. The device may identify a first region within the frame including a first feature corresponding to the selected coordinate and a second region within the frame including a second feature. The device may generate a first score for the first feature and a second score for the second feature. The first score may be greater than the second score based on the first feature corresponding to the selected coordinate. The device may crop the frame to include the first region and the second region within a predetermined display area comprising a subset of regions of the frame in a second orientation.Type: ApplicationFiled: April 4, 2024Publication date: July 25, 2024Inventors: Brian Mulford, Nathan Frey, Alexandros Panagopoulos, Yinquan Hao, Yuan Zhang
-
Patent number: 11978238Abstract: Described herein are systems and methods of converting media dimensions. A device may identify a set of frames from a video in a first orientation as belonging to a scene. The device may receive a selected coordinate on a frame of the set of frames for the scene. The device may identify a first region within the frame including a first feature corresponding to the selected coordinate and a second region within the frame including a second feature. The device may generate a first score for the first feature and a second score for the second feature. The first score may be greater than the second score based on the first feature corresponding to the selected coordinate. The device may crop the frame to include the first region and the second region within a predetermined display area comprising a subset of regions of the frame in a second orientation.Type: GrantFiled: March 13, 2023Date of Patent: May 7, 2024Assignee: GOOGLE LLCInventors: Brian Mulford, Nathan Frey, Alexandros Panagopoulos, Yinquan Hao, Yuan Zhang
-
Publication number: 20230419997Abstract: The present disclosure provides systems, methods, and computer program products for performing automated non-linear editing style transfer. A computer-implemented method may include determining one or more shot boundaries in a video, analyzing identified content in each of one or more shots in the video based on performing object detection, determining an editing style for each of the one or more shots in the video based at least in part on measuring motion across frames within the respective shots, determining a content segment to adjust from a set of target content based on analyzing the set of target content in view of the identified content and the determined editing style of a shot from the video, and automatically adjusting the content segment from the set of target content based at least in part on modifying the content segment with the determined editing style of the shot from the video.Type: ApplicationFiled: November 13, 2020Publication date: December 28, 2023Inventors: Nathan Frey, Weilong Yang
-
Publication number: 20230237760Abstract: Described herein are systems and methods of converting media dimensions. A device may identify a set of frames from a video in a first orientation as belonging to a scene. The device may receive a selected coordinate on a frame of the set of frames for the scene. The device may identify a first region within the frame including a first feature corresponding to the selected coordinate and a second region within the frame including a second feature. The device may generate a first score for the first feature and a second score for the second feature. The first score may be greater than the second score based on the first feature corresponding to the selected coordinate. The device may crop the frame to include the first region and the second region within a predetermined display area comprising a subset of regions of the frame in a second orientation.Type: ApplicationFiled: March 13, 2023Publication date: July 27, 2023Inventors: Brian Mulford, Nathan Frey, Alexandros Panagopoulos, Yinquan Hao, Yuan Zhang
-
Patent number: 11605150Abstract: Described herein are systems and methods of converting media dimensions. A device may identify a set of frames from a video in a first orientation as belonging to a scene. The device may receive a selected coordinate on a frame of the set of frames for the scene. The device may identify a first region within the frame including a first feature corresponding to the selected coordinate and a second region within the frame including a second feature. The device may generate a first score for the first feature and a second score for the second feature. The first score may be greater than the second score based on the first feature corresponding to the selected coordinate. The device may crop the frame to include the first region and the second region within a predetermined display area comprising a subset of regions of the frame in a second orientation.Type: GrantFiled: February 28, 2022Date of Patent: March 14, 2023Assignee: GOOGLE LLCInventors: Brian Mulford, Nathan Frey, Alexandros Panagopoulos, Yinquan Hao, Yuan Zhang
-
Publication number: 20220245756Abstract: Described herein are systems and methods of converting media dimensions. A device may identify a set of frames from a video in a first orientation as belonging to a scene. The device may receive a selected coordinate on a frame of the set of frames for the scene. The device may identify a first region within the frame including a first feature corresponding to the selected coordinate and a second region within the frame including a second feature. The device may generate a first score for the first feature and a second score for the second feature. The first score may be greater than the second score based on the first feature corresponding to the selected coordinate. The device may crop the frame to include the first region and the second region within a predetermined display area comprising a subset of regions of the frame in a second orientation.Type: ApplicationFiled: February 28, 2022Publication date: August 4, 2022Inventors: Brian Mulford, Nathan Frey, Alexandros Panagopoulos, Yinquan Hao, Yuan Zhang
-
Patent number: 11282163Abstract: Described herein are systems and methods of converting media dimensions. A device may identify a set of frames from a video in a first orientation as belonging to a scene. The device may receive a selected coordinate on a frame of the set of frames for the scene. The device may identify a first region within the frame including a first feature corresponding to the selected coordinate and a second region within the frame including a second feature. The device may generate a first score for the first feature and a second score for the second feature. The first score may be greater than the second score based on the first feature corresponding to the selected coordinate. The device may crop the frame to include the first region and the second region within a predetermined display area comprising a subset of regions of the frame in a second orientation.Type: GrantFiled: May 24, 2018Date of Patent: March 22, 2022Assignee: GOOGLE LLCInventors: Brian Mulford, Nathan Frey, Alexandros Panagopoulos, Yinquan Hao, Yuan Zhang
-
Publication number: 20210012502Abstract: Described herein are systems and methods of converting media dimensions. A device may identify a set of frames from a video in a first orientation as belonging to a scene. The device may receive a selected coordinate on a frame of the set of frames for the scene. The device may identify a first region within the frame including a first feature corresponding to the selected coordinate and a second region within the frame including a second feature. The device may generate a first score for the first feature and a second score for the second feature. The first score may be greater than the second score based on the first feature corresponding to the selected coordinate. The device may crop the frame to include the first region and the second region within a predetermined display area comprising a subset of regions of the frame in a second orientation.Type: ApplicationFiled: May 24, 2018Publication date: January 14, 2021Applicant: Google LLCInventors: Brian Mulford, Nathan Frey, Alexandros Panagopoulos, Yinquan Hao, Yuan Zhang
-
Publication number: 20200020071Abstract: Systems and methods for cropping media for a particular orientation using a computing device are described. A method may first comprise receiving by a video preprocessor of the device, a first frame of media in a first orientation. A first region comprising a first feature within the first frame may be identified, by an image analyzer. A cropping calculator of the device may generate a score for the first region based on a characteristic of the first feature and determine that the score for the first region exceeds a threshold. An image processor of the device may then crop the first frame of the video, responsive to the determination that the score for the first region exceeds the threshold, to include the first region within a predetermined display area comprising a subset of the first frame in a second orientation.Type: ApplicationFiled: December 4, 2017Publication date: January 16, 2020Applicant: GOOGLE LLCInventors: Nathan Frey, Alexandros Panagopoulos