Patents by Inventor Kristen Marie Holtz
Kristen Marie Holtz has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 12210355Abstract: An unmanned aerial vehicle (UAV) comprises a flight control system and an electromechanical system directed by the flight control system. The flight control system is configured to track a position of a beacon that is in motion and monitor a difference between an actual position of the unmanned aerial vehicle and a desired position of the unmanned aerial vehicle relative to the position of the beacon. The flight control system configures one or more flight objectives based on one or more factors comprising whether the difference between the actual position and the desired position exceeds a threshold, wherein the flight objectives comprise a velocity objective and a position objective. The flight control system also commands the electromechanical system based at least on the one or more flight objectives.Type: GrantFiled: May 18, 2022Date of Patent: January 28, 2025Assignee: Skydio, Inc.Inventors: James Anthony Ferrandini, Jeremy Christopher Crowley, Kristen Marie Holtz
-
Patent number: 12169404Abstract: Technology for operating an unmanned aerial vehicle (UAV) is disclosed herein that allows a drone to be flown along a computed spline, while also accommodating in-flight modifications. In various implementations, a UAV includes a flight control subsystem and an electromechanical subsystem. The flight control subsystem records keyframes during flight and computes a spline based on the keyframes. The flight control subsystem then saves the computed spline for playback, at which time the UAV automatically flies in accordance with the computed spline.Type: GrantFiled: March 8, 2022Date of Patent: December 17, 2024Assignee: Skydio, Inc.Inventors: Saumya Pravinbhai Shah, Matthew Thomas Beaudouin-Lafon, Kristen Marie Holtz, James Anthony Ferrandini, Hayk Martirosyan, Matthew Joseph Donahoe, Charles Vanschoonhoven Wood, Clara Kelley, Adam Parker Bry, Jack Louis Zhu
-
Publication number: 20240288862Abstract: Techniques are described for developing and using applications and skills with autonomous vehicles. In some embodiments, a development platform is provided that enables access to a developer console for developing software modules for use with autonomous vehicles. For example, a developer can specify instructions for causing an autonomous vehicle to perform one or more operations. To control the behavior of an autonomous vehicle, the instructions can cause an executing computer system at the autonomous vehicle to generate calls to an application programming interface (API) associated with an autonomous navigation system of autonomous vehicle. Such calls to the API can be configured to adjust parameters of a behavioral objective associated with a trajectory generation process performed by the autonomous navigation system that controls the behavior of the autonomous vehicle. The instructions specified by the developer can be packaged as a software module that can be deployed for use at autonomous vehicle.Type: ApplicationFiled: November 27, 2023Publication date: August 29, 2024Applicant: Skydio, Inc.Inventors: Roshan Neel Jobanputra, Jeffrey Robert DeCew, Matthew Joseph Donahoe, Mark Edward Rubin, Adam Parker Bry, Abraham Galton Bachrach, Jack Louis Zhu, Kristen Marie Holtz
-
Publication number: 20240255943Abstract: Technology for generating and displaying a graphical user interface for operating an unmanned aerial vehicle (UAV) is disclosed herein that generates and updates a representation of a spline flight path. In various implementations, a graphical user interface detects user interactions with a remote control device directing the flight control subsystem of the UAV to record keyframes and to compute a spline based on the keyframes during flight. The graphical user interface displays a real-time perspective of the UAV with a representation of the spline and the keyframes overlaying the view. The graphical user interface continually updates the representation as the UAV flies and when the spline is updated as the keyframes are updated.Type: ApplicationFiled: February 15, 2024Publication date: August 1, 2024Applicant: Skydio, Inc.Inventors: Matthew Thomas Beaudouin-Lafon, Saumya Pravinbhai Shah, Kristen Marie Holtz, James Anthony Ferrandini, Hayk Martirosyan, Matthew Joseph Donahoe, Charles VanSchoonhoven Wood, Clara Kelley, Adam Parker Bry, Jack Louis Zhu
-
Publication number: 20240176030Abstract: In some examples, an aerial vehicle may determine, based on sensor information received from at least one onboard sensor, that an amount of light fails to satisfy a light threshold. Based at least in part on determining that the amount of light fails to satisfy the light threshold, the aerial vehicle is caused to takeoff at a specified trajectory and a specified acceleration for enabling navigation via an inertial measurement unit (IMU) and a satellite positioning system. Further, the aerial vehicle is directed to navigate an environment based at least on determining a relative heading of the aerial vehicle from information received from the IMU and information received from the satellite positioning system.Type: ApplicationFiled: February 7, 2024Publication date: May 30, 2024Inventors: Anurag MAKINENI, Kristen Marie Holtz, Gareth Benoit Cross, Hayk Martirosyan
-
Publication number: 20240169719Abstract: Autonomous aerial navigation in low-light and no-light conditions includes using night mode obstacle avoidance intelligence, training, and mechanisms for vision-based unmanned aerial vehicle (UAV) navigation to enable autonomous flight operations of a UAV in low-light and no-light environments using infrared data.Type: ApplicationFiled: November 21, 2023Publication date: May 23, 2024Inventors: Samuel Shenghung Wang, Vladimir Nekrasov, Ryan David Kennedy, Gareth Benoit Cross, Peter Benjamin Henry, Kristen Marie Holtz, Hayk Martirosyan, Abraham Galton Bachrach, Adam Parker Bry
-
Publication number: 20240140625Abstract: Described herein are unmanned aerial vehicles (UAVs), systems, and methods for capturing panoramic images using cameras onboard a UAV. For example, an embodiment pertains to a UAV including a flight control system, a propulsion system operatively coupled with the flight control system, and an image system comprising navigational cameras and a gimbal camera. The image system is configured to capture a first set of images of a scene using the navigational cameras, stitch the first set of images together to create a first panoramic image of the scene, identify a flight plan for capturing a second set of images with which to create a second panoramic image of the scene using the gimbal camera, capture the second set of images of the scene using the gimbal camera, and stitch the second set of images together to create the second panoramic image.Type: ApplicationFiled: November 1, 2023Publication date: May 2, 2024Inventors: James Anthony Ferrandini, Noah Brian Greene, Charles VanSchoonhoven Wood, Saumya Pravinbhai Shah, Shreyas Arora, Kristen Marie Holtz
-
Patent number: 11921500Abstract: Technology for generating and displaying a graphical user interface for operating an unmanned aerial vehicle (UAV) is disclosed herein that generates and updates a representation of a spline flight path. In various implementations, a graphical user interface detects user interactions with a remote control device directing the flight control subsystem of the UAV to record keyframes and to compute a spline based on the keyframes during flight. The graphical user interface displays a real-time perspective of the UAV with a representation of the spline and the keyframes overlaying the view. The graphical user interface continually updates the representation as the UAV flies and when the spline is updated as the keyframes are updated.Type: GrantFiled: March 8, 2022Date of Patent: March 5, 2024Assignee: Skydio, Inc.Inventors: Matthew Thomas Beaudouin-Lafon, Saumya Pravinbhai Shah, Kristen Marie Holtz, James Anthony Ferrandini, Hayk Martirosyan, Matthew Joseph Donahoe, Charles VanSchoonhoven Wood, Clara Kelley, Adam Parker Bry, Jack Louis Zhu
-
Publication number: 20240069572Abstract: A technique is introduced for touchdown detection during autonomous landing by an aerial vehicle. In some embodiments, the introduced technique includes processing perception inputs with a dynamics model of the aerial vehicle to estimate the external forces and/or torques acting on the aerial vehicle. The estimated external forces and/or torques are continually monitored while the aerial vehicle is landing to determine when the aerial vehicle is sufficiently supported by a landing surface. In some embodiments, semantic information associated with objects in the environment is utilized to configure parameters associated with the touchdown detection process.Type: ApplicationFiled: July 11, 2023Publication date: February 29, 2024Applicant: Skydio, Inc.Inventors: Rowland Wilde O'Flaherty, Teodor Tomic, Hayk Martirosyan, Abraham Galton Bachrach, Kristen Marie Holtz, Jack Louis Zhu
-
Patent number: 11906639Abstract: In some examples, an unmanned aerial vehicle (UAV) may determine a first acceleration of the UAV based at least on information from an onboard accelerometer received at least one of prior to or during takeoff. The UAV may determine a second acceleration of the UAV based at least on location information received via a satellite positioning system receiver at least one of prior to or during takeoff. The UAV may further determine a relative heading of the UAV based at least in part on the first acceleration and the second acceleration, and may be directed to navigate an environment based at least on the determined relative heading.Type: GrantFiled: February 17, 2023Date of Patent: February 20, 2024Assignee: SKYDIO, INC.Inventors: Anurag Makineni, Kristen Marie Holtz, Gareth Benoit Cross, Hayk Martirosyan
-
Publication number: 20240053771Abstract: Techniques are described for controlling an autonomous vehicle such as an unmanned aerial vehicle (UAV) using objective-based inputs. In an embodiment, the underlying functionality of an autonomous navigation system is exposed via an application programming interface (API) allowing the UAV to be controlled through specifying a behavioral objective, for example, using a call to the API to set parameters for the behavioral objective. The autonomous navigation system can then incorporate perception inputs such as sensor data from sensors mounted to the UAV and the set parameters using a multi-objective motion planning process to generate a proposed trajectory that most closely satisfies the behavioral objective in view of certain constraints. In some embodiments, developers can utilize the API to build customized applications for the UAV. Such applications, also referred to as “skills,” can be developed, shared, and executed to control behavior of an autonomous UAV and aid in overall system improvement.Type: ApplicationFiled: July 21, 2023Publication date: February 15, 2024Applicant: Skydio, Inc.Inventors: Jack Louis Zhu, Hayk Martirosyan, Abraham Bachrach, Matthew Donahoe, Patrick Lowe, Kristen Marie Holtz, Adam Bry
-
Patent number: 11861896Abstract: Autonomous aerial navigation in low-light and no-light conditions includes using night mode obstacle avoidance intelligence, training, and mechanisms for vision-based unmanned aerial vehicle (UAV) navigation to enable autonomous flight operations of a UAV in low-light and no-light environments using infrared data.Type: GrantFiled: March 29, 2022Date of Patent: January 2, 2024Assignee: Skydio, Inc.Inventors: Samuel Shenghung Wang, Vladimir Nekrasov, Ryan David Kennedy, Gareth Benoit Cross, Peter Benjamin Henry, Kristen Marie Holtz, Hayk Martirosyan, Abraham Galton Bachrach, Adam Parker Bry
-
Patent number: 11829139Abstract: A technique is described for developing and using applications and skills with an autonomous vehicle. In an example embodiment, a development platform is provided that enables access to a developer console for developing software modules for use with an autonomous vehicle. Using the developer console, a developer user can specify instructions for causing an autonomous vehicle to perform one or more operations. For example, to control the behavior of an autonomous vehicle, the instructions can cause an executing computer system at the autonomous vehicle to generate calls to an application programming interface (API) associated with an autonomous navigation system of autonomous vehicle. Such calls to the API can be configured to adjust a parameter of a behavioral objective associated with a trajectory generation process performed by the autonomous navigation system that controls the behavior of the autonomous vehicle.Type: GrantFiled: April 18, 2022Date of Patent: November 28, 2023Assignee: Skydio, Inc.Inventors: Roshan Neel Jobanputra, Jeffrey Robert DeCew, Matthew Joseph Donahoe, Mark Edward Rubin, Adam Parker Bry, Abraham Galton Bachrach, Jack Louis Zhu, Kristen Marie Holtz
-
Publication number: 20230296793Abstract: A calibration of an unmanned aerial vehicle is performed without the use of a magnetometer. The unmanned aerial vehicle generates a first acceleration vector in a navigation frame of reference and a second acceleration vector in a GPS frame of reference. The unmanned aerial vehicle estimates a heading of the unmanned aerial vehicle based on the first acceleration vector and the second acceleration vector. The unmanned aerial vehicle performs a calibration based on the estimated heading of the unmanned aerial vehicle.Type: ApplicationFiled: July 28, 2022Publication date: September 21, 2023Inventors: Anh Tung Dang, Peter Benjamin Henry, Hayk Martirosyan, Kristen Marie Holtz, Dominic William Pattison
-
Patent number: 11755041Abstract: Techniques are described for controlling an autonomous vehicle such as an unmanned aerial vehicle (UAV) using objective-based inputs. In an embodiment, the underlying functionality of an autonomous navigation system is exposed via an application programming interface (API) allowing the UAV to be controlled through specifying a behavioral objective, for example, using a call to the API to set parameters for the behavioral objective. The autonomous navigation system can then incorporate perception inputs such as sensor data from sensors mounted to the UAV and the set parameters using a multi-objective motion planning process to generate a proposed trajectory that most closely satisfies the behavioral objective in view of certain constraints. In some embodiments, developers can utilize the API to build customized applications for the UAV. Such applications, also referred to as “skills,” can be developed, shared, and executed to control behavior of an autonomous UAV and aid in overall system improvement.Type: GrantFiled: June 28, 2021Date of Patent: September 12, 2023Assignee: Skydio, Inc.Inventors: Jack Louis Zhu, Hayk Martirosyan, Abraham Bachrach, Matthew Donahoe, Patrick Lowe, Kristen Marie Holtz, Adam Bry
-
Publication number: 20230280765Abstract: A computer accesses an input element storage and an output element storage. The computer accesses a symbolic expression for output element storage as a function of the input element storage. The computer computes, using a symbolic computation engine of the computer, a symbolic expression for the tangent space Jacobian of the output element storage with respect to an input tangent space. The computer outputs the computed expression.Type: ApplicationFiled: January 27, 2023Publication date: September 7, 2023Inventors: Hayk Martirosyan, Aaron Christopher Miller, Nathan Leo Bucki, Bradley Matthew Solliday, Ryan David Kennedy, Jack Louis Zhu, Teodor Tomic, Yixiao Sun, Josiah Timothy VanderMey, Gareth Benoit Cross, Peter Benjamin Henry, Dominic William Pattison, Samuel Shenghung Wang, Kristen Marie Holtz, Harrison Zheng
-
Publication number: 20230259145Abstract: An unmanned aerial vehicle (UAV) comprises a flight control system and an electromechanical system directed by the flight control system. The flight control system is configured to track a position of a beacon that is in motion and monitor a difference between an actual position of the unmanned aerial vehicle and a desired position of the unmanned aerial vehicle relative to the position of the beacon. The flight control system configures one or more flight objectives based on one or more factors comprising whether the difference between the actual position and the desired position exceeds a threshold, wherein the flight objectives comprise a velocity objective and a position objective. The flight control system also commands the electromechanical system based at least on the one or more flight objectives.Type: ApplicationFiled: May 18, 2022Publication date: August 17, 2023Applicant: Skydio, Inc.Inventors: James Anthony Ferrandini, Jeremy Christopher Crowley, Kristen Marie Holtz
-
Patent number: 11726498Abstract: A technique is introduced for touchdown detection during autonomous landing by an aerial vehicle. In some embodiments, the introduced technique includes processing perception inputs with a dynamics model of the aerial vehicle to estimate the external forces and/or torques acting on the aerial vehicle. The estimated external forces and/or torques are continually monitored while the aerial vehicle is landing to determine when the aerial vehicle is sufficiently supported by a landing surface. In some embodiments, semantic information associated with objects in the environment is utilized to configure parameters associated with the touchdown detection process.Type: GrantFiled: May 3, 2021Date of Patent: August 15, 2023Assignee: Skydio, Inc.Inventors: Rowland Wilde O'Flaherty, Teodor Tomic, Hayk Martirosyan, Abraham Galton Bachrach, Kristen Marie Holtz, Jack Louis Zhu
-
Publication number: 20230244750Abstract: A computer accesses a first symbolic expression for an output value as a function of an input value. The computer computes a first symbolic Jacobian of the input value with respect to an input tangent space from a symbolic Lie group definition. The computer computes a second symbolic Jacobian of the output value with respect to the input value. The computer computes a third symbolic Jacobian of an output tangent space with respect to the input value from the symbolic Lie group definition. The computer applies symbolic matrix multiplication to the first symbolic Jacobian, the second symbolic Jacobian, and the third symbolic Jacobian to obtain a second symbolic expression for the output tangent space with respect to the input tangent space. The computer provides a representation of the second symbolic expression.Type: ApplicationFiled: January 27, 2023Publication date: August 3, 2023Inventors: Hayk Martirosyan, Aaron Christopher Miller, Nathan Leo Bucki, Bradley Matthew Solliday, Ryan David Kennedy, Jack Louis Zhu, Teodor Tomic, Yixiao Sun, Josiah Timothy VanderMey, Gareth Benoit Cross, Peter Benjamin Henry, Dominic William Pattison, Samuel Shenghung Wang, Kristen Marie Holtz, Harrison Zheng
-
Publication number: 20230244231Abstract: A computer accesses a first symbolic expression for an output matrix as a function of an input matrix at a computing device comprising processing circuitry and memory. The computer computes a first Jacobian of the input matrix with respect to an input tangent space. The computer computes a second Jacobian of the output matrix with respect to the input matrix. The computer computes a third Jacobian of an output tangent space with respect to the input matrix. The computer applies symbolic matrix multiplication to the first Jacobian, the second Jacobian, and the third Jacobian to obtain a second symbolic expression for the output tangent space with respect to the input tangent space. The computer provides a representation of the second symbolic expression, the second symbolic expression representing a computed tangent-space Jacobian.Type: ApplicationFiled: January 27, 2023Publication date: August 3, 2023Inventors: Hayk Martirosyan, Aaron Christopher Miller, Nathan Leo Bucki, Bradley Matthew Solliday, Ryan David Kennedy, Jack Louis Zhu, Teodor Tomic, Yixiao Sun, Josiah Timothy VanderMey, Gareth Benoit Cross, Peter Benjamin Henry, Dominic William Pattison, Samuel Shenghung Wang, Kristen Marie Holtz, Harrison Zheng