Patents by Inventor Jack Louis Zhu

Jack Louis Zhu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 12271190
    Abstract: Technology for generating and displaying a graphical user interface for operating an unmanned aerial vehicle (UAV) is disclosed herein that generates and updates a representation of a spline flight path. In various implementations, a graphical user interface detects user interactions with a remote control device directing the flight control subsystem of the UAV to record keyframes and to compute a spline based on the keyframes during flight. The graphical user interface displays a real-time perspective of the UAV with a representation of the spline and the keyframes overlaying the view. The graphical user interface continually updates the representation as the UAV flies and when the spline is updated as the keyframes are updated.
    Type: Grant
    Filed: February 15, 2024
    Date of Patent: April 8, 2025
    Assignee: Skydio, Inc.
    Inventors: Matthew Thomas Beaudouin-Lafon, Saumya Pravinbhai Shah, Kristen Marie Holtz, James Anthony Ferrandini, Hayk Martirosyan, Matthew Joseph Donahoe, Charles VanSchoonhoven Wood, Clara Kelley, Adam Parker Bry, Jack Louis Zhu
  • Patent number: 12271208
    Abstract: A technique is introduced for touchdown detection during autonomous landing by an aerial vehicle. In some embodiments, the introduced technique includes processing perception inputs with a dynamics model of the aerial vehicle to estimate the external forces and/or torques acting on the aerial vehicle. The estimated external forces and/or torques are continually monitored while the aerial vehicle is landing to determine when the aerial vehicle is sufficiently supported by a landing surface. In some embodiments, semantic information associated with objects in the environment is utilized to configure parameters associated with the touchdown detection process.
    Type: Grant
    Filed: July 11, 2023
    Date of Patent: April 8, 2025
    Assignee: Skydio, Inc.
    Inventors: Rowland Wilde O'Flaherty, Teodor Tomic, Hayk Martirosyan, Abraham Galton Bachrach, Kristen Marie Holtz, Jack Louis Zhu
  • Publication number: 20250093868
    Abstract: Technology for operating an unmanned aerial vehicle (UAV) is disclosed herein that allows a drone to be flown along a computed spline, while also accommodating in-flight modifications. In various implementations, a UAV includes a flight control subsystem and an electromechanical subsystem. The flight control subsystem records keyframes during flight and computes a spline based on the keyframes. The flight control subsystem then saves the computed spline for playback, at which time the UAV automatically flies in accordance with the computed spline.
    Type: Application
    Filed: December 4, 2024
    Publication date: March 20, 2025
    Applicant: Skydio, Inc.
    Inventors: Saumya Pravinbhai Shah, Matthew Thomas Beaudouin-Lafon, Kristen Marie Holtz, James Anthony Ferrandini, Hayk Martirosyan, Matthew Joseph Donahoe, Charles VanSchoonhoven Wood, Clara Kelley, Adam Parker Bry, Jack Louis Zhu
  • Patent number: 12169404
    Abstract: Technology for operating an unmanned aerial vehicle (UAV) is disclosed herein that allows a drone to be flown along a computed spline, while also accommodating in-flight modifications. In various implementations, a UAV includes a flight control subsystem and an electromechanical subsystem. The flight control subsystem records keyframes during flight and computes a spline based on the keyframes. The flight control subsystem then saves the computed spline for playback, at which time the UAV automatically flies in accordance with the computed spline.
    Type: Grant
    Filed: March 8, 2022
    Date of Patent: December 17, 2024
    Assignee: Skydio, Inc.
    Inventors: Saumya Pravinbhai Shah, Matthew Thomas Beaudouin-Lafon, Kristen Marie Holtz, James Anthony Ferrandini, Hayk Martirosyan, Matthew Joseph Donahoe, Charles Vanschoonhoven Wood, Clara Kelley, Adam Parker Bry, Jack Louis Zhu
  • Publication number: 20240288862
    Abstract: Techniques are described for developing and using applications and skills with autonomous vehicles. In some embodiments, a development platform is provided that enables access to a developer console for developing software modules for use with autonomous vehicles. For example, a developer can specify instructions for causing an autonomous vehicle to perform one or more operations. To control the behavior of an autonomous vehicle, the instructions can cause an executing computer system at the autonomous vehicle to generate calls to an application programming interface (API) associated with an autonomous navigation system of autonomous vehicle. Such calls to the API can be configured to adjust parameters of a behavioral objective associated with a trajectory generation process performed by the autonomous navigation system that controls the behavior of the autonomous vehicle. The instructions specified by the developer can be packaged as a software module that can be deployed for use at autonomous vehicle.
    Type: Application
    Filed: November 27, 2023
    Publication date: August 29, 2024
    Applicant: Skydio, Inc.
    Inventors: Roshan Neel Jobanputra, Jeffrey Robert DeCew, Matthew Joseph Donahoe, Mark Edward Rubin, Adam Parker Bry, Abraham Galton Bachrach, Jack Louis Zhu, Kristen Marie Holtz
  • Publication number: 20240255943
    Abstract: Technology for generating and displaying a graphical user interface for operating an unmanned aerial vehicle (UAV) is disclosed herein that generates and updates a representation of a spline flight path. In various implementations, a graphical user interface detects user interactions with a remote control device directing the flight control subsystem of the UAV to record keyframes and to compute a spline based on the keyframes during flight. The graphical user interface displays a real-time perspective of the UAV with a representation of the spline and the keyframes overlaying the view. The graphical user interface continually updates the representation as the UAV flies and when the spline is updated as the keyframes are updated.
    Type: Application
    Filed: February 15, 2024
    Publication date: August 1, 2024
    Applicant: Skydio, Inc.
    Inventors: Matthew Thomas Beaudouin-Lafon, Saumya Pravinbhai Shah, Kristen Marie Holtz, James Anthony Ferrandini, Hayk Martirosyan, Matthew Joseph Donahoe, Charles VanSchoonhoven Wood, Clara Kelley, Adam Parker Bry, Jack Louis Zhu
  • Publication number: 20240228035
    Abstract: An autonomous vehicle that is equipped with image capture devices can use information gathered from the image capture devices to plan a future three-dimensional (3D) trajectory through a physical environment. To this end, a technique is described for image-space based motion planning. In an embodiment, a planned 3D trajectory is projected into an image-space of an image captured by the autonomous vehicle. The planned 3D trajectory is then optimized according to a cost function derived from information (e.g., depth estimates) in the captured image. The cost function associates higher cost values with identified regions of the captured image that are associated with areas of the physical environment into which travel is risky or otherwise undesirable. The autonomous vehicle is thereby encouraged to avoid these areas while satisfying other motion planning objectives.
    Type: Application
    Filed: September 8, 2023
    Publication date: July 11, 2024
    Applicant: Skydio, Inc.
    Inventors: Ryan David KENNEDY, Peter Benjamin HENRY, Hayk MARTIROSYAN, Jack Louis ZHU, Abraham Galton BACHRACH, Adam Parker BRY
  • Publication number: 20240083605
    Abstract: A method includes: establishing wireless connection between an unmanned aerial vehicle (UAV) and a user interface; generating, via the user interface, a flight path for the unmanned aerial vehicle; generating, via the user interface, a flight schedule for the unmanned aerial vehicle, the flight schedule being associated with the flight path and include one or more designated times; and initiating, via the user interface, autonomous operation of the unmanned aerial vehicle for the unmanned aerial vehicle to autonomously fly the flight path at the one or more designated times
    Type: Application
    Filed: May 16, 2023
    Publication date: March 14, 2024
    Inventors: Jack Louis Zhu, Christopher Brian Grasberger, Abraham Galton Bachrach, Adam Parker Bry, Hayk Martirosyan, Gareth Benoit Cross
  • Patent number: 11921500
    Abstract: Technology for generating and displaying a graphical user interface for operating an unmanned aerial vehicle (UAV) is disclosed herein that generates and updates a representation of a spline flight path. In various implementations, a graphical user interface detects user interactions with a remote control device directing the flight control subsystem of the UAV to record keyframes and to compute a spline based on the keyframes during flight. The graphical user interface displays a real-time perspective of the UAV with a representation of the spline and the keyframes overlaying the view. The graphical user interface continually updates the representation as the UAV flies and when the spline is updated as the keyframes are updated.
    Type: Grant
    Filed: March 8, 2022
    Date of Patent: March 5, 2024
    Assignee: Skydio, Inc.
    Inventors: Matthew Thomas Beaudouin-Lafon, Saumya Pravinbhai Shah, Kristen Marie Holtz, James Anthony Ferrandini, Hayk Martirosyan, Matthew Joseph Donahoe, Charles VanSchoonhoven Wood, Clara Kelley, Adam Parker Bry, Jack Louis Zhu
  • Publication number: 20240067334
    Abstract: An autonomous vehicle that is equipped with image capture devices can use information gathered from the image capture devices to plan a future three-dimensional (3D) trajectory through a physical environment. To this end, a technique is described for image-space based motion planning. In an embodiment, a planned 3D trajectory is projected into an image-space of an image captured by the autonomous vehicle. The planned 3D trajectory is then optimized according to a cost function derived from information (e.g., depth estimates) in the captured image. The cost function associates higher cost values with identified regions of the captured image that are associated with areas of the physical environment into which travel is risky or otherwise undesirable. The autonomous vehicle is thereby encouraged to avoid these areas while satisfying other motion planning objectives.
    Type: Application
    Filed: September 8, 2023
    Publication date: February 29, 2024
    Applicant: Skydio, Inc.
    Inventors: Ryan David Kennedy, Peter Benjamin Henry, Hayk Martirosyan, Jack Louis Zhu, Abraham Galton Bachrach, Adam Parker Bry
  • Publication number: 20240069572
    Abstract: A technique is introduced for touchdown detection during autonomous landing by an aerial vehicle. In some embodiments, the introduced technique includes processing perception inputs with a dynamics model of the aerial vehicle to estimate the external forces and/or torques acting on the aerial vehicle. The estimated external forces and/or torques are continually monitored while the aerial vehicle is landing to determine when the aerial vehicle is sufficiently supported by a landing surface. In some embodiments, semantic information associated with objects in the environment is utilized to configure parameters associated with the touchdown detection process.
    Type: Application
    Filed: July 11, 2023
    Publication date: February 29, 2024
    Applicant: Skydio, Inc.
    Inventors: Rowland Wilde O'Flaherty, Teodor Tomic, Hayk Martirosyan, Abraham Galton Bachrach, Kristen Marie Holtz, Jack Louis Zhu
  • Publication number: 20240053771
    Abstract: Techniques are described for controlling an autonomous vehicle such as an unmanned aerial vehicle (UAV) using objective-based inputs. In an embodiment, the underlying functionality of an autonomous navigation system is exposed via an application programming interface (API) allowing the UAV to be controlled through specifying a behavioral objective, for example, using a call to the API to set parameters for the behavioral objective. The autonomous navigation system can then incorporate perception inputs such as sensor data from sensors mounted to the UAV and the set parameters using a multi-objective motion planning process to generate a proposed trajectory that most closely satisfies the behavioral objective in view of certain constraints. In some embodiments, developers can utilize the API to build customized applications for the UAV. Such applications, also referred to as “skills,” can be developed, shared, and executed to control behavior of an autonomous UAV and aid in overall system improvement.
    Type: Application
    Filed: July 21, 2023
    Publication date: February 15, 2024
    Applicant: Skydio, Inc.
    Inventors: Jack Louis Zhu, Hayk Martirosyan, Abraham Bachrach, Matthew Donahoe, Patrick Lowe, Kristen Marie Holtz, Adam Bry
  • Patent number: 11858628
    Abstract: An autonomous vehicle that is equipped with image capture devices can use information gathered from the image capture devices to plan a future three-dimensional (3D) trajectory through a physical environment. To this end, a technique is described for image-space based motion planning. In an embodiment, a planned 3D trajectory is projected into an image-space of an image captured by the autonomous vehicle. The planned 3D trajectory is then optimized according to a cost function derived from information (e.g., depth estimates) in the captured image. The cost function associates higher cost values with identified regions of the captured image that are associated with areas of the physical environment into which travel is risky or otherwise undesirable. The autonomous vehicle is thereby encouraged to avoid these areas while satisfying other motion planning objectives.
    Type: Grant
    Filed: January 31, 2023
    Date of Patent: January 2, 2024
    Assignee: Skydio, Inc.
    Inventors: Ryan David Kennedy, Peter Benjamin Henry, Hayk Martirosyan, Jack Louis Zhu, Abraham Galton Bachrach, Adam Parker Bry
  • Patent number: 11829139
    Abstract: A technique is described for developing and using applications and skills with an autonomous vehicle. In an example embodiment, a development platform is provided that enables access to a developer console for developing software modules for use with an autonomous vehicle. Using the developer console, a developer user can specify instructions for causing an autonomous vehicle to perform one or more operations. For example, to control the behavior of an autonomous vehicle, the instructions can cause an executing computer system at the autonomous vehicle to generate calls to an application programming interface (API) associated with an autonomous navigation system of autonomous vehicle. Such calls to the API can be configured to adjust a parameter of a behavioral objective associated with a trajectory generation process performed by the autonomous navigation system that controls the behavior of the autonomous vehicle.
    Type: Grant
    Filed: April 18, 2022
    Date of Patent: November 28, 2023
    Assignee: Skydio, Inc.
    Inventors: Roshan Neel Jobanputra, Jeffrey Robert DeCew, Matthew Joseph Donahoe, Mark Edward Rubin, Adam Parker Bry, Abraham Galton Bachrach, Jack Louis Zhu, Kristen Marie Holtz
  • Publication number: 20230373663
    Abstract: A dock assembly includes a docking station and a stand or mount coupled to the docking station. The dock assembly may be configured for an unmanned aerial vehicle (UAV). The docking station may include a landing surface configured to interface with the UAV, an extended portion coupled to the landing surface and extending from the landing surface, and a fiducial located on the extended portion.
    Type: Application
    Filed: May 16, 2023
    Publication date: November 23, 2023
    Inventors: Yevgeniy Kozlenko, Benjamin Scott Thompson, Jack Zi Qi Ye, Christopher Brian Grasberger, Gareth Benoit Cross, Jack Louis Zhu, Abraham Galton Bachrach, Adam Parker Bry, Hayk Martirosyan
  • Publication number: 20230373668
    Abstract: A battery configured to power an unmanned aerial vehicle. The battery includes an enclosure configured to house a power module of the battery. The battery also includes one or more conducting contacts located on the enclosure configured to contact one or more pogo pins of a battery charger located on a docking station of the unmanned aerial vehicle.
    Type: Application
    Filed: May 16, 2023
    Publication date: November 23, 2023
    Inventors: Yevgeniy Kozlenko, Benjamin Scott Thompson, Jack Zi Qi Ye, Christopher Brian Grasberger, Gareth Benoit Cross, Jack Louis Zhu, Abraham Galton Bachrach, Adam Parker Bry, Hayk Martirosyan
  • Patent number: 11787543
    Abstract: An autonomous vehicle that is equipped with image capture devices can use information gathered from the image capture devices to plan a future three-dimensional (3D) trajectory through a physical environment. To this end, a technique is described for image-space based motion planning. In an embodiment, a planned 3D trajectory is projected into an image-space of an image captured by the autonomous vehicle. The planned 3D trajectory is then optimized according to a cost function derived from information (e.g., depth estimates) in the captured image. The cost function associates higher cost values with identified regions of the captured image that are associated with areas of the physical environment into which travel is risky or otherwise undesirable. The autonomous vehicle is thereby encouraged to avoid these areas while satisfying other motion planning objectives.
    Type: Grant
    Filed: January 31, 2023
    Date of Patent: October 17, 2023
    Assignee: Skydio, Inc.
    Inventors: Ryan David Kennedy, Peter Benjamin Henry, Hayk Martirosyan, Jack Louis Zhu, Abraham Galton Bachrach, Adam Parker Bry
  • Patent number: 11755041
    Abstract: Techniques are described for controlling an autonomous vehicle such as an unmanned aerial vehicle (UAV) using objective-based inputs. In an embodiment, the underlying functionality of an autonomous navigation system is exposed via an application programming interface (API) allowing the UAV to be controlled through specifying a behavioral objective, for example, using a call to the API to set parameters for the behavioral objective. The autonomous navigation system can then incorporate perception inputs such as sensor data from sensors mounted to the UAV and the set parameters using a multi-objective motion planning process to generate a proposed trajectory that most closely satisfies the behavioral objective in view of certain constraints. In some embodiments, developers can utilize the API to build customized applications for the UAV. Such applications, also referred to as “skills,” can be developed, shared, and executed to control behavior of an autonomous UAV and aid in overall system improvement.
    Type: Grant
    Filed: June 28, 2021
    Date of Patent: September 12, 2023
    Assignee: Skydio, Inc.
    Inventors: Jack Louis Zhu, Hayk Martirosyan, Abraham Bachrach, Matthew Donahoe, Patrick Lowe, Kristen Marie Holtz, Adam Bry
  • Publication number: 20230280765
    Abstract: A computer accesses an input element storage and an output element storage. The computer accesses a symbolic expression for output element storage as a function of the input element storage. The computer computes, using a symbolic computation engine of the computer, a symbolic expression for the tangent space Jacobian of the output element storage with respect to an input tangent space. The computer outputs the computed expression.
    Type: Application
    Filed: January 27, 2023
    Publication date: September 7, 2023
    Inventors: Hayk Martirosyan, Aaron Christopher Miller, Nathan Leo Bucki, Bradley Matthew Solliday, Ryan David Kennedy, Jack Louis Zhu, Teodor Tomic, Yixiao Sun, Josiah Timothy VanderMey, Gareth Benoit Cross, Peter Benjamin Henry, Dominic William Pattison, Samuel Shenghung Wang, Kristen Marie Holtz, Harrison Zheng
  • Publication number: 20230257115
    Abstract: An autonomous vehicle that is equipped with image capture devices can use information gathered from the image capture devices to plan a future three-dimensional (3D) trajectory through a physical environment. To this end, a technique is described for image-space based motion planning. In an embodiment, a planned 3D trajectory is projected into an image-space of an image captured by the autonomous vehicle. The planned 3D trajectory is then optimized according to a cost function derived from information (e.g., depth estimates) in the captured image. The cost function associates higher cost values with identified regions of the captured image that are associated with areas of the physical environment into which travel is risky or otherwise undesirable. The autonomous vehicle is thereby encouraged to avoid these areas while satisfying other motion planning objectives.
    Type: Application
    Filed: January 31, 2023
    Publication date: August 17, 2023
    Applicant: Skydio, Inc.
    Inventors: Ryan David Kennedy, Peter Benjamin Henry, Hayk Martirosyan, Jack Louis Zhu, Abraham Galton Bachrach, Adam Parker Bry