Patents by Inventor Jack Louis Zhu

Jack Louis Zhu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240083605
    Abstract: A method includes: establishing wireless connection between an unmanned aerial vehicle (UAV) and a user interface; generating, via the user interface, a flight path for the unmanned aerial vehicle; generating, via the user interface, a flight schedule for the unmanned aerial vehicle, the flight schedule being associated with the flight path and include one or more designated times; and initiating, via the user interface, autonomous operation of the unmanned aerial vehicle for the unmanned aerial vehicle to autonomously fly the flight path at the one or more designated times
    Type: Application
    Filed: May 16, 2023
    Publication date: March 14, 2024
    Inventors: Jack Louis Zhu, Christopher Brian Grasberger, Abraham Galton Bachrach, Adam Parker Bry, Hayk Martirosyan, Gareth Benoit Cross
  • Patent number: 11921500
    Abstract: Technology for generating and displaying a graphical user interface for operating an unmanned aerial vehicle (UAV) is disclosed herein that generates and updates a representation of a spline flight path. In various implementations, a graphical user interface detects user interactions with a remote control device directing the flight control subsystem of the UAV to record keyframes and to compute a spline based on the keyframes during flight. The graphical user interface displays a real-time perspective of the UAV with a representation of the spline and the keyframes overlaying the view. The graphical user interface continually updates the representation as the UAV flies and when the spline is updated as the keyframes are updated.
    Type: Grant
    Filed: March 8, 2022
    Date of Patent: March 5, 2024
    Assignee: Skydio, Inc.
    Inventors: Matthew Thomas Beaudouin-Lafon, Saumya Pravinbhai Shah, Kristen Marie Holtz, James Anthony Ferrandini, Hayk Martirosyan, Matthew Joseph Donahoe, Charles VanSchoonhoven Wood, Clara Kelley, Adam Parker Bry, Jack Louis Zhu
  • Publication number: 20240069572
    Abstract: A technique is introduced for touchdown detection during autonomous landing by an aerial vehicle. In some embodiments, the introduced technique includes processing perception inputs with a dynamics model of the aerial vehicle to estimate the external forces and/or torques acting on the aerial vehicle. The estimated external forces and/or torques are continually monitored while the aerial vehicle is landing to determine when the aerial vehicle is sufficiently supported by a landing surface. In some embodiments, semantic information associated with objects in the environment is utilized to configure parameters associated with the touchdown detection process.
    Type: Application
    Filed: July 11, 2023
    Publication date: February 29, 2024
    Applicant: Skydio, Inc.
    Inventors: Rowland Wilde O'Flaherty, Teodor Tomic, Hayk Martirosyan, Abraham Galton Bachrach, Kristen Marie Holtz, Jack Louis Zhu
  • Publication number: 20240067334
    Abstract: An autonomous vehicle that is equipped with image capture devices can use information gathered from the image capture devices to plan a future three-dimensional (3D) trajectory through a physical environment. To this end, a technique is described for image-space based motion planning. In an embodiment, a planned 3D trajectory is projected into an image-space of an image captured by the autonomous vehicle. The planned 3D trajectory is then optimized according to a cost function derived from information (e.g., depth estimates) in the captured image. The cost function associates higher cost values with identified regions of the captured image that are associated with areas of the physical environment into which travel is risky or otherwise undesirable. The autonomous vehicle is thereby encouraged to avoid these areas while satisfying other motion planning objectives.
    Type: Application
    Filed: September 8, 2023
    Publication date: February 29, 2024
    Applicant: Skydio, Inc.
    Inventors: Ryan David Kennedy, Peter Benjamin Henry, Hayk Martirosyan, Jack Louis Zhu, Abraham Galton Bachrach, Adam Parker Bry
  • Publication number: 20240053771
    Abstract: Techniques are described for controlling an autonomous vehicle such as an unmanned aerial vehicle (UAV) using objective-based inputs. In an embodiment, the underlying functionality of an autonomous navigation system is exposed via an application programming interface (API) allowing the UAV to be controlled through specifying a behavioral objective, for example, using a call to the API to set parameters for the behavioral objective. The autonomous navigation system can then incorporate perception inputs such as sensor data from sensors mounted to the UAV and the set parameters using a multi-objective motion planning process to generate a proposed trajectory that most closely satisfies the behavioral objective in view of certain constraints. In some embodiments, developers can utilize the API to build customized applications for the UAV. Such applications, also referred to as “skills,” can be developed, shared, and executed to control behavior of an autonomous UAV and aid in overall system improvement.
    Type: Application
    Filed: July 21, 2023
    Publication date: February 15, 2024
    Applicant: Skydio, Inc.
    Inventors: Jack Louis Zhu, Hayk Martirosyan, Abraham Bachrach, Matthew Donahoe, Patrick Lowe, Kristen Marie Holtz, Adam Bry
  • Patent number: 11858628
    Abstract: An autonomous vehicle that is equipped with image capture devices can use information gathered from the image capture devices to plan a future three-dimensional (3D) trajectory through a physical environment. To this end, a technique is described for image-space based motion planning. In an embodiment, a planned 3D trajectory is projected into an image-space of an image captured by the autonomous vehicle. The planned 3D trajectory is then optimized according to a cost function derived from information (e.g., depth estimates) in the captured image. The cost function associates higher cost values with identified regions of the captured image that are associated with areas of the physical environment into which travel is risky or otherwise undesirable. The autonomous vehicle is thereby encouraged to avoid these areas while satisfying other motion planning objectives.
    Type: Grant
    Filed: January 31, 2023
    Date of Patent: January 2, 2024
    Assignee: Skydio, Inc.
    Inventors: Ryan David Kennedy, Peter Benjamin Henry, Hayk Martirosyan, Jack Louis Zhu, Abraham Galton Bachrach, Adam Parker Bry
  • Patent number: 11829139
    Abstract: A technique is described for developing and using applications and skills with an autonomous vehicle. In an example embodiment, a development platform is provided that enables access to a developer console for developing software modules for use with an autonomous vehicle. Using the developer console, a developer user can specify instructions for causing an autonomous vehicle to perform one or more operations. For example, to control the behavior of an autonomous vehicle, the instructions can cause an executing computer system at the autonomous vehicle to generate calls to an application programming interface (API) associated with an autonomous navigation system of autonomous vehicle. Such calls to the API can be configured to adjust a parameter of a behavioral objective associated with a trajectory generation process performed by the autonomous navigation system that controls the behavior of the autonomous vehicle.
    Type: Grant
    Filed: April 18, 2022
    Date of Patent: November 28, 2023
    Assignee: Skydio, Inc.
    Inventors: Roshan Neel Jobanputra, Jeffrey Robert DeCew, Matthew Joseph Donahoe, Mark Edward Rubin, Adam Parker Bry, Abraham Galton Bachrach, Jack Louis Zhu, Kristen Marie Holtz
  • Publication number: 20230373663
    Abstract: A dock assembly includes a docking station and a stand or mount coupled to the docking station. The dock assembly may be configured for an unmanned aerial vehicle (UAV). The docking station may include a landing surface configured to interface with the UAV, an extended portion coupled to the landing surface and extending from the landing surface, and a fiducial located on the extended portion.
    Type: Application
    Filed: May 16, 2023
    Publication date: November 23, 2023
    Inventors: Yevgeniy Kozlenko, Benjamin Scott Thompson, Jack Zi Qi Ye, Christopher Brian Grasberger, Gareth Benoit Cross, Jack Louis Zhu, Abraham Galton Bachrach, Adam Parker Bry, Hayk Martirosyan
  • Publication number: 20230373668
    Abstract: A battery configured to power an unmanned aerial vehicle. The battery includes an enclosure configured to house a power module of the battery. The battery also includes one or more conducting contacts located on the enclosure configured to contact one or more pogo pins of a battery charger located on a docking station of the unmanned aerial vehicle.
    Type: Application
    Filed: May 16, 2023
    Publication date: November 23, 2023
    Inventors: Yevgeniy Kozlenko, Benjamin Scott Thompson, Jack Zi Qi Ye, Christopher Brian Grasberger, Gareth Benoit Cross, Jack Louis Zhu, Abraham Galton Bachrach, Adam Parker Bry, Hayk Martirosyan
  • Patent number: 11787543
    Abstract: An autonomous vehicle that is equipped with image capture devices can use information gathered from the image capture devices to plan a future three-dimensional (3D) trajectory through a physical environment. To this end, a technique is described for image-space based motion planning. In an embodiment, a planned 3D trajectory is projected into an image-space of an image captured by the autonomous vehicle. The planned 3D trajectory is then optimized according to a cost function derived from information (e.g., depth estimates) in the captured image. The cost function associates higher cost values with identified regions of the captured image that are associated with areas of the physical environment into which travel is risky or otherwise undesirable. The autonomous vehicle is thereby encouraged to avoid these areas while satisfying other motion planning objectives.
    Type: Grant
    Filed: January 31, 2023
    Date of Patent: October 17, 2023
    Assignee: Skydio, Inc.
    Inventors: Ryan David Kennedy, Peter Benjamin Henry, Hayk Martirosyan, Jack Louis Zhu, Abraham Galton Bachrach, Adam Parker Bry
  • Patent number: 11755041
    Abstract: Techniques are described for controlling an autonomous vehicle such as an unmanned aerial vehicle (UAV) using objective-based inputs. In an embodiment, the underlying functionality of an autonomous navigation system is exposed via an application programming interface (API) allowing the UAV to be controlled through specifying a behavioral objective, for example, using a call to the API to set parameters for the behavioral objective. The autonomous navigation system can then incorporate perception inputs such as sensor data from sensors mounted to the UAV and the set parameters using a multi-objective motion planning process to generate a proposed trajectory that most closely satisfies the behavioral objective in view of certain constraints. In some embodiments, developers can utilize the API to build customized applications for the UAV. Such applications, also referred to as “skills,” can be developed, shared, and executed to control behavior of an autonomous UAV and aid in overall system improvement.
    Type: Grant
    Filed: June 28, 2021
    Date of Patent: September 12, 2023
    Assignee: Skydio, Inc.
    Inventors: Jack Louis Zhu, Hayk Martirosyan, Abraham Bachrach, Matthew Donahoe, Patrick Lowe, Kristen Marie Holtz, Adam Bry
  • Publication number: 20230280765
    Abstract: A computer accesses an input element storage and an output element storage. The computer accesses a symbolic expression for output element storage as a function of the input element storage. The computer computes, using a symbolic computation engine of the computer, a symbolic expression for the tangent space Jacobian of the output element storage with respect to an input tangent space. The computer outputs the computed expression.
    Type: Application
    Filed: January 27, 2023
    Publication date: September 7, 2023
    Inventors: Hayk Martirosyan, Aaron Christopher Miller, Nathan Leo Bucki, Bradley Matthew Solliday, Ryan David Kennedy, Jack Louis Zhu, Teodor Tomic, Yixiao Sun, Josiah Timothy VanderMey, Gareth Benoit Cross, Peter Benjamin Henry, Dominic William Pattison, Samuel Shenghung Wang, Kristen Marie Holtz, Harrison Zheng
  • Publication number: 20230257116
    Abstract: An autonomous vehicle that is equipped with image capture devices can use information gathered from the image capture devices to plan a future three-dimensional (3D) trajectory through a physical environment. To this end, a technique is described for image-space based motion planning. In an embodiment, a planned 3D trajectory is projected into an image-space of an image captured by the autonomous vehicle. The planned 3D trajectory is then optimized according to a cost function derived from information (e.g., depth estimates) in the captured image. The cost function associates higher cost values with identified regions of the captured image that are associated with areas of the physical environment into which travel is risky or otherwise undesirable. The autonomous vehicle is thereby encouraged to avoid these areas while satisfying other motion planning objectives.
    Type: Application
    Filed: January 31, 2023
    Publication date: August 17, 2023
    Applicant: Skydio, Inc.
    Inventors: Ryan David Kennedy, Peter Benjamin Henry, Hayk Martirosyan, Jack Louis Zhu, Abraham Galton Bachrach, Adam Parker Bry
  • Publication number: 20230257115
    Abstract: An autonomous vehicle that is equipped with image capture devices can use information gathered from the image capture devices to plan a future three-dimensional (3D) trajectory through a physical environment. To this end, a technique is described for image-space based motion planning. In an embodiment, a planned 3D trajectory is projected into an image-space of an image captured by the autonomous vehicle. The planned 3D trajectory is then optimized according to a cost function derived from information (e.g., depth estimates) in the captured image. The cost function associates higher cost values with identified regions of the captured image that are associated with areas of the physical environment into which travel is risky or otherwise undesirable. The autonomous vehicle is thereby encouraged to avoid these areas while satisfying other motion planning objectives.
    Type: Application
    Filed: January 31, 2023
    Publication date: August 17, 2023
    Applicant: Skydio, Inc.
    Inventors: Ryan David Kennedy, Peter Benjamin Henry, Hayk Martirosyan, Jack Louis Zhu, Abraham Galton Bachrach, Adam Parker Bry
  • Patent number: 11726498
    Abstract: A technique is introduced for touchdown detection during autonomous landing by an aerial vehicle. In some embodiments, the introduced technique includes processing perception inputs with a dynamics model of the aerial vehicle to estimate the external forces and/or torques acting on the aerial vehicle. The estimated external forces and/or torques are continually monitored while the aerial vehicle is landing to determine when the aerial vehicle is sufficiently supported by a landing surface. In some embodiments, semantic information associated with objects in the environment is utilized to configure parameters associated with the touchdown detection process.
    Type: Grant
    Filed: May 3, 2021
    Date of Patent: August 15, 2023
    Assignee: Skydio, Inc.
    Inventors: Rowland Wilde O'Flaherty, Teodor Tomic, Hayk Martirosyan, Abraham Galton Bachrach, Kristen Marie Holtz, Jack Louis Zhu
  • Publication number: 20230244247
    Abstract: A computer of an unmanned aerial vehicle (UAV) accesses, from a memory unit, a problem definition comprising cost functions associated with travel of the UAV. The computer causes movement of the UAV based on the cost functions. The computer adjusts one or more of the cost functions during a flight of the UAV. The computer causes further movement of the UAV based on the adjusted one or more of the cost functions.
    Type: Application
    Filed: January 27, 2023
    Publication date: August 3, 2023
    Inventors: Hayk Martirosyan, Aaron Christopher Miller, Nathan Leo Bucki, Bradley Matthew Solliday, Ryan David Kennedy, Jack Louis Zhu, Teodor Tomic, Yixiao Sun, Josiah Timothy VanderMey, Gareth Benoit Cross, Peter Benjamin Henry, Dominic William Pattison, Samuel Shenghung Wang, Kristen Marie Holtz, Harrison Zheng
  • Publication number: 20230242250
    Abstract: A computer stores dense maps generated by one or more aerial vehicles. The computer generates a global graph based on the dense maps and a sparse map. The computer stores a representation of one or more paths traversed by the one or more aerial vehicles within the global graph. The computer determines a path from an origin location to a destination location based on the global graph. The determined path enables an aerial vehicle to avoid objects.
    Type: Application
    Filed: April 11, 2022
    Publication date: August 3, 2023
    Inventors: Jack Louis Zhu, Margaret Bai Wang, Maximilian Joseph Halper Krogisu, Kristen Marie Holtz, Shreetej Varakantam Reddy, Hayk Martirosyan, Peter Benjamin Henry
  • Publication number: 20230244750
    Abstract: A computer accesses a first symbolic expression for an output value as a function of an input value. The computer computes a first symbolic Jacobian of the input value with respect to an input tangent space from a symbolic Lie group definition. The computer computes a second symbolic Jacobian of the output value with respect to the input value. The computer computes a third symbolic Jacobian of an output tangent space with respect to the input value from the symbolic Lie group definition. The computer applies symbolic matrix multiplication to the first symbolic Jacobian, the second symbolic Jacobian, and the third symbolic Jacobian to obtain a second symbolic expression for the output tangent space with respect to the input tangent space. The computer provides a representation of the second symbolic expression.
    Type: Application
    Filed: January 27, 2023
    Publication date: August 3, 2023
    Inventors: Hayk Martirosyan, Aaron Christopher Miller, Nathan Leo Bucki, Bradley Matthew Solliday, Ryan David Kennedy, Jack Louis Zhu, Teodor Tomic, Yixiao Sun, Josiah Timothy VanderMey, Gareth Benoit Cross, Peter Benjamin Henry, Dominic William Pattison, Samuel Shenghung Wang, Kristen Marie Holtz, Harrison Zheng
  • Publication number: 20230244231
    Abstract: A computer accesses a first symbolic expression for an output matrix as a function of an input matrix at a computing device comprising processing circuitry and memory. The computer computes a first Jacobian of the input matrix with respect to an input tangent space. The computer computes a second Jacobian of the output matrix with respect to the input matrix. The computer computes a third Jacobian of an output tangent space with respect to the input matrix. The computer applies symbolic matrix multiplication to the first Jacobian, the second Jacobian, and the third Jacobian to obtain a second symbolic expression for the output tangent space with respect to the input tangent space. The computer provides a representation of the second symbolic expression, the second symbolic expression representing a computed tangent-space Jacobian.
    Type: Application
    Filed: January 27, 2023
    Publication date: August 3, 2023
    Inventors: Hayk Martirosyan, Aaron Christopher Miller, Nathan Leo Bucki, Bradley Matthew Solliday, Ryan David Kennedy, Jack Louis Zhu, Teodor Tomic, Yixiao Sun, Josiah Timothy VanderMey, Gareth Benoit Cross, Peter Benjamin Henry, Dominic William Pattison, Samuel Shenghung Wang, Kristen Marie Holtz, Harrison Zheng
  • Patent number: 11592844
    Abstract: An autonomous vehicle that is equipped with image capture devices can use information gathered from the image capture devices to plan a future three-dimensional (3D) trajectory through a physical environment. To this end, a technique is described for image-space based motion planning. In an embodiment, a planned 3D trajectory is projected into an image-space of an image captured by the autonomous vehicle. The planned 3D trajectory is then optimized according to a cost function derived from information (e.g., depth estimates) in the captured image. The cost function associates higher cost values with identified regions of the captured image that are associated with areas of the physical environment into which travel is risky or otherwise undesirable. The autonomous vehicle is thereby encouraged to avoid these areas while satisfying other motion planning objectives.
    Type: Grant
    Filed: October 28, 2021
    Date of Patent: February 28, 2023
    Assignee: Skydio, Inc.
    Inventors: Ryan David Kennedy, Peter Benjamin Henry, Hayk Martirosyan, Jack Louis Zhu, Abraham Galton Bachrach, Adam Parker Bry