Patents by Inventor Peter Benjamin Henry

Peter Benjamin Henry has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240067334
    Abstract: An autonomous vehicle that is equipped with image capture devices can use information gathered from the image capture devices to plan a future three-dimensional (3D) trajectory through a physical environment. To this end, a technique is described for image-space based motion planning. In an embodiment, a planned 3D trajectory is projected into an image-space of an image captured by the autonomous vehicle. The planned 3D trajectory is then optimized according to a cost function derived from information (e.g., depth estimates) in the captured image. The cost function associates higher cost values with identified regions of the captured image that are associated with areas of the physical environment into which travel is risky or otherwise undesirable. The autonomous vehicle is thereby encouraged to avoid these areas while satisfying other motion planning objectives.
    Type: Application
    Filed: September 8, 2023
    Publication date: February 29, 2024
    Applicant: Skydio, Inc.
    Inventors: Ryan David Kennedy, Peter Benjamin Henry, Hayk Martirosyan, Jack Louis Zhu, Abraham Galton Bachrach, Adam Parker Bry
  • Patent number: 11861896
    Abstract: Autonomous aerial navigation in low-light and no-light conditions includes using night mode obstacle avoidance intelligence, training, and mechanisms for vision-based unmanned aerial vehicle (UAV) navigation to enable autonomous flight operations of a UAV in low-light and no-light environments using infrared data.
    Type: Grant
    Filed: March 29, 2022
    Date of Patent: January 2, 2024
    Assignee: Skydio, Inc.
    Inventors: Samuel Shenghung Wang, Vladimir Nekrasov, Ryan David Kennedy, Gareth Benoit Cross, Peter Benjamin Henry, Kristen Marie Holtz, Hayk Martirosyan, Abraham Galton Bachrach, Adam Parker Bry
  • Patent number: 11858628
    Abstract: An autonomous vehicle that is equipped with image capture devices can use information gathered from the image capture devices to plan a future three-dimensional (3D) trajectory through a physical environment. To this end, a technique is described for image-space based motion planning. In an embodiment, a planned 3D trajectory is projected into an image-space of an image captured by the autonomous vehicle. The planned 3D trajectory is then optimized according to a cost function derived from information (e.g., depth estimates) in the captured image. The cost function associates higher cost values with identified regions of the captured image that are associated with areas of the physical environment into which travel is risky or otherwise undesirable. The autonomous vehicle is thereby encouraged to avoid these areas while satisfying other motion planning objectives.
    Type: Grant
    Filed: January 31, 2023
    Date of Patent: January 2, 2024
    Assignee: Skydio, Inc.
    Inventors: Ryan David Kennedy, Peter Benjamin Henry, Hayk Martirosyan, Jack Louis Zhu, Abraham Galton Bachrach, Adam Parker Bry
  • Patent number: 11787543
    Abstract: An autonomous vehicle that is equipped with image capture devices can use information gathered from the image capture devices to plan a future three-dimensional (3D) trajectory through a physical environment. To this end, a technique is described for image-space based motion planning. In an embodiment, a planned 3D trajectory is projected into an image-space of an image captured by the autonomous vehicle. The planned 3D trajectory is then optimized according to a cost function derived from information (e.g., depth estimates) in the captured image. The cost function associates higher cost values with identified regions of the captured image that are associated with areas of the physical environment into which travel is risky or otherwise undesirable. The autonomous vehicle is thereby encouraged to avoid these areas while satisfying other motion planning objectives.
    Type: Grant
    Filed: January 31, 2023
    Date of Patent: October 17, 2023
    Assignee: Skydio, Inc.
    Inventors: Ryan David Kennedy, Peter Benjamin Henry, Hayk Martirosyan, Jack Louis Zhu, Abraham Galton Bachrach, Adam Parker Bry
  • Publication number: 20230296793
    Abstract: A calibration of an unmanned aerial vehicle is performed without the use of a magnetometer. The unmanned aerial vehicle generates a first acceleration vector in a navigation frame of reference and a second acceleration vector in a GPS frame of reference. The unmanned aerial vehicle estimates a heading of the unmanned aerial vehicle based on the first acceleration vector and the second acceleration vector. The unmanned aerial vehicle performs a calibration based on the estimated heading of the unmanned aerial vehicle.
    Type: Application
    Filed: July 28, 2022
    Publication date: September 21, 2023
    Inventors: Anh Tung Dang, Peter Benjamin Henry, Hayk Martirosyan, Kristen Marie Holtz, Dominic William Pattison
  • Publication number: 20230280765
    Abstract: A computer accesses an input element storage and an output element storage. The computer accesses a symbolic expression for output element storage as a function of the input element storage. The computer computes, using a symbolic computation engine of the computer, a symbolic expression for the tangent space Jacobian of the output element storage with respect to an input tangent space. The computer outputs the computed expression.
    Type: Application
    Filed: January 27, 2023
    Publication date: September 7, 2023
    Inventors: Hayk Martirosyan, Aaron Christopher Miller, Nathan Leo Bucki, Bradley Matthew Solliday, Ryan David Kennedy, Jack Louis Zhu, Teodor Tomic, Yixiao Sun, Josiah Timothy VanderMey, Gareth Benoit Cross, Peter Benjamin Henry, Dominic William Pattison, Samuel Shenghung Wang, Kristen Marie Holtz, Harrison Zheng
  • Publication number: 20230257116
    Abstract: An autonomous vehicle that is equipped with image capture devices can use information gathered from the image capture devices to plan a future three-dimensional (3D) trajectory through a physical environment. To this end, a technique is described for image-space based motion planning. In an embodiment, a planned 3D trajectory is projected into an image-space of an image captured by the autonomous vehicle. The planned 3D trajectory is then optimized according to a cost function derived from information (e.g., depth estimates) in the captured image. The cost function associates higher cost values with identified regions of the captured image that are associated with areas of the physical environment into which travel is risky or otherwise undesirable. The autonomous vehicle is thereby encouraged to avoid these areas while satisfying other motion planning objectives.
    Type: Application
    Filed: January 31, 2023
    Publication date: August 17, 2023
    Applicant: Skydio, Inc.
    Inventors: Ryan David Kennedy, Peter Benjamin Henry, Hayk Martirosyan, Jack Louis Zhu, Abraham Galton Bachrach, Adam Parker Bry
  • Publication number: 20230257115
    Abstract: An autonomous vehicle that is equipped with image capture devices can use information gathered from the image capture devices to plan a future three-dimensional (3D) trajectory through a physical environment. To this end, a technique is described for image-space based motion planning. In an embodiment, a planned 3D trajectory is projected into an image-space of an image captured by the autonomous vehicle. The planned 3D trajectory is then optimized according to a cost function derived from information (e.g., depth estimates) in the captured image. The cost function associates higher cost values with identified regions of the captured image that are associated with areas of the physical environment into which travel is risky or otherwise undesirable. The autonomous vehicle is thereby encouraged to avoid these areas while satisfying other motion planning objectives.
    Type: Application
    Filed: January 31, 2023
    Publication date: August 17, 2023
    Applicant: Skydio, Inc.
    Inventors: Ryan David Kennedy, Peter Benjamin Henry, Hayk Martirosyan, Jack Louis Zhu, Abraham Galton Bachrach, Adam Parker Bry
  • Publication number: 20230244231
    Abstract: A computer accesses a first symbolic expression for an output matrix as a function of an input matrix at a computing device comprising processing circuitry and memory. The computer computes a first Jacobian of the input matrix with respect to an input tangent space. The computer computes a second Jacobian of the output matrix with respect to the input matrix. The computer computes a third Jacobian of an output tangent space with respect to the input matrix. The computer applies symbolic matrix multiplication to the first Jacobian, the second Jacobian, and the third Jacobian to obtain a second symbolic expression for the output tangent space with respect to the input tangent space. The computer provides a representation of the second symbolic expression, the second symbolic expression representing a computed tangent-space Jacobian.
    Type: Application
    Filed: January 27, 2023
    Publication date: August 3, 2023
    Inventors: Hayk Martirosyan, Aaron Christopher Miller, Nathan Leo Bucki, Bradley Matthew Solliday, Ryan David Kennedy, Jack Louis Zhu, Teodor Tomic, Yixiao Sun, Josiah Timothy VanderMey, Gareth Benoit Cross, Peter Benjamin Henry, Dominic William Pattison, Samuel Shenghung Wang, Kristen Marie Holtz, Harrison Zheng
  • Publication number: 20230242250
    Abstract: A computer stores dense maps generated by one or more aerial vehicles. The computer generates a global graph based on the dense maps and a sparse map. The computer stores a representation of one or more paths traversed by the one or more aerial vehicles within the global graph. The computer determines a path from an origin location to a destination location based on the global graph. The determined path enables an aerial vehicle to avoid objects.
    Type: Application
    Filed: April 11, 2022
    Publication date: August 3, 2023
    Inventors: Jack Louis Zhu, Margaret Bai Wang, Maximilian Joseph Halper Krogisu, Kristen Marie Holtz, Shreetej Varakantam Reddy, Hayk Martirosyan, Peter Benjamin Henry
  • Publication number: 20230244247
    Abstract: A computer of an unmanned aerial vehicle (UAV) accesses, from a memory unit, a problem definition comprising cost functions associated with travel of the UAV. The computer causes movement of the UAV based on the cost functions. The computer adjusts one or more of the cost functions during a flight of the UAV. The computer causes further movement of the UAV based on the adjusted one or more of the cost functions.
    Type: Application
    Filed: January 27, 2023
    Publication date: August 3, 2023
    Inventors: Hayk Martirosyan, Aaron Christopher Miller, Nathan Leo Bucki, Bradley Matthew Solliday, Ryan David Kennedy, Jack Louis Zhu, Teodor Tomic, Yixiao Sun, Josiah Timothy VanderMey, Gareth Benoit Cross, Peter Benjamin Henry, Dominic William Pattison, Samuel Shenghung Wang, Kristen Marie Holtz, Harrison Zheng
  • Publication number: 20230244750
    Abstract: A computer accesses a first symbolic expression for an output value as a function of an input value. The computer computes a first symbolic Jacobian of the input value with respect to an input tangent space from a symbolic Lie group definition. The computer computes a second symbolic Jacobian of the output value with respect to the input value. The computer computes a third symbolic Jacobian of an output tangent space with respect to the input value from the symbolic Lie group definition. The computer applies symbolic matrix multiplication to the first symbolic Jacobian, the second symbolic Jacobian, and the third symbolic Jacobian to obtain a second symbolic expression for the output tangent space with respect to the input tangent space. The computer provides a representation of the second symbolic expression.
    Type: Application
    Filed: January 27, 2023
    Publication date: August 3, 2023
    Inventors: Hayk Martirosyan, Aaron Christopher Miller, Nathan Leo Bucki, Bradley Matthew Solliday, Ryan David Kennedy, Jack Louis Zhu, Teodor Tomic, Yixiao Sun, Josiah Timothy VanderMey, Gareth Benoit Cross, Peter Benjamin Henry, Dominic William Pattison, Samuel Shenghung Wang, Kristen Marie Holtz, Harrison Zheng
  • Publication number: 20230239575
    Abstract: In some examples, a computing device receives, from an unmanned aerial vehicle (UAV), a first image from a first camera on the UAV and a plurality of second images from a plurality of second cameras on the UAV. The plurality of second cameras may be positioned on the UAV for providing a plurality of different fields of view in a plurality of different directions around the UAV. Further, the first camera has a longer focal length than the second cameras. The computing device presents, on a display, a composite image including at least a portion of the first image within a merged image generated from the plurality of second images. The presented composite image enables a user to at least one of: zoom out from the at least one first image to the merged image, or zoom in from the merged image to the at least one first image.
    Type: Application
    Filed: March 17, 2023
    Publication date: July 27, 2023
    Inventors: Peter Benjamin HENRY, Hayk MARTIROSYAN, Abraham Galton BACHRACH, Clement GODARD, Adam Parker BRY, Ryan David KENNEDY
  • Publication number: 20230142394
    Abstract: In some examples, an unmanned aerial vehicle (UAV) may determine a plurality of contour paths spaced apart from each other along at least one axis associated with a scan target. For instance, each contour path may be spaced away from a surface of the scan target based on a selected distance. The UAV may determine a plurality of image capture locations for each contour path. The image capture locations may indicate locations at which an image of a surface of the scan target is to be captured. The UAV may navigate along the plurality of contour paths based on a determined speed while capturing images of the surface of the scan target based on the image capture locations.
    Type: Application
    Filed: November 10, 2021
    Publication date: May 11, 2023
    Inventors: Peter Benjamin HENRY, Hayk MARTIROSYAN, Quentin Allen Wah Yen DELEPINE, Himel MONDAL, Abraham Galton BACHRACH
  • Patent number: 11611700
    Abstract: In some examples, an unmanned aerial vehicle (UAV) may control a position of a first camera to cause the first camera to capture a first image of a target. The UAV may receive a plurality of second images from a plurality of second cameras, the plurality of second cameras positioned on the UAV for providing a plurality of different fields of view in a plurality of different directions around the UAV, the first camera having a longer focal length than the second cameras. The UAV may combine at least some of the plurality of second images to generate a composite image corresponding to the first image and having a wider-angle field of view than the first image. The UAV may send the first image and the composite image to a computing device.
    Type: Grant
    Filed: July 12, 2021
    Date of Patent: March 21, 2023
    Assignee: SKYDIO, INC.
    Inventors: Peter Benjamin Henry, Hayk Martirosyan, Abraham Galton Bachrach, Clement Godard, Adam Parker Bry, Ryan David Kennedy
  • Patent number: 11592844
    Abstract: An autonomous vehicle that is equipped with image capture devices can use information gathered from the image capture devices to plan a future three-dimensional (3D) trajectory through a physical environment. To this end, a technique is described for image-space based motion planning. In an embodiment, a planned 3D trajectory is projected into an image-space of an image captured by the autonomous vehicle. The planned 3D trajectory is then optimized according to a cost function derived from information (e.g., depth estimates) in the captured image. The cost function associates higher cost values with identified regions of the captured image that are associated with areas of the physical environment into which travel is risky or otherwise undesirable. The autonomous vehicle is thereby encouraged to avoid these areas while satisfying other motion planning objectives.
    Type: Grant
    Filed: October 28, 2021
    Date of Patent: February 28, 2023
    Assignee: Skydio, Inc.
    Inventors: Ryan David Kennedy, Peter Benjamin Henry, Hayk Martirosyan, Jack Louis Zhu, Abraham Galton Bachrach, Adam Parker Bry
  • Patent number: 11592845
    Abstract: An autonomous vehicle that is equipped with image capture devices can use information gathered from the image capture devices to plan a future three-dimensional (3D) trajectory through a physical environment. To this end, a technique is described for image-space based motion planning. In an embodiment, a planned 3D trajectory is projected into an image-space of an image captured by the autonomous vehicle. The planned 3D trajectory is then optimized according to a cost function derived from information (e.g., depth estimates) in the captured image. The cost function associates higher cost values with identified regions of the captured image that are associated with areas of the physical environment into which travel is risky or otherwise undesirable. The autonomous vehicle is thereby encouraged to avoid these areas while satisfying other motion planning objectives.
    Type: Grant
    Filed: October 28, 2021
    Date of Patent: February 28, 2023
    Assignee: Skydio, Inc.
    Inventors: Ryan David Kennedy, Peter Benjamin Henry, Hayk Martirosyan, Jack Louis Zhu, Abraham Galton Bachrach, Adam Parker Bry
  • Publication number: 20220390940
    Abstract: In some examples, a computing apparatus may include one or more non-transitory computer-readable storage media and program instructions stored on the one or more computer-readable storage media that, when executed by one or more processors, direct the computing apparatus to perform various steps. For example, the program instructions may continually present a graphical user interface (GUI) at the computing apparatus including a display of a current view of the physical environment from a perspective of an aerial vehicle. The program instructions may detect user interactions with the GUI while the aerial vehicle is in flight. The user interactions may include instructions directing the aerial vehicle to maneuver within the physical environment and configure parameters for scanning a three-dimensional (3D) scan volume. The program instruction may then transmit, to the aerial vehicle, data encoding the instructions for performing a 3D scan of the 3D scan volume.
    Type: Application
    Filed: June 2, 2022
    Publication date: December 8, 2022
    Inventors: Brian Richman, Matthew Thomas Beaudouin-Lafon, Charles VanSchoonhoven Wood, Peter Benjamin Henry, Jack Louis Zhu, Harrison Zheng, Hayk Martirosyan, Matthew Donahoe, Abraham Galton Bachrach, Adam Parker Bry
  • Publication number: 20220315220
    Abstract: Autonomous aerial navigation in low-light and no-light conditions includes using night mode obstacle avoidance intelligence and mechanisms for vision-based unmanned aerial vehicle (UAV) navigation to enable autonomous flight operations of a UAV in low-light and no-light environments using infrared data.
    Type: Application
    Filed: October 19, 2021
    Publication date: October 6, 2022
    Inventors: Abraham Galton Bachrach, Adam Parker Bry, Gareth Benoit Cross, Peter Benjamin Henry, Kristen Marie Holtz, Ryan David Kennedy, Hayk Martirosyan, Vladimir Nekrasov, Samuel Shenghung Wang
  • Publication number: 20220234733
    Abstract: A technique is introduced for autonomous landing by an aerial vehicle. In some embodiments, the introduced technique includes processing a sensor data such as images captured by onboard cameras to generate a ground map comprising multiple cells. A suitable footprint, comprising a subset of the multiple cells in the ground map that satisfy one or more landing criteria, is selected and control commands are generated to cause the aerial vehicle to autonomously land on an area corresponding to the footprint. In some embodiments, the introduced technique involves a geometric smart landing process to select a relatively flat area on the ground for landing. In some embodiments, the introduced technique involves a semantic smart landing process where semantic information regarding detected objects is incorporated into the ground map.
    Type: Application
    Filed: February 7, 2022
    Publication date: July 28, 2022
    Applicant: Skydio, Inc.
    Inventors: Kristen Marie Holtz, Hayk Martirosyan, Jack Louis Zhu, Adam Parker Bry, Matthew Joseph Donahoe, Abraham Galton Bachrach, Peter Benjamin Henry, Ryan David Kennedy