Patents by Inventor Richard W. Ely

Richard W. Ely has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 12586359
    Abstract: A method includes obtaining training data having first image pairs, where each of the first image pairs includes (i) a first training image and (ii) a first ground truth image. The method also includes training a machine learning model to generate realistic images using the first image pairs. The method further includes obtaining additional training data having second image pairs, where each of the second image pairs includes (i) a second training image and (ii) a second ground truth image. At least some of the images in the second image pairs are less aligned or of lower quality than at least some of the images in the first image pairs. In addition, the method includes continuing to train the machine learning model to generate the realistic images using the second image pairs.
    Type: Grant
    Filed: June 23, 2023
    Date of Patent: March 24, 2026
    Assignee: Raytheon Company
    Inventors: Jonathan H. Goldstein, Lauren E. Turney, Richard W. Ely, Jody D. Verret, Brett N. Appleton
  • Patent number: 12511832
    Abstract: Devices, systems, and methods for three-dimensional (3D) evaluation point (3DEP) identification; wherein a method can include receiving a first conjugate point of a first real two-dimensional (2D) image, receiving a second conjugate point of a second real 2D image, the first and second conjugate points corresponding to a same geographical location, determining a first set of points of a 3D point set that project to within a specified distance of the first conjugate point in the first real 2D image, determining a second set of points of the 3D point set that project to within the specified distance of the second conjugate point in the second real 2D image, identifying a common point in both the first set of points and the second set of points that satisfies a specified heuristic relative to all other points in both the first set of points and the second set of points, and using the point as the 3DEP.
    Type: Grant
    Filed: August 24, 2023
    Date of Patent: December 30, 2025
    Assignee: Raytheon Company
    Inventors: Richard W. Ely, Jody D. Verret
  • Publication number: 20250069330
    Abstract: Devices, systems, and methods for three-dimensional (3D) evaluation point (3DEP) identification; wherein a method can include receiving a first conjugate point of a first real two-dimensional (2D) image, receiving a second conjugate point of a second real 2D image, the first and second conjugate points corresponding to a same geographical location, determining a first set of points of a 3D point set that project to within a specified distance of the first conjugate point in the first real 2D image, determining a second set of points of the 3D point set that project to within the specified distance of the second conjugate point in the second real 2D image, identifying a common point in both the first set of points and the second set of points that satisfies a specified heuristic relative to all other points in both the first set of points and the second set of points, and using the point as the 3DEP.
    Type: Application
    Filed: August 24, 2023
    Publication date: February 27, 2025
    Inventors: Richard W. Ely, Jody D. Verret
  • Publication number: 20250069241
    Abstract: Devices, systems, and methods for image processing; wherein a method can include generating a synthetic image based on the 3D point set of a same geographical region as the 2D real image and performing a coarse registration to grossly register the synthetic image to the 2D real image, the coarse registration including determining, for a plurality of synthetic image tiles that span the synthetic and at each of a plurality of offsets in a search region, a correlation score resulting in a plurality of correlation score arrays, determining a weighted combination of scores in the correlation score arrays resulting in a combined correlation score array, identifying an offset of the plurality of offsets based on the combined correlation score array, and moving the synthetic image relative to the 2D real image by the identified offset.
    Type: Application
    Filed: August 24, 2023
    Publication date: February 27, 2025
    Inventor: Richard W. Ely
  • Publication number: 20240428568
    Abstract: A method includes obtaining training data having first image pairs, where each of the first image pairs includes (i) a first training image and (ii) a first ground truth image. The method also includes training a machine learning model to generate realistic images using the first image pairs. The method further includes obtaining additional training data having second image pairs, where each of the second image pairs includes (i) a second training image and (ii) a second ground truth image. At least some of the images in the second image pairs are less aligned or of lower quality than at least some of the images in the first image pairs. In addition, the method includes continuing to train the machine learning model to generate the realistic images using the second image pairs.
    Type: Application
    Filed: June 23, 2023
    Publication date: December 26, 2024
    Inventors: Jonathan H. Goldstein, Lauren E. Turney, Richard W. Ely, Jody D. Verret, Brett N. Appleton
  • Patent number: 11964762
    Abstract: Subject matter regards generating a 3D point cloud and registering the 3D point cloud to the surface of the Earth (sometimes called “geo-locating”). A method can include capturing, by unmanned vehicles (UVs), image data representative of respective overlapping subsections of the object, registering the overlapping subsections to each other, and geo-locating the registered overlapping subsections.
    Type: Grant
    Filed: February 9, 2021
    Date of Patent: April 23, 2024
    Assignee: Raytheon Company
    Inventors: Torsten A. Staab, Steven B. Seida, Jody D. Verret, Richard W. Ely, Stephen J. Raif
  • Patent number: 11568638
    Abstract: A method can include identifying a geolocation of an object in an image, the method comprising receiving data indicating a pixel coordinate of the image selected by a user, identifying a data point in a targetable three-dimensional (3D) data set corresponding to the selected pixel coordinate, and providing a 3D location of the identified data point.
    Type: Grant
    Filed: September 14, 2020
    Date of Patent: January 31, 2023
    Assignee: Raytheon Company
    Inventors: Wyatt D. Sharp, III, Kathryn A. Welin, Jody D. Verret, Richard W. Ely, Stephen J. Raif
  • Patent number: 11538135
    Abstract: Discussed herein are devices, systems, and methods for multi-image ground control point (GCP) determination. A method can include extracting, from a first image including image data of a first geographical region, a first image template, the first image template including a contiguous subset of pixels from the first image and a first pixel of the first image indicated by the GCP, predicting a first pixel location of the GCP in a second image, the second image including image data of a second geographical overlapping with the first geographical region, extracting, from the second image, a second image template, the second image template including a contiguous subset of pixels from the second image and a second pixel corresponding to the pixel location, identifying a second pixel of the second image corresponding to a highest correlation score, and adding a second pixel location of the identified pixel to the GCP.
    Type: Grant
    Filed: February 25, 2020
    Date of Patent: December 27, 2022
    Assignee: Raytheon Company
    Inventors: Richard W. Ely, Jody D. Verret
  • Patent number: 11348310
    Abstract: Discussed herein are devices, systems, and methods for building mask generation. A method can include setting a respective pixel value of an image to a first specified value if the respective pixel corresponds, according to a three-dimensional (3D) point set, to an elevation greater than a specified Z threshold, otherwise setting the respective pixel value to a second, different specified value, grouping contiguous pixels set to the first specified value into one or more groups, determining a feature of each of the one or more groups, comparing the determined feature to a threshold and retaining the group if the feature is greater than a threshold, otherwise removing the group, and providing a building mask that includes pixels of the retained group set to a value and other pixels set to a different value.
    Type: Grant
    Filed: November 13, 2019
    Date of Patent: May 31, 2022
    Assignee: Raytheon Company
    Inventor: Richard W. Ely
  • Patent number: 11127145
    Abstract: Discussed herein are devices, systems, and methods for image processing. A method can include generating a synthetic image based on a two-dimensional (2D) image of the geographical region, performing a coarse registration to grossly, register the synthetic image to the 2D image, and performing a fine registration following the coarse registration to improve the registration between the synthetic image and the 2D image.
    Type: Grant
    Filed: July 10, 2019
    Date of Patent: September 21, 2021
    Assignee: Raytheon Company
    Inventor: Richard W. Ely
  • Publication number: 20210264561
    Abstract: Discussed herein are devices, systems, and methods for multi-image ground control point (GCP) determination. A method can include extracting, from a first image including image data of a first geographical region, a first image template, the first image template including a contiguous subset of pixels from the first image and a first pixel of the first image indicated by the GCP, predicting a first pixel location of the GCP in a second image, the second image including image data of a second geographical overlapping with the first geographical region, extracting, from the second image, a second image template, the second image template including a contiguous subset of pixels from the second image and a second pixel corresponding to the pixel location, identifying a second pixel of the second image corresponding to a highest correlation score, and adding a second pixel location of the identified pixel to the GCP.
    Type: Application
    Filed: February 25, 2020
    Publication date: August 26, 2021
    Inventors: Richard W. Ely, Jody D. Verret
  • Publication number: 20210256722
    Abstract: Subject matter regards generating a 3D point cloud and registering the 3D point cloud to the surface of the Earth (sometimes called “geo-locating”). A method can include capturing, by unmanned vehicles (UVs), image data representative of respective overlapping subsections of the object, registering the overlapping subsections to each other, and geo-locating the registered overlapping subsections.
    Type: Application
    Filed: February 9, 2021
    Publication date: August 19, 2021
    Inventors: Torsten A. Staab, Steven B. Seida, Jody D. Verret, Richard W. Ely, Stephen J. Raif
  • Patent number: 11087532
    Abstract: A system receives digital images of a geographic location, associates each digital image with ground control points in a set of reference stereo images, and associates each digital image to each other digital image via image to image tiepoints. The system updates a geometry of each image via a bundle adjustment, and uses a prioritized stacking order to establish piecewise linear seam lines between each of the images. The system finally builds a prioritized map in a mosaic space specifying the source image pixels that are used in each region of the output mosaic, and forms the mosaic image using the prioritized map.
    Type: Grant
    Filed: November 5, 2019
    Date of Patent: August 10, 2021
    Assignee: Raytheon Company
    Inventors: Jody D. Verret, Ali J. Arik, Richard W. Ely, Corey J. Collard, Jerry O. Moore, Robert M. Willer, Matthew A. Schaefer, Robert T. Pierce, Stephen J. Raif, Grant B. Boroughs, James G. Hayes, Kevin M. Grange, Robert V. Opalecky, Mark J. Graebner
  • Patent number: 11042998
    Abstract: Discussed herein are devices, systems, and methods for synthetic image generation. A method can include projecting a three-dimensional (3D) point set of a first geographical region to an image space of an image of a second geographical region to generate synthetic image data, identifying control points (CPs) between the image and the synthetic image data, adjusting a geometry of the synthetic image data based on the identified CPs, determining metadata for the synthetic image based on metadata of the image, and associating the determined metadata with the synthetic image data to generate the synthetic image.
    Type: Grant
    Filed: July 10, 2019
    Date of Patent: June 22, 2021
    Assignee: Raytheon Company
    Inventor: Richard W. Ely
  • Publication number: 20210142558
    Abstract: Discussed herein are devices, systems, and methods for building mask generation. A method can include setting a respective pixel value of an image to a first specified value if the respective pixel corresponds, according to a three-dimensional (3D) point set, to an elevation greater than a specified Z threshold, otherwise setting the respective pixel value to a second, different specified value, grouping contiguous pixels set to the first specified value into one or more groups, determining a feature of each of the one or more groups, comparing the determined feature to a threshold and retaining the group if the feature is greater than a threshold, otherwise removing the group, and providing a building mask that includes pixels of the retained group set to a value and other pixels set to a different value.
    Type: Application
    Filed: November 13, 2019
    Publication date: May 13, 2021
    Inventor: Richard W. Ely
  • Publication number: 20210134055
    Abstract: A system receives digital images of a geographic location, associates each digital image with ground control points in a set of reference stereo images, and associates each digital image to each other digital image via image to image tiepoints. The system updates a geometry of each image via a bundle adjustment, and uses a prioritized stacking order to establish piecewise linear seam lines between each of the images. The system finally builds a prioritized map in a mosaic space specifying the source image pixels that are used in each region of the output mosaic, and forms the mosaic image using the prioritized map.
    Type: Application
    Filed: November 5, 2019
    Publication date: May 6, 2021
    Inventors: Jody D. Verret, Ali J. Arik, Richard W. Ely, Corey J. Collard, Jerry O. Moore, Robert M. Willer, Matthew A. Schaefer, Robert T. Pierce, Stephen J. Raif, Grant B. Boroughs, James G. Hayes, Kevin M. Grange, Robert V. Opalecky, Mark J. Graebner
  • Patent number: 10970815
    Abstract: A method can include registering a first image of a region to a three-dimensional (3D) point set of the region to generate a registered first image, registering a second image of the region to the 3D point set to generate a registered second image, identifying, based on the 3D point set, geometric tie points of the registered first image and the registered second image, projecting, using an affine transformation determined based on the identified geometric tie points, pixels of the registered first image to an image space of the registered second image to generate a registered and transformed first image, and displaying the registered and transformed first image and the registered second image simultaneously.
    Type: Grant
    Filed: March 26, 2019
    Date of Patent: April 6, 2021
    Assignee: Raytheon Company
    Inventor: Richard W. Ely
  • Publication number: 20210097280
    Abstract: A method can include identifying a geolocation of an object in an image, the method comprising receiving data indicating a pixel coordinate of the image selected by a user, identifying a data point in a targetable three-dimensional (3D) data set corresponding to the selected pixel coordinate, and providing a 3D location of the identified data point.
    Type: Application
    Filed: September 14, 2020
    Publication date: April 1, 2021
    Inventors: Wyatt D. Sharp, III, Kathryn A. Welin, Jody D. Verret, Richard W. Ely, Stephen J. Raif
  • Patent number: 10943392
    Abstract: A method can include receiving, first and second digital elevation models (DEMs) including first elevation data of a geographic location and second elevation data of the geographic location, respectively, identifying differences between the first elevation data and the second elevation data that are greater than a first threshold, determining, for a point in the second elevation data identified to correspond to a difference greater than the first threshold, a slope of the geographic location around and including the point, and altering, in response to determining the difference is greater than a second threshold determined based on the determined slope, elevation data of the second DEM corresponding to the point.
    Type: Grant
    Filed: November 13, 2019
    Date of Patent: March 9, 2021
    Assignee: Raytheon Company
    Inventor: Richard W. Ely
  • Publication number: 20200193701
    Abstract: A method can include receiving, first and second digital elevation models (DEMs) including first elevation data of a geographic location and second elevation data of the geographic location, respectively, identifying differences between the first elevation data and the second elevation data that are greater than a first threshold, determining, for a point in the second elevation data identified to correspond to a difference greater than the first threshold, a slope of the geographic location around and including the point, and altering, in response to determining the difference is greater than a second threshold determined based on the determined slope, elevation data of the second DEM corresponding to the point.
    Type: Application
    Filed: November 13, 2019
    Publication date: June 18, 2020
    Inventor: Richard W. Ely