Patents by Inventor Stephen J. Raif

Stephen J. Raif has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 12051172
    Abstract: Systems and methods for VIIRS image processing. The method can include receiving image data of immediately adjacent VIIRS image scans including a first image scan and a second image scan. The first image scan and the second image scan provide a partially overlapping view of a geographic area. The method can further involve resampling columns of pixels of the first image scan and the second image scan. The resampling can include selecting, in the first image scan and the second image scan, a subset of pixel values in each column that correspond to a specified geographic distance. The method can further involve upsampling the selected pixels to an equal number of pixels in each column resulting in upsampled pixel values and interpolating the upsampled pixel values to produce modified first and second image scans.
    Type: Grant
    Filed: November 5, 2021
    Date of Patent: July 30, 2024
    Assignee: Raytheon Company
    Inventors: Philip A. Sallee, Stephen J. Raif, Nicole A. Haffke
  • Patent number: 11964762
    Abstract: Subject matter regards generating a 3D point cloud and registering the 3D point cloud to the surface of the Earth (sometimes called “geo-locating”). A method can include capturing, by unmanned vehicles (UVs), image data representative of respective overlapping subsections of the object, registering the overlapping subsections to each other, and geo-locating the registered overlapping subsections.
    Type: Grant
    Filed: February 9, 2021
    Date of Patent: April 23, 2024
    Assignee: Raytheon Company
    Inventors: Torsten A. Staab, Steven B. Seida, Jody D. Verret, Richard W. Ely, Stephen J. Raif
  • Patent number: 11682142
    Abstract: Subject matter regards colorizing a three-dimensional (3D) point set. A method of colorizing a 3D point can include voxelizing 3D points including the 3D point into voxels such that a voxel of the voxels including the 3D point includes a voxel subset of the 3D points, projecting the voxel subset to respective image spaces of first and second images used to generate the 3D points, and associating a color value, determined based on a respective number of pixels of the first and second images to which the voxel subset projects, with the 3D point.
    Type: Grant
    Filed: September 14, 2020
    Date of Patent: June 20, 2023
    Assignee: Raytheon Company
    Inventors: Stephen J. Raif, Allen Hainline
  • Publication number: 20230146360
    Abstract: Systems and methods for VIIRS image processing. The method can include receiving image data of immediately adjacent VIIRS image scans including a first image scan and a second image scan. The first image scan and the second image scan provide a partially overlapping view of a geographic area. The method can further involve resampling columns of pixels of the first image scan and the second image scan. The resampling can include selecting, in the first image scan and the second image scan, a subset of pixel values in each column that correspond to a specified geographic distance. The method can further involve upsampling the selected pixels to an equal number of pixels in each column resulting in upsampled pixel values and interpolating the upsampled pixel values to produce modified first and second image scans.
    Type: Application
    Filed: November 5, 2021
    Publication date: May 11, 2023
    Inventors: Philip A. Sallee, Stephen J. Raif, Nicole A. Haffke
  • Patent number: 11568638
    Abstract: A method can include identifying a geolocation of an object in an image, the method comprising receiving data indicating a pixel coordinate of the image selected by a user, identifying a data point in a targetable three-dimensional (3D) data set corresponding to the selected pixel coordinate, and providing a 3D location of the identified data point.
    Type: Grant
    Filed: September 14, 2020
    Date of Patent: January 31, 2023
    Assignee: Raytheon Company
    Inventors: Wyatt D. Sharp, III, Kathryn A. Welin, Jody D. Verret, Richard W. Ely, Stephen J. Raif
  • Patent number: 11468266
    Abstract: A machine receives a large image having large image dimensions that exceed memory threshold dimensions. The large image includes metadata. The machine adjusts an orientation and a scaling of the large image based on the metadata. The machine divides the large image into a plurality of image tiles, each image tile having tile dimensions smaller than or equal to the memory threshold dimensions. The machine provides the plurality of image tiles to an artificial neural network. The machine identifies, using the artificial neural network, at least a portion of the target in at least one image tile. The machine identifies the target in the large image based on at least the portion of the target being identified in at least one image tile.
    Type: Grant
    Filed: September 27, 2019
    Date of Patent: October 11, 2022
    Assignee: Raytheon Company
    Inventors: Jonathan Goldstein, Stephen J. Raif, Philip A. Sallee, Jeffrey S. Klein, Steven A. Israel, Franklin Tanner, Shane A. Zabel, James Talamonti, Lisa A. Mccoy
  • Patent number: 11170264
    Abstract: Subject matter regards improving image segmentation or image annotation. A method can include receiving, through a user interface (UI), for each class label of class labels to be identified by the ML model and for a proper subset of pixels of the image data, data indicating respective pixels associated with the class label, partially training the ML model based on the received data, generating, using the partially trained ML model, pseudo-labels for each pixel of the image data for which a class label has not been received, and receiving, through the UT, a further class label that corrects a pseudo-label of the generated pseudo-labels.
    Type: Grant
    Filed: May 31, 2019
    Date of Patent: November 9, 2021
    Assignee: Raytheon Company
    Inventors: Philip A. Sallee, Stephen J. Raif, James Talamonti
  • Publication number: 20210256722
    Abstract: Subject matter regards generating a 3D point cloud and registering the 3D point cloud to the surface of the Earth (sometimes called “geo-locating”). A method can include capturing, by unmanned vehicles (UVs), image data representative of respective overlapping subsections of the object, registering the overlapping subsections to each other, and geo-locating the registered overlapping subsections.
    Type: Application
    Filed: February 9, 2021
    Publication date: August 19, 2021
    Inventors: Torsten A. Staab, Steven B. Seida, Jody D. Verret, Richard W. Ely, Stephen J. Raif
  • Patent number: 11087532
    Abstract: A system receives digital images of a geographic location, associates each digital image with ground control points in a set of reference stereo images, and associates each digital image to each other digital image via image to image tiepoints. The system updates a geometry of each image via a bundle adjustment, and uses a prioritized stacking order to establish piecewise linear seam lines between each of the images. The system finally builds a prioritized map in a mosaic space specifying the source image pixels that are used in each region of the output mosaic, and forms the mosaic image using the prioritized map.
    Type: Grant
    Filed: November 5, 2019
    Date of Patent: August 10, 2021
    Assignee: Raytheon Company
    Inventors: Jody D. Verret, Ali J. Arik, Richard W. Ely, Corey J. Collard, Jerry O. Moore, Robert M. Willer, Matthew A. Schaefer, Robert T. Pierce, Stephen J. Raif, Grant B. Boroughs, James G. Hayes, Kevin M. Grange, Robert V. Opalecky, Mark J. Graebner
  • Publication number: 20210192789
    Abstract: Subject matter regards colorizing a three-dimensional (3D) point set. A method of colorizing a 3D point can include voxelizing 3D points including the 3D point into voxels such that a voxel of the voxels including the 3D point includes a voxel subset of the 3D points, projecting the voxel subset to respective image spaces of first and second images used to generate the 3D points, and associating a color value, determined based on a respective number of pixels of the first and second images to which the voxel subset projects, with the 3D point.
    Type: Application
    Filed: September 14, 2020
    Publication date: June 24, 2021
    Inventors: Stephen J. Raif, Allen Hainline
  • Publication number: 20210134055
    Abstract: A system receives digital images of a geographic location, associates each digital image with ground control points in a set of reference stereo images, and associates each digital image to each other digital image via image to image tiepoints. The system updates a geometry of each image via a bundle adjustment, and uses a prioritized stacking order to establish piecewise linear seam lines between each of the images. The system finally builds a prioritized map in a mosaic space specifying the source image pixels that are used in each region of the output mosaic, and forms the mosaic image using the prioritized map.
    Type: Application
    Filed: November 5, 2019
    Publication date: May 6, 2021
    Inventors: Jody D. Verret, Ali J. Arik, Richard W. Ely, Corey J. Collard, Jerry O. Moore, Robert M. Willer, Matthew A. Schaefer, Robert T. Pierce, Stephen J. Raif, Grant B. Boroughs, James G. Hayes, Kevin M. Grange, Robert V. Opalecky, Mark J. Graebner
  • Publication number: 20210097344
    Abstract: A machine receives a large image having large image dimensions that exceed memory threshold dimensions. The large image includes metadata. The machine adjusts an orientation and a scaling of the large image based on the metadata. The machine divides the large image into a plurality of image tiles, each image tile having tile dimensions smaller than or equal to the memory threshold dimensions. The machine provides the plurality of image tiles to an artificial neural network. The machine identifies, using the artificial neural network, at least a portion of the target in at least one image tile. The machine identifies the target in the large image based on at least the portion of the target being identified in at least one image tile.
    Type: Application
    Filed: September 27, 2019
    Publication date: April 1, 2021
    Inventors: Jonathan Goldstein, Stephen J. Raif, Philip A. Sallee, Jeffrey S. Klein, Steven A. Israel, Franklin Tanner, Shane A. Zabel, James Talamonti, Lisa A. Mccoy
  • Publication number: 20210097280
    Abstract: A method can include identifying a geolocation of an object in an image, the method comprising receiving data indicating a pixel coordinate of the image selected by a user, identifying a data point in a targetable three-dimensional (3D) data set corresponding to the selected pixel coordinate, and providing a 3D location of the identified data point.
    Type: Application
    Filed: September 14, 2020
    Publication date: April 1, 2021
    Inventors: Wyatt D. Sharp, III, Kathryn A. Welin, Jody D. Verret, Richard W. Ely, Stephen J. Raif
  • Patent number: 10957056
    Abstract: An image processing technique uses requirements for a geospatial distribution of image tie points for a triangulation of images. The images are correlated, thereby generating candidate tie points across the images. Statistical consistency checks are applied to the images to identify and dispose of the candidate tie points that are local outliers, and a geometric identification technique is applied to the images to identify and dispose of the candidate tie points that are global outliers. The candidate tie points that are not local outliers or global outliers are spatially down-selected such that the spatially down-selected candidate tie points satisfy the one or more requirements for the geospatial distribution.
    Type: Grant
    Filed: August 30, 2019
    Date of Patent: March 23, 2021
    Assignee: Raytheon Company
    Inventors: Grant B. Boroughs, Stephen J. Raif, Jody D. Verret
  • Publication number: 20210065386
    Abstract: An image processing technique uses requirements for a geospatial distribution of image tie points for a triangulation of images. The images are correlated, thereby generating candidate tie points across the images. Statistical consistency checks are applied to the images to identify and dispose of the candidate tie points that are local outliers, and a geometric identification technique is applied to the images to identify and dispose of the candidate tie points that are global outliers. The candidate tie points that are not local outliers or global outliers are spatially down-selected such that the spatially down-selected candidate tie points satisfy the one or more requirements for the geospatial distribution.
    Type: Application
    Filed: August 30, 2019
    Publication date: March 4, 2021
    Inventors: Grant B. Boroughs, Stephen J. Raif, Jody D. Verret
  • Patent number: 10930062
    Abstract: A computer vision method, executed by one or more processors, for generating a single 3D model view of a geographic scene includes: receiving image data for the scene from a plurality of sensors located at different angles with respect to the geographic scene; dividing the image data into a plurality of image spatial regions; correlating the image data in each image spatial region to obtain a score for each image data in each image spatial region; grouping the image data in each image spatial region into two or more image clusters, based on the scores for each image; performing a multi-ray intersection within each image cluster to obtain a 3D reference point for each region; for each region, combining the one or more clusters, based on the 3D reference point for the region; and registering the combined clusters for each region to obtain a single 3D model view of the scene.
    Type: Grant
    Filed: July 18, 2019
    Date of Patent: February 23, 2021
    Assignee: Raytheon Company
    Inventors: Jacob Wesely Gallaway, Jeremy Jens Gerhart, Stephen J. Raif, Jody Dale Verret
  • Publication number: 20210019937
    Abstract: A computer vision method, executed by one or more processors, for generating a single 3D model view of a geographic scene includes: receiving image data for the scene from a plurality of sensors located at different angles with respect to the geographic scene; dividing the image data into a plurality of image spatial regions; correlating the image data in each image spatial region to obtain a score for each image data in each image spatial region; grouping the image data in each image spatial region into two or more image clusters, based on the scores for each image; performing a multi-ray intersection within each image cluster to obtain a 3D reference point for each region; for each region, combining the one or more clusters, based on the 3D reference point for the region; and registering the combined clusters for each region to obtain a single 3D model view of the scene.
    Type: Application
    Filed: July 18, 2019
    Publication date: January 21, 2021
    Inventors: Jacob Wesely Gallaway, Jeremy Jens Gerhart, Stephen J. Raif, Jody Dale Verret
  • Publication number: 20200380304
    Abstract: Subject matter regards improving image segmentation or image annotation. A method can include receiving, through a user interface (UI), for each class label of class labels to be identified by the ML model and for a proper subset of pixels of the image data, data indicating respective pixels associated with the class label, partially training the ML model based on the received data, generating, using the partially trained ML model, pseudo-labels for each pixel of the image data for which a class label has not been received, and receiving, through the UT, a further class label that corrects a pseudo-label of the generated pseudo-labels.
    Type: Application
    Filed: May 31, 2019
    Publication date: December 3, 2020
    Inventors: Philip A. Sallee, Stephen J. Raif, James Talamonti
  • Patent number: 9430872
    Abstract: A system and method of generating point clouds from passive images. Image clusters are formed, wherein each image cluster includes two or more passive images selected from a set of passive images. Quality of the point cloud that could be generated from each image cluster is predicted for each image cluster based on a performance prediction score for each image cluster. A subset of image clusters is selected for further processing based on their performance prediction scores. A mission-specific quality score is determined for each point cloud generated and the point cloud with the highest quality score is selected for storage.
    Type: Grant
    Filed: March 7, 2014
    Date of Patent: August 30, 2016
    Assignee: Raytheon Company
    Inventors: Stephen J. Raif, John J. Coogan, Steven B. Seida, Paul L. Pryor, Carlton E. Nance, Wyatt D. Sharp, III, Jody D. Verret
  • Patent number: 9317968
    Abstract: The system and methods described herein operate on a plurality of images that include multiple views of the same scene, typically from slightly different viewing angles and/or lighting conditions. One of the images is selected as a reference image. For each image ray in a non-reference image, the system and methods resample a local region from the non-reference image's space to the reference image's space. The resampling is performed multiple times, each time with a different surface orientation hypothesis. The system and methods run cross-correlation style correlators on the resampled images, evaluate correlation scores for each of the resampled images, and select the surface orientation hypothesis associated with the highest correlation score. The system and methods project a peak of the correlation surface back through a geometry model for the selected surface orientation hypothesis to determine a three-dimensional (ground) location for the image ray.
    Type: Grant
    Filed: October 22, 2013
    Date of Patent: April 19, 2016
    Assignee: Raytheon Company
    Inventor: Stephen J. Raif