Patents by Inventor Stephen J. Raif
Stephen J. Raif has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 12051172Abstract: Systems and methods for VIIRS image processing. The method can include receiving image data of immediately adjacent VIIRS image scans including a first image scan and a second image scan. The first image scan and the second image scan provide a partially overlapping view of a geographic area. The method can further involve resampling columns of pixels of the first image scan and the second image scan. The resampling can include selecting, in the first image scan and the second image scan, a subset of pixel values in each column that correspond to a specified geographic distance. The method can further involve upsampling the selected pixels to an equal number of pixels in each column resulting in upsampled pixel values and interpolating the upsampled pixel values to produce modified first and second image scans.Type: GrantFiled: November 5, 2021Date of Patent: July 30, 2024Assignee: Raytheon CompanyInventors: Philip A. Sallee, Stephen J. Raif, Nicole A. Haffke
-
Patent number: 11964762Abstract: Subject matter regards generating a 3D point cloud and registering the 3D point cloud to the surface of the Earth (sometimes called “geo-locating”). A method can include capturing, by unmanned vehicles (UVs), image data representative of respective overlapping subsections of the object, registering the overlapping subsections to each other, and geo-locating the registered overlapping subsections.Type: GrantFiled: February 9, 2021Date of Patent: April 23, 2024Assignee: Raytheon CompanyInventors: Torsten A. Staab, Steven B. Seida, Jody D. Verret, Richard W. Ely, Stephen J. Raif
-
Patent number: 11682142Abstract: Subject matter regards colorizing a three-dimensional (3D) point set. A method of colorizing a 3D point can include voxelizing 3D points including the 3D point into voxels such that a voxel of the voxels including the 3D point includes a voxel subset of the 3D points, projecting the voxel subset to respective image spaces of first and second images used to generate the 3D points, and associating a color value, determined based on a respective number of pixels of the first and second images to which the voxel subset projects, with the 3D point.Type: GrantFiled: September 14, 2020Date of Patent: June 20, 2023Assignee: Raytheon CompanyInventors: Stephen J. Raif, Allen Hainline
-
Publication number: 20230146360Abstract: Systems and methods for VIIRS image processing. The method can include receiving image data of immediately adjacent VIIRS image scans including a first image scan and a second image scan. The first image scan and the second image scan provide a partially overlapping view of a geographic area. The method can further involve resampling columns of pixels of the first image scan and the second image scan. The resampling can include selecting, in the first image scan and the second image scan, a subset of pixel values in each column that correspond to a specified geographic distance. The method can further involve upsampling the selected pixels to an equal number of pixels in each column resulting in upsampled pixel values and interpolating the upsampled pixel values to produce modified first and second image scans.Type: ApplicationFiled: November 5, 2021Publication date: May 11, 2023Inventors: Philip A. Sallee, Stephen J. Raif, Nicole A. Haffke
-
Patent number: 11568638Abstract: A method can include identifying a geolocation of an object in an image, the method comprising receiving data indicating a pixel coordinate of the image selected by a user, identifying a data point in a targetable three-dimensional (3D) data set corresponding to the selected pixel coordinate, and providing a 3D location of the identified data point.Type: GrantFiled: September 14, 2020Date of Patent: January 31, 2023Assignee: Raytheon CompanyInventors: Wyatt D. Sharp, III, Kathryn A. Welin, Jody D. Verret, Richard W. Ely, Stephen J. Raif
-
Patent number: 11468266Abstract: A machine receives a large image having large image dimensions that exceed memory threshold dimensions. The large image includes metadata. The machine adjusts an orientation and a scaling of the large image based on the metadata. The machine divides the large image into a plurality of image tiles, each image tile having tile dimensions smaller than or equal to the memory threshold dimensions. The machine provides the plurality of image tiles to an artificial neural network. The machine identifies, using the artificial neural network, at least a portion of the target in at least one image tile. The machine identifies the target in the large image based on at least the portion of the target being identified in at least one image tile.Type: GrantFiled: September 27, 2019Date of Patent: October 11, 2022Assignee: Raytheon CompanyInventors: Jonathan Goldstein, Stephen J. Raif, Philip A. Sallee, Jeffrey S. Klein, Steven A. Israel, Franklin Tanner, Shane A. Zabel, James Talamonti, Lisa A. Mccoy
-
Patent number: 11170264Abstract: Subject matter regards improving image segmentation or image annotation. A method can include receiving, through a user interface (UI), for each class label of class labels to be identified by the ML model and for a proper subset of pixels of the image data, data indicating respective pixels associated with the class label, partially training the ML model based on the received data, generating, using the partially trained ML model, pseudo-labels for each pixel of the image data for which a class label has not been received, and receiving, through the UT, a further class label that corrects a pseudo-label of the generated pseudo-labels.Type: GrantFiled: May 31, 2019Date of Patent: November 9, 2021Assignee: Raytheon CompanyInventors: Philip A. Sallee, Stephen J. Raif, James Talamonti
-
Publication number: 20210256722Abstract: Subject matter regards generating a 3D point cloud and registering the 3D point cloud to the surface of the Earth (sometimes called “geo-locating”). A method can include capturing, by unmanned vehicles (UVs), image data representative of respective overlapping subsections of the object, registering the overlapping subsections to each other, and geo-locating the registered overlapping subsections.Type: ApplicationFiled: February 9, 2021Publication date: August 19, 2021Inventors: Torsten A. Staab, Steven B. Seida, Jody D. Verret, Richard W. Ely, Stephen J. Raif
-
Patent number: 11087532Abstract: A system receives digital images of a geographic location, associates each digital image with ground control points in a set of reference stereo images, and associates each digital image to each other digital image via image to image tiepoints. The system updates a geometry of each image via a bundle adjustment, and uses a prioritized stacking order to establish piecewise linear seam lines between each of the images. The system finally builds a prioritized map in a mosaic space specifying the source image pixels that are used in each region of the output mosaic, and forms the mosaic image using the prioritized map.Type: GrantFiled: November 5, 2019Date of Patent: August 10, 2021Assignee: Raytheon CompanyInventors: Jody D. Verret, Ali J. Arik, Richard W. Ely, Corey J. Collard, Jerry O. Moore, Robert M. Willer, Matthew A. Schaefer, Robert T. Pierce, Stephen J. Raif, Grant B. Boroughs, James G. Hayes, Kevin M. Grange, Robert V. Opalecky, Mark J. Graebner
-
Publication number: 20210192789Abstract: Subject matter regards colorizing a three-dimensional (3D) point set. A method of colorizing a 3D point can include voxelizing 3D points including the 3D point into voxels such that a voxel of the voxels including the 3D point includes a voxel subset of the 3D points, projecting the voxel subset to respective image spaces of first and second images used to generate the 3D points, and associating a color value, determined based on a respective number of pixels of the first and second images to which the voxel subset projects, with the 3D point.Type: ApplicationFiled: September 14, 2020Publication date: June 24, 2021Inventors: Stephen J. Raif, Allen Hainline
-
Publication number: 20210134055Abstract: A system receives digital images of a geographic location, associates each digital image with ground control points in a set of reference stereo images, and associates each digital image to each other digital image via image to image tiepoints. The system updates a geometry of each image via a bundle adjustment, and uses a prioritized stacking order to establish piecewise linear seam lines between each of the images. The system finally builds a prioritized map in a mosaic space specifying the source image pixels that are used in each region of the output mosaic, and forms the mosaic image using the prioritized map.Type: ApplicationFiled: November 5, 2019Publication date: May 6, 2021Inventors: Jody D. Verret, Ali J. Arik, Richard W. Ely, Corey J. Collard, Jerry O. Moore, Robert M. Willer, Matthew A. Schaefer, Robert T. Pierce, Stephen J. Raif, Grant B. Boroughs, James G. Hayes, Kevin M. Grange, Robert V. Opalecky, Mark J. Graebner
-
Publication number: 20210097344Abstract: A machine receives a large image having large image dimensions that exceed memory threshold dimensions. The large image includes metadata. The machine adjusts an orientation and a scaling of the large image based on the metadata. The machine divides the large image into a plurality of image tiles, each image tile having tile dimensions smaller than or equal to the memory threshold dimensions. The machine provides the plurality of image tiles to an artificial neural network. The machine identifies, using the artificial neural network, at least a portion of the target in at least one image tile. The machine identifies the target in the large image based on at least the portion of the target being identified in at least one image tile.Type: ApplicationFiled: September 27, 2019Publication date: April 1, 2021Inventors: Jonathan Goldstein, Stephen J. Raif, Philip A. Sallee, Jeffrey S. Klein, Steven A. Israel, Franklin Tanner, Shane A. Zabel, James Talamonti, Lisa A. Mccoy
-
Publication number: 20210097280Abstract: A method can include identifying a geolocation of an object in an image, the method comprising receiving data indicating a pixel coordinate of the image selected by a user, identifying a data point in a targetable three-dimensional (3D) data set corresponding to the selected pixel coordinate, and providing a 3D location of the identified data point.Type: ApplicationFiled: September 14, 2020Publication date: April 1, 2021Inventors: Wyatt D. Sharp, III, Kathryn A. Welin, Jody D. Verret, Richard W. Ely, Stephen J. Raif
-
Patent number: 10957056Abstract: An image processing technique uses requirements for a geospatial distribution of image tie points for a triangulation of images. The images are correlated, thereby generating candidate tie points across the images. Statistical consistency checks are applied to the images to identify and dispose of the candidate tie points that are local outliers, and a geometric identification technique is applied to the images to identify and dispose of the candidate tie points that are global outliers. The candidate tie points that are not local outliers or global outliers are spatially down-selected such that the spatially down-selected candidate tie points satisfy the one or more requirements for the geospatial distribution.Type: GrantFiled: August 30, 2019Date of Patent: March 23, 2021Assignee: Raytheon CompanyInventors: Grant B. Boroughs, Stephen J. Raif, Jody D. Verret
-
Publication number: 20210065386Abstract: An image processing technique uses requirements for a geospatial distribution of image tie points for a triangulation of images. The images are correlated, thereby generating candidate tie points across the images. Statistical consistency checks are applied to the images to identify and dispose of the candidate tie points that are local outliers, and a geometric identification technique is applied to the images to identify and dispose of the candidate tie points that are global outliers. The candidate tie points that are not local outliers or global outliers are spatially down-selected such that the spatially down-selected candidate tie points satisfy the one or more requirements for the geospatial distribution.Type: ApplicationFiled: August 30, 2019Publication date: March 4, 2021Inventors: Grant B. Boroughs, Stephen J. Raif, Jody D. Verret
-
Patent number: 10930062Abstract: A computer vision method, executed by one or more processors, for generating a single 3D model view of a geographic scene includes: receiving image data for the scene from a plurality of sensors located at different angles with respect to the geographic scene; dividing the image data into a plurality of image spatial regions; correlating the image data in each image spatial region to obtain a score for each image data in each image spatial region; grouping the image data in each image spatial region into two or more image clusters, based on the scores for each image; performing a multi-ray intersection within each image cluster to obtain a 3D reference point for each region; for each region, combining the one or more clusters, based on the 3D reference point for the region; and registering the combined clusters for each region to obtain a single 3D model view of the scene.Type: GrantFiled: July 18, 2019Date of Patent: February 23, 2021Assignee: Raytheon CompanyInventors: Jacob Wesely Gallaway, Jeremy Jens Gerhart, Stephen J. Raif, Jody Dale Verret
-
Publication number: 20210019937Abstract: A computer vision method, executed by one or more processors, for generating a single 3D model view of a geographic scene includes: receiving image data for the scene from a plurality of sensors located at different angles with respect to the geographic scene; dividing the image data into a plurality of image spatial regions; correlating the image data in each image spatial region to obtain a score for each image data in each image spatial region; grouping the image data in each image spatial region into two or more image clusters, based on the scores for each image; performing a multi-ray intersection within each image cluster to obtain a 3D reference point for each region; for each region, combining the one or more clusters, based on the 3D reference point for the region; and registering the combined clusters for each region to obtain a single 3D model view of the scene.Type: ApplicationFiled: July 18, 2019Publication date: January 21, 2021Inventors: Jacob Wesely Gallaway, Jeremy Jens Gerhart, Stephen J. Raif, Jody Dale Verret
-
Publication number: 20200380304Abstract: Subject matter regards improving image segmentation or image annotation. A method can include receiving, through a user interface (UI), for each class label of class labels to be identified by the ML model and for a proper subset of pixels of the image data, data indicating respective pixels associated with the class label, partially training the ML model based on the received data, generating, using the partially trained ML model, pseudo-labels for each pixel of the image data for which a class label has not been received, and receiving, through the UT, a further class label that corrects a pseudo-label of the generated pseudo-labels.Type: ApplicationFiled: May 31, 2019Publication date: December 3, 2020Inventors: Philip A. Sallee, Stephen J. Raif, James Talamonti
-
Patent number: 9430872Abstract: A system and method of generating point clouds from passive images. Image clusters are formed, wherein each image cluster includes two or more passive images selected from a set of passive images. Quality of the point cloud that could be generated from each image cluster is predicted for each image cluster based on a performance prediction score for each image cluster. A subset of image clusters is selected for further processing based on their performance prediction scores. A mission-specific quality score is determined for each point cloud generated and the point cloud with the highest quality score is selected for storage.Type: GrantFiled: March 7, 2014Date of Patent: August 30, 2016Assignee: Raytheon CompanyInventors: Stephen J. Raif, John J. Coogan, Steven B. Seida, Paul L. Pryor, Carlton E. Nance, Wyatt D. Sharp, III, Jody D. Verret
-
Patent number: 9317968Abstract: The system and methods described herein operate on a plurality of images that include multiple views of the same scene, typically from slightly different viewing angles and/or lighting conditions. One of the images is selected as a reference image. For each image ray in a non-reference image, the system and methods resample a local region from the non-reference image's space to the reference image's space. The resampling is performed multiple times, each time with a different surface orientation hypothesis. The system and methods run cross-correlation style correlators on the resampled images, evaluate correlation scores for each of the resampled images, and select the surface orientation hypothesis associated with the highest correlation score. The system and methods project a peak of the correlation surface back through a geometry model for the selected surface orientation hypothesis to determine a three-dimensional (ground) location for the image ray.Type: GrantFiled: October 22, 2013Date of Patent: April 19, 2016Assignee: Raytheon CompanyInventor: Stephen J. Raif