Patents by Inventor Stephen Charles Hsu
Stephen Charles Hsu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20080181487Abstract: A method and apparatus for high-resolution 3D imaging ladar system which can penetrate foliage and camouflage to sample fragments of concealed surfaces of interest is disclosed. Samples collected while the ladar moves can be integrated into a coherent object shape. In one embodiment, a system and method for automatic data-driven registration of ladar frames, comprises a coarse search stage, a pairwise fine registration stage using an iterated closest points algorithm, and a multi-view registration strategy. After alignment and aggregation, it is often difficult for human observers to find, assess and recognize objects from a point cloud display. Basic display manipulations, surface fitting techniques, and clutter suppression to enhance visual exploitation of 3D imaging ladar data may be utilized.Type: ApplicationFiled: June 25, 2007Publication date: July 31, 2008Inventors: Stephen Charles Hsu, Supun Samarasekera, Rakesh Kumar, Wen-Yi Zhao, Keith J. Hanna
-
Patent number: 7242460Abstract: A method and apparatus for high-resolution 3D imaging ladar system which can penetrate foliage and camouflage to sample fragments of concealed surfaces of interest is disclosed. Samples collected while the ladar moves can be integrated into a coherent object shape. In one embodiment, a system and method for automatic data-driven registration of ladar frames, comprises a coarse search stage, a pairwise fine registration stage using an iterated closest points algorithm, and a multi-view registration strategy. After alignment and aggregation, it is often difficult for human observers to find, assess and recognize objects from a point cloud display. Basic display manipulations, surface fitting techniques, and clutter suppression to enhance visual exploitation of 3D imaging ladar data may be utilized.Type: GrantFiled: April 16, 2004Date of Patent: July 10, 2007Assignee: Sarnoff CorporationInventors: Stephen Charles Hsu, Supun Samarasekera, Rakesh Kumar, Wen-Yi Zhao, Keith J. Hanna
-
Patent number: 7187809Abstract: A method and apparatus for performing two-dimensional video alignment onto three-dimensional point clouds. The system recovers camera pose from camera video, determines a depth map, converts the depth map to a Euclidean video point cloud, and registers two-dimensional video to the three-dimensional point clouds.Type: GrantFiled: June 10, 2005Date of Patent: March 6, 2007Assignee: Sarnoff CorporationInventors: Wenyi Zhao, David Nister, Stephen Charles Hsu
-
Publication number: 20030218674Abstract: A method and apparatus for performing georegistration using both a telemetry based rendering technique and an interative rendering technique. The method begins with a telemetry based rendering that produces reference imagery that substantially matches a view being imaged by the camera. The reference imagery is rendered using the telemetry of the present camera orientation. Upon obtaining a certain level of accuracy, the method proceeds to perform iterative rendering. During iterative rendering, the method uses image motion information from the video to enhance rendering of the reference imagery. A further embodiment uses sequential statistical framework to provide a unified approach to georegistration.Type: ApplicationFiled: May 22, 2003Publication date: November 27, 2003Applicant: Sarnoff CorporationInventors: Wenyi Zhao, Bogdan Matei, Ying Shan, Stephen Charles Hsu, Michael W. Hansen
-
Patent number: 6597818Abstract: A system and method for accurately mapping between image coordinates and geo-coordinates, called geo-spatial registration. The system utilizes the imagery and terrain information contained in the geo-spatial database to precisely align geodetically calibrated reference imagery with an input image, e.g., dynamically generated video images, and thus achieve a high accuracy identification of locations within the scene. When a sensor, such as a video camera, images a scene contained in the geo-spatial database, the system recalls a reference image pertaining to the imaged scene. This reference image is aligned very accurately with the sensor's images using a parametric transformation. Thereafter, other information that is associated with the reference image can easily be overlaid upon or otherwise associated with the sensor imagery.Type: GrantFiled: March 9, 2001Date of Patent: July 22, 2003Assignee: Sarnoff CorporationInventors: Rakesh Kumar, Stephen Charles Hsu, Keith Hanna, Supun Samarasekera, Richard Patrick Wildes, David James Hirvonen, Thomas Edward Klinedinst, William Brian Lehman, Bodgan Matei, Wenyi Zhao, Barbara Levienaise-Obadia
-
Patent number: 6587601Abstract: A system and method for accurately mapping between camera coordinates and geo-coordinates, called geo-spatial registration, using a Euclidean model. The system utilizes the imagery and terrain information contained in the geo-spatial database to precisely align geographically calibrated reference imagery with an input image, e.g., dynamically generated video images, and thus achieve a high accuracy identification of locations within the scene. When a sensor, such as a video camera, images a scene contained in the geo-spatial database, the system recalls a reference image pertaining to the imaged scene. This reference image is aligned very accurately with the sensor's images using a parametric transformation produced by a Euclidean model. Thereafter, other information that is associated with the reference image can easily be overlaid upon or otherwise associated with the sensor imagery.Type: GrantFiled: June 28, 2000Date of Patent: July 1, 2003Assignee: Sarnoff CorporationInventors: Stephen Charles Hsu, Supun Samarasekera
-
Patent number: 6512857Abstract: A system and method for accurately mapping between camera coordinates and geo-coordinates, called geo-spatial registration. The system utilizes the imagery and terrain information contained in the geo-spatial database to precisely align geographically calibrated reference imagery with an input image, e.g., dynamically generated video images, and thus achieve a high accuracy identification of locations within the scene. When a sensor, such as a video camera, images a scene contained in the geo-spatial database, the system recalls a reference image pertaining to the imaged scene. This reference image is aligned very accurately with the sensor's images using a parametric transformation. Thereafter, other information that is associated with the reference image can easily be overlaid upon or otherwise associated with the sensor imagery.Type: GrantFiled: May 8, 1998Date of Patent: January 28, 2003Assignee: Sarnoff CorporationInventors: Stephen Charles Hsu, Rakesh Kumar, Harpreet Singh Sawhney, Jane Asmuth
-
Publication number: 20030014224Abstract: A method and apparatus for automatically combining aerial images and oblique images to form a three-dimensional (3D) site model. The apparatus or method is supplied with aerial and oblique imagery. The imagery is processed to identify building boundaries and outlines as well as to produce a depth map. The building boundaries and the depth map may be combined to form a 3D plan view model or used separately as a 2D plan view model. The imagery and plan view model is further processed to determine roof models for the buildings in the scene. The result is a 3D site model having buildings represented rectangular boxes with accurately defined roof shapes.Type: ApplicationFiled: July 8, 2002Publication date: January 16, 2003Inventors: Yanlin Guo, Rakesh Kumar, Stephen Charles Hsu, Harpreet Singh Sawhney
-
Patent number: 6393163Abstract: A system for automatically generating a mosaic from a plurality of input images. The system sequentially executes an image alignment process, an editing process, and a combining process such that, from a sequence of images, the system automatically produces a seamless mosaic for various applications. Illustrative applications for the mosaic include: (1) a mosaic based display system including an image printing system, (2) a surveillance system and (3) a mosaic based compression system. The mosaic based display system permits a system user to display, manipulate and alter a mosaic. The mosaic based compression system exploits the temporal and spatial redundancy in image sequences and efficiently compresses the image information. The compression system can be used for compressing image information for storage in a storage device or can be used for compressing image information for transmission through a band-limited transmission channel.Type: GrantFiled: December 2, 1999Date of Patent: May 21, 2002Assignee: Sarnoff CorporationInventors: Peter J. Burt, Michal Irani, Stephen Charles Hsu, Padmanabhan Anandan, Michael W. Hansen
-
Publication number: 20010038718Abstract: A system and method for accurately mapping between image coordinates and geo-coordinates, called geo-spatial registration. The system utilizes the imagery and terrain information contained in the geo-spatial database to precisely align geodetically calibrated reference imagery with an input image, e.g., dynamically generated video images, and thus achieve a high accuracy identification of locations within the scene. When a sensor, such as a video camera, images a scene contained in the geo-spatial database, the system recalls a reference image pertaining to the imaged scene. This reference image is aligned very accurately with the sensor's images using a parametric transformation. Thereafter, other information that is associated with the reference image can easily be overlaid upon or otherwise associated with the sensor imagery.Type: ApplicationFiled: March 9, 2001Publication date: November 8, 2001Inventors: Rakesh Kumar, Stephen Charles Hsu, Keith Hanna, Supun Samarasekera, Richard Patrick Wildes, David James Hirvonen, Thomas Edward Klinedinst, William Brian Lehman, Bodgan Matei, Wenyi Zhao, Barbara Levienaise-Obadia
-
Patent number: 6078701Abstract: A method and apparatus that determines the topology of a sequence of images and then globally aligns the images with respect to each image's neighboring images. The apparatus includes a topology determination module, a local coarse registration module, a local fine registration module, a global consistency module, and a color matching/blending module. To accurately render a mosaic image from a sequence of images the topology determination and global alignment processes are iterated to progressively produce accurately aligned images. The apparatus efficiently and accurately combines a plurality of source images into a seamless panoramic mosaic representation of a scene, of arbitrarily wide spatial and angular extent, regardless of the order of image acquisition.Type: GrantFiled: May 29, 1998Date of Patent: June 20, 2000Assignee: Sarnoff CorporationInventors: Stephen Charles Hsu, Rakesh Kumar, Harpreet Singh Sawhney, James R. Bergen, Doug Dixon, Vince Paragano, Gary Gendel
-
Patent number: 5999662Abstract: A system for automatically generating a mosaic from a plurality of input images. The system sequentially executes an image alignment process, an editing process, and a combining process such that, from a sequence of images, the system automatically produces a seamless mosaic for various applications. Illustrative applications for the mosaic include: (1) a mosaic based display system including an image printing system, (2) a surveillance system and (3) a mosaic based compression system. The mosaic based display system permits a system user to display, manipulate and alter a mosaic. The mosaic based compression system exploits the temporal and spatial redundancy in image sequences and efficiently compresses the image information. The compression system can be used for compressing image information for storage in a storage device or can be used for compressing image information for transmission through a band-limited transmission channel.Type: GrantFiled: December 18, 1998Date of Patent: December 7, 1999Assignee: Sarnoff CorporationInventors: Peter J. Burt, Michal Irani, Stephen Charles Hsu, Padmanabhan Anandan, Michael W. Hansen
-
Patent number: 5991444Abstract: A system for automatically generating a mosaic from a plurality of input images. The system sequentially executes an image alignment process, an editing process, and a combining process such that, from a sequence of images, the system automatically produces a seamless mosaic for various applications. Illustrative applications for the mosaic include: (1) a mosaic based display system including an image printing system, (2) a surveillance system and (3) a mosaic based compression system. The mosaic based display system permits a system user to display, manipulate and alter a mosaic. The mosaic based compression system exploits the temporal and spatial redundancy in image sequences and efficiently compresses the image information. The compression system can be used for compressing image information for storage in a storage device or can be used for compressing image information for transmission through a band-limited transmission channel.Type: GrantFiled: June 25, 1997Date of Patent: November 23, 1999Assignee: Sarnoff CorporationInventors: Peter J. Burt, Michal Irani, Stephen Charles Hsu, Padmanabhan Anandan, Michael W. Hansen
-
Patent number: 5847755Abstract: Method and apparatus for processing a sequence of images to detect object movement within the sequence. Specifically, the method comprises the steps of: (a) supplying a sequence of image frames; (b) initializing a reference image that contains image information regarding stationary objects within a scene represented by the sequence of images; (c) supplying a next image frame which temporally follows the sequence of image frames; (d) comparing the next image to the reference image to produce a motion image representing motion information regarding movement of objects within the scene; (e) updating the reference image with information within the next image that represents stationary objects within the scene; and (f) repeating steps (c), (d), and (e) for each next image supplied. The method is implemented by image processing apparatus.Type: GrantFiled: December 11, 1996Date of Patent: December 8, 1998Assignee: Sarnoff CorporationInventors: Lambert Ernest Wixson, Stephen Charles Hsu
-
Patent number: 5751836Abstract: Iris recognition is achieved by (1) iris acquisition that permits a user to self-position his or her eye into an imager's field of view without the need for any physical contact, (2) spatially locating the data defining that portion of a digitized video image of the user's eye that defines solely the iris thereof without any initial spatial condition of the iris being provided, and (3) pattern matching the spatially located data defining the iris of the user's eye with stored data defining a model iris by employing normalized spatial correlation for first comparing, at each of a plurality of spatial scales, each of distinctive spatial characteristics of the respective irises that are spatially registered with one another to quantitatively determine, at each of the plurality of spatial scales, a goodness value of match at that spatial scale, and then judging whether or not the pattern which manifests solely the iris of the user's eye matches the digital data which manifests solely the model iris in accordanceType: GrantFiled: September 27, 1996Date of Patent: May 12, 1998Assignee: David Sarnoff Research Center Inc.Inventors: Richard Patrick Wildes, Jane Circle Asmuth, Keith James Hanna, Stephen Charles Hsu, Raymond Joseph Kolczynski, James Regis Matey, Sterling Eduard McBride
-
Patent number: 5742710Abstract: A block-matching method for generating motion vectors performs block matching on successively higher resolution images by refining motion vectors determined in a lower resolution image. At respective higher resolution images, search areas of limited search range are defined via a motion vector associated with corresponding image areas in the immediately lower resolution search. For at least one level of image resolution, the search blocks are overlapped to provide a plurality of search areas of limited search range for performing block matching searches for each block in the next higher resolution level.Type: GrantFiled: July 11, 1995Date of Patent: April 21, 1998Assignee: RCA Thomson Licensing CorporationInventors: Stephen Charles Hsu, Padmanabhan Anandan
-
Patent number: 5649032Abstract: A system for automatically generating a mosaic from a plurality of input images. The system sequentially executes an image alignment process, an editing process, and a combining process such that, from a sequence of images, the system automatically produces a seamless mosaic for various applications. Illustrative applications for the mosaic include: (1) a mosaic based display system including an image printing system, (2) a surveillance system and (3) a mosaic based compression system. The mosaic based display system permits a system user to display, manipulate and alter a mosaic. The mosaic based compression system exploits the temporal and spatial redundancy in image sequences and efficiently compresses the image information. The compression system can be used for compressing image information for storage in a storage device or can be used for compressing image information for transmission through a band-limited transmission channel.Type: GrantFiled: November 14, 1994Date of Patent: July 15, 1997Assignee: David Sarnoff Research Center, Inc.Inventors: Peter J. Burt, Michal Irani, Stephen Charles Hsu, Padmanabhan Anandan, Michael W. Hansen