Patents by Inventor Stephen Charles Hsu

Stephen Charles Hsu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20080181487
    Abstract: A method and apparatus for high-resolution 3D imaging ladar system which can penetrate foliage and camouflage to sample fragments of concealed surfaces of interest is disclosed. Samples collected while the ladar moves can be integrated into a coherent object shape. In one embodiment, a system and method for automatic data-driven registration of ladar frames, comprises a coarse search stage, a pairwise fine registration stage using an iterated closest points algorithm, and a multi-view registration strategy. After alignment and aggregation, it is often difficult for human observers to find, assess and recognize objects from a point cloud display. Basic display manipulations, surface fitting techniques, and clutter suppression to enhance visual exploitation of 3D imaging ladar data may be utilized.
    Type: Application
    Filed: June 25, 2007
    Publication date: July 31, 2008
    Inventors: Stephen Charles Hsu, Supun Samarasekera, Rakesh Kumar, Wen-Yi Zhao, Keith J. Hanna
  • Patent number: 7242460
    Abstract: A method and apparatus for high-resolution 3D imaging ladar system which can penetrate foliage and camouflage to sample fragments of concealed surfaces of interest is disclosed. Samples collected while the ladar moves can be integrated into a coherent object shape. In one embodiment, a system and method for automatic data-driven registration of ladar frames, comprises a coarse search stage, a pairwise fine registration stage using an iterated closest points algorithm, and a multi-view registration strategy. After alignment and aggregation, it is often difficult for human observers to find, assess and recognize objects from a point cloud display. Basic display manipulations, surface fitting techniques, and clutter suppression to enhance visual exploitation of 3D imaging ladar data may be utilized.
    Type: Grant
    Filed: April 16, 2004
    Date of Patent: July 10, 2007
    Assignee: Sarnoff Corporation
    Inventors: Stephen Charles Hsu, Supun Samarasekera, Rakesh Kumar, Wen-Yi Zhao, Keith J. Hanna
  • Patent number: 7187809
    Abstract: A method and apparatus for performing two-dimensional video alignment onto three-dimensional point clouds. The system recovers camera pose from camera video, determines a depth map, converts the depth map to a Euclidean video point cloud, and registers two-dimensional video to the three-dimensional point clouds.
    Type: Grant
    Filed: June 10, 2005
    Date of Patent: March 6, 2007
    Assignee: Sarnoff Corporation
    Inventors: Wenyi Zhao, David Nister, Stephen Charles Hsu
  • Publication number: 20030218674
    Abstract: A method and apparatus for performing georegistration using both a telemetry based rendering technique and an interative rendering technique. The method begins with a telemetry based rendering that produces reference imagery that substantially matches a view being imaged by the camera. The reference imagery is rendered using the telemetry of the present camera orientation. Upon obtaining a certain level of accuracy, the method proceeds to perform iterative rendering. During iterative rendering, the method uses image motion information from the video to enhance rendering of the reference imagery. A further embodiment uses sequential statistical framework to provide a unified approach to georegistration.
    Type: Application
    Filed: May 22, 2003
    Publication date: November 27, 2003
    Applicant: Sarnoff Corporation
    Inventors: Wenyi Zhao, Bogdan Matei, Ying Shan, Stephen Charles Hsu, Michael W. Hansen
  • Patent number: 6597818
    Abstract: A system and method for accurately mapping between image coordinates and geo-coordinates, called geo-spatial registration. The system utilizes the imagery and terrain information contained in the geo-spatial database to precisely align geodetically calibrated reference imagery with an input image, e.g., dynamically generated video images, and thus achieve a high accuracy identification of locations within the scene. When a sensor, such as a video camera, images a scene contained in the geo-spatial database, the system recalls a reference image pertaining to the imaged scene. This reference image is aligned very accurately with the sensor's images using a parametric transformation. Thereafter, other information that is associated with the reference image can easily be overlaid upon or otherwise associated with the sensor imagery.
    Type: Grant
    Filed: March 9, 2001
    Date of Patent: July 22, 2003
    Assignee: Sarnoff Corporation
    Inventors: Rakesh Kumar, Stephen Charles Hsu, Keith Hanna, Supun Samarasekera, Richard Patrick Wildes, David James Hirvonen, Thomas Edward Klinedinst, William Brian Lehman, Bodgan Matei, Wenyi Zhao, Barbara Levienaise-Obadia
  • Patent number: 6587601
    Abstract: A system and method for accurately mapping between camera coordinates and geo-coordinates, called geo-spatial registration, using a Euclidean model. The system utilizes the imagery and terrain information contained in the geo-spatial database to precisely align geographically calibrated reference imagery with an input image, e.g., dynamically generated video images, and thus achieve a high accuracy identification of locations within the scene. When a sensor, such as a video camera, images a scene contained in the geo-spatial database, the system recalls a reference image pertaining to the imaged scene. This reference image is aligned very accurately with the sensor's images using a parametric transformation produced by a Euclidean model. Thereafter, other information that is associated with the reference image can easily be overlaid upon or otherwise associated with the sensor imagery.
    Type: Grant
    Filed: June 28, 2000
    Date of Patent: July 1, 2003
    Assignee: Sarnoff Corporation
    Inventors: Stephen Charles Hsu, Supun Samarasekera
  • Patent number: 6512857
    Abstract: A system and method for accurately mapping between camera coordinates and geo-coordinates, called geo-spatial registration. The system utilizes the imagery and terrain information contained in the geo-spatial database to precisely align geographically calibrated reference imagery with an input image, e.g., dynamically generated video images, and thus achieve a high accuracy identification of locations within the scene. When a sensor, such as a video camera, images a scene contained in the geo-spatial database, the system recalls a reference image pertaining to the imaged scene. This reference image is aligned very accurately with the sensor's images using a parametric transformation. Thereafter, other information that is associated with the reference image can easily be overlaid upon or otherwise associated with the sensor imagery.
    Type: Grant
    Filed: May 8, 1998
    Date of Patent: January 28, 2003
    Assignee: Sarnoff Corporation
    Inventors: Stephen Charles Hsu, Rakesh Kumar, Harpreet Singh Sawhney, Jane Asmuth
  • Publication number: 20030014224
    Abstract: A method and apparatus for automatically combining aerial images and oblique images to form a three-dimensional (3D) site model. The apparatus or method is supplied with aerial and oblique imagery. The imagery is processed to identify building boundaries and outlines as well as to produce a depth map. The building boundaries and the depth map may be combined to form a 3D plan view model or used separately as a 2D plan view model. The imagery and plan view model is further processed to determine roof models for the buildings in the scene. The result is a 3D site model having buildings represented rectangular boxes with accurately defined roof shapes.
    Type: Application
    Filed: July 8, 2002
    Publication date: January 16, 2003
    Inventors: Yanlin Guo, Rakesh Kumar, Stephen Charles Hsu, Harpreet Singh Sawhney
  • Patent number: 6393163
    Abstract: A system for automatically generating a mosaic from a plurality of input images. The system sequentially executes an image alignment process, an editing process, and a combining process such that, from a sequence of images, the system automatically produces a seamless mosaic for various applications. Illustrative applications for the mosaic include: (1) a mosaic based display system including an image printing system, (2) a surveillance system and (3) a mosaic based compression system. The mosaic based display system permits a system user to display, manipulate and alter a mosaic. The mosaic based compression system exploits the temporal and spatial redundancy in image sequences and efficiently compresses the image information. The compression system can be used for compressing image information for storage in a storage device or can be used for compressing image information for transmission through a band-limited transmission channel.
    Type: Grant
    Filed: December 2, 1999
    Date of Patent: May 21, 2002
    Assignee: Sarnoff Corporation
    Inventors: Peter J. Burt, Michal Irani, Stephen Charles Hsu, Padmanabhan Anandan, Michael W. Hansen
  • Publication number: 20010038718
    Abstract: A system and method for accurately mapping between image coordinates and geo-coordinates, called geo-spatial registration. The system utilizes the imagery and terrain information contained in the geo-spatial database to precisely align geodetically calibrated reference imagery with an input image, e.g., dynamically generated video images, and thus achieve a high accuracy identification of locations within the scene. When a sensor, such as a video camera, images a scene contained in the geo-spatial database, the system recalls a reference image pertaining to the imaged scene. This reference image is aligned very accurately with the sensor's images using a parametric transformation. Thereafter, other information that is associated with the reference image can easily be overlaid upon or otherwise associated with the sensor imagery.
    Type: Application
    Filed: March 9, 2001
    Publication date: November 8, 2001
    Inventors: Rakesh Kumar, Stephen Charles Hsu, Keith Hanna, Supun Samarasekera, Richard Patrick Wildes, David James Hirvonen, Thomas Edward Klinedinst, William Brian Lehman, Bodgan Matei, Wenyi Zhao, Barbara Levienaise-Obadia
  • Patent number: 6078701
    Abstract: A method and apparatus that determines the topology of a sequence of images and then globally aligns the images with respect to each image's neighboring images. The apparatus includes a topology determination module, a local coarse registration module, a local fine registration module, a global consistency module, and a color matching/blending module. To accurately render a mosaic image from a sequence of images the topology determination and global alignment processes are iterated to progressively produce accurately aligned images. The apparatus efficiently and accurately combines a plurality of source images into a seamless panoramic mosaic representation of a scene, of arbitrarily wide spatial and angular extent, regardless of the order of image acquisition.
    Type: Grant
    Filed: May 29, 1998
    Date of Patent: June 20, 2000
    Assignee: Sarnoff Corporation
    Inventors: Stephen Charles Hsu, Rakesh Kumar, Harpreet Singh Sawhney, James R. Bergen, Doug Dixon, Vince Paragano, Gary Gendel
  • Patent number: 5999662
    Abstract: A system for automatically generating a mosaic from a plurality of input images. The system sequentially executes an image alignment process, an editing process, and a combining process such that, from a sequence of images, the system automatically produces a seamless mosaic for various applications. Illustrative applications for the mosaic include: (1) a mosaic based display system including an image printing system, (2) a surveillance system and (3) a mosaic based compression system. The mosaic based display system permits a system user to display, manipulate and alter a mosaic. The mosaic based compression system exploits the temporal and spatial redundancy in image sequences and efficiently compresses the image information. The compression system can be used for compressing image information for storage in a storage device or can be used for compressing image information for transmission through a band-limited transmission channel.
    Type: Grant
    Filed: December 18, 1998
    Date of Patent: December 7, 1999
    Assignee: Sarnoff Corporation
    Inventors: Peter J. Burt, Michal Irani, Stephen Charles Hsu, Padmanabhan Anandan, Michael W. Hansen
  • Patent number: 5991444
    Abstract: A system for automatically generating a mosaic from a plurality of input images. The system sequentially executes an image alignment process, an editing process, and a combining process such that, from a sequence of images, the system automatically produces a seamless mosaic for various applications. Illustrative applications for the mosaic include: (1) a mosaic based display system including an image printing system, (2) a surveillance system and (3) a mosaic based compression system. The mosaic based display system permits a system user to display, manipulate and alter a mosaic. The mosaic based compression system exploits the temporal and spatial redundancy in image sequences and efficiently compresses the image information. The compression system can be used for compressing image information for storage in a storage device or can be used for compressing image information for transmission through a band-limited transmission channel.
    Type: Grant
    Filed: June 25, 1997
    Date of Patent: November 23, 1999
    Assignee: Sarnoff Corporation
    Inventors: Peter J. Burt, Michal Irani, Stephen Charles Hsu, Padmanabhan Anandan, Michael W. Hansen
  • Patent number: 5847755
    Abstract: Method and apparatus for processing a sequence of images to detect object movement within the sequence. Specifically, the method comprises the steps of: (a) supplying a sequence of image frames; (b) initializing a reference image that contains image information regarding stationary objects within a scene represented by the sequence of images; (c) supplying a next image frame which temporally follows the sequence of image frames; (d) comparing the next image to the reference image to produce a motion image representing motion information regarding movement of objects within the scene; (e) updating the reference image with information within the next image that represents stationary objects within the scene; and (f) repeating steps (c), (d), and (e) for each next image supplied. The method is implemented by image processing apparatus.
    Type: Grant
    Filed: December 11, 1996
    Date of Patent: December 8, 1998
    Assignee: Sarnoff Corporation
    Inventors: Lambert Ernest Wixson, Stephen Charles Hsu
  • Patent number: 5751836
    Abstract: Iris recognition is achieved by (1) iris acquisition that permits a user to self-position his or her eye into an imager's field of view without the need for any physical contact, (2) spatially locating the data defining that portion of a digitized video image of the user's eye that defines solely the iris thereof without any initial spatial condition of the iris being provided, and (3) pattern matching the spatially located data defining the iris of the user's eye with stored data defining a model iris by employing normalized spatial correlation for first comparing, at each of a plurality of spatial scales, each of distinctive spatial characteristics of the respective irises that are spatially registered with one another to quantitatively determine, at each of the plurality of spatial scales, a goodness value of match at that spatial scale, and then judging whether or not the pattern which manifests solely the iris of the user's eye matches the digital data which manifests solely the model iris in accordance
    Type: Grant
    Filed: September 27, 1996
    Date of Patent: May 12, 1998
    Assignee: David Sarnoff Research Center Inc.
    Inventors: Richard Patrick Wildes, Jane Circle Asmuth, Keith James Hanna, Stephen Charles Hsu, Raymond Joseph Kolczynski, James Regis Matey, Sterling Eduard McBride
  • Patent number: 5742710
    Abstract: A block-matching method for generating motion vectors performs block matching on successively higher resolution images by refining motion vectors determined in a lower resolution image. At respective higher resolution images, search areas of limited search range are defined via a motion vector associated with corresponding image areas in the immediately lower resolution search. For at least one level of image resolution, the search blocks are overlapped to provide a plurality of search areas of limited search range for performing block matching searches for each block in the next higher resolution level.
    Type: Grant
    Filed: July 11, 1995
    Date of Patent: April 21, 1998
    Assignee: RCA Thomson Licensing Corporation
    Inventors: Stephen Charles Hsu, Padmanabhan Anandan
  • Patent number: 5649032
    Abstract: A system for automatically generating a mosaic from a plurality of input images. The system sequentially executes an image alignment process, an editing process, and a combining process such that, from a sequence of images, the system automatically produces a seamless mosaic for various applications. Illustrative applications for the mosaic include: (1) a mosaic based display system including an image printing system, (2) a surveillance system and (3) a mosaic based compression system. The mosaic based display system permits a system user to display, manipulate and alter a mosaic. The mosaic based compression system exploits the temporal and spatial redundancy in image sequences and efficiently compresses the image information. The compression system can be used for compressing image information for storage in a storage device or can be used for compressing image information for transmission through a band-limited transmission channel.
    Type: Grant
    Filed: November 14, 1994
    Date of Patent: July 15, 1997
    Assignee: David Sarnoff Research Center, Inc.
    Inventors: Peter J. Burt, Michal Irani, Stephen Charles Hsu, Padmanabhan Anandan, Michael W. Hansen