Patents by Inventor Te-Mei Wang

Te-Mei Wang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20220011579
    Abstract: A method and a system for simultaneously tracking several 6 DoF poses of a movable object and a movable camera are provided. The method the following steps: A series of images are captured by a movable camera, several environmental feature points are extracted from the images and are matched to compute several camera matrixes of the movable camera, and the 6 DoF poses of the movable camera are computed using the camera matrixes. At the same time, several feature points of the movable object are inferred from the images captured by the movable camera, the coordinates of the feature points of the movable object are corrected using the camera matrixes corresponding to the images as well as the predefined geometric and temporal constraints. Then, the 6 DoF poses of the movable object are computed using the coordinates of the corrected feature points and their corresponding camera matrixes.
    Type: Application
    Filed: July 7, 2021
    Publication date: January 13, 2022
    Applicant: INDUSTRIAL TECHNOLOGY RESEARCH INSTITUTE
    Inventors: Te-Mei WANG, Chung-Yang HSIEH
  • Patent number: 11164321
    Abstract: A motion tracking system includes a first image-capturing module, a computing module and a database. The first image-capturing module captures the full body motion of an object to obtain a depth image. The database provides a plurality of training samples, wherein the training samples include a plurality of depth feature information related to joint positions of the object. The computing module receives the depth image, performs an association operation and a prediction operation for the depth image to obtain a plurality of first joint positions of the object. The computing module projects the first joint positions to a three-dimensional space to generate a three-dimensional skeleton of the object. The depth image includes an image in which limbs of the object are not occluded or an image in which some of limbs of the object are not occluded and the others of limbs of the object are occluded.
    Type: Grant
    Filed: April 10, 2019
    Date of Patent: November 2, 2021
    Assignee: INDUSTRIAL TECHNOLOGY RESEARCH INSTITUTE
    Inventors: Fu-Song Hsu, Te-Mei Wang
  • Publication number: 20210201577
    Abstract: A method, a system, and a computing device for reconstructing three-dimensional planes are provided. The method includes the following steps: obtaining a series of color information, depth information and pose information of a dynamic scene by a sensing device; extracting a plurality of feature points according to the color information and the depth information, and marking part of the feature points as non-planar objects including dynamic objects and fragmentary objects; computing point cloud according to the unmarked feature points and the pose information, and instantly converting the point cloud to a three-dimensional mesh; and growing the three-dimensional mesh to fill vacancy corresponding to the non-planar objects according to the information of the three-dimensional mesh surrounding or adjacent to the non-planar objects.
    Type: Application
    Filed: May 22, 2020
    Publication date: July 1, 2021
    Applicant: INDUSTRIAL TECHNOLOGY RESEARCH INSTITUTE
    Inventor: Te-Mei WANG
  • Patent number: 10977829
    Abstract: A depth camera calibration device and a method thereof are provided. The method comprises: disabling a projection function of a camera and photographing surface planes to obtain a first image; enabling the projection function of the camera and photographing the surface planes to obtain a second image, and a positional relationship between the camera and a calibration plate assembly remaining unchanged when obtaining the first image and the second image; and obtaining parameters of the camera by cropping an image boundary, calculating positions of characteristic points, reading a projection pattern, calculating positions of corresponding points and excluding abnormal points according to the first image and the second image.
    Type: Grant
    Filed: December 27, 2018
    Date of Patent: April 13, 2021
    Assignee: INDUSTRIAL TECHNOLOGY RESEARCH INSTITUTE
    Inventors: Tien-Yan Ma, Te-Mei Wang, Ping-Chang Shih
  • Patent number: 10921119
    Abstract: A three dimensional image measurement system including a first optical system and a second optical system is provided. The first optical system is adapted to output a structural light beam and a zero order light beam. There is an angle between the structural light beam and the zero order light beam. The first optical system performs an optical operation to project the structural light beam to a three dimensional object to obtain three dimensional information of the three dimensional object. The second optical system is adapted to receive the zero order light beam and perform another optical operation by using the zero order light beam. The first optical system includes a plurality of optical elements. The value of the angle between the structural light beam and the zero order light beam is determined according to position parameters of the optical elements.
    Type: Grant
    Filed: October 25, 2017
    Date of Patent: February 16, 2021
    Assignee: Industrial Technology Research Institute
    Inventors: Yu-Wen Chen, Te-Mei Wang
  • Patent number: 10742961
    Abstract: A depth sensing apparatus with self-calibration and a self-calibration method thereof are provided. The depth sensing apparatus includes a projection apparatus, an image capturing apparatus and a calibration module. The projection apparatus projects a calibration pattern and a depth computation pattern to a reference plane based on a predefined calibration pattern and a predefined depth computation pattern. The image capturing apparatus captures an image including the calibration pattern and the depth computation pattern. The calibration module coupled to the image capturing apparatus adjusts apparatus parameters of the depth sensing apparatus to calibrate a depth computation deviation according to the calibration pattern of the image, the predefined calibration pattern and a predefined lookup table corresponding to the predefined calibration pattern.
    Type: Grant
    Filed: September 2, 2016
    Date of Patent: August 11, 2020
    Assignee: Industrial Technology Research Institute
    Inventors: Te-Mei Wang, Zen-Chung Shih
  • Publication number: 20200202495
    Abstract: An apparatus for dynamically adjusting depth resolution is provided. The apparatus includes a depth capture module, an image capture module and a computing unit. The depth capture module obtains a set of images for disparity computation. The image capture module obtains a high-resolution image. The computing unit computes a disparity map and a corresponding depth map using the set of images obtained by the depth capture module, and sets a 3D region of interest according to a pre-defined object feature, the high-resolution image and the depth map. The 3D region of interest can be dynamically adjusted by tracking the movement of the object. In the 3D region of interest, the computing unit re-computes the depth map in higher resolution along Z axis by re-computing the disparity map in appropriate sub-pixels and allocating the required number of bits to store the sub-pixel disparity values.
    Type: Application
    Filed: July 9, 2019
    Publication date: June 25, 2020
    Applicant: INDUSTRIAL TECHNOLOGY RESEARCH INSTITUTE
    Inventor: Te-Mei WANG
  • Publication number: 20200202538
    Abstract: A motion tracking system includes a first image-capturing module, a computing module and a database. The first image-capturing module captures the full body motion of an object to obtain a depth image. The database provides a plurality of training samples, wherein the training samples include a plurality of depth feature information related to joint positions of the object. The computing module receives the depth image, performs an association operation and a prediction operation for the depth image to obtain a plurality of first joint positions of the object. The computing module projects the first joint positions to a three-dimensional space to generate a three-dimensional skeleton of the object. The depth image includes an image in which limbs of the object are not occluded or an image in which some of limbs of the object are not occluded and the others of limbs of the object are occluded.
    Type: Application
    Filed: April 10, 2019
    Publication date: June 25, 2020
    Inventors: Fu-Song HSU, Te-Mei WANG
  • Publication number: 20200184684
    Abstract: A depth camera calibration device and a method thereof are provided. The method comprises: disabling a projection function of a camera and photographing surface planes to obtain a first image; enabling the projection function of the camera and photographing the surface planes to obtain a second image, and a positional relationship between the camera and a calibration plate assembly remaining unchanged when obtaining the first image and the second image; and obtaining parameters of the camera by cropping an image boundary, calculating positions of characteristic points, reading a projection pattern, calculating positions of corresponding points and excluding abnormal points according to the first image and the second image.
    Type: Application
    Filed: December 27, 2018
    Publication date: June 11, 2020
    Inventors: Tien-Yan MA, Te-Mei Wang, Ping-Chang Shih
  • Publication number: 20190056217
    Abstract: A three dimensional image measurement system including a first optical system and a second optical system is provided. The first optical system is adapted to output a structural light beam and a zero order light beam. There is an angle between the structural light beam and the zero order light beam. The first optical system performs an optical operation to project the structural light beam to a three dimensional object to obtain three dimensional information of the three dimensional object. The second optical system is adapted to receive the zero order light beam and perform another optical operation by using the zero order light beam. The first optical system includes a plurality of optical elements. The value of the angle between the structural light beam and the zero order light beam is determined according to position parameters of the optical elements.
    Type: Application
    Filed: October 25, 2017
    Publication date: February 21, 2019
    Applicant: Industrial Technology Research Institute
    Inventors: Yu-Wen Chen, Te-Mei Wang
  • Patent number: 9998719
    Abstract: A non-planar surface projecting system, an auto-calibration method thereof and an auto-calibration device thereof are provided. In an embodiment of the non-planar surface auto-calibration method, a depth map of a projection surface is measured, a corresponding area corresponding to a projecting area and a depth sensing area is calibrated; and in the corresponding area, an interactive content is adjusted according to the depth map of the projection surface.
    Type: Grant
    Filed: May 31, 2017
    Date of Patent: June 12, 2018
    Assignee: INDUSTRIAL TECHNOLOGY RESEARCH INSTITUTE
    Inventors: Te-Mei Wang, Zen-Chung Shih
  • Publication number: 20180074648
    Abstract: A tapping detecting device, a tapping detecting method and a smart projecting system using the same are provided. The tapping detecting device comprises a fingertip size providing unit, a laser emitting unit, a laser sensing unit and a processing unit. The fingertip size providing unit is used for providing the size of a fingertip of a finger. The laser emitting unit is used for providing a laser at a parallel surface above a plane. The laser sensing unit is used for capturing a reflecting image which shows the reflection of the laser caused by the fingertip. The processing unit is used for obtaining a reflecting region according to the reflecting image, and for adjusting a threshold value according to the size of the fingertip. If the area of the reflecting region is larger than the threshold value, then the processing unit deems that the fingertip touches the plane.
    Type: Application
    Filed: December 13, 2016
    Publication date: March 15, 2018
    Inventors: Fu-Song HSU, Te-Mei WANG
  • Publication number: 20170347079
    Abstract: A non-planar surface projecting system, an auto-calibration method thereof and an auto-calibration device thereof are provided. In an embodiment of the non-planar surface auto-calibration method, a depth map of a projection surface is measured, a corresponding area corresponding to a projecting area and a depth sensing area is calibrated; and in the corresponding area, an interactive content is adjusted according to the depth map of the projection surface.
    Type: Application
    Filed: May 31, 2017
    Publication date: November 30, 2017
    Inventors: Te-Mei WANG, Zen-Chung SHIH
  • Publication number: 20170064288
    Abstract: A depth sensing apparatus with self-calibration and a self-calibration method thereof are provided. The depth sensing apparatus includes a projection apparatus, an image capturing apparatus and a calibration module. The projection apparatus projects a calibration pattern and a depth computation pattern to a reference plane based on a predefined calibration pattern and a predefined depth computation pattern. The image capturing apparatus captures an image including the calibration pattern and the depth computation pattern. The calibration module coupled to the image capturing apparatus adjusts apparatus parameters of the depth sensing apparatus to calibrate a depth computation deviation according to the calibration pattern of the image, the predefined calibration pattern and a predefined lookup table corresponding to the predefined calibration pattern.
    Type: Application
    Filed: September 2, 2016
    Publication date: March 2, 2017
    Applicant: Industrial Technology Research Institute
    Inventors: Te-Mei Wang, Zen-Chung Shih
  • Patent number: 9443349
    Abstract: An electronic apparatus and a method for incremental pose estimation and photographing are provided. In the method, at least two images of a 3D object are captured at different positions encircling the 3D object. Displacements and angular displacements are detected when capturing the images. Features of the 3D object in the images, the displacements and the angular displacements are used to estimate a central position of the 3D object and a distance between the electronic apparatus and the 3D object. A circumference suitable for capturing the images of the 3D object is estimated based on the distance and is divided into several segments, and a timing interval of a timer is adjusted based on a length of the segments. A camera of the electronic apparatus is triggered at intervals set by the timer to capture the images of the 3D object.
    Type: Grant
    Filed: December 18, 2014
    Date of Patent: September 13, 2016
    Assignee: Industrial Technology Research Institute
    Inventors: Te-Mei Wang, Chen-Hao Wei, Hsiao-Wei Chen
  • Publication number: 20160163091
    Abstract: An electronic apparatus and a method for incremental pose estimation and photographing are provided. In the method, at least two images of a 3D object are captured at different positions encircling the 3D object. Displacements and angular displacements are detected when capturing the images. Features of the 3D object in the images, the displacements and the angular displacements are used to estimate a central position of the 3D object and a distance between the electronic apparatus and the 3D object. A circumference suitable for capturing the images of the 3D object is estimated based on the distance and is divided into several segments, and a timing interval of a timer is adjusted based on a length of the segments. A camera of the electronic apparatus is triggered at intervals set by the timer to capture the images of the 3D object.
    Type: Application
    Filed: December 18, 2014
    Publication date: June 9, 2016
    Inventors: Te-Mei Wang, Chen-Hao Wei, Hsiao-Wei Chen
  • Patent number: 9076249
    Abstract: A hole filling method for multi-view disparity maps is provided. At least one disparity map is respectively captured as a plurality of known views among a plurality of views for capturing an object. As for a plurality of virtual views among the views excluding the at least one known view, disparity maps of the virtual views are synthesized by sequentially using the disparity maps of the known views according to a distance of a virtual camera position or a transformed angle between each virtual view and each known view. Hole filling information of the disparity maps of other virtual views having the distances or the transformed angles smaller than that of the virtual view is used to fill holes in the synthesized disparity maps of the virtual views.
    Type: Grant
    Filed: March 8, 2013
    Date of Patent: July 7, 2015
    Assignee: Industrial Technology Research Institute
    Inventors: Hsiao-Wei Chen, Te-Mei Wang, Wei-Yi Lee
  • Patent number: 8934707
    Abstract: An image processing apparatus includes a determination unit, a search unit, a weight assignment unit and a filling unit. The determination unit determines whether a hole is surrounded by the foreground in a disparity map or a depth map. The search unit searches for multiple relative backgrounds along multiple directions when the hole is surrounded by the foreground. The weight assignment unit respectively assigns weights to the relative backgrounds. The filling unit selects an extremum from the weights, and fills the hole according to the relative background corresponding to the extremum.
    Type: Grant
    Filed: December 26, 2012
    Date of Patent: January 13, 2015
    Assignee: Industrial Technology Research Institute
    Inventors: Te-Mei Wang, Hsiao-Wei Chen
  • Patent number: 8593394
    Abstract: A cumulative function of image is obtained according to its gray levels of pixels. This function is then mapped to obtain a backlight modulation function according to a reference line. The backlight brightness provided for different regions of the liquid crystal display are decided by the backlight modulation function while displaying the images.
    Type: Grant
    Filed: November 2, 2012
    Date of Patent: November 26, 2013
    Assignee: AU Optronics Corporation
    Inventors: Fanf-Cheng Lin, Cheng-Yu Liao, Lin-Yao Liao, Yi-Pai Huang, Te-Mei Wang, Han-Ping D. Shieh
  • Patent number: 8330704
    Abstract: A cumulative function of image is obtained according to its gray levels of pixels. This function is then mapped to obtain a backlight modulation function according to a reference line. The backlight brightness provided for different regions of the liquid crystal display are decided by the backlight modulation function while displaying the images.
    Type: Grant
    Filed: August 31, 2007
    Date of Patent: December 11, 2012
    Assignee: AU Optronics Corporation
    Inventors: Fang-Cheng Lin, Cheng-Yu Liao, Lin-Yao Liao, Yi-Pai Huang, Te-Mei Wang, Han-Ping Shieh