Patents by Inventor Sheng-Wen Jeng

Sheng-Wen Jeng has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 9642521
    Abstract: Method for automatically measuring pupillary distance includes extracting facial features of face image, a head current center indicator is shown/displayed based on facial feature extraction, elliptical frame and target center indicator are shown, a first distance between head current center indicator and target center indicator is calculated to see if below a threshold range, then allowing head current center indicator, elliptical frame and target center indicator to disappear. Card window based on facial tracking result is shown. Credit card band detection is performed to see if located within card window. Card window then disappear. Elliptical frame of moving head and target elliptical frame are shown. Elliptical frame of the moving head is aligned with the target elliptical frame and maintaining a correct head posture. If elliptical frame of moving head is aligned with target elliptical frame, then allow them to disappear from view, and performing a pupillary distance measurement.
    Type: Grant
    Filed: November 25, 2014
    Date of Patent: May 9, 2017
    Assignee: ULSee Inc.
    Inventors: Zhou Ye, Sheng-Wen Jeng, Ying-Ko Lu, Shih Wei Liu
  • Patent number: 9262869
    Abstract: A method of 3D morphing driven by facial tracking is provided. First, a 3D model is loaded. After that, facial feature control points and boundary control points are picked up respectively. A configure file “A.config” including the facial feature control points and boundary control points data that are picked up corresponding to the 3D avatar is saved. Facial tracking algorithm is started, and then “A.config” is loaded. After that, controlled morphing of a 3D avatar by facial tracking based on “A.config” is performed in real time by a deformation method having control points. Meanwhile, teeth and tongue tracking of the real-time face image, and scaling, translation and rotation of the real-time 3D avatar image is also provided. In addition, a control point reassignment and reconfiguration method, and a pupil movement detection method is also provided in the method of 3D morphing driven by facial tracking.
    Type: Grant
    Filed: July 12, 2013
    Date of Patent: February 16, 2016
    Assignee: UL See Inc.
    Inventors: Zhou Ye, Ying-Ko Lu, Yi-Chia Hsu, Sheng-Wen Jeng
  • Patent number: 9224248
    Abstract: Method of applying virtual makeup and producing makeover effects to 3D face model driven by facial tracking in real-time includes the steps: capturing static or live facial images of a user; performing facial tracking of facial image, and obtaining tracking points on captured facial image; and producing makeover effects according to tracking points in real time. Virtual makeup can be applied using virtual makeup input tool such as a user's finger sliding over touch panel screen, mouse cursor or an object passing through makeup-allowed area. Makeup-allowed area for producing makeover effects is defined by extracting feature points from facial tracking points and dividing makeup-allowed area into segments and layers; and defining and storing parameters of makeup-allowed area. Virtual visual effects including color series, alpha blending, and/or superposition are capable of being applied.
    Type: Grant
    Filed: August 8, 2013
    Date of Patent: December 29, 2015
    Assignee: ULSee Inc.
    Inventors: Zhou Ye, Ying-Ko Lu, Yi-Chia Hsu, Sheng-Wen Jeng, Hsin-Wei Hsiao
  • Patent number: 9182813
    Abstract: Image-based object tracking system includes at least a controller with two or more color clusters, an input button, a processing unit with a camera, an object tracking algorithm and a display. Camera is configured to capture images of the controller, the processing unit is connected to display to display processed image contents, the controller is directly interacting with displayed processed image content. The controller can have two or three color clusters located on a side surface thereof and two color clusters having concentric circular areas located at a top surface thereof, the color of the first color cluster can be the same as or different from the color of the third color cluster. An object tracking method with or without scale calibration is also provided, which includes color learning and color relearning, image capturing, separating and splitting of the controller and the background, object pairing procedure steps on the controller.
    Type: Grant
    Filed: November 28, 2013
    Date of Patent: November 10, 2015
    Assignee: ULSee Inc.
    Inventors: Zhou Ye, Sheng-Wen Jeng, Chih-Ming Chang, Hsin-Wei Hsiao, Yi-Chia Hsu, Ying-Ko Lu
  • Publication number: 20150146169
    Abstract: Method for automatically measuring pupillary distance includes extracting facial features of face image, a head current center indicator is shown/displayed based on facial feature extraction, elliptical frame and target center indicator are shown, a first distance between head current center indicator and target center indicator is calculated to see if below a threshold range, then allowing head current center indicator, elliptical frame and target center indicator to disappear. Card window based on facial tracking result is shown. Credit card band detection is performed to see if located within card window. Card window then disappear. Elliptical frame of moving head and target elliptical frame are shown. Elliptical frame of the moving head is aligned with the target elliptical frame and maintaining a correct head posture. If elliptical frame of moving head is aligned with target elliptical frame, then allow them to disappear from view, and performing a pupillary distance measurement.
    Type: Application
    Filed: November 25, 2014
    Publication date: May 28, 2015
    Inventors: Zhou Ye, Sheng-Wen Jeng, Ying-Ko Lu, Shih Wei Liu
  • Patent number: 8983203
    Abstract: A face-tracking method with high accuracy is provided. The face-tracking method includes generating an initial face shape according to the detected face region of an input image and a learned data base, wherein the initial face shape comprises an initial inner shape and an initial outer shape; generating a refined inner shape by refining the initial inner shape according to the input image and the learned data base; and generating a refined outer shape by searching an edge of the refined outer shape from the initial outer shape toward the limit of outer shape.
    Type: Grant
    Filed: October 11, 2012
    Date of Patent: March 17, 2015
    Assignee: ULSee Inc.
    Inventors: Zhou Ye, Ying-Ko Lu, Sheng-Wen Jeng
  • Patent number: 8971574
    Abstract: A method of performing facial recognition and tracking of an image captured by an electronic device includes: utilizing a camera of the electronic device to capture an image including at least a face; displaying the image on a display screen of the electronic device; determining a degree of orientation of the electronic device; and adjusting an orientation of scanning lines used to scan the image for performing face detection so that the orientation of the scanning lines corresponds to the orientation of the electronic device.
    Type: Grant
    Filed: November 22, 2012
    Date of Patent: March 3, 2015
    Assignee: Ulsee Inc.
    Inventors: Zhou Ye, Ying-Ko Lu, Sheng-Wen Jeng
  • Publication number: 20140085194
    Abstract: Image-based object tracking system includes at least a controller with two or more color clusters, an input button, a processing unit with a camera, an object tracking algorithm and a display. Camera is configured to capture images of the controller, the processing unit is connected to display to display processed image contents, the controller is directly interacting with displayed processed image content. The controller can have two or three color clusters located on a side surface thereof and two color clusters having concentric circular areas located at a top surface thereof, the color of the first color cluster can be the same as or different from the color of the third color cluster. An object tracking method with or without scale calibration is also provided, which includes color learning and color relearning, image capturing, separating and splitting of the controller and the background, object pairing procedure steps on the controller.
    Type: Application
    Filed: November 28, 2013
    Publication date: March 27, 2014
    Applicant: Cywee Group Limited
    Inventors: Zhou Ye, Sheng-Wen Jeng, Chih-ming Chang, Hsin-Wei Hsiao, Yi-Chia Hsu, Ying-Ko Lu
  • Publication number: 20140022249
    Abstract: A method of 3D morphing driven by facial tracking is provided. First, a 3D model is loaded. After that, facial feature control points and boundary control points are picked up respectively. A configure file “A.config” including the facial feature control points and boundary control points data that are picked up corresponding to the 3D avatar is saved. Facial tracking algorithm is started, and then “A.config” is loaded. After that, controlled morphing of a 3D avatar by facial tracking based on “A.config” is performed in real time by a deformation method having control points. Meanwhile, teeth and tongue tracking of the real-time face image, and scaling, translation and rotation of the real-time 3D avatar image is also provided. In addition, a control point reassignment and reconfiguration method, and a pupil movement detection method is also provided in the method of 3D morphing driven by facial tracking.
    Type: Application
    Filed: July 12, 2013
    Publication date: January 23, 2014
    Inventors: Zhou Ye, Ying-Ko Lu, Yi-Chia Hsu, Sheng-Wen Jeng
  • Publication number: 20140016823
    Abstract: Method of applying virtual makeup and producing makeover effects to 3D face model driven by facial tracking in real-time includes the steps: capturing static or live facial images of a user; performing facial tracking of facial image, and obtaining tracking points on captured facial image; and producing makeover effects according to tracking points in real time. Virtual makeup can be applied using virtual makeup input tool such as a user's finger sliding over touch panel screen, mouse cursor or an object passing through makeup-allowed area. Makeup-allowed area for producing makeover effects is defined by extracting feature points from facial tracking points and dividing makeup-allowed area into segments and layers; and defining and storing parameters of makeup-allowed area. Virtual visual effects including color series, alpha blending, and/or superposition are capable of being applied.
    Type: Application
    Filed: August 8, 2013
    Publication date: January 16, 2014
    Applicant: CYWEE GROUP LIMITED
    Inventors: Zhou Ye, Ying-Ko Lu, Yi-Chia Hsu, Sheng-Wen Jeng, Hsin-Wei Hsiao
  • Patent number: 8578299
    Abstract: A computing device in a system for motion detection comprises an image processing device to determine a motion of an object of interest, and a graphical user interface (GUI) module to drive a virtual role based on the motion determined by the image processing device.
    Type: Grant
    Filed: October 8, 2010
    Date of Patent: November 5, 2013
    Assignees: Industrial Technology Research Institute, Cywee Group Ltd.
    Inventors: Po-Lung Chen, Chien-Chun Kuo, Wen-Yang Wang, Duan-Li Liao, Zhou Ye, Sheng-Wen Jeng
  • Patent number: 8555205
    Abstract: The present invention discloses a system for human and machine interface. The system includes a 3-dimensional (3D) image capture device, for capturing a gesture of a motion object in a period of time; a hand-held inertial device (HHID), for transmitting a control signal; and a computing device. The computing device includes a system integration and GUI module, for compensating the control signal according to an image signal corresponding to the motion object, to generate a compensated control signal.
    Type: Grant
    Filed: May 10, 2011
    Date of Patent: October 8, 2013
    Assignee: Cywee Group Limited
    Inventors: Zhou Ye, Sheng-Wen Jeng, Shun-Nan Liou, Ying-Ko Lu
  • Publication number: 20120086637
    Abstract: The present invention discloses a system for human and machine interface. The system includes a 3-dimensional (3D) image capture device, for capturing a gesture of a motion object in a period of time; a hand-held inertial device (HHID), for transmitting a control signal; and a computing device. The computing device includes a system integration and GUI module, for compensating the control signal according to an image signal corresponding to the motion object, to generate a compensated control signal.
    Type: Application
    Filed: May 10, 2011
    Publication date: April 12, 2012
    Applicant: CYWEE GROUP LIMITED
    Inventors: Zhou Ye, Sheng-Wen Jeng, Shun-Nan Liou, Ying-Ko Lu
  • Patent number: 7973766
    Abstract: An inertial input apparatus with six-axial detection ability, structured with a gyroscope and an acceleration module capable of detecting accelerations of X, Y, Z axes defined by a 3-D Cartesian coordinates, which is operable either being held to move on a planar surface or in a free space. When the inertial input apparatus is being held to move and operate on a planar surface by a user, a two-dimensional detection mode is adopted thereby that the gyroscope is used for detection rotations of the inertial input apparatus caused by unconscious rolling motions of the user and thus compensating the erroneous rotations, by which the technical disadvantages of prior-art inertial input apparatuses equipped with only accelerometer can be overcame and thus control smoothness of using the input apparatus is enhanced.
    Type: Grant
    Filed: August 31, 2010
    Date of Patent: July 5, 2011
    Assignee: Industrial Technology Research Institute
    Inventors: Sheng-Wen Jeng, Shun-Nan Liou, Shih-Ching Huang, Ming-Jye Tsai
  • Publication number: 20100328210
    Abstract: An inertial input apparatus with six-axial detection ability, structured with a gyroscope and an acceleration module capable of detecting accelerations of X, Y, Z axes defined by a 3-D Cartesian coordinates, which is operable either being held to move on a planar surface or in a free space. When the inertial input apparatus is being held to move and operate on a planar surface by a user, a two-dimensional detection mode is adopted thereby that the gyroscope is used for detection rotations of the inertial input apparatus caused by unconscious rolling motions of the user and thus compensating the erroneous rotations, by which the technical disadvantages of prior-art inertial input apparatuses equipped with only accelerometer can be overcame and thus control smoothness of using the input apparatus is enhanced.
    Type: Application
    Filed: August 31, 2010
    Publication date: December 30, 2010
    Applicant: Industrial Technology Research Institute
    Inventors: Sheng-Wen Jeng, Shun-Nan Liou, Shih-Ching Huang, Ming-Jye Tsai
  • Patent number: 7843430
    Abstract: An inertial input apparatus with six-axial detection ability, structured with a gyroscope and an acceleration module capable of detecting accelerations of X, Y, Z axes defined by a 3-D Cartesian coordinates, which is operable either being held to move on a planar surface or in a free space. When the inertial input apparatus is being held to move and operate on a planar surface by a user, a two-dimensional detection mode is adopted thereby that the gyroscope is used for detection rotations of the inertial input apparatus caused by unconscious rolling motions of the user and thus compensating the erroneous rotations, by which the technical disadvantages of prior-art inertial input apparatuses equipped with only accelerometer can be overcame and thus control smoothness of using the input apparatus is enhanced.
    Type: Grant
    Filed: February 15, 2007
    Date of Patent: November 30, 2010
    Assignee: Industrial Technology Research Institute
    Inventors: Sheng-Wen Jeng, Shun-Nan Liou, Shih-Ching Huang, Ming-Jye Tsai
  • Patent number: 7830360
    Abstract: An inertial sensing input apparatus is disclosed, which includes: an accelerometer module, capable of detecting accelerations with respect to a Cartesian coordinate system of X-, Y-, and Z-axes; and a gyroscope, used for detecting a rotation measured with respect to the Z-axis. By the aforesaid input apparatus, an input method can be provided which comprises steps of: (a) defining base signals with respect to each of such sensing elements; (b) detecting and determining whether Z-axis accelerations are varying; (c) enabling the input apparatus to enter a surface (2D) operating mode while no acceleration varying is detected along the Z axis; (d) enabling the input apparatus to enter a space (3D) operating mode while acceleration varying is detected along the Z axis.
    Type: Grant
    Filed: February 14, 2007
    Date of Patent: November 9, 2010
    Assignee: Industrial Technology Research Institute
    Inventors: Sheng-Wen Jeng, Shun-Nan Liou, Ming-Jye Tsai
  • Patent number: 7817134
    Abstract: A pointing device is disclosed in the present invention, which comprises a planar sensing unit, an inertial sensing unit and a controller unit. The planar sensing unit is capable of detecting a movement of the point device moving on a planar surface and generating a planar sensing signal accordingly. The inertial sensing unit is capable of detecting a movement of the point device while it is moving in a free space and thus generating an inertial sensing signal accordingly. The controller unit is coupled to the planar sensing unit and the inertial sensing unit for enabling the same to receive and process the planar sensing signal and the inertial sensing signal.
    Type: Grant
    Filed: December 20, 2006
    Date of Patent: October 19, 2010
    Assignee: Industrial Technology Research Institute
    Inventors: Shih-Ching Huang, Sheng-Wen Jeng, Shun-Nan Liou, Ming-Jye Tsai
  • Publication number: 20080134784
    Abstract: An inertial input apparatus with six-axial detection ability, structured with a gyroscope and an acceleration module capable of detecting accelerations of X, Y, Z axes defined by a 3-D Cartesian coordinates, which is operable either being held to move on a planar surface or in a free space. When the inertial input apparatus is being held to move and operate on a planar surface by a user, a two-dimensional detection mode is adopted thereby that the gyroscope is used for detection rotations of the inertial input apparatus caused by unconscious rolling motions of the user and thus compensating the erroneous rotations, by which the technical disadvantages of prior-art inertial input apparatuses equipped with only accelerometer can be overcame and thus control smoothness of using the input apparatus is enhanced.
    Type: Application
    Filed: February 15, 2007
    Publication date: June 12, 2008
    Applicant: INDUSTRIAL TECHNOLOGY RESEARCH INSTITUTE
    Inventors: Sheng-Wen Jeng, Shun-Nan Liou, Shih-Ching Huang, Ming-Jye Tsai
  • Publication number: 20080134783
    Abstract: An inertial sensing input apparatus is disclosed, which includes: an accelerometer module, capable of detecting accelerations with respect to a Cartesian coordinate system of X-, Y-, and Z-axes; and a gyroscope, used for detecting a rotation measured with respect to the Z-axis.
    Type: Application
    Filed: February 14, 2007
    Publication date: June 12, 2008
    Applicant: INDUSTRIAL TECHNOLOGY RESEARCH INSTITUTE
    Inventors: Sheng-Wen Jeng, Shun-Nan Liou, Ming-Jye Tsai