Patents by Inventor Kah Kuen Fu

Kah Kuen Fu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11858143
    Abstract: An autonomous mobile device (AMD) follows a user who may move among other people, change orientation, or move in and out view of a camera on the AMD. A predicted location of the user may be determined based on a previous location and previous movement. A proximity value is determined by the distance between a location in physical space of a user and the predicted location. An image from a camera is processed to determine a user depicted in the image and generate a feature vector (FV) of that depiction. A gallery of FVs of the user as viewed from different angles, poses, and so forth is stored. A similarity value is determined between a FV of an unidentified user in an image and the FVs in the gallery. The user may be identified using the proximity value and the similarity value.
    Type: Grant
    Filed: March 2, 2020
    Date of Patent: January 2, 2024
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Chi Liu, Wei Wang, Rajesh Shankarrao Padgilwar, Ning Zhou, Kah Kuen Fu
  • Patent number: 10027883
    Abstract: Various embodiments enable a primary user to be identified and tracked using stereo association and multiple tracking algorithms. For example, a face detection algorithm can be run on each image captured by a respective camera independently. Stereo association can be performed to match faces between cameras. If the faces are matched and a primary user is determined, a face pair is created and used as the first data point in memory for initializing object tracking. Further, features of a user's face can be extracted and the change in position of these features between images can determine what tracking method will be used for that particular frame.
    Type: Grant
    Filed: June 18, 2014
    Date of Patent: July 17, 2018
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Cheng-Hao Kuo, Jim Oommen Thomas, Tianyang Ma, Stephen Vincent Mangiat, Sisil Sanjeev Mehta, Ambrish Tyagi, Amit Kumar Agrawal, Kah Kuen Fu, Sharadh Ramaswamy
  • Patent number: 9729792
    Abstract: Image capture can be improved by capturing a sequence of images and analyzing the images to select the image with the least blur and/or an acceptable amount of blur. Gradients can be calculated for at least a portion of the images, and gradient histograms generated. Two or more component curves can be fit to each histogram, such as by using a Gaussian mixture model, and the curves can be compared to determine an amount of variation between the curves. The image with the smallest differences between component curves, or with differences less than a specified blur threshold, can be selected as a sufficiently sharp image and provided for viewing, processing, or another intended purpose of the image to be captured.
    Type: Grant
    Filed: December 29, 2014
    Date of Patent: August 8, 2017
    Assignee: Amazon Technologies, Inc.
    Inventors: Kah Kuen Fu, Kenneth Mark Karakotsios, Volodymyr V. Ivanchenko
  • Patent number: 9729865
    Abstract: Various embodiments enable a primary user to be identified and tracked using stereo association and multiple tracking algorithms. For example, a face detection algorithm can be run on each image captured by a respective camera independently. Stereo association can be performed to match faces between cameras. If the faces are matched and a primary user is determined, a face pair is created and used as the first data point in memory for initializing object tracking. Further, features of a user's face can be extracted and the change in position of these features between images can determine what tracking method will be used for that particular frame.
    Type: Grant
    Filed: June 18, 2014
    Date of Patent: August 8, 2017
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Cheng-Hao Kuo, Jim Oommen Thomas, Tianyang Ma, Stephen Vincent Mangiat, Sisil Sanjeev Mehta, Ambrish Tyagi, Amit Kumar Agrawal, Kah Kuen Fu, Sharadh Ramaswamy
  • Patent number: 9652031
    Abstract: A device configured with a user interface (UI) that changes based on a position of a user determines the position of the user through multiple data sources including camera based head tracking and output from motion sensors such as a gyroscope. Each data source may output its own estimated head position. The device may apply a reliability weight to the head position determined by each data source. A composite head position is then determined from the weighted position. The composite position is then used to render the UI.
    Type: Grant
    Filed: June 17, 2014
    Date of Patent: May 16, 2017
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Paul Aksenti Savastinuk, Jim Oommen Thomas, Geoffrey Scott Heller, Michael Lee Sandige, Kah Kuen Fu
  • Patent number: 9575155
    Abstract: The relative positions of two or more electronic devices can be determined utilizing ultrasonic beacons. Each device can have a unique signature that can be included in the beacon broadcast by that device. A device having an array of ultrasonic detectors can receive a beacon and correlate the beacon received at each detector. The time of arrival then can be used to determine the relative position of the source of the beacon. The signature in that beacon can also be used to determine the identity of the device that broadcast the beacon, in order to determine the identity of the device, or a user of that device, at the determined relative position. The devices can be configured to transmit signals over the air or through a specific transmission medium, such as propagating surface. Further, a dedicated detector array can be used for determining multiple relative positions.
    Type: Grant
    Filed: July 2, 2014
    Date of Patent: February 21, 2017
    Assignee: Amazon Technologies, Inc.
    Inventors: Andrew D. Price, Kah Kuen Fu, Kaixiang Hu
  • Patent number: 9355301
    Abstract: The computational resources needed to perform processes such as image recognition can be reduced by determining appropriate frames of image information to use for the processing. In some embodiments, infrared imaging can be used to determine when a person is looking substantially towards a device, such that an image frame captured at that time will likely be adequate for facial recognition. In other embodiments, sound triangulation or motion sensing can be used to assist in determining which captured image frames to discard and which to select for processing based on any of a number of factors indicative of a proper frame for processing.
    Type: Grant
    Filed: November 24, 2014
    Date of Patent: May 31, 2016
    Assignee: Amazon Technologies, Inc.
    Inventors: Kenneth M. Karakotsios, Kah Kuen Fu, Volodymyr V. Ivanchenko, Mingjing Huang
  • Patent number: 9332189
    Abstract: A user attempting to obtain information about an object can capture image information including a view of that object, and the image information can be used with a matching or identification process to provide information about that type of object to the user. In order to narrow the search space to a specific category, and thus improve the accuracy of the results and the speed at which results can be obtained, the user can be guided to capture image information with an appropriate orientation. An outline or other graphical guide can be displayed over image information captured by a computing device, in order to guide the user in capturing the object from an appropriate direction and with an appropriate scale for the type of matching and/or information used for the matching. Such an approach enables three-dimensional objects to be analyzed using conventional two-dimensional identification algorithms, among other such processes.
    Type: Grant
    Filed: December 31, 2014
    Date of Patent: May 3, 2016
    Assignee: Amazon Technologies, Inc.
    Inventors: Francislav Petrov Penov, Aaron Michael Donsbach, Geoffrey Scott Heller, Kenneth Mark Karakotsios, Daniel Bibireata, Kah Kuen Fu, Richard Howard Suplee, III, Timothy Youngjin Sohn
  • Patent number: 9298974
    Abstract: Various embodiments enable a primary user to be identified and tracked using stereo association and multiple tracking algorithms. For example, a face detection algorithm can be run on each image captured by a respective camera independently. Stereo association can be performed to match faces between cameras. If the faces are matched and a primary user is determined, a face pair is created and used as the first data point in memory for initializing object tracking. Further, features of a user's face can be extracted and the change in position of these features between images can determine what tracking method will be used for that particular frame.
    Type: Grant
    Filed: June 18, 2014
    Date of Patent: March 29, 2016
    Assignee: Amazon Technologies, Inc.
    Inventors: Cheng-Hao Kuo, Jim Oommen Thomas, Tianyang Ma, Stephen Vincent Mangiat, Sisil Sanjeev Mehta, Ambrish Tyagi, Amit Kumar Agrawal, Kah Kuen Fu, Sharadh Ramaswamy
  • Publication number: 20150362989
    Abstract: Object tracking, such as may involve face tracking, can utilize different detection templates that can be trained using different data. A computing device can determine state information, such as the orientation of the device, an active illumination, or an active camera to select an appropriate template for detecting an object, such as a face, in a captured image. Information about the object, such as the age range or gender of a person, can also be used, if available, to select an appropriate template. In some embodiments instances of templates can be used to process various orientations, while in other embodiments specific orientations, such as upside down orientations, may not be processed for reasons such as rate of inaccuracies or infrequency of use for the corresponding additional resource overhead.
    Type: Application
    Filed: June 17, 2014
    Publication date: December 17, 2015
    Inventors: Ambrish Tyagi, Kah Kuen Fu, Tianyang Ma, Kenneth Mark Karakotsios, Michael Lee Sandige, David Wayne Stafford, Steven Bennett
  • Publication number: 20150189188
    Abstract: A user attempting to obtain information about an object can capture image information including a view of that object, and the image information can be used with a matching or identification process to provide information about that type of object to the user. In order to narrow the search space to a specific category, and thus improve the accuracy of the results and the speed at which results can be obtained, the user can be guided to capture image information with an appropriate orientation. An outline or other graphical guide can be displayed over image information captured by a computing device, in order to guide the user in capturing the object from an appropriate direction and with an appropriate scale for the type of matching and/or information used for the matching. Such an approach enables three-dimensional objects to be analyzed using conventional two-dimensional identification algorithms, among other such processes.
    Type: Application
    Filed: December 31, 2014
    Publication date: July 2, 2015
    Inventors: Francislav Petrov Penov, Aaron Michael Donsbach, Geoffrey Scott Heller, Kenneth Mark Karakotsios, Daniel Bibireata, Kah Kuen Fu, Richard Howard Suplee, III, Timothy Youngjin Sohn
  • Publication number: 20150116518
    Abstract: Image capture can be improved by capturing a sequence of images and analyzing the images to select the image with the least blur and/or an acceptable amount of blur. Gradients can be calculated for at least a portion of the images, and gradient histograms generated. Two or more component curves can be fit to each histogram, such as by using a Gaussian mixture model, and the curves can be compared to determine an amount of variation between the curves. The image with the smallest differences between component curves, or with differences less than a specified blur threshold, can be selected as a sufficiently sharp image and provided for viewing, processing, or another intended purpose of the image to be captured.
    Type: Application
    Filed: December 29, 2014
    Publication date: April 30, 2015
    Inventors: Kah Kuen Fu, Kenneth Mark Karakotsios, Volodymyr V. Ivanchenko
  • Publication number: 20150078623
    Abstract: The computational resources needed to perform processes such as image recognition can be reduced by determining appropriate frames of image information to use for the processing. In some embodiments, infrared imaging can be used to determine when a person is looking substantially towards a device, such that an image frame captured at that time will likely be adequate for facial recognition. In other embodiments, sound triangulation or motion sensing can be used to assist in determining which captured image frames to discard and which to select for processing based on any of a number of factors indicative of a proper frame for processing.
    Type: Application
    Filed: November 24, 2014
    Publication date: March 19, 2015
    Inventors: KENNETH M. KARAKOTSIOS, Kah Kuen Fu, Volodymyr V. Ivanchenko, Mingjing Huang
  • Patent number: 8922662
    Abstract: Image capture can be improved by capturing a sequence of images and analyzing the images to select the image with the least blur and/or an acceptable amount of blur. Gradients can be calculated for at least a portion of the images, and gradient histograms generated. Two or more component curves can be fit to each histogram, such as by using a Gaussian mixture model, and the curves can be compared to determine an amount of variation between the curves. The image with the smallest differences between component curves, or with differences less than a specified blur threshold, can be selected as a sufficiently sharp image and provided for viewing, processing, or another intended purpose of the image to be captured.
    Type: Grant
    Filed: July 25, 2012
    Date of Patent: December 30, 2014
    Assignee: Amazon Technologies, Inc.
    Inventors: Kah Kuen Fu, Kenneth M. Karakotsios, Volodymyr V. Ivanchenko
  • Patent number: 8897510
    Abstract: The computational resources needed to perform processes such as image recognition can be reduced by determining appropriate frames of image information to use for the processing. In some embodiments, infrared imaging can be used to determine when a person is looking substantially towards a device, such that an image frame captured at that time will likely be adequate for facial recognition. In other embodiments, sound triangulation or motion sensing can be used to assist in determining which captured image frames to discard and which to select for processing based on any of a number of factors indicative of a proper frame for processing.
    Type: Grant
    Filed: January 9, 2014
    Date of Patent: November 25, 2014
    Assignee: Amazon Technologies, Inc.
    Inventors: Kenneth M. Karakotsios, Kah Kuen Fu, Volodymyr V. Ivanchenko, Mingjing Huang
  • Publication number: 20140313858
    Abstract: The relative positions of two or more electronic devices can be determined utilizing ultrasonic beacons. Each device can have a unique signature that can be included in the beacon broadcast by that device. A device having an array of ultrasonic detectors can receive a beacon and correlate the beacon received at each detector. The time of arrival then can be used to determine the relative position of the source of the beacon. The signature in that beacon can also be used to determine the identity of the device that broadcast the beacon, in order to determine the identity of the device, or a user of that device, at the determined relative position. The devices can be configured to transmit signals over the air or through a specific transmission medium, such as propagating surface. Further, a dedicated detector array can be used for determining multiple relative positions.
    Type: Application
    Filed: July 2, 2014
    Publication date: October 23, 2014
    Inventors: Andrew D. Price, Kah Kuen Fu, Kaixiang Hu
  • Publication number: 20140211067
    Abstract: A user attempting to obtain information about an object can capture image information including a view of that object, and the image information can be used with a matching or identification process to provide information about that type of object to the user. In order to narrow the search space to a specific category, and thus improve the accuracy of the results and the speed at which results can be obtained, the user can be guided to capture image information with an appropriate orientation. An outline or other graphical guide can be displayed over image information captured by a computing device, in order to guide the user in capturing the object from an appropriate direction and with an appropriate scale for the type of matching and/or information used for the matching. Such an approach enables three-dimensional objects to be analyzed using conventional two-dimensional identification algorithms, among other such processes.
    Type: Application
    Filed: March 31, 2014
    Publication date: July 31, 2014
    Applicant: Amazon Technologies, Inc.
    Inventors: Francislav Petrov Penov, Aaron Michael Donsbach, Geoffrey Scott Heller, Kenneth Mark Karakotsios, Daniel Bibireata, Kah Kuen Fu, Richard Howard Suplee, III, Timothy Youngjin Sohn
  • Patent number: 8743051
    Abstract: An electronic device automatically reverses a left-right orientation of content displayed by the device when detecting that a user is viewing content of the device via a mirror. Some embodiments reverse the content upon detecting a trigger such as a reflection of an image displayed by the device, indicating that the device is displaying content against a mirror. In some embodiments, the device reverses the content upon detecting that blinking markers displayed by the device are inverted or upon detecting a blinking marker flashing in a particular pattern consistent to that emitted by the device. Some embodiments reverse the content upon detecting both the reflection of the image and a reflection of the user. Further, some embodiments reverse the content upon determining that the user is facing a mirror and switches back to its normal orientation when the user is viewing the content by directly looking at the device.
    Type: Grant
    Filed: September 20, 2011
    Date of Patent: June 3, 2014
    Assignee: Amazon Technologies, Inc.
    Inventors: Steven Ka Cheung Moy, Kah Kuen Fu, Volodymyr V. Ivanchenko, Gunnar Hovden
  • Publication number: 20140126777
    Abstract: The computational resources needed to perform processes such as image recognition can be reduced by determining appropriate frames of image information to use for the processing. In some embodiments, infrared imaging can be used to determine when a person is looking substantially towards a device, such that an image frame captured at that time will likely be adequate for facial recognition. In other embodiments, sound triangulation or motion sensing can be used to assist in determining which captured image frames to discard and which to select for processing based on any of a number of factors indicative of a proper frame for processing.
    Type: Application
    Filed: January 9, 2014
    Publication date: May 8, 2014
    Applicant: AMAZON TECHNOLOGIES, INC.
    Inventors: Kenneth M. Karakotsios, KAH KUEN FU, VOLODYMYR V. IVANCHENKO, MINGJING HUANG
  • Patent number: 8705812
    Abstract: The computational resources needed to perform processes such as image recognition can be reduced by determining appropriate frames of image information to use for the processing. In some embodiments, infrared imaging can be used to determine when a person is looking substantially towards a device, such that an image frame captured at that time will likely be adequate for facial recognition. In other embodiments, sound triangulation or motion sensing can be used to assist in determining which captured image frames to discard and which to select for processing based on any of a number of factors indicative of a proper frame for processing.
    Type: Grant
    Filed: June 10, 2011
    Date of Patent: April 22, 2014
    Assignee: Amazon Technologies, Inc.
    Inventors: Kenneth M. Karakotsios, Kah Kuen Fu, Volodymyr V. Ivanchenko, Mingjing Huang