Patents by Inventor Zongyi Liu

Zongyi Liu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11516538
    Abstract: Systems and methods are described herein for detecting image impairments indicating low quality images within video content. An image impairment detection (IMD) model can be generated with a training data set including images that include one or more image impairments. Video content comprising a set of video frames may be obtained and a video frame provided to the image impairment detection model as input. Output may be received from the image impairment detection model indicating that the video frame includes an image impairment artifact indicative of a particular image impairment. One or more operations may be executed based at least in part on the output received.
    Type: Grant
    Filed: September 29, 2020
    Date of Patent: November 29, 2022
    Assignee: Amazon Technologies, Inc.
    Inventors: Zongyi Liu, Bruce Ferry, Simon Paul Lacasse, Hai Wei
  • Patent number: 11445168
    Abstract: Techniques for content-adaptive video sampling for automated video quality monitoring are described.
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: September 13, 2022
    Assignee: Amazon Technologies, Inc.
    Inventors: Hai Wei, Charles Benjamin Waggoner, Zongyi Liu, Srinivas Rajagopalan, Lei Li
  • Patent number: 11336935
    Abstract: Techniques are described for detecting desynchronization between an audio stream and a video stream.
    Type: Grant
    Filed: November 25, 2020
    Date of Patent: May 17, 2022
    Assignee: Amazon Technologies, Inc.
    Inventors: Yongjun Wu, Joshua Peter Ebenezer, Sriram Sethuraman, Hai Wei, Zongyi Liu
  • Patent number: 11160466
    Abstract: A wearable heart rate monitoring device includes an optical sensor configured to translate test light reflected from a wearer of the wearable heart rate monitoring device into a machine-readable heart rate signal. The wearable heart rate monitoring device also includes an elevation sensor configured to translate an elevation of the wearable heart rate monitoring device into a machine-readable elevation signal. The wearable heart rate monitoring device further includes a heart rate reporting machine configured to output an estimated heart rate based on at least the machine-readable heart rate signal and the machine-readable elevation signal.
    Type: Grant
    Filed: February 2, 2016
    Date of Patent: November 2, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Zongyi Liu, Haithem Albadawi, Shunan Li
  • Patent number: 11096595
    Abstract: Methods and devices for blood pressure monitoring may include receiving one or more sensor measurements from the at least one sensor. The methods and devices may further include determining at least one of a first blood pressure indication using a first regression representation based on the one or more sensor measurements, a second blood pressure indication using a second regression representation based on the one or more sensor measurements, or a third blood pressure indication using a third regression representation based on the one or more sensor measurements. The methods and devices may include performing a blood pressure selection procedure using the first blood pressure indication, the second blood pressure indication, and the third blood pressure indication to determine an estimated blood pressure indication based on one or more classification characteristics. The methods and devices may further include transmitting the estimated blood pressure indication to the output device.
    Type: Grant
    Filed: November 15, 2016
    Date of Patent: August 24, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Haithem Albadawi, Zongyi Liu, Christopher Nuesmeyer
  • Patent number: 10898144
    Abstract: Methods and devices for heart rate monitoring may include determining whether an adjustment triggering condition has been met. Moreover, the methods and devices may include, in accordance with a determination that the adjustment triggering condition has been met, adjusting the second sensor indication to obtain an adjusted second sensor indication based at least on the difference between the first sensor indication and the second sensor indication. The methods and devices may further include, in accordance with a determination that the adjustment triggering condition has not been met, transmitting the second sensor indication to the signaling filter.
    Type: Grant
    Filed: November 22, 2016
    Date of Patent: January 26, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Zongyi Liu, Haithem Albadawi, Han Yee Mimi Fung, Christopher Nuesmeyer
  • Patent number: 10869091
    Abstract: Systems, methods, and computer-readable media are disclosed for systems and methods for latency detection for streaming video. Example methods may include receiving a request to determine a time to first frame for video content, determining a streaming service and a playback device associated with the request, and determining a time at which playback of the content is initiated. Example methods include capturing a playback sequence of the video content, classifying individual frames of the playback sequence, where each classification is associated with a probability value indicative of a likelihood the frame is a first frame, analyzing classifications of the individual frames, and determining, based at least in part on the analysis of the classifications of the individual frames, the time to first frame for the video content.
    Type: Grant
    Filed: August 6, 2019
    Date of Patent: December 15, 2020
    Assignee: Amazon Technologies, Inc.
    Inventors: Zongyi Liu, Bruce Ferry, Ayush Goyal, Kun Chen
  • Patent number: 10766143
    Abstract: Techniques for systems and methods that provide for utilizing a robotic system to type commands that correspond to voice commands using a keyboard of a device are described herein. In embodiments, an image of a device may be received from a camera. A keyboard region of the device may be determined based on a keyboard detection algorithm that uses the image. One or more characters in a portion of the image that corresponds to the keyboard region of the device may be detected based on a character detection algorithm. The one or more characters may be grouped into one or more groups based on the portion of the image. A character of a portion of character associated with a group may be edited based on an error detection algorithm.
    Type: Grant
    Filed: November 13, 2018
    Date of Patent: September 8, 2020
    Assignee: Amazon Technologies, Inc.
    Inventors: Zongyi Liu, Bruce Ferry, Kun Chen, Andrew Becker
  • Patent number: 10621478
    Abstract: Examples are disclosed herein that relate to entity tracking. One examples provides a computing device comprising a logic processor and a storage device holding instructions executable by the logic processor to receive image data of an environment including a person, process the image data using a face detection algorithm to produce a first face detection output at a first frequency, determine an identity of the person based on the first face detection output, and process the image data using another algorithm that uses less computational resources of the computing device than the face detection algorithm. The instructions are further executable to track the person within the environment based on the tracking output, and perform one or more of updating the other algorithm using a second face detection output, and updating the face detection algorithm using the tracking output.
    Type: Grant
    Filed: September 17, 2019
    Date of Patent: April 14, 2020
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Haithem Albadawi, Zongyi Liu
  • Publication number: 20200012906
    Abstract: Examples are disclosed herein that relate to entity tracking. One examples provides a computing device comprising a logic processor and a storage device holding instructions executable by the logic processor to receive image data of an environment including a person, process the image data using a face detection algorithm to produce a first face detection output at a first frequency, determine an identity of the person based on the first face detection output, and process the image data using another algorithm that uses less computational resources of the computing device than the face detection algorithm. The instructions are further executable to track the person within the environment based on the tracking output, and perform one or more of updating the other algorithm using a second face detection output, and updating the face detection algorithm using the tracking output.
    Type: Application
    Filed: September 17, 2019
    Publication date: January 9, 2020
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Haithem ALBADAWI, Zongyi LIU
  • Patent number: 10467509
    Abstract: A computationally-efficient method for a smart assistant computer to track a human includes receiving data from one or more sensors configured to monitor a physical environment. The data is computer-analyzed to recognize presence of a human in the physical environment, and upon confirming an identity of the human, a first level of computational resources of the smart assistant computer is dedicated to track the human. Upon failing to confirm the identity of the human while a known user is present, a second level of computational resources of the smart assistant computer, greater than the first level, is dedicated to determine the identity of the human. Upon failing to confirm the identity of the human while the known user is absent, a third level of computational resources of the smart assistant computer, is dedicated to determine the identity of the human.
    Type: Grant
    Filed: June 28, 2017
    Date of Patent: November 5, 2019
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Haithem Albadawi, Zongyi Liu
  • Patent number: 10467510
    Abstract: Examples are disclosed herein that relate to entity tracking. One examples provides a computing device comprising a logic processor and a storage device holding instructions executable by the logic processor to receive image data of an environment including a person, process the image data using a face detection algorithm to produce a first face detection output at a first frequency, determine an identity of the person based on the first face detection output, and process the image data using another algorithm that uses less computational resources of the computing device than the face detection algorithm. The instructions are further executable to track the person within the environment based on the tracking output, and perform one or more of updating the other algorithm using a second face detection output, and updating the face detection algorithm using the tracking output.
    Type: Grant
    Filed: June 28, 2017
    Date of Patent: November 5, 2019
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Haithem Albadawi, Zongyi Liu
  • Patent number: 10423863
    Abstract: Examples are disclosed herein that relate to entity tracking. One examples provides a computing device comprising a logic processor and a storage device holding instructions executable by the logic processor to receive image data of an environment including a person, process the image data using a face detection algorithm to produce a first face detection output at a first frequency, determine an identity of the person based on the first face detection output, and process the image data using another algorithm that uses less computational resources of the computing device than the face detection algorithm. The instructions are further executable to track the person within the environment based on the tracking output, and perform one or more of updating the other algorithm using a second face detection output, and updating the face detection algorithm using the tracking output.
    Type: Grant
    Filed: June 28, 2017
    Date of Patent: September 24, 2019
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Haithem Albadawi, Zongyi Liu
  • Patent number: 10314504
    Abstract: Methods and devices for correcting electrocardiogram (EKG) indication saturation may include receiving an EKG indication from at least one sensor and determining that a saturation condition has been met in response to receiving the EKG indication. Additionally, the methods and devices may include incrementing an EKG saturation level based on a determination that the saturation condition has been met. Moreover, the methods and devices may include determining whether the EKG saturation level satisfies an EKG saturation threshold. The methods and device may include disregarding at least a second EKG indication in accordance with a determination that the saturation level satisfies the EKG saturation threshold. The methods and devices may further include transmitting the second EKG indication to an output device in accordance with a determination that the saturation level does not satisfy the EKG saturation threshold.
    Type: Grant
    Filed: November 15, 2016
    Date of Patent: June 11, 2019
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Haithem Albadawi, Chris Reidy, Zongyi Liu
  • Publication number: 20180293221
    Abstract: A method to execute computer-actionable directives conveyed in human speech comprises: receiving audio data recording speech from one or more speakers; converting the audio data into a linguistic representation of the recorded speech; detecting a target corresponding to the linguistic representation; committing to the data structure language data associated with the detected target and based on the linguistic representation; parsing the data structure to identify one or more of the computer-actionable directives; and submitting the one or more of the computer-actionable directives to the computer for processing.
    Type: Application
    Filed: June 11, 2018
    Publication date: October 11, 2018
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Erich-Soren FINKELSTEIN, Han Yee Mimi FUNG, Aleksandar UZELAC, Oz SOLOMON, Keith Coleman HEROLD, Vivek PRADEEP, Zongyi LIU, Kazuhito KOISHIDA, Haithem ALBADAWI, Steven Nabil BATHICHE, Christopher Lance NUESMEYER, Michelle Lynn HOLTMANN, Christopher Brian QUIRK, Pablo Luis SALA
  • Publication number: 20180232902
    Abstract: A computationally-efficient method for a smart assistant computer to track a human includes receiving data from one or more sensors configured to monitor a physical environment. The data is computer-analyzed to recognize presence of a human in the physical environment, and upon confirming an identity of the human, a first level of computational resources of the smart assistant computer is dedicated to track the human. Upon failing to confirm the identity of the human while a known user is present, a second level of computational resources of the smart assistant computer, greater than the first level, is dedicated to determine the identity of the human. Upon failing to confirm the identity of the human while the known user is absent, a third level of computational resources of the smart assistant computer, is dedicated to determine the identity of the human.
    Type: Application
    Filed: June 28, 2017
    Publication date: August 16, 2018
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Haithem ALBADAWI, Zongyi LIU
  • Publication number: 20180232563
    Abstract: Examples are disclosed herein that relate to entity tracking. One examples provides a computing device comprising a logic processor and a storage device holding instructions executable by the logic processor to receive image data of an environment including a person, process the image data using a face detection algorithm to produce a first face detection output at a first frequency, determine an identity of the person based on the first face detection output, and process the image data using another algorithm that uses less computational resources of the computing device than the face detection algorithm. The instructions are further executable to track the person within the environment based on the tracking output, and perform one or more of updating the other algorithm using a second face detection output, and updating the face detection algorithm using the tracking output.
    Type: Application
    Filed: June 28, 2017
    Publication date: August 16, 2018
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Haithem ALBADAWI, Zongyi LIU
  • Patent number: 9980657
    Abstract: An optical heart rate sensor stores data indicating the timing of heart beats in a first-in-first-out rolling buffer. During a first condition, new data is added to the rolling buffer and adjusted such that a duration preceding a newly detected heart beat is closer to an average duration between each pair of consecutive heart beats stored in the rolling buffer if the duration preceding the newly detected heart beat differs from the average duration by more than a duration threshold. The rolling buffer is cleared when a number of data adjustments over a predetermined time period exceeds a counting threshold. The rolling buffer is then repopulated such that the duration between each pair of consecutive heart beats is equal to a most recent duration between consecutive heart beats that did not differ from the average duration by more than the duration threshold.
    Type: Grant
    Filed: May 30, 2014
    Date of Patent: May 29, 2018
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Zongyi Liu, Haithem Albadawi, Qing Xie
  • Publication number: 20180140253
    Abstract: Methods and devices for heart rate monitoring may include determining whether an adjustment triggering condition has been met. Moreover, the methods and devices may include, in accordance with a determination that the adjustment triggering condition has been met, adjusting the second sensor indication to obtain an adjusted second sensor indication based at least on the difference between the first sensor indication and the second sensor indication. The methods and devices may further include, in accordance with a determination that the adjustment triggering condition has not been met, transmitting the second sensor indication to the signaling filter.
    Type: Application
    Filed: November 22, 2016
    Publication date: May 24, 2018
    Inventors: Zongyi LIU, Haithem ALBADAWI, Han Yee Mimi FUNG, Christopher NUESMEYER
  • Publication number: 20180132731
    Abstract: Methods and devices for blood pressure monitoring may include receiving one or more sensor measurements from the at least one sensor. The methods and devices may further include determining at least one of a first blood pressure indication using a first regression representation based on the one or more sensor measurements, a second blood pressure indication using a second regression representation based on the one or more sensor measurements, or a third blood pressure indication using a third regression representation based on the one or more sensor measurements. The methods and devices may include performing a blood pressure selection procedure using the first blood pressure indication, the second blood pressure indication, and the third blood pressure indication to determine an estimated blood pressure indication based on one or more classification characteristics. The methods and devices may further include transmitting the estimated blood pressure indication to the output device.
    Type: Application
    Filed: November 15, 2016
    Publication date: May 17, 2018
    Inventors: Haithem ALBADAWI, Zongyi LIU, Christopher NUESMEYER