Patents by Inventor Yu Ouyang

Yu Ouyang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240082169
    Abstract: The present invention provides nanoparticle carriers of active agents which are functionalized by stimuli-responsive conjugation with DNA-nano structures, methods and processes for their preparation, compositions comprising them and uses thereof in methods of treating diseases, disorders and symptoms thereof.
    Type: Application
    Filed: January 17, 2022
    Publication date: March 14, 2024
    Applicant: Yissum Research Development Company of The Hebrew University of Jerusalem Ltd.
    Inventors: Itamar WILLNER, Eli PIKARSKY, Rachel NECHUSHTAI, Yang-Sung SOHN, Pu ZHANG, Yu OUYANG
  • Publication number: 20240086063
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for cross input modality learning in a mobile device are disclosed. In one aspect, a method includes activating a first modality user input mode in which user inputs by way of a first modality are recognized using a first modality recognizer; and receiving a user input by way of the first modality. The method includes, obtaining, as a result of the first modality recognizer recognizing the user input, a transcription that includes a particular term; and generating an input context data structure that references at least the particular term. The method further includes, transmitting, by the first modality recognizer, the input context data structure to a second modality recognizer for use in updating a second modality recognition model associated with the second modality recognizer.
    Type: Application
    Filed: November 22, 2023
    Publication date: March 14, 2024
    Inventors: Yu Ouyang, Diego Melendo Casado, Mohammadinamul Hasan Sheik, Francoise Beaufays, Dragan Zivkovic, Meltem Oktem
  • Patent number: 11914964
    Abstract: The present application discloses a method and apparatus for training a semantic representation model, a device and a computer storage medium, which relates to the field of natural language processing technologies in artificial intelligence.
    Type: Grant
    Filed: March 22, 2021
    Date of Patent: February 27, 2024
    Assignee: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
    Inventors: Shuohuan Wang, Jiaxiang Liu, Xuan Ouyang, Yu Sun, Hua Wu, Haifeng Wang
  • Patent number: 11875274
    Abstract: A method may include determining, by a computing device and based on at least one user coherency factor, a user coherency level. The coherency level may include a predicted ability of a user to comprehend information. The method may also include determining, by the computing device and based on the user coherency level, information having a complexity that satisfies the predicted ability of the user to comprehend information. The method may further include outputting, by the computing device, at least a portion of the information.
    Type: Grant
    Filed: January 23, 2023
    Date of Patent: January 16, 2024
    Assignee: GOOGLE LLC
    Inventor: Yu Ouyang
  • Patent number: 11842045
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for cross input modality learning in a mobile device are disclosed. In one aspect, a method includes activating a first modality user input mode in which user inputs by way of a first modality are recognized using a first modality recognizer; and receiving a user input by way of the first modality. The method includes, obtaining, as a result of the first modality recognizer recognizing the user input, a transcription that includes a particular term; and generating an input context data structure that references at least the particular term. The method further includes, transmitting, by the first modality recognizer, the input context data structure to a second modality recognizer for use in updating a second modality recognition model associated with the second modality recognizer.
    Type: Grant
    Filed: August 31, 2022
    Date of Patent: December 12, 2023
    Assignee: Google LLC
    Inventors: Yu Ouyang, Diego Melendo Casado, Mohammadinamul Hasan Sheik, Francoise Beaufays, Dragan Zivkovic, Meltem Oktem
  • Patent number: 11783596
    Abstract: Machine-learning models are described detecting the signaling state of a traffic signaling unit. A system can obtain an image of the traffic signaling unit, and select a model of the traffic signaling unit that identifies a position of each traffic lighting element on the unit. First and second neural network inputs are processed with a neural network to generate an estimated signaling state of the traffic signaling unit. The first neural network input can represent the image of the traffic signaling unit, and the second neural network input can represent the model of the traffic signaling unit. Using the estimated signaling state of the traffic signaling unit, the system can inform a driving decision of a vehicle.
    Type: Grant
    Filed: May 6, 2022
    Date of Patent: October 10, 2023
    Assignee: Waymo LLC
    Inventors: Edward Hsiao, Yu Ouyang, Maoqing Yao
  • Patent number: 11670038
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing point cloud data using dynamic voxelization. When deployed within an on-board system of a vehicle, processing the point cloud data using dynamic voxelization can be used to make autonomous driving decisions for the vehicle with enhanced accuracy, for example by combining representations of point cloud data characterizing a scene from multiple views of the scene.
    Type: Grant
    Filed: November 1, 2021
    Date of Patent: June 6, 2023
    Assignee: Waymo LLC
    Inventors: Yin Zhou, Pei Sun, Yu Zhang, Dragomir Anguelov, Jiyang Gao, Yu Ouyang, Zijian Guo, Jiquan Ngiam, Vijay Vasudevan
  • Patent number: 11573698
    Abstract: In some examples, a computing device includes at least one processor; and at least one module, operable by the at least one processor to: output, for display at an output device, a graphical keyboard; receive an indication of a gesture detected at a location of a presence-sensitive input device, wherein the location of the presence-sensitive input device corresponds to a location of the output device that outputs the graphical keyboard; determine, based on at least one spatial feature of the gesture that is processed by the computing device using a neural network, at least one character string, wherein the at least one spatial feature indicates at least one physical property of the gesture; and output, for display at the output device, based at least in part on the processing of the at least one spatial feature of the gesture using the neural network, the at least one character string.
    Type: Grant
    Filed: September 8, 2021
    Date of Patent: February 7, 2023
    Assignee: Google LLC
    Inventors: Shumin Zhai, Thomas Breuel, Ouais Alsharif, Yu Ouyang, Francoise Beaufays, Johan Schalkwyk
  • Patent number: 11562261
    Abstract: A method may include determining, by a computing device and based on at least one user coherency factor, a user coherency level. The coherency level may include a predicted ability of a user to comprehend information. The method may also include determining, by the computing device and based on the user coherency level, information having a complexity that satisfies the predicted ability of the user to comprehend information. The method may further include outputting, by the computing device, at least a portion of the information.
    Type: Grant
    Filed: April 4, 2019
    Date of Patent: January 24, 2023
    Assignee: Google LLC
    Inventor: Yu Ouyang
  • Publication number: 20220413696
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for cross input modality learning in a mobile device are disclosed. In one aspect, a method includes activating a first modality user input mode in which user inputs by way of a first modality are recognized using a first modality recognizer; and receiving a user input by way of the first modality. The method includes, obtaining, as a result of the first modality recognizer recognizing the user input, a transcription that includes a particular term; and generating an input context data structure that references at least the particular term. The method further includes, transmitting, by the first modality recognizer, the input context data structure to a second modality recognizer for use in updating a second modality recognition model associated with the second modality recognizer.
    Type: Application
    Filed: August 31, 2022
    Publication date: December 29, 2022
    Inventors: Yu Ouyang, Diego Melendo Casado, Mohammadinamul Hasan Sheik, Francoise Beaufays, Dragan Zivkovic, Meltem Oktem
  • Publication number: 20220335731
    Abstract: Machine-learning models are described detecting the signaling state of a traffic signaling unit. A system can obtain an image of the traffic signaling unit, and select a model of the traffic signaling unit that identifies a position of each traffic lighting element on the unit. First and second neural network inputs are processed with a neural network to generate an estimated signaling state of the traffic signaling unit. The first neural network input can represent the image of the traffic signaling unit, and the second neural network input can represent the model of the traffic signaling unit. Using the estimated signaling state of the traffic signaling unit, the system can inform a driving decision of a vehicle.
    Type: Application
    Filed: May 6, 2022
    Publication date: October 20, 2022
    Inventors: Edward Hsiao, Yu Ouyang, Maoqing Yao
  • Patent number: 11435898
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for cross input modality learning in a mobile device are disclosed. In one aspect, a method includes activating a first modality user input mode in which user inputs by way of a first modality are recognized using a first modality recognizer; and receiving a user input by way of the first modality. The method includes, obtaining, as a result of the first modality recognizer recognizing the user input, a transcription that includes a particular term; and generating an input context data structure that references at least the particular term. The method further includes, transmitting, by the first modality recognizer, the input context data structure to a second modality recognizer for use in updating a second modality recognition model associated with the second modality recognizer.
    Type: Grant
    Filed: October 6, 2020
    Date of Patent: September 6, 2022
    Assignee: Google LLC
    Inventors: Yu Ouyang, Diego Melendo Casado, Mohammadinamul Hasan Sheik, Francoise Beaufays, Dragan Zivkovic, Meltem Oktem
  • Patent number: 11379663
    Abstract: A computing device outputs a keyboard for display, receives an indication of a first gesture to select a first sequence of one or more keys, determines a set of candidate strings based in part on the first sequence of keys, and outputs for display at least one of the set of candidate strings. The computing device receives an indication of a second gesture to select a second sequence of one or more keys, and determines that characters associated with the second sequence of keys are included in a first candidate word based at least in part on the set of candidate strings, or are included in a second candidate word not based on the first sequence of keys. The computing device modifies the set of candidate strings based at least in part on the determination and outputs for display at least one of the modified candidate strings.
    Type: Grant
    Filed: March 4, 2021
    Date of Patent: July 5, 2022
    Assignee: Google LLC
    Inventors: Yu Ouyang, Shumin Zhai, Xiaojun Bi
  • Publication number: 20220156972
    Abstract: Methods, computer systems, and apparatus, including computer programs encoded on computer storage media, for generating a distance estimate for a target object that is depicted in an image of a scene in an environment. The system obtains data specifying (i) a target portion of the image that depicts the target object detected in the image, and (ii) one or more reference portions of the image that each depict a respective reference object detected in the image. The system further obtains, for each of the one or more reference objects, a respective distance measurement for the reference object that is a measurement of a distance from the reference object to a specified location in the environment. The system processes the obtained data to generate a distance estimate for the target object that is an estimate of a distance from the target object to the specified location in the environment.
    Type: Application
    Filed: November 15, 2021
    Publication date: May 19, 2022
    Inventors: Yu-Han Chen, Maya Kabkab, Ruichi Yu, Yingwei Li, Hang Zhao, Yu Ouyang
  • Patent number: 11328519
    Abstract: Machine-learning models are described detecting the signaling state of a traffic signaling unit. A system can obtain an image of the traffic signaling unit, and select a model of the traffic signaling unit that identifies a position of each traffic lighting element on the unit. First and second neural network inputs are processed with a neural network to generate an estimated signaling state of the traffic signaling unit. The first neural network input can represent the image of the traffic signaling unit, and the second neural network input can represent the model of the traffic signaling unit. Using the estimated signaling state of the traffic signaling unit, the system can inform a driving decision of a vehicle.
    Type: Grant
    Filed: July 23, 2020
    Date of Patent: May 10, 2022
    Assignee: Waymo LLC
    Inventors: Edward Hsiao, Yu Ouyang, Maoqing Yao
  • Publication number: 20220058858
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing point cloud data using dynamic voxelization. When deployed within an on-board system of a vehicle, processing the point cloud data using dynamic voxelization can be used to make autonomous driving decisions for the vehicle with enhanced accuracy, for example by combining representations of point cloud data characterizing a scene from multiple views of the scene.
    Type: Application
    Filed: November 1, 2021
    Publication date: February 24, 2022
    Inventors: Yin Zhou, Pei Sun, Yu Zhang, Dragomir Anguelov, Jiyang Gao, Yu Ouyang, Zijian Guo, Jiquan Ngiam, Vijay Vasudevan
  • Publication number: 20220027645
    Abstract: Machine-learning models are described detecting the signaling state of a traffic signaling unit. A system can obtain an image of the traffic signaling unit, and select a model of the traffic signaling unit that identifies a position of each traffic lighting element on the unit. First and second neural network inputs are processed with a neural network to generate an estimated signaling state of the traffic signaling unit. The first neural network input can represent the image of the traffic signaling unit, and the second neural network input can represent the model of the traffic signaling unit. Using the estimated signaling state of the traffic signaling unit, the system can inform a driving decision of a vehicle.
    Type: Application
    Filed: July 23, 2020
    Publication date: January 27, 2022
    Inventors: Edward Hsiao, Yu Ouyang, Maoqing Yao
  • Publication number: 20210405868
    Abstract: In some examples, a computing device includes at least one processor; and at least one module, operable by the at least one processor to: output, for display at an output device, a graphical keyboard; receive an indication of a gesture detected at a location of a presence-sensitive input device, wherein the location of the presence-sensitive input device corresponds to a location of the output device that outputs the graphical keyboard; determine, based on at least one spatial feature of the gesture that is processed by the computing device using a neural network, at least one character string, wherein the at least one spatial feature indicates at least one physical property of the gesture; and output, for display at the output device, based at least in part on the processing of the at least one spatial feature of the gesture using the neural network, the at least one character string.
    Type: Application
    Filed: September 8, 2021
    Publication date: December 30, 2021
    Applicant: Google LLC
    Inventors: Shumin Zhai, Thomas Breuel, Ouais Alsharif, Yu Ouyang, Francoise Beaufays, Johan Schalkwyk
  • Patent number: 11164363
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing point cloud data using dynamic voxelization. When deployed within an on-board system of a vehicle, processing the point cloud data using dynamic voxelization can be used to make autonomous driving decisions for the vehicle with enhanced accuracy, for example by combining representations of point cloud data characterizing a scene from multiple views of the scene.
    Type: Grant
    Filed: July 8, 2020
    Date of Patent: November 2, 2021
    Assignee: Waymo LLC
    Inventors: Yin Zhou, Pei Sun, Yu Zhang, Dragomir Anguelov, Jiyang Gao, Yu Ouyang, Zijian Guo, Jiquan Ngiam, Vijay Vasudevan
  • Patent number: D994164
    Type: Grant
    Filed: April 9, 2022
    Date of Patent: August 1, 2023
    Inventor: Yu Ouyang