Patents by Inventor YUNQI ZHAO

YUNQI ZHAO has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240325901
    Abstract: A device may access a feature vector generated based on interactions by a user with a video game. The device may access a cluster map comprising a mapping of user clusters, wherein each location within the cluster map is associated with a set of users whose feature vectors are within a threshold degree of similarity of each other. The cluster map may be generated using a plurality of extracted feature vectors obtained from interaction information. A device may determine a map location within the cluster map associated with the user based at least in part on the feature vector. A device may determine a target map location within the cluster map. A device may determine a guidance action based at least in part on the target map location and the map location associated with the user. A device may execute the guidance action.
    Type: Application
    Filed: March 30, 2023
    Publication date: October 3, 2024
    Inventors: Siddharth Mysore Sthaneshwar, Yunqi Zhao, Xin Gao, Alec Jarred Antrim, Harold Henry Chaput, Fernando de Mesentier Silva
  • Patent number: 11534690
    Abstract: According to a first aspect of this specification, there is disclosed a computer implemented method comprising: training, based on an initial behavior goal and using reinforcement-learning, a reinforcement-learning model for controlling behavior of a non-playable character in a computer game environment; converting the trained reinforcement-learning model into a behavior tree model for controlling behavior of the non-playable character; editing, based on a user input, the behavior tree model to generate an updated behavior tree model for controlling behavior of the non-playable character; and outputting a final model for controlling non-player character behavior for use in the computer game environment, wherein the model for controlling non-player character behavior is based at least in part on the updated behavior tree model.
    Type: Grant
    Filed: August 21, 2020
    Date of Patent: December 27, 2022
    Assignee: ELECTRONIC ARTS INC.
    Inventors: Meng Wu, Harold Chaput, Navid Aghdaie, Kazi Zaman, Yunqi Zhao, Qilian Yu
  • Publication number: 20220054943
    Abstract: According to a first aspect of this specification, there is disclosed a computer implemented method comprising: training, based on an initial behavior goal and using reinforcement-learning, a reinforcement-learning model for controlling behavior of a non-playable character in a computer game environment; converting the trained reinforcement-learning model into a behavior tree model for controlling behavior of the non-playable character; editing, based on a user input, the behavior tree model to generate an updated behavior tree model for controlling behavior of the non-playable character; and outputting a final model for controlling non-player character behavior for use in the computer game environment, wherein the model for controlling non-player character behavior is based at least in part on the updated behavior tree model.
    Type: Application
    Filed: August 21, 2020
    Publication date: February 24, 2022
    Inventors: Meng Wu, Harold Chaput, Navid Aghdaie, Kazi Zaman, Yunqi Zhao, Qilian Yu
  • Patent number: 11110353
    Abstract: System and methods for utilizing a video game console to monitor the player's video game, detect when a particular gameplay situation occurs during the player's video game experience, and collect game state data corresponding to how the player reacts to the particular gameplay situation or an effect of the reaction. In some cases, the video game console can receive an exploratory rule set to apply during the particular gameplay situation. In some cases, the video game console can trigger the particular gameplay situation. A system can receive the game state data from many video game consoles and train a rule set based on the game state data. Advantageously, the system can save computational resources by utilizing the players' video game experience to train the rule set.
    Type: Grant
    Filed: July 10, 2019
    Date of Patent: September 7, 2021
    Assignee: Electronic Arts Inc.
    Inventors: Caedmon Somers, Jason Rupert, Igor Borovikov, Ahmad Beirami, Yunqi Zhao, Mohsen Sardari, John Kolen, Navid Aghdaie, Kazi Atif-Uz Zaman
  • Patent number: 10940393
    Abstract: Systems and methods are disclosed for training a machine learning model to control an in-game character or other entity in a video game in a manner that aims to imitate how a particular player would control the character or entity. A generic behavior model that is trained without respect to the particular player may be obtained and then customized based on observed gameplay of the particular player. The customization training process may include freezing at least a subset of layers or levels in the generic model, then generating one or more additional layers or levels that are trained using gameplay data for the particular player.
    Type: Grant
    Filed: July 2, 2019
    Date of Patent: March 9, 2021
    Assignee: Electronic Arts Inc.
    Inventors: Caedmon Somers, Jason Rupert, Igor Borovikov, Ahmad Beirami, Yunqi Zhao, Mohsen Sardari, Harold Henry Chaput, Navid Aghdaie, Kazi Atif-Uz Zaman
  • Publication number: 20210008456
    Abstract: System and methods for utilizing a video game console to monitor the player's video game, detect when a particular gameplay situation occurs during the player's video game experience, and collect game state data corresponding to how the player reacts to the particular gameplay situation or an effect of the reaction. In some cases, the video game console can receive an exploratory rule set to apply during the particular gameplay situation. In some cases, the video game console can trigger the particular gameplay situation. A system can receive the game state data from many video game consoles and train a rule set based on the game state data. Advantageously, the system can save computational resources by utilizing the players' video game experience to train the rule set.
    Type: Application
    Filed: July 10, 2019
    Publication date: January 14, 2021
    Inventors: Caedmon Somers, Jason Rupert, Igor Borovikov, Ahmad Beirami, Yunqi Zhao, Mohsen Sardari, John Kolen, Navid Aghdaie, Kazi Atif-Uz Zaman
  • Publication number: 20210001229
    Abstract: Systems and methods are disclosed for training a machine learning model to control an in-game character or other entity in a video game in a manner that aims to imitate how a particular player would control the character or entity. A generic behavior model that is trained without respect to the particular player may be obtained and then customized based on observed gameplay of the particular player. The customization training process may include freezing at least a subset of layers or levels in the generic model, then generating one or more additional layers or levels that are trained using gameplay data for the particular player.
    Type: Application
    Filed: July 2, 2019
    Publication date: January 7, 2021
    Inventors: Caedmon Somers, Jason Rupert, Igor Borovikov, Ahmad Beirami, Yunqi Zhao, Mohsen Sardari, Harold Henry Chaput, Navid Aghdaie, Kazi Atif-Uz Zaman
  • Patent number: 10161161
    Abstract: An enclosing wallboard firm-connection device includes an enclosing wall, a column body and a door. The column body is mounted on the enclosing wall, the door is mounted on the column body. The enclosing wall consists of enclosing wallboards, a lower end cap is mounted at lower end of the enclosing wall, a connecting piece is mounted on the lower end cap. The enclosing wallboards are inserted into the connecting piece, bumps are arranged at upper ends of the enclosing wallboards, grooves are formed in lower ends of the enclosing wallboards. The enclosing wallboards are combined together. The fence is mounted at upper end of the enclosing wall, protection strips are mounted on upper and lower edges of the fence, the connecting piece is mounted at upper end of the protection strip, and an upper end cap is mounted at upper end of the connecting piece.
    Type: Grant
    Filed: January 31, 2016
    Date of Patent: December 25, 2018
    Inventors: Jihong Yin, Xiaochen Hu, Yunqi Zhao, Jiabin Zhao
  • Patent number: 9856660
    Abstract: The invention relates to the field of home decoration, in particular to a home plate connecting device, which includes a plate and plate connecting piece, a glass and plate connecting piece, a plate bottom edge and ground connecting piece, a decorative plate and plate connecting piece, a doorframe and wall connecting piece and a plate chamfer connecting piece, wherein each of the connecting pieces is provided with a rubber barbed tenon structure and a mortise structure with a barbed accommodation groove. According to the invention, the mortise and tenon structures and a threaded connection manner are adopted for fixation, so that the device can be freely dismounted and conveniently packaged and transported; each part is matched, and is easy to position, so that mounting and dismounting working efficiency is improved; and the dismounted parts are prevented from damage, and are high in reutilization rate, so that the device can be widely applied to the field of home mounting and decoration.
    Type: Grant
    Filed: January 31, 2016
    Date of Patent: January 2, 2018
    Inventors: Jihong Yin, Yongkang Zhao, Xiaochen Hu, Yunqi Zhao
  • Publication number: 20170191275
    Abstract: The invention relates to the field of home decoration, in particular to a home plate connecting device, which includes a plate and plate connecting piece, a glass and plate connecting piece, a plate bottom edge and ground connecting piece, a decorative plate and plate connecting piece, a doorframe and wall connecting piece and a plate chamfer connecting piece, wherein each of the connecting pieces is provided with a rubber barbed tenon structure and a mortise structure with a barbed accommodation groove. According to the invention, the mortise and tenon structures and a threaded connection manner are adopted for fixation, so that the device can be freely dismounted and conveniently packaged and transported; each part is matched, and is easy to position, so that mounting and dismounting working efficiency is improved; and the dismounted parts are prevented from damage, and are high in reutilization rate, so that the device can be widely applied to the field of home mounting and decoration.
    Type: Application
    Filed: January 31, 2016
    Publication date: July 6, 2017
    Inventors: Jihong Yin, Yongkang Zhao, Xiaochen Hu, Yunqi Zhao
  • Publication number: 20160362909
    Abstract: The invention relates to a novel enclosing wallboard firm-connection device, and belongs to the field of furniture.
    Type: Application
    Filed: January 31, 2016
    Publication date: December 15, 2016
    Inventors: Jihong Yin, Xiaochen Hu, Yunqi Zhao, Jiabin Zhao
  • Publication number: 20160279108
    Abstract: The present invention is directed to drug conjugates of mTOR inhibitors comprising an mTOR inhibitor, such as rapamycin, conjugated to hyaluronic acid by a linker comprising an ester, carbonate, or carbamate. The present invention is also directed to pharmaceutical compositions comprising the drug conjugates, and methods of making and using the drug conjugates and the pharmaceutical compositions.
    Type: Application
    Filed: February 24, 2016
    Publication date: September 29, 2016
    Applicants: UNIVERSITY OF KANSAS, NANOPHARM LLC (d/b/a HYLAPHARM)
    Inventors: MARCUS LAIRD FORREST, TI ZHANG, S P SANJEEWA N. SENADHEERA, DANIEL AIRES, YUNQI ZHAO, SHAOFENG DUAN, CHAD GROER