Patents by Inventor YUNQI ZHAO
YUNQI ZHAO has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240325901Abstract: A device may access a feature vector generated based on interactions by a user with a video game. The device may access a cluster map comprising a mapping of user clusters, wherein each location within the cluster map is associated with a set of users whose feature vectors are within a threshold degree of similarity of each other. The cluster map may be generated using a plurality of extracted feature vectors obtained from interaction information. A device may determine a map location within the cluster map associated with the user based at least in part on the feature vector. A device may determine a target map location within the cluster map. A device may determine a guidance action based at least in part on the target map location and the map location associated with the user. A device may execute the guidance action.Type: ApplicationFiled: March 30, 2023Publication date: October 3, 2024Inventors: Siddharth Mysore Sthaneshwar, Yunqi Zhao, Xin Gao, Alec Jarred Antrim, Harold Henry Chaput, Fernando de Mesentier Silva
-
Patent number: 11534690Abstract: According to a first aspect of this specification, there is disclosed a computer implemented method comprising: training, based on an initial behavior goal and using reinforcement-learning, a reinforcement-learning model for controlling behavior of a non-playable character in a computer game environment; converting the trained reinforcement-learning model into a behavior tree model for controlling behavior of the non-playable character; editing, based on a user input, the behavior tree model to generate an updated behavior tree model for controlling behavior of the non-playable character; and outputting a final model for controlling non-player character behavior for use in the computer game environment, wherein the model for controlling non-player character behavior is based at least in part on the updated behavior tree model.Type: GrantFiled: August 21, 2020Date of Patent: December 27, 2022Assignee: ELECTRONIC ARTS INC.Inventors: Meng Wu, Harold Chaput, Navid Aghdaie, Kazi Zaman, Yunqi Zhao, Qilian Yu
-
Publication number: 20220054943Abstract: According to a first aspect of this specification, there is disclosed a computer implemented method comprising: training, based on an initial behavior goal and using reinforcement-learning, a reinforcement-learning model for controlling behavior of a non-playable character in a computer game environment; converting the trained reinforcement-learning model into a behavior tree model for controlling behavior of the non-playable character; editing, based on a user input, the behavior tree model to generate an updated behavior tree model for controlling behavior of the non-playable character; and outputting a final model for controlling non-player character behavior for use in the computer game environment, wherein the model for controlling non-player character behavior is based at least in part on the updated behavior tree model.Type: ApplicationFiled: August 21, 2020Publication date: February 24, 2022Inventors: Meng Wu, Harold Chaput, Navid Aghdaie, Kazi Zaman, Yunqi Zhao, Qilian Yu
-
Patent number: 11110353Abstract: System and methods for utilizing a video game console to monitor the player's video game, detect when a particular gameplay situation occurs during the player's video game experience, and collect game state data corresponding to how the player reacts to the particular gameplay situation or an effect of the reaction. In some cases, the video game console can receive an exploratory rule set to apply during the particular gameplay situation. In some cases, the video game console can trigger the particular gameplay situation. A system can receive the game state data from many video game consoles and train a rule set based on the game state data. Advantageously, the system can save computational resources by utilizing the players' video game experience to train the rule set.Type: GrantFiled: July 10, 2019Date of Patent: September 7, 2021Assignee: Electronic Arts Inc.Inventors: Caedmon Somers, Jason Rupert, Igor Borovikov, Ahmad Beirami, Yunqi Zhao, Mohsen Sardari, John Kolen, Navid Aghdaie, Kazi Atif-Uz Zaman
-
Patent number: 10940393Abstract: Systems and methods are disclosed for training a machine learning model to control an in-game character or other entity in a video game in a manner that aims to imitate how a particular player would control the character or entity. A generic behavior model that is trained without respect to the particular player may be obtained and then customized based on observed gameplay of the particular player. The customization training process may include freezing at least a subset of layers or levels in the generic model, then generating one or more additional layers or levels that are trained using gameplay data for the particular player.Type: GrantFiled: July 2, 2019Date of Patent: March 9, 2021Assignee: Electronic Arts Inc.Inventors: Caedmon Somers, Jason Rupert, Igor Borovikov, Ahmad Beirami, Yunqi Zhao, Mohsen Sardari, Harold Henry Chaput, Navid Aghdaie, Kazi Atif-Uz Zaman
-
Publication number: 20210008456Abstract: System and methods for utilizing a video game console to monitor the player's video game, detect when a particular gameplay situation occurs during the player's video game experience, and collect game state data corresponding to how the player reacts to the particular gameplay situation or an effect of the reaction. In some cases, the video game console can receive an exploratory rule set to apply during the particular gameplay situation. In some cases, the video game console can trigger the particular gameplay situation. A system can receive the game state data from many video game consoles and train a rule set based on the game state data. Advantageously, the system can save computational resources by utilizing the players' video game experience to train the rule set.Type: ApplicationFiled: July 10, 2019Publication date: January 14, 2021Inventors: Caedmon Somers, Jason Rupert, Igor Borovikov, Ahmad Beirami, Yunqi Zhao, Mohsen Sardari, John Kolen, Navid Aghdaie, Kazi Atif-Uz Zaman
-
Publication number: 20210001229Abstract: Systems and methods are disclosed for training a machine learning model to control an in-game character or other entity in a video game in a manner that aims to imitate how a particular player would control the character or entity. A generic behavior model that is trained without respect to the particular player may be obtained and then customized based on observed gameplay of the particular player. The customization training process may include freezing at least a subset of layers or levels in the generic model, then generating one or more additional layers or levels that are trained using gameplay data for the particular player.Type: ApplicationFiled: July 2, 2019Publication date: January 7, 2021Inventors: Caedmon Somers, Jason Rupert, Igor Borovikov, Ahmad Beirami, Yunqi Zhao, Mohsen Sardari, Harold Henry Chaput, Navid Aghdaie, Kazi Atif-Uz Zaman
-
Patent number: 10161161Abstract: An enclosing wallboard firm-connection device includes an enclosing wall, a column body and a door. The column body is mounted on the enclosing wall, the door is mounted on the column body. The enclosing wall consists of enclosing wallboards, a lower end cap is mounted at lower end of the enclosing wall, a connecting piece is mounted on the lower end cap. The enclosing wallboards are inserted into the connecting piece, bumps are arranged at upper ends of the enclosing wallboards, grooves are formed in lower ends of the enclosing wallboards. The enclosing wallboards are combined together. The fence is mounted at upper end of the enclosing wall, protection strips are mounted on upper and lower edges of the fence, the connecting piece is mounted at upper end of the protection strip, and an upper end cap is mounted at upper end of the connecting piece.Type: GrantFiled: January 31, 2016Date of Patent: December 25, 2018Inventors: Jihong Yin, Xiaochen Hu, Yunqi Zhao, Jiabin Zhao
-
Patent number: 9856660Abstract: The invention relates to the field of home decoration, in particular to a home plate connecting device, which includes a plate and plate connecting piece, a glass and plate connecting piece, a plate bottom edge and ground connecting piece, a decorative plate and plate connecting piece, a doorframe and wall connecting piece and a plate chamfer connecting piece, wherein each of the connecting pieces is provided with a rubber barbed tenon structure and a mortise structure with a barbed accommodation groove. According to the invention, the mortise and tenon structures and a threaded connection manner are adopted for fixation, so that the device can be freely dismounted and conveniently packaged and transported; each part is matched, and is easy to position, so that mounting and dismounting working efficiency is improved; and the dismounted parts are prevented from damage, and are high in reutilization rate, so that the device can be widely applied to the field of home mounting and decoration.Type: GrantFiled: January 31, 2016Date of Patent: January 2, 2018Inventors: Jihong Yin, Yongkang Zhao, Xiaochen Hu, Yunqi Zhao
-
Publication number: 20170191275Abstract: The invention relates to the field of home decoration, in particular to a home plate connecting device, which includes a plate and plate connecting piece, a glass and plate connecting piece, a plate bottom edge and ground connecting piece, a decorative plate and plate connecting piece, a doorframe and wall connecting piece and a plate chamfer connecting piece, wherein each of the connecting pieces is provided with a rubber barbed tenon structure and a mortise structure with a barbed accommodation groove. According to the invention, the mortise and tenon structures and a threaded connection manner are adopted for fixation, so that the device can be freely dismounted and conveniently packaged and transported; each part is matched, and is easy to position, so that mounting and dismounting working efficiency is improved; and the dismounted parts are prevented from damage, and are high in reutilization rate, so that the device can be widely applied to the field of home mounting and decoration.Type: ApplicationFiled: January 31, 2016Publication date: July 6, 2017Inventors: Jihong Yin, Yongkang Zhao, Xiaochen Hu, Yunqi Zhao
-
Publication number: 20160362909Abstract: The invention relates to a novel enclosing wallboard firm-connection device, and belongs to the field of furniture.Type: ApplicationFiled: January 31, 2016Publication date: December 15, 2016Inventors: Jihong Yin, Xiaochen Hu, Yunqi Zhao, Jiabin Zhao
-
Publication number: 20160279108Abstract: The present invention is directed to drug conjugates of mTOR inhibitors comprising an mTOR inhibitor, such as rapamycin, conjugated to hyaluronic acid by a linker comprising an ester, carbonate, or carbamate. The present invention is also directed to pharmaceutical compositions comprising the drug conjugates, and methods of making and using the drug conjugates and the pharmaceutical compositions.Type: ApplicationFiled: February 24, 2016Publication date: September 29, 2016Applicants: UNIVERSITY OF KANSAS, NANOPHARM LLC (d/b/a HYLAPHARM)Inventors: MARCUS LAIRD FORREST, TI ZHANG, S P SANJEEWA N. SENADHEERA, DANIEL AIRES, YUNQI ZHAO, SHAOFENG DUAN, CHAD GROER