Abstract: User inputs can indicate an intent of a user to target a location on a display. In order to determine a targeted point based on a user input, a computing device can receive an indication of at least one point, an indication of a width, and an indication of a height. The computing device can estimate a portion of the display based on the indication of the at least one point, the indication of the width, and the indication of the height. The computing device can also determine the targeted point based on a location of the at least one point and based on a location of a portion of one or more objects within the estimated portion of the display.

Abstract: A method for generating a reactive agent definition may include acquiring, by a reactive agent development environment (RADE) tool of a computing device, an extensible markup language (XML) schema template for defining a reactive agent of a digital personal assistant running on the computing device. The RADE tool may receive input identifying at least one domain-intent pair associated with a category of functions performed by the computing device. A multi-turn dialog flow defining a plurality of states associated with the domain-intent pair may be generated using a graphical user interface of the RADE tool. The XML schema template may be updated based on the received input and the multi-turn dialog flow to produce an updated XML schema specific to the domain-intent pair. The reactive agent definition may be generated using the updated XML schema.

Abstract: User inputs can indicate an intent of a user to target a location on a display. In order to determine a targeted point based on a user input, a computing device can receive an indication of at least one point, an indication of a width, and an indication of a height. The computing device can estimate a portion of the display based on the indication of the at least one point, the indication of the width, and the indication of the height. The computing device can also determine the targeted point based on a location of the at least one point and based on a location of a portion of one or more objects within the estimated portion of the display.