Abstract: Provided are an electronic device for navigating an application screen, and an operating method thereof. The method may include receiving a user input; determining, based on the user input, a user intent for controlling the electronic device; determining a command for performing a control operation corresponding to the user intent as a goal; identifying elements of a user interface on the screen of the application; determining, based on the user intent and the elements of the user interface, at least one sub-goal for executing the command; and executing the command by performing at least one task corresponding to the at least one sub-goal, wherein the at least one sub-goal is changeable based on a validation of an operation of navigating the application for executing the command, and the at least one task includes units of action for navigating the application.

Abstract: An electronic device and a method for controlling thereof is provided. The electronic device includes a memory including a neural network model, a display, a communicator including circuitry, and a processor configured to identify, based on a user command to transmit a first image to an external device being input, whether private information of a user is included in the first image by inputting the first image in the neural network model, based on identifying that private information of the user is included in the first image, display a first user interface (UI) asking whether to process at least one private information based on the private information included in the first image, and based on a user command input through the first UI, process the first image and control the communicator to transmit the processed to the external device.

Abstract: An electronic device and a method of controlling the electronic device are provided. The electronic device includes a microphone, a display, memory, and a processor configured to obtain, based on a user voice being received through the microphone while a first user interface (UI) screen is being displayed, text information corresponding to the user voice by inputting the user voice, obtain first information including information on a command and information on an execution target of the command included in the text information, obtain second information including information on functions corresponding to the plurality of objects and information on texts included in the plurality of objects, identify whether a target object corresponding to the user voice is present from among the plurality of objects, and control the display to display a second UI screen corresponding to the target object for performing an operation corresponding to the command.

Abstract: An electronic apparatus is provided. The electronic apparatus includes a memory configured to store a plurality of nodes corresponding to a plurality of user interface (UI) types, for each application, a display, and a processor connected with the memory and the display and controls the electronic apparatus, wherein the processor is configured to identify a first UI graph corresponding to the target application, acquire information on a target node that will perform the user command among a plurality of first nodes included in the first UI graph based on the user command and the at least one parameter, identify the current node corresponding to a UI displayed through the display, identify an action sequence from the current node to the target node based on the information on the current node and the target node, and perform an action corresponding to the user voice based on the action sequence.

Abstract: Provided are an electronic device for navigating an application screen, and an operating method thereof. The method may include receiving a user input; determining, based on the user input, a user intent for controlling the electronic device; determining a command for performing a control operation corresponding to the user intent as a goal; identifying elements of a user interface on the screen of the application; determining, based on the user intent and the elements of the user interface, at least one sub-goal for executing the command; and executing the command by performing at least one task corresponding to the at least one sub-goal, wherein the at least one sub-goal is changeable based on a validation of an operation of navigating the application for executing the command, and the at least one task includes units of action for navigating the application.

Abstract: An electronic device and a method for controlling thereof is provided. The electronic device includes a memory including a neural network model, a display, a communicator including circuitry, and a processor configured to identify, based on a user command to transmit a first image to an external device being input, whether private information of a user is included in the first image by inputting the first image in the neural network model, based on identifying that private information of the user is included in the first image, display a first user interface (UI) asking whether to process at least one private information based on the private information included in the first image, and based on a user command input through the first UI, process the first image and control the communicator to transmit the processed to the external device.