Abstract: A method of providing a task assistant to provide an interface to an application is described. The method comprises receiving input from a user through multimodal input including a plurality of speech input, typing input, and touch input, interpreting the input, and providing a formatted query to the application, receiving data from the application in response to the query, and providing a response to the user through multimodal output including a plurality of: speech output, text output, non-speech audio output, haptic output, and visual non-text output.

Abstract: A method of managing digital content includes displaying a user interface on a display screen of the electronic device. A search instruction is generated according to a search condition. Each of a plurality of cloud servers is controlled to search for digital content meeting the search condition. Related information of the digital content meeting the search condition is received from each of the plurality of cloud servers. A user interface object is generated according to the related information received from each of the plurality of cloud servers, such that a plurality of user interface objects are obtained. Once an object list is generated by aggregating the plurality of the user interface objects, the object list is displayed on a display screen.

Abstract: A method of providing a task assistant to provide an interface to an application is described. The method comprises receiving input from a user through multimodal input including a plurality of speech input, typing input, and touch input, interpreting the input, and providing a formatted query to the application, receiving data from the application in response to the query, and providing a response to the user through multimodal output including a plurality of: speech output, text output, non-speech audio output, haptic output, and visual non-text output.

Abstract: A method of managing data of an electronic device includes capturing contents from user interfaces of programs displayed on a display of the electronic device. An application layer is displayed on the display when each content is captured. Each content is moved to the application layer in response to a predetermined input. Contents in the application layer are arranged in a first layout, and can be arranged in a second layout when the second layout is selected.

Abstract: A method of providing a task assistant to provide an interface to an application, the method comprising activating the task assistant, the activation having an associated visual display. The method in one embodiment includes receiving input from a user through multimodal input including a plurality of speech input, typing input, and touch input, interpreting the input, and providing a formatted query to the application, receiving data from the application in response to the query, and providing a response to the user through multimodal output including a plurality of: speech output, text output, non-speech audio output, haptic output, and visual non-text output, wherein the task assistant has a plurality of active states, each of the active states having an associated visual display.

Abstract: A method of providing a task assistant to provide an interface to an application is described. The method comprises receiving input from a user through multimodal input including a plurality of speech input, typing input, and touch input, interpreting the input, and providing a formatted query to the application, receiving data from the application in response to the query, and providing a response to the user through multimodal output including a plurality of: speech output, text output, non-speech audio output, haptic output, and visual non-text output.

Abstract: A method of managing digital content includes displaying a user interface on a display screen of the electronic device. A search instruction is generated according to a search condition. Each of a plurality of cloud servers is controlled to search for digital content meeting the search condition. Related information of the digital content meeting the search condition is received from each of the plurality of cloud servers. A user interface object is generated according to the related information received from each of the plurality of cloud servers, such that a plurality of user interface objects are obtained. Once an object list is generated by aggregating the plurality of the user interface objects, the object list is displayed on a display screen.

Abstract: A method of providing a task assistant is described. The task assistant is designed to receive input from a user through multimodal input including a plurality of speech input, typing input, and touch input, determine the meaning of the input, and determining whether there is a context based on prior interactions with the user. The method further to generate an interpreted input based on a combination of the input and the context, and providing a formatted query to an application. The method further to receive data from the application in response to the formatted query, and provide a response to the user through multimodal output including a plurality of: speech output, text output, non-speech audio output, haptic output, and visual non-text output. The method further to update the context based on the interpreted input.

Abstract: A method of providing a task assistant to provide an interface to an application is described. The method includes, in one embodiment, identifying a user and determining whether there is a push notification to be shown to the user. When there is a push notification to be shown to the user, the task assistant displaying the push notification to the user, such that when the user acknowledges the push notification, the user is directed to a push destination. When there is no push notification, receiving input from a user through multimodal input including a plurality of speech input, typing input, and touch input, interpreting the input, and providing a formatted query to the application, receiving data from the application in response to the query, and providing a response to the user through multimodal output including a plurality of: speech output, text output, non-speech audio output, haptic output, and visual non-text output.

Abstract: A method of managing data of an electronic device includes capturing contents from user interfaces of programs displayed on a display of the electronic device. An application layer is displayed on the display when each content is captured. Each content is moved to the application layer in response to a predetermined input. Contents in the application layer are arranged in a first layout, and can be arranged in a second layout when the second layout is selected.

Abstract: A method of providing biometric authorization comprising enabling a user to log into an account, and determining whether there is a hold on the account. When there is a hold on the account, informing the user of the hold, and enabling the user to respond to a transaction that caused the hold. The method, in one embodiment further comprising prompting the user to enter a biometric authentication, in conjunction with the response, and processing the unblock request in real-time upon receiving and validating the biometric authentication.

Abstract: A method of providing a task assistant comprising starting to receive speech input from a user, and identifying a format associated with a destination for speech input based on a flag associated with the destination field. When the format comprises dictation, converting the speech to text, and inserting it into the destination location, and when the format comprises an intent, determining a meaning of the input, and sending a formatted query to an application. The method further comprising receiving data from the application in response to the intent and providing a response to the user through multimodal output.

Abstract: A method of providing a custom response in conjunction with an application providing speech interaction is described. In one embodiment, the method comprises determining a context of a current interaction with the user, and identifying an associated custom animation, when the associated custom animation exists. The method further comprises displaying the custom animation by overlaying it over a native response of the application. In one embodiment, when no custom animation exists, the method determines whether there is a default animation, and displays the default animation as part of a state change of the application.

Abstract: A method of providing a task assistant to provide an interface to an application is described. The method comprises, in one embodiment, providing a task assistant to provide an interface to an application, to receive input from a user through multimodal input including a plurality of speech input, typing input, and touch input. The method further comprises receiving a request from a user for a suggestion, determining a current transaction state, based on interactions with the user during a current session, and selecting suggestions relevant to a transaction type associated with the current transaction state.

Abstract: A method of providing a task assistant to provide an interface to an application, the method comprising activating the task assistant, the activation having an associated visual display. The method in one embodiment includes receiving input from a user through multimodal input including a plurality of speech input, typing input, and touch input, interpreting the input, and providing a formatted query to the application, receiving data from the application in response to the query, and providing a response to the user through multimodal output including a plurality of: speech output, text output, non-speech audio output, haptic output, and visual non-text output, wherein the task assistant has a plurality of active states, each of the active states having an associated visual display.

Abstract: A method of providing a task assistant is described. The task assistant is designed to receive input from a user through multimodal input including a plurality of speech input, typing input, and touch input, determine the meaning of the input, and determining whether there is a context based on prior interactions with the user. The method further to generate an interpreted input based on a combination of the input and the context, and providing a formatted query to an application. The method further to receive data from the application in response to the formatted query, and provide a response to the user through multimodal output including a plurality of: speech output, text output, non-speech audio output, haptic output, and visual non-text output. The method further to update the context based on the interpreted input.

Abstract: A method of providing a task assistant to provide an interface to an application is described. The method comprises receiving input from a user through multimodal input including a plurality of speech input, typing input, and touch input, interpreting the input, and providing a formatted query to the application, receiving data from the application in response to the query, and providing a response to the user through multimodal output including a plurality of: speech output, text output, non-speech audio output, haptic output, and visual non-text output.

Abstract: A method of providing a task assistant to provide an interface to an application is described. The method includes, in one embodiment, receiving input from a user through multimodal input including a plurality of each input, typing input, and touch input, interpreting the input, and providing a formatted query to the application, and receiving data from the application in response to the query. The method further includes identifying a destination providing a response to the query, identifying an anchor pointing to a specific location in the application associated with the response to the query, and directing the user to the specific location, using the anchor, the specific location providing a response to the user.

Abstract: A method of providing a task assistant to provide an interface to an application is described. The method includes, in one embodiment, identifying a user and determining whether there is a push notification to be shown to the user. When there is a push notification to be shown to the user, the task assistant displaying the push notification to the user, such that when the user acknowledges the push notification, the user is directed to a push destination. When there is no push notification, receiving input from a user through multimodal input including a plurality of speech input, typing input, and touch input, interpreting the input, and providing a formatted query to the application, receiving data from the application in response to the query, and providing a response to the user through multimodal output including a plurality of: speech output, text output, non-speech audio output, haptic output, and visual non-text output.

Abstract: A method of providing a task assistant comprising starting to receive speech input from a user, and identifying a format associated with a destination for speech input based on a flag associated with the destination field. When the format comprises dictation, converting the speech to text, and inserting it into the destination location, and when the format comprises an intent, determining a meaning of the input, and sending a formatted query to an application. The method further comprising receiving data from the application in response to the intent and providing a response to the user through multimodal output.