Abstract: Embodiments described herein are generally directed towards systems and methods relating to a crowd-sourced digital assistant system and related methods. In particular, embodiments facilitate the intuitive creation, maintenance, and distribution of action datasets that include computing events or tasks that can be reproduced when an associated command, stored in an action dataset, is determined received by a digital assistant device. The digital assistant device described herein can generate new action datasets, on-board new action datasets to a remote server, and receive new action datasets or updates to existing action datasets from the remote server. The digital assistant server described herein can receive action datasets, maintain action datasets, and distribute action datasets to one or more digital assistant devices.

Abstract: Various embodiments, methods and systems for implementing a digital assistant connectivity system are provided. In operation, a request to receive a unique identifier is communicated from a digital assistant device. The unique identifier is utilized to pair the digital assistant device with a smart assistant device. The unique identifier is received from and generated by a digital assistant server to correspond with the digital assistant device and a corresponding digital assistant device application instance. An instruction to perform an action on the digital assistant device is received at the digital assistant device application. The instruction is communicated based on an established command-driven session between the digital assistant device application and the smart assistant device. The command-driven session is associated with the unique identifier that paired the digital assistant device and the smart assistant device.

Abstract: Embodiments of the present invention provide systems, methods, and computer storage media directed to providing talk back automation for applications installed on a mobile device. To do so actions (e.g., talk back features) can be created, via the digital assistant, by recording a series of events that are typically provided by a user of the mobile device when manually invoking the desired action. At a desired state, the user may select an object that represents the output of the application. The recording embodies the action and can be associated with a series of verbal commands that the user would typically announce to the digital assistant when an invocation of the action is desired. In response, the object is verbally communicated to the user via the digital assistant, a different digital assistant, or even another device. Alternatively, the object may be communicated to the same application or another application as input.

Abstract: Embodiments described herein are generally directed towards systems and methods relating to a crowd-sourced digital assistant and system. In particular, embodiments facilitate the intuitive creation and distribution of action datasets that include computing events or tasks that can be reproduced when an associated command, stored in an action dataset, is determined received by a digital assistant device. The digital assistant device described herein can generate new action datasets, on-board new action datasets, and receive new action datasets or updates to existing action datasets. Each digital assistant device in the described system can participate in the building of action datasets, so as to crowd-source a dialect that can be understood by a digital assistant device.

Abstract: Embodiments of the present invention are directed to action recipes for a crowdsourced digital assistant. Users can define an action recipe by recording a set of inputs across one or more applications, by providing multiple sub-commands in a single on-the-fly command, by providing one or more associated commands, or otherwise. An action recipe dataset is generated, and stored and indexed on a user device and/or on an action cloud server. As such, any user can invoke an action recipe by providing an associated command to a crowdsourced digital assistant application on a user device. The crowdsourced digital assistant searches for a matching command on the user device and/or the action cloud server, and if a match is located, the corresponding action recipe dataset is accessed, and the crowdsourced digital assistant emulates the actions in the action recipe on the user device.

Abstract: A user device may include a touchscreen, a storage device, and a processing device. The storage device stores native applications and their corresponding icon data. The icon data includes an icon, a location of the icon on a launch screen, a flag indicating whether the icon is hidden or visible, and an unlocking instruction. The processing device may display the launch screen via the touchscreen whereby the launch screen displaying one or more icons. The processing device monitors the touchscreen and receives user input at an unpopulated screen location occupied by a hidden icon. The processing devices receives a user instruction at the unpopulated screen location, verifies the user instruction with the unlocking instruction associated with the icon. When the user instruction is verified, the processing device can display the hidden icon or may launch the native application corresponding to the hidden icon.

Abstract: A user device may include a touchscreen, a storage device, and a processing device. The storage device stores native applications and their corresponding icon data. The icon data includes an icon, a location of the icon on a launch screen, a flag indicating whether the icon is hidden or visible, and an unlocking instruction. The processing device may display the launch screen via the touchscreen whereby the launch screen displaying one or more icons. The processing device monitors the touchscreen and receives user input at an unpopulated screen location occupied by a hidden icon. The processing devices receives a user instruction at the unpopulated screen location, verifies the user instruction with the unlocking instruction associated with the icon. When the user instruction is verified, the processing device can display the hidden icon or may launch the native application corresponding to the hidden icon.

Abstract: A user device may include a touchscreen, a storage device, and a processing device. The storage device stores native applications and their corresponding icon data. The icon data includes an icon, a location of the icon on a launch screen, a flag indicating whether the icon is hidden or visible, and an unlocking instruction. The processing device may display the launch screen via the touchscreen whereby the launch screen displaying one or more icons. The processing device monitors the touchscreen and receives user input at an unpopulated screen location occupied by a hidden icon. The processing devices receives a user instruction at the unpopulated screen location, verifies the user instruction with the unlocking instruction associated with the icon. When the user instruction is verified, the processing device can display the hidden icon or may launch the native application corresponding to the hidden icon.