Abstract: Systems and processes for operating a digital assistant are provided. An example method includes, at an electronic device with one or more processors and memory, while an application is open on the electronic device: receiving a spoken input including a command, determining whether the command matches at least a portion of a metadata associated with an action of the application, and in accordance with a determination that the command matches at least the portion of the metadata associated with the action of the application, associating the command with the action, storing the association of the command with the action for subsequent use with the application by the digital assistant, and executing the action with the application.

Abstract: Systems, processes and methods for detecting rotated or angled text in an image based on global text geometry estimations are provided. A method includes, at an electronic device with memory and one or more processors, receiving an image including a plurality of pixels (802); determining, based on the image, one or more pixels of the plurality of pixels included in the image that contain text (804); identifying, based on the one or more pixels that contain text, a plurality of components in the image (810); determining a subset of components based on the plurality of components (814); determining, based on the pixels that contain text of the subset of components, one or more candidate text angles (816); determining a global text angle based on the determined one or more candidate text angles (824); and determining a first plurality of bounding boxes based on the global text angle (830).

Abstract: Systems, processes and methods for detecting rotated or angled text in an image based on global text geometry estimations are provided. A method includes, at an electronic device with memory and one or more processors, receiving an image including a plurality of pixels (802); determining, based on the image, one or more pixels of the plurality of pixels included in the image that contain text (804); identifying, based on the one or more pixels that contain text, a plurality of components in the image (810); determining a subset of components based on the plurality of components (814); determining, based on the pixels that contain text of the subset of components, one or more candidate text angles (816); determining a global text angle based on the determined one or more candidate text angles (824); and determining a first plurality of bounding boxes based on the global text angle (830).

Abstract: The present disclosure generally relates to browsing and searching content on an electronic device. An electronic device displays a first user interface including a search affordance and receives an input corresponding to selection of the search affordance. In response, the device displays a plurality of category affordances, including a first category affordance associated with a first category and a second category affordance associated with a second category. The device further receives an input corresponding to selection of the first category affordance and, in response, displays a representation of one or more information items that correspond to the first category and replaces at least a subset of the category affordances with a plurality of subcategory affordances that correspond to the first category. The plurality of subcategory affordances includes a first subcategory affordance associated with a first subcategory and a second subcategory affordance associated with a second subcategory.

Abstract: User interfaces for browsing and/or searching are described. In one embodiment, a method includes displaying a first display area for display representations of documents matching a search query, the first display area configured to display content of the documents which can have a plurality of different types of content including at least one of text-based content and a folder, and displaying a second display area for selecting a selected document to be displayed in the first display area. Other embodiments are also described, and computer readable media and apparatuses are also described.

Abstract: Some embodiments of the invention provide a map application with novel map exploration tools. In some embodiments, the map application executes on a mobile device (e.g., a handheld smartphone, a tablet, etc.) with a touch sensitive screen. The map application of some embodiments has a first display area to display a map of a region, and second and third display areas to display information about items displayed on the map in the first display area. In some embodiments, the second display area slides over the first display area to overlap at least a portion of the first display area. After the second display area slides over the first display area, the third display area in some embodiments slides over the first display area to overlap at least a portion of the first display area. In some embodiments, the second and third display areas slide over the first display area from one side of the first display area. This side is the bottom of the first display area in some embodiments.

Abstract: For a device that runs a mapping application, a method for providing maneuver indicators along a route of a map. The maneuver indicators are arrows that identify the direction and orientation of a maneuver. A maneuver arrow may be selected and displayed differently from unselected maneuver arrows. Maneuver arrows may be selected automatically based on a user's current location. The mapping application transitions between maneuver arrows and provides an animation for the transition. Complex maneuvers may be indicated by multiple arrows, providing a more detailed guidance for a user of the mapping application.

Abstract: For a device that runs a mapping application, a method for providing maneuver indicators along a route of a map. The maneuver indicators are arrows that identify the direction and orientation of a maneuver. A maneuver arrow may be selected and displayed differently from unselected maneuver arrows. Maneuver arrows may be selected automatically based on a user's current location. The mapping application transitions between maneuver arrows and provides an animation for the transition. Complex maneuvers may be indicated by multiple arrows, providing a more detailed guidance for a user of the mapping application.

Abstract: A device that provides a map and/or navigation application that displays items on the map and/or navigation instructions differently in different modes. The applications of some embodiments provide a day mode and a night mode. In some embodiments the application uses the day mode as a default and activates the night mode when the time is after sunset at the location of the device. Some embodiments activate night mode when multiple conditions are satisfied (for example, when (1) the time is after sunset at the location of the device and (2) the ambient light level is below a threshold brightness).

Abstract: The present disclosure generally relates to browsing and searching content on an electronic device. An electronic device displays a first user interface including a search affordance and receives an input corresponding to selection of the search affordance. In response, the device displays a plurality of category affordances, including a first category affordance associated with a first category and a second category affordance associated with a second category. The device further receives an input corresponding to selection of the first category affordance and, in response, displays a representation of one or more information items that correspond to the first category and replaces at least a subset of the category affordances with a plurality of subcategory affordances that correspond to the first category. The plurality of subcategory affordances includes a first subcategory affordance associated with a first subcategory and a second subcategory affordance associated with a second subcategory.

Abstract: For a device that runs a mapping application, a method for providing maneuver indicators along a route of a map. The maneuver indicators are arrows that identify the direction and orientation of a maneuver. A maneuver arrow may be selected and displayed differently from unselected maneuver arrows. Maneuver arrows may be selected automatically based on a user's current location. The mapping application transitions between maneuver arrows and provides an animation for the transition. Complex maneuvers may be indicated by multiple arrows, providing a more detailed guidance for a user of the mapping application.

Abstract: A method that simulates a three dimensional scene by producing reflections in a two dimensional scene. In some embodiments, the two dimensional scene includes a display area for displaying a set of images, and at least one object that is displayed near the display area. The method generates reflections of the set of images on the object and superimposes the generated reflections on the display of the object. In some embodiments, the method generates and displays the reflections in real-time as it displays the set of images in order to cause the display of the set of images to appear to be part of a 3D environment. In some embodiments, the set of images are part of a video that a device displays in real-time. The device generates reflections off one or more neighboring objects from the content displayed in each video frame.

Abstract: Assisted face selection is disclosed. According to some implementations, a method can include obtaining contact information associated with a contact and displaying on an interface of a computing device an image (e.g., a thumbnail image) representative of the contact. The method can include receiving an indication to change the contact-representative image, determining that one or more other images from a plurality of other images correspond to the contact based on the contact information, and displaying the one or more other images. The method can include receiving a selection of one of the one or more other images and displaying on the interface the selected image as the contact-representative image. Receiving the indication can include receiving a selection of the displayed contact-representative image. Automatic selection of images is also disclosed.

Abstract: User interfaces for browsing, searching, and/or previewing are described. In one embodiment, a method includes call a preview generator to generate an initial preview in response to receiving an input, receiving a content to be displayed from the preview generator, displaying the content as the initial preview, and displaying and scrolling concurrently an enhanced preview to a next item in a representation of items in a search result in response to an input to directionally move. Other embodiments are also described, and computer readable media and apparatuses are also described.

Abstract: For a device that runs a mapping application, a method for providing maneuver indicators along a route of a map. The maneuver indicators are arrows that identify the direction and orientation of a maneuver. A maneuver arrow may be selected and displayed differently from unselected maneuver arrows. Maneuver arrows may be selected automatically based on a user's current location. The mapping application transitions between maneuver arrows and provides an animation for the transition. Complex maneuvers may be indicated by multiple arrows, providing a more detailed guidance for a user of the mapping application.

Abstract: A device that provides a map and/or navigation application that displays items on the map and/or navigation instructions differently in different modes. The applications of some embodiments provide a day mode and a night mode. In some embodiments the application uses the day mode as a default and activates the night mode when the time is after sunset at the location of the device. Some embodiments activate night mode when multiple conditions are satisfied (for example, when (1) the time is after sunset at the location of the device and (2) the ambient light level is below a threshold brightness).

Abstract: This disclosure pertains to devices, methods, systems, and computer readable media for generating and/or interpreting image metadata to determine input parameters for various image processing routines, e.g., filters that distort or enhance an image, in a way that provides an intuitive experience for both the user and the software developer. Such techniques may attach the metadata to image frames and then send the image frames down an image processing pipeline to one or more image processing routines. Image metadata may include face location information, and the image processing routine may include an image filter that processes the image metadata in order to keep the central focus (or foci) of the image filter substantially coincident with one or more of the faces represented in the face location information. The generated and/or interpreted metadata may also be saved to a metadata track for later application to unfiltered image data.

Abstract: User interfaces for browsing and/or searching are described. In one embodiment, a method includes displaying a first display area for display representations of documents matching a search query, the first display area configured to display content of the documents which can have a plurality of different types of content including at least one of text-based content and a folder, and displaying a second display area for selecting a selected document to be displayed in the first display area. Other embodiments are also described, and computer readable media and apparatuses are also described.

Abstract: User interfaces for browsing and/or searching are described. In one embodiment, a method includes displaying a first display area for display representations of documents matching a search query, the first display area configured to display content of the documents which can have a plurality of different types of content including at least one of text-based content and a folder, and displaying a second display area for selecting a selected document to be displayed in the first display area. Other embodiments are also described, and computer readable media and apparatuses are also described.

Abstract: A three-dimensional (“3D”) avatar can be automatically created that resembles the physical appearance of an individual captured in one or more input images or video frames. The avatar can be further customized by the individual in an editing environment and used in various applications, including but not limited to gaming, social networking and video conferencing.