Abstract: Various implementations disclosed herein include devices, systems, and methods for presenting text representations of audible signal data based on language context. In some implementations, a first device includes a display, one or more processors, and a memory. The first device receives a first text representation of an audio signal corresponding to a spoken phrase detected at a second device. The first device determines a second text representation based on the first text representation, first language context information associated with the first device, and second language context information associated with the second device. The second text representation is presented via an output device.

Abstract: In some examples, the electronic device or a second electronic device in communication with the electronic device displays text at a first font size. In some examples, while displaying text at the first font size, the electronic device obtains a first set of data relating to the user of the electronic device and stores the first set of data. In some examples, at a second time, after the first time, the electronic device obtains a second set of data related to the user of the electronic device. In some examples, the electronic device compares the first set of data and the second set of data and if the second set of data satisfies one or more criteria, the electronic device updates the text size from the first font size to a second font size.

Abstract: In one implementation, a method of changing a state of an object is performed at a device including an image sensor, one or more processors, and non-transitory memory. The method includes receiving a vocal command. The method includes obtaining, using the image sensor, an image of a physical environment. The method includes detecting, in the image of the physical environment, an object based on a visual model of the object stored in the non-transitory memory in association with an object identifier of the object. The method includes generating, based on the vocal command and detection of the object, an instruction including the object identifier of the object. The method includes effectuating the instruction to change a state of the object.

Abstract: Some examples of the disclosure are directed to systems and methods for moving virtual objects in three-dimensional environments in accordance with detected movement of the electronic device. In some examples, the electronic device detects movement according to a first or second movement pattern described in more detail herein. In some examples, in response to detecting the first movement pattern, the electronic device applies a first correction factor to movement of a virtual object in the environment. In some examples, in response to detecting the first movement pattern, the electronic device applies a first correction factor to movement of a virtual object in the environment.

Abstract: A method for a self-guided vision test can include, at a first electronic device in communication with a second electronic device, obtaining data indicative of a position of a target displayed by the second electronic device relative to the first electronic device or a user of the first electronic device while the target moves relative to the first electronic device, tracking, using one or more first image sensors, a direction of gaze of the user, and based on a relationship between the position of the target and the direction of gaze while the target moves relative to the first electronic device or a user of the first electronic device, presenting an indication of abnormal eye movement.

Abstract: In some implementations, the method includes: while presenting media via a computing system, obtaining an audio sample from within a physical environment; in response to obtaining the audio sample, determining a class for the audio sample; determining a priority value for the audio sample based on the determined class for the audio sample; in response to determining that the priority value for the audio sample satisfies an interruption criterion, determining whether a user of the computing system has reacted to the audio sample; and in response to determining that the user has not reacted to the audio sample within a predefined time period, modifying the presentation of the media.

Abstract: In some implementation, a method includes: while operating according to a first mode, obtaining audio data associated with a physical environment and motion sensor data; determining whether at least one of the audio data and the motion sensor data satisfies a mode transition criterion; in response to determining that at least one of the audio data and the motion sensor data satisfies the mode transition criterion, transitioning the computing system from the first mode to a second mode; and while operating according to the second mode: obtaining image frames of the physical environment based on an image frame ingestion rate; determining a current location for an enrolled object by performing a set of image processing functions on the image frames; and updating a record for the enrolled object to include the current location.

Abstract: In some examples, an electronic device detects initiation of an exercise activity associated with a user of the electronic device. In some examples, in response to detecting the initiation of the exercise activity, the electronic device activates an image compilation capture mode of operation in which one or more images for formulating a compilation of the one or more images corresponding to the exercise activity are captured, including capturing one or more portions of a physical environment. In some examples, while the image compilation capture mode of operation is active, the electronic device visually detects a first object in the one or more captured portions of the physical environment. In some examples, in accordance with a determination that the first object satisfies one or more criteria, the electronic device generates a first event associated with formulating a first compilation of one or more images corresponding to the exercise activity.

Abstract: In some implementations, the method includes: while presenting media via a computing system, obtaining an audio sample from within a physical environment; in response to obtaining the audio sample, determining a class for the audio sample; determining a priority value for the audio sample based on the determined class for the audio sample; in response to determining that the priority value for the audio sample satisfies an interruption criterion, determining whether a user of the computing system has reacted to the audio sample; and in response to determining that the user has not reacted to the audio sample within a predefined time period, modifying the presentation of the media.

Abstract: In some embodiments, the present disclosure includes techniques and user interfaces for interacting with graphical user interfaces using gaze. In some embodiments, the present disclosure includes techniques and user interfaces for repositioning virtual objects. In some embodiments, the present disclosure includes techniques and user interfaces for transitioning modes of a camera capture user interface.

Abstract: In one implementation, a method for dynamically changing sensory and/or input modes associated with content based on a current contextual state. The method includes: while in a first contextual state, presenting extended reality (XR) content, via the display device, according to a first presentation mode and enabling a first set of input modes to be directed to the XR content; detecting a change from the first contextual state to a second contextual state; and in response to detecting the change from the first contextual state to the second contextual state, presenting, via the display device, the XR content according to a second presentation mode different from the first presentation mode and enabling a second set of input modes to be directed to the XR content that are different from the first set of input modes.

Abstract: In some examples, an electronic device detects initiation of an exercise activity associated with a user of the electronic device. In some examples, in response to detecting the initiation of the exercise activity, the electronic device activates an image compilation capture mode of operation in which one or more images for formulating a compilation of the one or more images corresponding to the exercise activity are captured, including capturing one or more portions of a physical environment. In some examples, while the image compilation capture mode of operation is active, the electronic device visually detects a first object in the one or more captured portions of the physical environment. In some examples, in accordance with a determination that the first object satisfies one or more criteria, the electronic device generates a first event associated with formulating a first compilation of one or more images corresponding to the exercise activity.

Abstract: Various implementations disclosed herein include devices, systems, and methods that present virtual content based on detecting a reflective object and determining a three-dimensional (3D) position of the reflective object in a physical environment. For example, an example process may include obtaining sensor data in a physical environment that includes one or more objects. The method may further include detecting a reflection of a first object of the one or more objects upon a reflective surface of a reflective object based on the sensor data. The method may further include determining a 3D position of the reflective object in the physical environment based on determining a 3D position of the reflection of the first object. The method may further include presenting virtual content in a view of the physical environment. The virtual content may be positioned at a 3D location based on the 3D position of the reflective object.

Abstract: Various implementations disclosed herein include devices, systems, and methods that determine that a user is interested in audio content by determining that a movement (e.g., a user's head bob) has a time-based relationship with detected audio content (e.g., the beat of music playing in the background). Some implementations involve obtaining first sensor data and second sensor data corresponding to a physical environment, the first sensor data corresponding to audio in the physical environment and the second sensor data corresponding to a body movement in the physical environment. A time-based relationship between one or more elements of the audio and one or more aspects of the body movement is identified based on the first sensor data and the second sensor data. An interest in content of the audio is identified based on identifying the time-based relationship. Various actions may be performed proactively based on identifying the interest in the content.

Abstract: Various implementations disclosed herein include devices, systems, and methods for displaying presentation notes at varying positions within a presenter's field of view. In some implementations, a device includes a display, one or more processors, and a memory. A first portion of a media content item corresponding to a presentation is displayed at a first location in a three-dimensional environment. Audience engagement data corresponding to an engagement level of a member of an audience is received. A second portion of the media content item is displayed at a second location in the three-dimensional environment. The second location is selected based on the audience engagement data.

Abstract: In one implementation, a method for dynamically changing sensory and/or input modes associated with content based on a current contextual state. The method includes: while in a first contextual state, presenting extended reality (XR) content, via the display device, according to a first presentation N mode and enabling a first set of input modes to be directed to the XR content; detecting a change from the first contextual state to a second contextual state; and in response to detecting the change from the first contextual state to the second contextual state, presenting, via the display device, the XR content according to a second presentation mode different from the first presentation mode and enabling a second set of input modes to be directed to the XR content that are different from the first set of input modes.

Abstract: This relates generally to systems and methods for changing tinting levels of one or more lenses or displays, and more particularly to changing tinting levels of one or more lenses or displays of an electronic device in response to environmental stimuli. In some examples, an electronic device applies a first tinting level to the one or more lenses or displays (e.g., a dedicated layer of the display or a discrete layer that is separate from a display to adjust opacity). In some examples, while applying the first tinting level to the one or more lenses or displays, the electronic device determines that the one or more criteria are satisfied. In some examples, in response to determining that the one or more criteria are satisfied, the electronic device applies a second tinting level, different than the first tinting level to the one or more lenses or displays.

Abstract: In some examples, an electronic device presents, via a display, a representation of a prediction of a food being consumed by a user of the electronic device in a computer-generated environment. In some examples, the electronic device presents, via the display, an indication of possible non-compliance of medication in the computer-generated environment. In some examples, the electronic device initiates a smoking detection mode in response to the acquisition and processing of data from the user of the electronic device or from the physical environment of the user of the electronic device.

Abstract: This relates generally to systems and methods for tracking and recording pupil dilation and/or signs of unconsciousness in response to detecting specific movements of the electronic device. In some examples, the electronic device captures and tracks first biometric data including pupil dilation using one or more input devices. In some examples, in response to detecting a movement of the electronic device, such as a rapid acceleration or deceleration of the electronic device, the electronic device captures second biometric data. In some examples, the electronic device displays a virtual object while presenting an extended reality environment, such as a visual indication in response to detecting that the second biometric data meets one or more criteria based on a comparison of the second biometric data with the first biometric data. In some examples, the electronic device initiates an emergency response based on the second biometric data.

Abstract: Some examples of the disclosure are directed to systems and methods for presenting extended reality environments and, more particularly, to displaying one or more images relating to exercises in a physical environment while presenting an extended reality environment. In some situations, the electronic device detects an initiation of an exercise activity of a user of the electronic device using at least an optical sensor. In some examples, the electronic device presents a user interface including a representation of the identified exercise activity in the extended reality environment. In some examples, in response to detecting progression of the identified exercise activity, the user interface is updated with the updated representation of the exercise activity. In some examples, the electronic device presents a rest user interface during rest periods and/or after detecting rest.