Abstract: A three-dimensional computer-generated environment can be presented to a user. The user can create a virtual representation of a real-world object within the computer-generated environment by directing an input device towards the real-world object and tracing contours of the real-world object. The virtual representation can include voxels. The user can edit the virtual representation or create a new virtual object formed of voxels by depositing or removing voxels at virtual locations within the computer-generated environment based on selection inputs, release inputs, and optionally movement inputs detected by the input device. In some cases, the user can provide inputs via another input source, such as a hand of the user, that are detected by additional sensors or devices.

Abstract: In some embodiments, a computer system performs virtual object manipulation operations using respective portions of the user's body and/or input device(s). In some embodiments, a computer system manipulates a virtual object based on input from a hand of a user and/or a handheld device. In some embodiments, a computer system manipulates a virtual object directly or indirectly.

Abstract: A three-dimensional computer-generated environment can be presented to a user. The user can create a virtual representation of a real-world object within the computer-generated environment by directing an input device towards the real-world object and tracing contours of the real-world object. The virtual representation can include voxels. The user can edit the virtual representation or create a new virtual object formed of voxels by depositing or removing voxels at virtual locations within the computer-generated environment based on selection inputs, release inputs, and optionally movement inputs detected by the input device. In some cases, the user can provide inputs via another input source, such as a hand of the user, that are detected by additional sensors or devices.

Abstract: A three-dimensional control system includes an input device, a computing device, and a tracking assembly. The input device can include an input sensor, an inertial measurement unit sensor, and an ultrasonic speaker. The tracking assembly can include a plurality of ultrasonic microphones and an inertial measurement unit disposed on or with the computing device. The plurality of ultrasonic microphones can include three microphones in a first plane and at least one other ultrasonic microphone disposed out of the first plane. The ultrasonic microphones can be configured to detect ultrasonic waves output by the speaker of the input device and the computing device can triangulate the position of the input device relative to the computing device in space.

Abstract: A computer input system includes a mouse including a housing having an interior surface defining an internal volume and a sensor assembly disposed in the internal volume. A processor is electrically coupled to the sensor assembly and a memory component having electronic instructions stored thereon that, when executed by the processor, causes the processor to determine an orientation of the mouse relative to a hand based on a touch input from the hand detected by the sensor assembly. The mouse can also have a circular array of touch sensors or lights that detect hand position and provide orientation information to the user.

Abstract: An input device, such as a mouse, can include a housing defining an exterior grip portion and an internal volume, a sensor assembly disposed in the internal volume, and an emitter electrically coupled to the sensor assembly. In response to the sensor assembly detecting a first touch input on the housing, the emitter sends a first signal including information regarding an angular position of the grip portion. In response to the sensor assembly detecting a second touch input on the housing, the emitter sends a second signal including information regarding a direction of a force exerted on the housing from the second touch input.

Abstract: An input device can include a housing defining an internal volume and a lower portion, the lower portion defining an aperture, an input sensor disposed in the internal volume, and a haptic assembly disposed in the internal volume. The haptic assembly can include an actuator and a foot coupled to the actuator and aligned with the aperture. The actuator can be configured to selectively extend the foot through the aperture to vary a sliding resistance of the input device on a support surface.

Abstract: A handheld electronic device may include a microphone for receiving voice commands, a speaker for providing audio feedback, a display for providing visual output and receiving touch input, and a motion sensor for receiving gesture input. The handheld electronic device may include control circuitry that processes voice commands differently depending on the application running on the handheld electronic device and the icon being displayed on the display. The control circuitry may determine the location of the handheld electronic device and may provide content based on the location. For example, a remote control interface for controlling an external device may be displayed when the handheld electronic device approaches the external device. A head-mounted device may display virtual images based on the location of the handheld electronic device. The virtual images may include a live video feed from a video call, virtual images associated with voice commands, or other virtual images.

Abstract: A method includes recording a first video stream characterized by a first value of a first quality characteristic. The method includes determining that the first video stream satisfies a trigger criterion. The trigger criterion characterizes a threshold amount of video content change information. The method includes, in response to determining that the first video stream satisfies the trigger criterion, obtaining a second video stream characterized by a second value of a second quality characteristic. The second video stream includes scene information also included in the first video stream. The second value of the second quality characteristic is indicative of a higher quality video stream than the first value of the first quality characteristic. The method includes generating a third video stream by adding information from the second video stream to the first video stream. The third video stream corresponds to a higher quality version of the first video stream.

Abstract: A method includes recording a first video stream characterized by a first value of a first quality characteristic. The method includes determining that the first video stream satisfies a trigger criterion. The trigger criterion characterizes a threshold amount of video content change information. The method includes, in response to determining that the first video stream satisfies the trigger criterion, obtaining a second video stream characterized by a second value of a second quality characteristic. The second video stream includes scene information also included in the first video stream. The second value of the second quality characteristic is indicative of a higher quality video stream than the first value of the first quality characteristic. The method includes generating a third video stream by adding information from the second video stream to the first video stream. The third video stream corresponds to a higher quality version of the first video stream.

Abstract: A device displays, in a first display region of a camera user interface, a first live view from a first camera. While displaying the first live view from the first camera, the device detects movement of a first user input (e.g., a first contact on a touch-sensitive surface). In accordance with a determination that the movement of the first user input meets first movement criteria, the device moves the first live view in the first display region in accordance with the movement of the first user input, displays a second live view from a second camera, and moves the second live view in the first display region in accordance with the movement of the first user input.

Abstract: Various implementations disclosed herein include devices, systems, and methods that generates and displays a portion of a representation of a face of a user. For example, an example process may include obtaining a first set of data corresponding to features of a face of a user in a plurality of configurations, while a user is using an electronic device, obtaining a second set of data corresponding to one or more partial views of the face from one or more image sensors, generating a representation of the face of the user based on the first set of data and the second set of data, wherein portions of the representation correspond to different confidence values, and displaying the portions of the representation based on the corresponding confidence values.

Abstract: A device displays a camera user interface for recording media images in a plurality of media recording modes. While displaying the camera user interface, the device captures media with one or more cameras. In response to capturing the media, in accordance with a determination that the captured media is consistent with a first media recording mode, the device displays a first prompt in the camera user interface that prompts a user to take one or more actions associated with the first media recording mode; and in accordance with a determination that the captured media is consistent with a second media recording mode, the device displays a second prompt in the camera user interface that prompts the user to take one or more actions associated with the second media recording mode, where the first media recording mode is different from the second media recording mode.

Abstract: An audio output device case that includes one or more input devices and is in communication with at least one or more audio output devices and an audio source, performs a method, while the audio source is in communication with the one or more audio output devices, that includes receiving an input via the one or more input devices of the audio output device case, and in response to receiving the input, causes the one or more audio output devices to perform an operation associated with the received input while maintaining communication of the audio source with the one or more audio output devices.

Abstract: The method includes: displaying first graphical elements associated with first plurality of output modalities within an XR environment; while displaying the first graphical elements, detecting movement of a physical object; and in response to detecting the movement of the physical object: in accordance with a determination that the movement of the physical object causes the physical object to breach a distance threshold relative to a first graphical element among the first graphical elements, selecting a first output modality associated with the first graphical element as a current output modality for the physical object; and in accordance with a determination that the movement of the physical object causes the physical to breach the distance threshold relative to a second graphical element among the first graphical elements, selecting a second output modality associated with the second graphical element as the current output modality for the physical object.

Abstract: The present disclosure generally relates to using avatars and image data for enhanced user interactions. In some examples, user status dependent avatars are generated and displayed with a message associated with the user status. In some examples, a device captures image information to scan an object to create a 3D model of the object. The device determines an algorithm for the 3D model based on the capture image information and provides visual feedback on additional image data that is needed for the algorithm to build the 3D model. In some examples, an application's operation on a device is restricted based on whether an authorized user is identified as using the device based on captured image data.

Abstract: A method includes recording a first video stream characterized by a first value of a first quality characteristic. The method includes determining that the first video stream satisfies a trigger criterion. The trigger criterion characterizes a threshold amount of video content change information. The method includes, in response to determining that the first video stream satisfies the trigger criterion, obtaining a second video stream characterized by a second value of a second quality characteristic. The second video stream includes scene information also included in the first video stream. The second value of the second quality characteristic is indicative of a higher quality video stream than the first value of the first quality characteristic. The method includes generating a third video stream by adding information from the second video stream to the first video stream. The third video stream corresponds to a higher quality version of the first video stream.

Abstract: A method includes recording a first video stream characterized by a first value of a first quality characteristic. The method includes determining that the first video stream satisfies a trigger criterion. The trigger criterion characterizes a threshold amount of video content change information. The method includes, in response to determining that the first video stream satisfies the trigger criterion, obtaining a second video stream characterized by a second value of a second quality characteristic. The second video stream includes scene information also included in the first video stream. The second value of the second quality characteristic is indicative of a higher quality video stream than the first value of the first quality characteristic. The method includes generating a third video stream by adding information from the second video stream to the first video stream. The third video stream corresponds to a higher quality version of the first video stream.

Abstract: In some embodiments, an electronic device enhances a two-dimensional drawing. In some embodiments, an electronic device manipulates an object in a three-dimensional environment. In some embodiments, an electronic device displays a contextual menu or moving an object in a three-dimensional environment. In some embodiments, an electronic device moves an object in a three-dimensional environment by an amount based on the distance of the object from the user. In some embodiments, an electronic device scans a real world object. In some embodiments, an electronic device manipulates a distant object.

Abstract: One or more techniques for managing virtual objects between one or more displays are described. In accordance with some embodiments, exemplary techniques for displaying a virtual object are described.