Abstract: The embodiments set forth a technique for enabling a computing device to securely communicate with a peripheral computing device. According to some embodiments, the method can include the steps of (1) receiving, at a detection sensor of the computing device, a light signal from the peripheral computing device, wherein the light signal is received at a first frequency that is higher than a second frequency capable of being detected by a camera system of the computing device, (2) extracting information from the light signal, and (3) performing an operation using the information.

Abstract: The present disclosure generally relates to providing product information. The appearance of a first product and a second product is detected within a field of view of one or more image sensors. Movement of the first product or the second product relative to one another is then detected. If the movement of the first product or the second product relative to one another causes the first product to come within a threshold distance of the second product, then comparison information is displayed at a location at least partially between the first product and the second product.

Abstract: The present disclosure generally relates to interacting with an electronic device without touching a display screen or other physical input mechanisms. In some examples, the electronic device performs an operation in response to a positioning of a user's hand and/or an orientation of the electronic device.

Abstract: Systems and methods for computer-generated reality user hailing are described. Some implementations may include accessing sensor data captured using one or more sensors; detecting a person within a distance of a head-mounted display based on the sensor data; detecting a hail event based on the sensor data; and responsive to the hail event, invoking an alert using the head-mounted display.

Abstract: The present disclosure generally relates to interacting with an electronic device without touching a display screen or other physical input mechanisms. In some examples, the electronic device performs an operation in response to a positioning of a user's hand and/or an orientation of the electronic device.

Abstract: In an exemplary technique for providing audio information, an input is received, and audio information responsive to the received input is provided using a speaker. While providing the audio information responsive to received input information, an external sound is detected. If it is determined that the external sound is a communication of a first type, then the provision of the audio information is stopped. If it is determined that the external sound is a communication of a second type, then the provision of the audio information continues.

Abstract: Systems and methods for computer-generated reality user hailing are described. Some implementations may include accessing sensor data captured using one or more sensors; detecting a person within a distance of a head-mounted display based on the sensor data; detecting a hail event based on the sensor data; and responsive to the hail event, invoking an alert using the head-mounted display.

Abstract: The present disclosure generally relates to providing product information. The appearance of a first product and a second product is detected within a field of view of one or more image sensors. Movement of the first product or the second product relative to one another is then detected. If the movement of the first product or the second product relative to one another causes the first product to come within a threshold distance of the second product, then comparison information is displayed at a location at least partially between the first product and the second product.

Abstract: An electronic device with a front side including a touch-sensitive display, a back side that does not include a display, and sensor(s) to detect contact intensities on the front and back side displays, on the touch-sensitive display, a user interface including objects. While displaying the user interface, the device detects an input on a side of the electronic device. In response, for a front side input with intensity that meets first criteria, the device performs a first operation corresponding to a first object; for front side input with intensity that meets second criteria, the device performs a second operation corresponding to the first object; for back side input with intensity that meets third criteria, the device performs a third operation that changes the user interface; and for back side input with intensity that does not meet the third criteria, the device maintains display of the user interface.

Abstract: The present disclosure generally relates to interacting with an electronic device without touching a display screen or other physical input mechanisms. In some examples, the electronic device performs an operation in response to a positioning of a user's hand and/or an orientation of the electronic device.

Abstract: In one implementation, a method of providing contextual computer-generated reality (CGR) digital assistant is performed at a device provided to deliver a CGR scene, the device including one or more processors, non-transitory memory, and one or more displays. The method includes obtaining image data characterizing a field of view captured by an image sensor. The method further includes identifying in the image data a contextual trigger for one of a plurality of contextual CGR digital assistants. The method additionally includes selecting a visual representation of the one of the plurality of contextual CGR digital assistants, where the visual representation is selected based on context and in response to identifying the contextual trigger. The method also includes presenting the CGR scene by displaying the visual representation of the one of the plurality of contextual CGR digital assistants, where the visual representation provides information associated with the contextual trigger.

Abstract: The present disclosure generally relates to interacting with an electronic device without touching a display screen or other physical input mechanisms. In some examples, the electronic device performs an operation in response to a positioning of a user's hand and/or an orientation of the electronic device.

Abstract: Systems and methods for computer-generated reality user hailing are described. Some implementations may include accessing sensor data captured using one or more sensors; detecting a person within a distance of a head-mounted display based on the sensor data; detecting a hail event based on the sensor data; and responsive to the hail event, invoking an alert using the head-mounted display.

Abstract: Systems and methods for calibrating a force input device are disclosed. The force input device includes a force-sensitive structure with a number of individual force sensors that compress or expand in response to input. The force input device measures an electrical property of the force sensors of the force-sensitive structure. After the force sensors are measured, the values obtained are adjusted based on a mechanical model of the response of the force sensitive structure. Upon receiving a force input event of high magnitude, the force input device recalibrates the mechanical model.

Abstract: Disclosed herein is a multifunction input device, such as, a keyboard. The multifunction input device has a capacitive sensing layer that enables a user to use the multifunction input device as standard keyboard and also as a touch sensitive surface such as, for example, a trackpad.

Abstract: The present disclosure generally relates to interacting with an electronic device without touching a display screen or other physical input mechanisms. In some examples, the electronic device performs an operation in response to a positioning of a user's hand and/or an orientation of the electronic device.

Abstract: In one aspect, the present disclosure relates to a method including detecting force applied to a force sensing layer in a device and detecting touch contacts applied to a touch screen layer in a device. The method also includes determining if the location and/or amount of force detected by the force sensing layer correlates to a touch contact, and, if it correlates, treating the force as front-side force, while if the location and/or amount of force detected by the force sensing layer does not correlate to a touch contact, treating the force as a back-side force. Based on the type of force detected, appropriate action may be taken, including back-side specific actions such as multi-tasking application switches or content or viewport manipulation.

Abstract: An electronic device with a front side including a touch-sensitive display, a back side that does not include a display, and sensor(s) to detect contact intensities on the front and back side displays, on the touch-sensitive display, a user interface including objects. While displaying the user interface, the device detects an input on a side of the electronic device. In response, for a front side input with intensity that meets first criteria, the device performs a first operation corresponding to a first object; for front side input with intensity that meets second criteria, the device performs a second operation corresponding to the first object; for back side input with intensity that meets third criteria, the device performs a third operation that changes the user interface; and for back side input with intensity that does not meet the third criteria, the device maintains display of the user interface.

Abstract: In one aspect, the present disclosure relates to a method including detecting force applied to a force sensing layer in a device and detecting touch contacts applied to a touch screen layer in a device. The method also includes determining if the location and/or amount of force detected by the force sensing layer correlates to a touch contact, and, if it correlates, treating the force as front-side force, while if the location and/or amount of force detected by the force sensing layer does not correlate to a touch contact, treating the force as a back-side force. Based on the type of force detected, appropriate action may be taken, including back-side specific actions such as multi-tasking application switches or content or viewport manipulation.

Abstract: An image processing system and method of operation includes: a source image having source pixels; homogeneous blocks in the source image having a block color; a homogeneous region in the source image formed by merging the homogeneous blocks having the block color within a color threshold; a text background region having text pixels and background pixels in the homogeneous region with the text background region having a texture feature above a texture threshold and a region size above a region size threshold; and a binary text mask representing the text pixels and the background pixels for displaying on a device.