Abstract: Approaches are described for constructing a single camera by combining an array (or other arrangement) of multiple smaller and lower resolution cameras. Each of the smaller cameras is aimed in a different direction in order to provide a wider angle and higher resolution field of view (FOV) for the resulting composite camera. Images captured by all of the cameras in the array can be stitched together using software to produce a single composite photograph. This construction method can enable the camera unit to be thinner and potentially cheaper in construction costs than an equivalent single-piece camera that has been conventionally implemented in portable devices.

Abstract: Approaches are described for constructing a single camera by combining an array (or other arrangement) of multiple smaller and lower resolution cameras. Each of the smaller cameras is aimed in a different direction in order to provide a wider angle and higher resolution field of view (FOV) for the resulting composite camera. Images captured by all of the cameras in the array can be stitched together using software to produce a single composite photograph. This construction method can enable the camera unit to be thinner and potentially cheaper in construction costs than an equivalent single-piece camera that has been conventionally implemented in portable devices.

Abstract: Applications such as gesture detection and head tracking can utilize one or more imaging elements on a computing device. While it can be desirable to hide these elements as much as possible so as to have minimal impact on the design or appearance of the device, hiding the elements can cause users to inadvertently cover or block these elements when performing certain actions. When one or more of these elements are determined to be blocked or obscured by a user, the device can provide one or more indicators or cues that can indicate not only that the user is blocking an element, but also indicates the location of the element. The cues can take the form of circles, arcs, arrows, or other elements that can guide the user to the location of an element. Other indicators can be used as well, as may include audio and/or haptic feedback.

Abstract: The ability of a user to provide input when using a touch screen or other such element of a computing device can be improved by correcting for parallax errors. A camera of the computing device can determine the relative position of the user's head or eyes with respect to the device, and determine a viewing perspective of the user with respect to content displayed on the touch screen. Using the perspective direction and information about the dimensions of the touch screen, the device can determine an amount and direction of parallax error, and can make adjustments to remove or minimize that error. The device can cause the position of the displayed graphical elements to shift and/or can adjust the mappings of the touch sensitive regions that correspond to the graphical elements. Such an approach enables the graphical elements and touch mappings to align from the current perspective of the user.

Abstract: Devices such as electronic book readers, tablet computers, laptops, and so forth may use reflective liquid crystal display (“LCD”) technologies. Described herein are devices and methods for illuminating the reflective LCD with a light guide panel. The light guide panel is configured with diffractive or other optical features configured to distribute light to the reflective LCD. A directive reflector may be arranged behind the reflective LCD to improve overall reflectivity by directing impinging light such that optical obstructions such as transistors and electrical traces within the reflective LCD are avoided.

Abstract: A user can capture an image of an object, using a computing device, to obtain information about that object. If a specular highlight (or other saturated region) is detected, the device can attempt to determine a location of a light source associated with the highlight. The device can then provide instructions as to a direction to move in order to reduce the presence of the specular highlight in subsequent images. Multiple images of the object can be captured and analyzed to generate a three-dimensional reconstruction of the environment, whereby a position of the light source can be determined. In other embodiments, movement of the specular reflections in response to movement of the device is used to determine a direction of the light source. In other embodiments, an image of the user is captured to determine the position of the light source based on shadows or reflections on the user.

Abstract: Approaches are described for constructing a single camera by combining an array (or other arrangement) of multiple smaller and lower resolution cameras. Each of the smaller cameras is aimed in a different direction in order to provide a wider angle and higher resolution field of view (FOV) for the resulting composite camera. Images captured by all of the cameras in the array can be stitched together using software to produce a single composite photograph. This construction method can enable the camera unit to be thinner and potentially cheaper in construction costs than an equivalent single-piece camera that has been conventionally implemented in portable devices.

Abstract: Approaches are described for constructing a single camera by combining an array (or other arrangement) of multiple smaller and lower resolution cameras. Each of the smaller cameras is aimed in a different direction in order to provide a wider angle and higher resolution field of view (FOV) for the resulting composite camera. Images captured by all of the cameras in the array can be stitched together using software to produce a single composite photograph. This construction method can enable the camera unit to be thinner and potentially cheaper in construction costs than an equivalent single-piece camera that has been conventionally implemented in portable devices.

Abstract: A user of a computing device can be authenticated using image information captured by at least one camera of the computing device. In addition to analyzing the image information using a facial recognition algorithm, for example, variations in color of a portion of the captured image information corresponding to a user's face can be monitored over a period of time. The variations can be analyzed to determine whether the captured image information likely corresponds to an actual human user instead of a representation (e.g., photo) of a human user, such as where the chroma variations in at least a red channel occur with an oscillation frequency and amplitude consistent with changes due to a pulse or heartbeat.

Abstract: A transmissive element including a diffractive and/or refractive pattern can be used with a display screen of a computing device to allow the display screen to function as a near field optical sensor (NFOS). The NFOS can be used to detect shadows cast on the display screen, and/or bright objects detected near the display screen, which can be used to determine the relative position of one or more features with respect to the device. These features can be, for example, the fingers or thumbs of a user attempting to provide input to the computing device. The device can support motion or gesture detection using cameras of the device, and touch input using touch screen functionality, but the NFOS can enable the device to also track motion in the dead zone between the field of view of the cameras and the touch screen.

Abstract: The amount of power and processing needed to process gesture input for a computing device can be reduced by utilizing a separate gesture sensor. The gesture sensor can have a form factor similar to that of conventional cameras to reduce costs by being able to utilize readily available low cost parts, but can have a lower resolution and adjustable virtual shutter such that fast motions can be captured and/or recognized by the device. In some devices, a subset of the pixels of the gesture sensor can be used as a motion detector, enabling the gesture sensor to run in a low power state unless there is likely gesture input to process. Further, at least some of the processing and circuitry can be included with the gesture sensor such that various functionality can be performed without accessing a central processor or system bus, thus further reducing power consumption.

Abstract: An electronic device can utilize one or more sensors and/or imaging elements to determine the relative position of at least one light source relative to the device. In various embodiments, the intensity of light can be determined in various directions around the device. By determining the relative intensity around the device, an approximate direction of one or more light sources can be determined. Utilizing the relative position of each light source, the electronic device can properly light or shade a graphical object to be rendered by the device, or otherwise process image information captured by the device.

Abstract: A transmissive element including a diffractive and/or refractive pattern can be used with a display screen of a computing device to allow the display screen to function as a near field optical sensor (NFOS). The NFOS can be used to detect shadows cast on the display screen, and/or bright objects detected near the display screen, which can be used to determine the relative position of one or more features with respect to the device. These features can be, for example, the fingers or thumbs of a user attempting to provide input to the computing device. The device can support motion or gesture detection using cameras of the device, and touch input using touch screen functionality, but the NFOS can enable the device to also track motion in the dead zone between the field of view of the cameras and the touch screen.

Abstract: The amount of power and processing capacity needed to process gesture input for a computing device can be reduced by utilizing one or more relatively low power, low resolution gesture sensors. The gesture sensors can have relatively large pixels, which provide enhanced sensitivity in low light situations. Further, the low resolution and high frame rates of the gesture sensors can enable relatively low bandwidth buses to be used, rather than dedicated image buses. These low bandwidth buses can conserve a significant amount of power, and can provide the image data from the gesture sensors to low power PIC-class microprocessors, or other such components, which can analyze image data and make basic gesture determinations without having to wake up an application processor or send data over a main bus, which can further reduce power consumption.

Abstract: An optically transmissive element of a computing device can be used to enable touch input. One or more light sources, such as infrared (IR) light emitting diodes (LEDs), can direct radiation into an edge of the transmissive element and direct light to reflect from at least one other side or edge using total internal reflection (TIR). The transmissive element can have one or more curved or shaped regions, the extent of which can affect the amount of light lost from the element due to less than TIR at those regions. If a user places a finger at a position where the light internally reflects, a portion of the light will be transmitted out of the element causing a reduction in the amount of light received to one or more light sensors. By monitoring patterns of intensity loss, the locations of user inputs can be determined.

Abstract: Stereo imaging can be provided on an electronic device without the need for two matched, high resolution, large format cameras. In various embodiments, two or more cameras of disparate types can be used to capture stereoscopic images. Various processing algorithms can be used to adjust aspects such as the effective pixel size and depth of focus in order to provide for sufficient information to generate three-dimensional images without significant artifacts resulting from differences in the mismatched cameras.

Abstract: A transmissive element including a diffractive and/or refractive pattern can be used with a display screen of a computing device to allow the display screen to function as a near field optical sensor (NFOS). The NFOS can be used to detect shadows cast on the display screen, and/or bright objects detected near the display screen, which can be used to determine the relative position of one or more features with respect to the device. These features can be, for example, the fingers or thumbs of a user attempting to provide input to the computing device. The device can support motion or gesture detection using cameras of the device, and touch input using touch screen functionality, but the NFOS can enable the device to also track motion in the dead zone between the field of view of the cameras and the touch screen.

Abstract: A dedicated application-specific integrated circuit (ASIC) is described that can be integrated into a mobile device (e.g., a mobile phone, tablet computer). The dedicated ASIC can provide an embedded low-power micro-controller to offload machine vision processing and other image processing from an application processor (AP) of the mobile device. Effectively, the offloading of image processing can enable the mobile device to save battery life and improve performance by utilizing lower speed buses and lower power consumption than would otherwise be consumed if the AP were to be utilized. In various embodiments, the ASIC can be used to either connect a single camera or multiple synchronized cameras depending on the application.

Abstract: A set of optical fibers can be used to enable touch input for a computing device. One or more light sources, such as infrared (IR) light emitting diodes (LEDs), can direct radiation into one or more fibers that propagates down the fibers and is detected by one or more sensors. If a user places a finger at a position where a portion of a fiber is exposed, a portion of the light propagating down the fiber will not undergo total internal reflection (TIR) and instead will be transmitted out of the fiber, causing a reduction in the amount of light received from that fiber to one of the sensors. By monitoring losses for the fibers and knowing the area at which each fiber is exposed, locations at which the losses occur can be determined. These locations can correspond to various types of user input.

Abstract: The amount of power and processing needed to process gesture input for a computing device can be reduced by utilizing a separate gesture sensor. The gesture sensor can have a form factor similar to that of conventional camera elements, in order to reduce costs by being able to utilize readily available low cost parts, but can have a lower resolution and adjustable virtual shutter such that fast motions can be captured and/or recognized by the device. In some devices, a subset of the pixels of the gesture sensor can be used as a motion detector, enabling the gesture sensor to run in a low power state unless there is likely gesture input to process. Further, at least some of the processing and circuitry can be included with the gesture sensor such that various functionality can be performed without accessing a central processor or system bus, thus further reducing power consumption.