Abstract: An interactive display, including a cover glass having a front surface that includes a viewing area provides an input/output (I/O) interface for a user of an electronic device. An arrangement includes a processor, a light source, and a camera disposed outside the periphery of the viewing area coplanar with or behind the cover glass. The camera receives scattered light resulting from interaction, with an object, of light outputted from the interactive display, the outputted light being received by the cover glass from the object and directed toward the camera. The processor determines, from image data output by the camera, an azimuthal angle of the object with respect to an optical axis of the camera and/or a distance of the object from the camera.

Abstract: This disclosure provides systems, methods and apparatus, including computer programs encoded on computer storage media, for sensing touch and/or gestures in the near-field area overlying a light-guiding layer within a device or other optical sensing system. In one aspect, modulated infrared light is emitted into the overlying area, and the light reflected by objects within the overlying area is redirected through the light-guiding layer to infrared sensors. In one aspect, a masking structure can be located between the light-guiding layer and the infrared sensors. In some aspects, probability mapping or backtracing can be used to estimate the locations of objects within the overlying area.

Abstract: This disclosure provides systems, methods and apparatus for a touch screens configured to determine a position of a touch event by selectively redirecting light to correlated locations on a light sensor. In one aspect, the touch screen apparatus can include a light guide forming a touch interface, a light source for injecting light into the light guide, a light sensor for detecting the injected light, and a pixilated light-turning layer. The pixilated light-turning layer can include a plurality of light-turning features forming pixels. The pixels can receive incident light corresponding to the emitted light scattered by an object contacting the light guide. The pixels can redirect the incident scattered light towards the light sensor such that light selectively propagates to one or more correlated light receiving locations. A processor can map the light receiving location to an area contacted by the object, thereby determining a position of a touch event.

Abstract: This disclosure relates to a channel waveguide, at least a portion of which is disposed within a viewing area of an interactive display, proximate to and substantially parallel to a user interface surface of the interactive display. A source of a first electromagnetic or acoustic signal is input to the channel waveguide. At least one detector is configured to receive, from the channel waveguide, a second signal corresponding to the first signal and to output a third signal indicative of a position of an object proximate to the channel waveguide.

Abstract: This disclosure provides systems, methods and apparatus for a touch screens configured to determine a position of a touch event by selectively redirecting light to correlated locations on a light sensor. In one aspect, the touch screen apparatus can include a light guide forming a touch interface, a light source for injecting light into the light guide, a light sensor for detecting the injected light, and a pixilated light-turning layer. The pixilated light-turning layer can include a plurality of light-turning features forming pixels. The pixels can receive incident light corresponding to the emitted light scattered by an object contacting the light guide. The pixels can redirect the incident scattered light towards the light sensor such that light selectively propagates to one or more correlated light receiving locations. A processor can map the light receiving location to an area contacted by the object, thereby determining a position of a touch event.

Abstract: This disclosure provides systems, methods and apparatus for touch and gesture recognition, using a field sequential color display. The display includes a processor, a lighting system, and an arrangement for spatial light modulation that includes an array of light modulators. Each light modulator is switchable between an open position that permits transmittance of light from the lighting system through a respective aperture and a shut position that blocks light transmission through the respective aperture. The processor switches the light modulators in accordance with a first modulation scheme to render an image and in accordance with a second modulation scheme to selectively pass object illuminating light through at least one of the respective apertures. A light sensor receives light resulting from interaction of the object illuminating with an object and outputs a signal to the processor. The processor recognizes, from the output of the light sensor, a characteristic of the object.

Abstract: This disclosure provides systems, methods and apparatus for touch and gesture recognition, using a field sequential color display. The display includes a processor, a lighting system, and an arrangement for spatial light modulation that includes an array of light modulators. Each light modulator is switchable between an open position that permits transmittance of light from the lighting system through a respective aperture and a shut position that blocks light transmission through the respective aperture. The processor switches the light modulators in accordance with a first modulation scheme to render an image and in accordance with a second modulation scheme to selectively pass object illuminating light through at least one of the respective apertures. A light sensor receives light resulting from interaction of the object illuminating with an object and outputs a signal to the processor. The processor recognizes, from the output of the light sensor, a characteristic of the object.

Abstract: This disclosure provides systems, methods and apparatus for touch and gesture recognition, using a field sequential color display. The display includes a processor, a lighting system, and an arrangement for spatial light modulation that includes a number of apertures, and devices for opening and shutting the apertures. A light directing arrangement includes at least one light turning feature. The display lighting system is configured to emit visible light and infrared (IR) light through at least a first opened one of the plurality of apertures. The light turning feature is configured to redirect IR light emitted through the opened aperture into at least one lobe, and to pass visible light emitted by the display lighting system through the opened aperture with substantially no redirection.

Abstract: This disclosure provides systems, methods and apparatus for touch and gesture recognition, using a field sequential color display. The display includes a processor, a lighting system, and an arrangement for spatial light modulation that includes an array of light modulators. Each light modulator is switchable between an open position that permits transmittance of light from the lighting system through a respective aperture and a shut position that blocks light transmission through the respective aperture. The processor switches the light modulators in accordance with a first modulation scheme to render an image and in accordance with a second modulation scheme to selectively pass object illuminating light through at least one of the respective apertures. A light sensor receives light resulting from interaction of the object illuminating with an object and outputs a signal to the processor. The processor recognizes, from the output of the light sensor, a characteristic of the object.

Abstract: This disclosure provides systems, methods and apparatus for adjusting an output color gamut of a display. The display includes a processor, a planar light guide, and light sensors disposed outside a periphery of the planar light guide. The planar light guide includes a first light-turning arrangement that redirects a portion of light received from the display toward one or more of the light sensors. Each light sensor is configured to output, to the processor, a signal representative of a characteristic of the redirected light. The first light-turning arrangement includes a first light turning element that turns ambient light toward a first light sensor, and a second light turning element that turns light received from the display toward a second, different, light sensor. The processor is configured to adjust an output color gamut of the display, responsive to respective outputs from the first light sensor and the second light sensor.

Abstract: This disclosure provides systems, methods and apparatus for an imaging system that includes a light guide having light-turning features that are configured to receive ambient light incident on the light guide, including light scattered from a scene to be imaged, and to direct the received ambient light towards an image sensor. The light-turning features may have angle-discriminating properties so that some light-turning features capture light incident upon the light guide at certain angles of incidence, but not others. Light scattered from multiple parts of a scene to be imaged may then be directed to correlated locations on an image sensor, which provides electronic data representing an image.

Abstract: This disclosure provides systems, methods and apparatus, including a display device that includes an overlying holographic film. In one aspect, the holographic film includes a hologram that is configured to turn light incident on the film. The light is turned towards the display device at desired angles. The display can be formed of interferometric modulators and the turned light can be reflected off the display, and towards a viewer, to form an image. For light that is incident on the film at angles outside of a view cone, the holographic film is provided with holographic light turning features that turn this light so that it is reflected off the display at angles within a view cone of the display.

Abstract: In various embodiments described herein, a display device includes a front illumination device that comprises a light guide disposed forward of an array of display elements, such as an array of interferometric modulators, to distribute light across the array of display elements. The light guide panel may include a turning layer to deliver uniform illumination from a light source to the array of display elements. For many portable display applications, the light guide panel comprises the substrate used in fabricating the display elements. The light guide panel may include additional films as well. The light guide panel, for example, may include a diffuser and/or an optical isolation layer to further enhance the optical imaging characteristics of the display.

Abstract: This disclosure provides systems, methods and apparatus, including computer programs encoded on computer storage media, for sensing touch and/or gestures in the near-field area overlying a light-guiding layer within a device or other optical sensing system. In one aspect, modulated infrared light is emitted into the overlying area, and the light reflected by objects within the overlying area is redirected through the light-guiding layer to infrared sensors. In one aspect, a masking structure can be located between the light-guiding layer and the infrared sensors. In some aspects, probability mapping or backtracing can be used to estimate the locations of objects within the overlying area.

Abstract: An integrated illumination apparatus includes a light injection portion having a first end for receiving light. The light injection portion supports propagation of light along the length of the light injection portion. Turning microstructure disposed on a first side of the light injection portion is configured to turn light incident on the first side and to direct light out a second opposite side of the light injection portion. A slit disposed along the length of the light injection portion forms an optical interface on the second opposite side of the light injection portion. The optical interface further transmits light turned by the turning microstructure. A light distribution portion is disposed with respect to the slit to receive the light transmitted through the slit. At least one bridge mechanically connects the light injection portion to the light distribution portion.

Abstract: In various embodiments described herein, a display device includes a front illumination device that comprises a light guide disposed forward of an array of display elements, such as an array of interferometric modulators, to distribute light across the array of display elements. The light guide may include a turning film to deliver uniform illumination from a light source to the array of display elements. For many portable display applications, the light guide comprises the substrate used in fabricating the display elements. The display device may include additional films as well. The light guide, for example, may include a diffuser and/or an optical isolation layer to further enhance the optical characteristics of the display.

Abstract: This disclosure provides systems, methods and apparatus for providing illumination by using a light guide to distribute light. In one aspect, the light guide has a surface, such as an edge, into which light is injected. The surface is treated to create a diffusive interface with a light source. For example, the surface may be subjected to abrasion to form a frosted surface that acts as the diffusive interface, or a diffusive structure may be attached to the edge, with the attached diffusive structure functioning as the diffusive interface. The diffusive interface diffuses light entering into the light guide, and can thereby increase the uniformity of light propagating within the light guide. The light guide may be provided with light turning features that redirect light out of the light guide. In some implementations, the redirected light may be applied to illuminate a display.

Abstract: This disclosure provides systems, methods and apparatus, including computer programs encoded on computer storage media, for providing a display device. In one aspect, the display device may include a light source system, a programmable hologram system, a light-turning layer and a control system. A control system may control the programmable hologram system to generate a sequence of holographic images of point light sources. The control system may control the programmable hologram system according to software stored in a non-transitory medium. By scanning a sequence of holographic images of point light sources across the light-turning layer, a frame of image data can be reproduced on the display device.

Abstract: This disclosure provides systems, methods and apparatus, including computer programs encoded on computer storage media, for providing a compact, low-sensor count scanning display that is capable of both displaying graphical content and of capturing images of objects placed on or above the scanning display. Various implementations are discussed, including raster scan, line scan, and compressive sampling version.

Abstract: This disclosure relates to a channel waveguide, at least a portion of which is disposed within a viewing area of an interactive display, proximate to and substantially parallel to a user interface surface of the interactive display. A source of a first electromagnetic or acoustic signal is input to the channel waveguide. At least one detector is configured to receive, from the channel waveguide, a second signal corresponding to the first signal and to output a third signal indicative of a position of an object proximate to the channel waveguide.