Abstract: An electronic device may be provided with imaging modules or communications modules. Imaging modules and communications modules may be improved with the use of plasmonic light collectors. Plasmonic light collectors exploit the interaction between incoming light and plasmons in the plasmonic light collector to redirect the path of the incoming light. Plasmonic light collectors may be used to form lenses for image pixels in an imaging module or to form light pipes or lenses for use in injecting optical communications into a fiber optic cable. Plasmonic lenses may be formed by lithography of metallic surfaces by implantation or by stacking and patterning of layers of materials having different dielectric properties. Plasmonic image pixels may be smaller and more efficient than conventional image pixels. Plasmonic light guides may have significantly less signal loss than conventional lenses and light guides.

Abstract: An ingestible scanning device includes, in an embodiment, a capsule housing having a transparent window and sized so as to be ingestible, a photo-sensing array located within the capsule housing, a mirror located within the housing and oriented to direct an image from a surface outside the transparent window to the photo-sensing array, and a light source for illuminating the surface outside the transparent window.

Abstract: Electronic devices may be provided with imaging modules that include plasmonic light collectors. Plasmonic light collectors may be configured to exploit an interaction between incoming light and plasmons in the plasmonic light collector to alter the path of the incoming light. Plasmonic light collectors may include one or more spectrally tuned plasmonic image pixels configured to preferentially trap light of a given frequency. Spectrally tuned plasmonic image pixels may include plasmonic structures formed form a patterned metal layer over doped silicon layers. Doped silicon layers may be interposed between plasmonic structures and a reflective layer. Plasmonic image pixels may be used to absorb and detect as much as, or more than, ninety percent of incident light at wavelengths ranging from the infrared to the ultraviolet. Plasmonic image pixels that capture light of different colors may be arranged in patterned arrays to form imager modules or imaging spectrometers for optofluidic microscopes.

Abstract: A light-based input device may be based on a wedge-shaped light-guide structure. Light may be introduced into the interior of the light-guide structure from a light source and corresponding reflected light exiting the light-guide structure may be measured using a light detector such as an image sensor. The location at which a user places an object in contact with an upper surface of the light-guide structure may be detected by analyzing the pattern of reflected light that exits the light-guide structure. Multiple layers of light-guide structures may be separated from each other by opaque material such as plastic so that the device can determine the direction in which the object is traversing the light-guide layers. A light-based input device may be implemented using free-space light beams that are interrupted by the user. Keys may be provided in a light-based input device by movably mounting contact pads to a light-guide structure.

Abstract: A light-based input device may have multiple branches each based on a respective light-guide structure. A light source may launch light into the light-guide structures. A light sensor may detect light reflected from the light-guide structures or transmitted through the light-guide structures. The light-based input device may be used to gather user input from a user of an electronic device. The user may move an object into contact with the light-guide structures. The light sensor may monitor light intensity fluctuations from the light-guide structures to determine where the light-guide structures have been contacted by the object. Multiple wavelengths of light may be used by the light source and light sensor to reduce crosstalk between adjacent branches of the light-based input device.

Abstract: A microfluidic system may include an image sensor integrated circuit containing image sensor pixels. A channel containing a fluid with particles such as cells may be formed on top of the image sensor. Flow control components may be mounted to the image sensor integrated circuit for controlling the flow of fluids through the channel. The flow control components may include a chemically powered pump. The chemical pump may include one or more chambers and a valve between the chambers. The valve may be operable to allow chemical reactants stored in the chambers to be mixed to produce gasses for generating pressure in the channel. The pressure in the channel may be used to control the flow of the fluid. As the fluid and particles flow through the channel, the image sensor pixels may be used to capture images of the particles.

Abstract: An electronic device may be provided with imaging modules or communications modules. Imaging modules and communications modules may be improved with the use of plasmonic light collectors. Plasmonic light collectors exploit the interaction between incoming light and plasmons in the plasmonic light collector to redirect the path of the incoming light. Plasmonic light collectors may be used to form lenses for image pixels in an imaging module or to form light pipes or lenses for use in injecting optical communications into a fiber optic cable. Plasmonic lenses may be formed by lithography of metallic surfaces, by implantation or by stacking and patterning of layers of materials having different dielectric properties. Plasmonic image pixels may be smaller and more efficient than conventional image pixels. Plasmonic light guides may have significantly less signal loss than conventional lenses and light guides.

Abstract: An acoustic system may be provided that includes image sensors and speakers. The system may include control circuitry that operates the speakers based on images captured by the image sensors. The control circuitry may operate the image sensors to capture images of users of the system in the listening environment, extract user attributes of the users from the captured images, and control the volume and phase of sounds generated by each of the speakers based on the extracted user attributes. The user attributes may include a location, a motion, a head height, a head tilt angle, a head rotational angle, the position of each ear of a user or other attributes of each user of the system. The control circuitry may operate the speakers to optimize the acoustic experience of each user by generating sounds based on the user attributes of that user.

Abstract: Optical accelerometers may be provided that detect acceleration in up to six axes. An optical accelerometer may include an image sensor and optical elements such as light pipes that extend over the image sensor. Light may be injected into the optical elements by a light source. The optical elements may guide the light onto corresponding portions of an image pixel array on the image sensor. The image pixels may be used to detect changes in the location, size, and intensity of illuminated portions of the pixel array when the optical elements move due to acceleration of the optical accelerometer. The optical accelerometer may include multiple light pipes having various lengths and thicknesses. Light pipes of matching length and thickness may be formed over opposing sides of a pixel array. The light pipes may be coated with a material that responds to electric or magnetic fields.

Abstract: An image sensor integrated circuit may contain image sensor pixels. A channel containing a fluid with particles such as cells may be formed on top of the image sensor. Some of the image sensor pixels may form a calibration sensor and some of the image sensor pixels may form an imager. As the fluid and particles flow through the channel at a flow rate, the calibration sensor may measures the flow rate and illumination intensity in the channel. Based on calibration data such as measured flow rate and measured illumination intensity, adjustments may be made to ensure that the imager acquires satisfactory image data. The adjustments may include flow rate adjustments, image acquisition data rate adjustments, and illumination adjustments. A processing unit in the channel may contain a laser or other component to destroy selected cells. A flared region in the channel may be used as a chromatograph.

Abstract: An ingestible scanning device includes, in an embodiment, a capsule housing having a transparent window and sized so as to be ingestible, a photo-sensing array located within the capsule housing, a mirror located within the housing and oriented to direct an image from a surface outside the transparent window to the photo-sensing array, and a light source for illuminating the surface outside the transparent window.

Abstract: A system may be provided that includes computing equipment and an optical input accessory. The computing equipment may use an imaging system to track the relative locations of light sources on the optical input device and to continuously capture images of optical markers on the optical input accessory and of user input objects. The computing equipment may be used to operate the system in operational modes that allow a user to record and playback musical sounds based on user input gathered with the optical input device, to generate musical sounds based on user input gathered with the optical input device and based on musical data received from a remote location, to provide musical instruction to a user of the optical input device, to generate a musical score using the optical input device, or to generate user instrument acoustic profiles.

Abstract: A system may include computing equipment and a handheld video overlay accessory. A video overlay accessory may include one or more light sources, an image sensor, and processing circuitry. The video overlay accessory may include an image projector that projects images onto external objects. The video overlay accessory may include a partially transparent beam splitter and a display that projects display content onto the partially transparent beam splitter. A user that views a scene through the partially transparent beam splitter may view the display content apparently overlaid onto the scene. Light sources in the video overlay accessory may be laser diodes or other light-emitting diodes that project tracking spots such as infrared tracking spots on to external objects. The image sensor may be used to capture images of the tracking spots. The processing circuitry may determine distance and position information based on the captured images.

Abstract: An electronic device may have a touch panel. The touch panel may detect touch events using one or more cameras. The touch panel may include a planar exterior surface, such as a cover glass, that extends over an active region of a display and an inactive peripheral region. The cameras may be located underneath the inactive peripheral region. The cameras may include a light turning element to allow the cameras to detect touch events, without being raised above the exterior surface of the active region of the display (e.g., without having a raised profile). The touch panel may detect touch events using dynamic zooming techniques. As an example, the touch panel may divide the active region into sections, search for touch events in each section, zoom into sections in which touch events are found, and further search the sections in which touch events were found.

Abstract: A system may be provided that includes computing equipment and an optical input accessory. The computing equipment may include an imaging system, storage and processing circuitry, a display, communications circuitry, and input-output devices. The optical input accessory may include one or more light sources and optical markers representing instrument components for multiple instruments. The optical markers may be printed, molded or otherwise formed on a surface of a housing structure. The light sources may each emit a particular type of light. The computing equipment may use the imaging system to track the relative locations of the light sources and to continuously capture images of the optical markers and of user input objects. The computing equipment may generate audio, video or other output based on user input data generated in response to detected changes in position of the user input object with respect to the optical markers in the images.

Abstract: Electronic devices may include touch-free user input components that include camera modules having overlapping fields-of-view. The overlapping fields-of-view may form a gesture tracking volume in which multi-dimensional user gestures can be tracked using images captured with the camera modules. A camera module may include an image sensor having an array of image pixels and a diffractive element that redirects light onto the array of image pixels. The diffractive element may re-orient the field-of-view of each camera module so that an outer edge of the field-of-view runs along an outer surface of a display for the device. The device may include processing circuitry that operates the device using user input data based on the user gestures in the gesture tracking volume. The processing circuitry may operate the display based on the user gestures by displaying regional markers having a size and a location that depend on the user gestures.

Abstract: Electronic devices may include imaging systems with camera modules and light sources. A camera module may be used to capture images while operating one or more light sources. Operating the light sources may generate changing illumination patterns on surfaces of objects to be imaged. Images of an object may be captured under one or more different illumination conditions generated using the light sources. Shadow patterns in the captured images may change from one image captured under one illumination condition to another image captured under a different illumination condition. The electronic device may detect changes in the shadow patterns between multiple captured images. The detected changes in shadow patterns may be used to determine whether an object in an image is a planar object or an object having protruding features. A user authentication system in the device may permit or deny access to the device based, in part, on that determination.

Abstract: An electronic device may have a camera module. The camera module may include a camera sensor capable of capturing foveated images. The camera sensor may be hardwired to capture foveated images with fixed regions of different quality levels or may be dynamically-reconfigurable to capture foveated images with selected regions of different quality levels. As one example, the camera module may be hardwired to capture a center region of an image at full resolution and peripheral regions at reduced resolutions, so that a user can merely center objects of interest in the image to capture a foveated image. As another example, the camera module may analyze previous images to identify objects of interest and may then reconfigure itself to capture the identified objects of interest at a high quality level, while capturing other regions at reduced quality levels.

Abstract: A microfluidic system may include an image sensor integrated circuit containing image sensor pixels. A channel containing a fluid with particles such as cells may be formed on top of the image sensor. Flow control components may be mounted to the image sensor integrated circuit for controlling the flow of fluids through the channel. The flow control components may include a chemically powered pump. The chemical pump may include one or more chambers and a valve between the chambers. The valve may be operable to allow chemical reactants stored in the chambers to be mixed to produce gasses for generating pressure in the channel. The pressure in the channel may be used to control the flow of the fluid. As the fluid and particles flow through the channel, the image sensor pixels may be used to capture images of the particles.

Abstract: Electronic devices may be provided with imaging modules that include plasmonic light collectors. Plasmonic light collectors may be configured to exploit an interaction between incoming light and plasmons in the plasmonic light collector to alter the path of the incoming light. Plasmonic light collectors may include one or more spectrally tuned plasmonic image pixels configured to preferentially trap light of a given frequency. Spectrally tuned plasmonic image pixels may include plasmonic structures formed form a patterned metal layer over doped silicon layers. Doped silicon layers may be interposed between plasmonic structures and a reflective layer. Plasmonic image pixels may be used to absorb and detect as much as, or more than, ninety percent of incident light at wavelengths ranging from the infrared to the ultraviolet. Plasmonic image pixels that capture light of different colors may be arranged in patterned arrays to form imager modules or imaging spectrometers for optofluidic microscopes.