Abstract: Logged data from an autonomous vehicle is processed to generate augmented data. The augmented data describes an actor in an environment of the autonomous vehicle, the actor having an associated actor type and an actor motion behavior characteristic. The augmented data may be varied to create different sets of augmented data. The sets of augmented data can be used to create one or more simulation scenarios that in turn are used to produce machine learning models to control the operation of autonomous vehicles.

Abstract: Logged data from an autonomous vehicle is processed to generate augmented data. The augmented data describes an actor in an environment of the autonomous vehicle, the actor having an associated actor type and an actor motion behavior characteristic. The augmented data may be varied to create different sets of augmented data. The sets of augmented data can be used to create one or more simulation scenarios that in turn are used to produce machine learning models to control the operation of autonomous vehicles.

Abstract: Logged data from an autonomous vehicle is processed to generate augmented data. The augmented data describes an actor in an environment of the autonomous vehicle, the actor having an associated actor type and an actor motion behavior characteristic. The augmented data may be varied to create different sets of augmented data. The sets of augmented data can be used to create one or more simulation scenarios that in turn are used to produce machine learning models to control the operation of autonomous vehicles.

Abstract: Logged data from an autonomous vehicle is processed to generate augmented data. The augmented data describes an actor in an environment of the autonomous vehicle, the actor having an associated actor type and an actor motion behavior characteristic. The augmented data may be varied to create different sets of augmented data. The sets of augmented data can be used to create one or more simulation scenarios that in turn are used to produce machine learning models to control the operation of autonomous vehicles.

Abstract: Logged data from an autonomous vehicle is processed to generate augmented data. The augmented data describes an actor in an environment of the autonomous vehicle, the actor having an associated actor type and an actor motion behavior characteristic. The augmented data may be varied to create different sets of augmented data. The sets of augmented data can be used to create one or more simulation scenarios that in turn are used to produce machine learning models to control the operation of autonomous vehicles.

Abstract: Logged data from an autonomous vehicle is processed to generate augmented data. The augmented data describes an actor in an environment of the autonomous vehicle, the actor having an associated actor type and an actor motion behavior characteristic. The augmented data may be varied to create different sets of augmented data. The sets of augmented data can be used to create one or more simulation scenarios that in turn are used to produce machine learning models to control the operation of autonomous vehicles.

Abstract: Logged data from an autonomous vehicle is processed to generate augmented data. The augmented data describes an actor in an environment of the autonomous vehicle, the actor having an associated actor type and an actor motion behavior characteristic. The augmented data may be varied to create different sets of augmented data. The sets of augmented data can be used to create one or more simulation scenarios that in turn are used to produce machine learning models to control the operation of autonomous vehicles.

Abstract: This disclosure provides systems, methods and apparatus related to biometric authentication of a user of an electronic device. An electronic display has a display cover glass with a front surface that includes a viewing area, and a fingerprint reading area within the viewing area. At least one photosensing element is configured to detect received scattered light, the received scattered light resulting from interaction of light with an object in at least partial optical contact with the front surface within the fingerprint reading area and to output, to a processor, fingerprint image data.

Abstract: An interactive display, including a cover glass having a front surface that includes a viewing area provides an input/output (I/O) interface for a user of an electronic device. An arrangement includes a processor, a light source, and a camera disposed outside the periphery of the viewing area coplanar with or behind the cover glass. The camera receives scattered light resulting from interaction, with an object, of light outputted from the interactive display, the outputted light being received by the cover glass from the object and directed toward the camera. The processor determines, from image data output by the camera, an azimuthal angle of the object with respect to an optical axis of the camera and/or a distance of the object from the camera.

Abstract: This disclosure relates to an interactive display, having a front surface including a viewing area, and providing an input/output interface for a user of an electronic device. A planar light guide (PLG) disposed substantially parallel to the front surface, has a periphery at least coextensive with the viewing area. A light-emitting source (LES), disposed outside the periphery of the PLG, is optically coupled with a PLG input. The PLG outputs reflected light, in a direction substantially orthogonal to the front surface, by reflecting light received from the LES. A light collecting device (LCD) collects scattered light that results from interaction of the reflected light with a user-controlled object. The LCD redirects the collected scattered light toward one or more light sensors. A processor recognizes, from outputs of the light sensors, an instance of a user gesture, and controls the interactive display and/or electronic device, responsive to the user gesture.

Abstract: This disclosure provides systems, methods and apparatus related to touch and gesture recognition with an electronic interactive display. The interactive display has a front surface that includes a viewing area, a planar light guide disposed proximate to and behind the front surface, a light source, and at least one photo sensing element coupled with the first planar light guide. The planar light guide is configured to receive scattered light, the received scattered light resulting from interaction between light emitted by the light source and an object in optical contact with the front surface. The photo sensing element is configured to detect at least some of the received scattered light and to output, to a processor, image data. The processor is configured to recognize, from the image data, one or both of a contact pressure and a rotational orientation of the object.

Abstract: This disclosure provides systems, methods and apparatus for touch and gesture recognition, using a field sequential color display. The display includes a processor, a lighting system, and an arrangement for spatial light modulation that includes an array of light modulators. Each light modulator is switchable between an open position that permits transmittance of light from the lighting system through a respective aperture and a shut position that blocks light transmission through the respective aperture. The processor switches the light modulators in accordance with a first modulation scheme to render an image and in accordance with a second modulation scheme to selectively pass object illuminating light through at least one of the respective apertures. A light sensor receives light resulting from interaction of the object illuminating with an object and outputs a signal to the processor. The processor recognizes, from the output of the light sensor, a characteristic of the object.

Abstract: A touch and hover-sensitive sensor system is provided. The system may include a planar light guide that has a plurality of light sources located along a first edge of the light guide and a plurality of light sensors located along a second edge of the light guide orthogonal to the first edge. The light guide may include light-turning arrangements that are configured to redirect light passing through a first side of the light guide from/along orthogonal directions within the light guide. A controller may illuminate proper subsets of the light sources; light that is emitted from the first side and that encounters an object, e.g., a fingertip, may be reflected back into the first side and then redirected to the light sensors. Depending on the light sensors that detect the highest redirected reflected light intensity and the active light sources, the controller may determine the XY/XYZ location of the object.

Abstract: This disclosure provides systems, methods and apparatus related to touch and gesture recognition with an electronic interactive display. The interactive display has a front surface that includes a viewing area, a planar light guide disposed proximate to and behind the front surface, a light source, and at least one photo sensing element coupled with the first planar light guide. The planar light guide is configured to receive scattered light, the received scattered light resulting from interaction between light emitted by the light source and an object in optical contact with the front surface. The photo sensing element is configured to detect at least some of the received scattered light and to output, to a processor, image data. The processor is configured to recognize, from the image data, one or both of a contact pressure and a rotational orientation of the object.

Abstract: Systems, methods, and apparatus for recognizing user interactions with an electronic device are provided. Implementations of the systems, methods, and apparatus include surface and air gesture recognition and identification of fingertips or other objects. In some implementations, a device including a plurality of detectors configured to receive signals indicating interaction of an object with the device at or above a detection area, such that a low resolution image can be generated from the signals, is provided. The device is configured to obtain low resolution image data from the signals and obtain a first reconstructed depth map from the low resolution image data. The first reconstructed depth map may have a higher resolution than the low resolution image. The device is further configured to obtain a second reconstructed depth map from the first reconstructed depth map. The second reconstructed depth map may provide improved boundaries and less noise within the object.

Abstract: This disclosure provides systems, methods and apparatus related to biometric authentication of a user of an electronic device. An electronic display has a display cover glass with a front surface that includes a viewing area, and a fingerprint reading area within the viewing area. At least one photosensing element is configured to detect received scattered light, the received scattered light resulting from interaction of light with an object in at least partial optical contact with the front surface within the fingerprint reading area and to output, to a processor, fingerprint image data.

Abstract: A system and method for wirelessly charging a chargeable device is provided. In one aspect, the method includes detecting a presence of a chargeable device within a charging region of the optical charger. The method further includes providing light to the chargeable device upon detecting the presence of the chargeable device within the charging region. The light provided through an optical casing and an elastomer when the chargeable device is in contact with the elastomer. The optical casing optically coupled to the elastomer. The light sufficient to charge or power the chargeable device and spectrally matched to a bandgap of an optical receiver positioned on the chargeable device.

Abstract: An interactive display, including a cover glass having a front surface that includes a viewing area provides an input/output (I/O) interface for a user of an electronic device. An arrangement includes a processor, a light source, and a camera disposed outside the periphery of the viewing area coplanar with or behind the cover glass. The camera receives scattered light resulting from interaction, with an object, of light outputted from the interactive display, the outputted light being received by the cover glass from the object and directed toward the camera. The processor determines, from image data output by the camera, an azimuthal angle of the object with respect to an optical axis of the camera and/or a distance of the object from the camera.

Abstract: A touch and hover-sensitive sensor system is provided. The system may include a planar light guide that has a plurality of light sources located along a first edge of the light guide and a plurality of light sensors located along a second edge of the light guide orthogonal to the first edge. The light guide may include light-turning arrangements that are configured to redirect light passing through a first side of the light guide from/along orthogonal directions within the light guide. A controller may illuminate proper subsets of the light sources; light that is emitted from the first side and that encounters an object, e.g., a fingertip, may be reflected back into the first side and then redirected to the light sensors. Depending on the light sensors that detect the highest redirected reflected light intensity and the active light sources, the controller may determine the XY/XYZ location of the object.

Abstract: This disclosure provides systems, methods and apparatus for touch and gesture recognition, using a field sequential color display. The display includes a processor, a lighting system, and an arrangement for spatial light modulation that includes an array of light modulators. Each light modulator is switchable between an open position that permits transmittance of light from the lighting system through a respective aperture and a shut position that blocks light transmission through the respective aperture. The processor switches the light modulators in accordance with a first modulation scheme to render an image and in accordance with a second modulation scheme to selectively pass object illuminating light through at least one of the respective apertures. A light sensor receives light resulting from interaction of the object illuminating with an object and outputs a signal to the processor. The processor recognizes, from the output of the light sensor, a characteristic of the object.