Abstract: Embodiments are directed to perceiving scene features using event sensors and image sensors. Paths may be scanned across objects in a scene with one or more beams. Images of the scene may be captured with frame cameras. Events may be generated based on detection of beam reflections that correspond to the objects. Trajectories may be based on the paths and the events. A distribution of intensity associated with the trajectories may be determined based on the energy associated with the traces in the images. Centroids for the trajectories may be determined based on the distribution of the intensity of energy, a resolution of the frame cameras, or timestamps associated with the events. Enhanced trajectories may be generated based on the centroids such that the enhanced trajectories may be provided to a modeling engine that executes actions based on the enhanced trajectories and the objects.

Abstract: Embodiments are directed to perceiving scene features using event sensors and image sensors. Paths may be scanned across objects in a scene with one or more beams. Images of the scene may be captured with frame cameras. Events may be generated based on detection of beam reflections that correspond to the objects. Trajectories may be based on the paths and the events. A distribution of intensity associated with the trajectories may be determined based on the energy associated with the traces in the images. Centroids for the trajectories may be determined based on the distribution of the intensity of energy, a resolution of the frame cameras, or timestamps associated with the events. Enhanced trajectories may be generated based on the centroids such that the enhanced trajectories may be provided to a modeling engine that executes actions based on the enhanced trajectories and the objects.

Abstract: Embodiments are directed to folded single sensor 3-D capture systems. An enclosure that includes an event camera, one or more beam generators, or an optical focusing system may be provided such that the beam generators may scan a scene. Paths may be scanned across objects in the scene with the beams. Events may be determined based on detection, by the event camera, of beam reflections that correspond to objects in the scene such that each beam reflection may be directed to a separate location on a sensor for the event camera by the optical focusing system. Trajectories may be determined based on the paths and the events such that each trajectory may be a parametric representation of a one-dimensional curve segment in a three-dimensional space. Three-dimensional information that corresponds to the objects may be generated based on the plurality of trajectories.

Abstract: Embodiments are directed to a sensing system that employs beams to scan paths across an object such that sensors may the beams reflected by the scanned object. Events may be provided based on the detected signals and the paths such that each event may be associated with a sensor and event metrics. Crossing points for each sensor may be determined based on where the paths intersect the scanned object such that events associated with each sensor are associated with the crossing points for each sensor. Each crossing point of each sensor may be compared to each correspondent crossing point of each other sensor. actual crossing points may be determined based on the comparison and the crossing points for each sensor. Position information for each sensor may be determined based on the actual crossing points.

Abstract: Embodiments are directed to vision systems. Enclosures that each include event scanners, beam generators, or frame cameras may be provided such that the event cameras or the frame cameras may be arranged to provide foveated resolution and such that the enclosures each may include an aperture that enables beams from the beam generators to scan a scene that may be in a field-of-view (FOV) of the aperture. Paths may be scanned across objects in the scene with the beams. Events may be determined based on detection of beam reflections corresponding to objects in the scene. The enclosures may be rotated to orient the apertures into a physical position for continued scanning of the objects within the FOV based on directions of travel for the objects such that the directions of travel for the objects is based on scanned trajectories.

Abstract: A scanning light imaging device for continuously pseudo randomly scanning patterns of light in a beam onto a remote surface to achieve spatio-temporal super resolution for finding remotely located objects. The scanning light imaging device employs a scanner to project image beams of visible or non-visible light and/or tracer beams of non-visible light onto a remote surface or remote object to detect reflections. The device employs a light detector to sense at least the reflections of light from one or more of the image beams or the tracer beams incident on the remote surface or remote object. The device employs the sensed reflections of light beams to predict the trajectory of subsequent scanned beams in a pseudo random pattern and determine up to a six degrees of freedom position for the remote surface or remote object.

Abstract: Embodiments are directed to a sensing system that employs beams to scan paths across an object such that sensors may the beams reflected by the scanned object. Events may be provided based on the detected signals and the paths such that each event may be associated with a sensor and event metrics. Crossing points for each sensor may be determined based on where the paths intersect the scanned object such that events associated with each sensor are associated with the crossing points for each sensor. Each crossing point of each sensor may be compared to each correspondent crossing point of each other sensor. actual crossing points may be determined based on the comparison and the crossing points for each sensor. Position information for each sensor may be determined based on the actual crossing points.

Abstract: Embodiments are directed to multi-sensor superresolution scanning and capture system. A sensing system may be employed to scan a plurality of paths across objects using beams such that the sensing system includes event sensors and image sensors and such that the image sensors are a higher resolution than the event sensors. The event sensors may be employed to provide events based on detection of the beams that are reflected by the objects. The image sensors may be employed to provide images based on the reflected the beams. Enhanced trajectories may be generated based on a plurality of first trajectories and a plurality of second trajectories such that the plurality of the first trajectories are based on the events and the plurality of paths and such that the plurality of second trajectories are based on the images and the plurality of paths.

Abstract: Embodiments are directed providing a stage studio for immersive 3-D video capture. A two-dimensional video of a scene may be captured with frame cameras oriented towards a center of the scene. Paths may be scanned across objects in the scene with signal beams oriented towards the center of the scene. Events may be generated based on signal beams that are reflected by the objects and detected by event cameras oriented towards the center of the scene. Trajectories may be generated based on the paths and the events. A scene that includes a representation of the objects based on the captured two-dimensional video and the trajectories may be generated such that a position and an orientation of the represented objects in the scene are based on the trajectories.

Abstract: Embodiments are directed providing a stage studio for immersive 3-D video capture. A two-dimensional video of a scene may be captured with frame cameras oriented towards a center of the scene. Paths may be scanned across objects in the scene with signal beams oriented towards the center of the scene. Events may be generated based on signal beams that are reflected by the objects and detected by event cameras oriented towards the center of the scene. Trajectories may be generated based on the paths and the events. A scene that includes a representation of the objects based on the captured two-dimensional video and the trajectories may be generated such that a position and an orientation of the represented objects in the scene are based on the trajectories.

Abstract: Embodiments are directed providing auxiliary devices for augmented reality. Images or video of a scene may be captured with frame cameras included in a mobile computer. A plurality of paths may be scanned across objects in the scene with beams provided by scanning devices that may be separate from the mobile computer. A plurality of events may be determined based on detection of beam reflections corresponding to the objects such that the beam reflections may be detected the scanning devices. A plurality of trajectories may be determined based on the plurality of paths and the plurality of events such that each trajectory may be a parametric representation of a one-dimensional curve segment in a three-dimensional space. The images or video of the scene may be augmented based on the plurality of trajectories.

Abstract: Embodiments are directed toward measuring a three dimensional range to a target. A transmitter emits light toward the target. An aperture may receive light reflections from the target. The aperture may direct the reflections toward a sensor that comprises rows of pixels that have columns. The sensor is offset a predetermined distance from the transmitter. Anticipated arrival times of the reflections on the sensor are based on the departure times and the predetermined offset distance. A portion of the pixels are sequentially activated based on the anticipated arrival times. The target's three dimensional range measurement is based on the reflections detected by the portion of the pixels.

Abstract: A system to determine a position of one or more objects includes a transmitter to emit a beam of photons to sequentially illuminate regions of one or more objects; multiple cameras that are spaced-apart with each camera having an array of pixels to detect photons; and one or more processor devices that execute stored instructions to perform actions of a method, including: directing the transmitter to sequentially illuminate regions of one or more objects with the beam of photons; for each of the regions, receiving, from the cameras, an array position of each pixel that detected photons of the beam reflected or scattered by the region of the one or more objects; and, for each of the regions detected by the cameras, determining a position of the regions using the received array positions of the pixels that detected the photons of the beam reflected or scattered by that region.

Abstract: Embodiments are directed to a sensing system that employs beams to scan paths across an object such that sensors may the beams reflected by the scanned object. Events may be provided based on the detected signals and the paths such that each event may be associated with a sensor and event metrics. Crossing points for each sensor may be determined based on where the paths intersect the scanned object such that events associated with each sensor are associated with the crossing points for each sensor. Each crossing point of each sensor may be compared to each correspondent crossing point of each other sensor. Actual crossing points may be determined based on the comparison and the crossing points for each sensor. Position information for each sensor may be determined based on the actual crossing points.

Abstract: Embodiments are directed to multi-sensor superresolution scanning and capture system. A sensing system may be employed to scan a plurality of paths across objects using beams such that the sensing system includes event sensors and image sensors and such that the image sensors are a higher resolution than the event sensors. The event sensors may be employed to provide events based on detection of the beams that are reflected by the objects. The image sensors may be employed to provide images based on the reflected the beams. Enhanced trajectories may be generated based on a plurality of first trajectories and a plurality of second trajectories such that the plurality of the first trajectories are based on the events and the plurality of paths and such that the plurality of second trajectories are based on the images and the plurality of paths.

Abstract: Embodiments are directed to a sensing system that employs beams to scan paths across an object such that sensors may the beams reflected by the scanned object. Events may be provided based on the detected signals and the paths such that each event may be associated with a sensor and event metrics. Crossing points for each sensor may be determined based on where the paths intersect the scanned object such that events associated with each sensor are associated with the crossing points for each sensor. Each crossing point of each sensor may be compared to each correspondent crossing point of each other sensor. Actual crossing points may be determined based on the comparison and the crossing points for each sensor. Position information for each sensor may be determined based on the actual crossing points.

Abstract: An image projection device for displaying an image onto a remote surface. The image projection device employs a scanner to project image beams of visible light and tracer beams of light onto a remote surface to form a display of the image. The device also employs a light detector to sense at least the reflections of light from the tracer beam pulses incident on the remote surface. The device employs the sensed tracer beam light pulses to predict the trajectory of subsequent image beam light pulses and tracer beam light pulses that form a display of the image on the remote surface in a pseudo random pattern. The trajectory of the projected image beam light pulses can be predicted so that the image is displayed from a point of view that can be selected by, or automatically adjusted for, a viewer of the displayed image.

Abstract: A scanning light imaging device for continuously pseudo randomly scanning patterns of light in a beam onto a remote surface to achieve spatio-temporal super resolution for finding remotely located objects. The scanning light imaging device employs a scanner to project image beams of visible or non-visible light and/or tracer beams of non-visible light onto a remote surface or remote object to detect reflections. The device employs a light detector to sense at least the reflections of light from one or more of the image beams or the tracer beams incident on the remote surface or remote object. The device employs the sensed reflections of light beams to predict the trajectory of subsequent scanned beams in a pseudo random pattern and determine up to a six degrees of freedom position for the remote surface or remote object.

Abstract: A scanning light imaging device for continuously pseudo randomly scanning patterns of light in a beam onto a remote surface to achieve spatio-temporal super resolution for finding remotely located objects. The scanning light imaging device employs a scanner to project image beams of visible or non-visible light and/or tracer beams of non-visible light onto a remote surface or remote object to detect reflections. The device employs a light detector to sense at least the reflections of light from one or more of the image beams or the tracer beams incident on the remote surface or remote object. The device employs the sensed reflections of light beams to predict the trajectory of subsequent scanned beams in a pseudo random pattern and determine up to a six degrees of freedom position for the remote surface or remote object.

Abstract: A system to scan a field of view with light beams can include a scanning mirror arrangement having a mirror and a drive mechanism configured to rotate the mirror about an axis between two terminal positions; at least one light source configured to simultaneously produce at least a first light beam and a second light beam directed at the mirror from different directions. Upon rotation of the mirror, the first and second light beams can scan a field of view. The scanning mirror arrangement may include a mirror; hinges attached at opposite sides of the mirror; and a drive mechanism attached to the hinges and configured to twist the hinges resulting in a larger twist to the mirror, wherein the hinges are disposed between the drive mechanism and the mirror.