Abstract: A light detection and ranging system includes synchronously scanning transmit and receive mirrors that scan a pulsed fanned laser beam in two dimensions. Imaging optics image a receive aperture onto an arrayed receiver that includes a plurality of light sensitive devices. Adaptive methods dynamically modify the size and location of the field of view as well as laser pulse properties in response to internal and external sensors data.

Abstract: A light detection and ranging system includes synchronously scanning transmit and receive mirrors that scan a pulsed fanned laser beam in two dimensions. Imaging optics image a receive aperture onto an arrayed receiver that includes a plurality of light sensitive devices. Scanning mirror offsets may be applied to modify a fan angle of the pulsed fanned laser beam. Adaptive methods dynamically modify the size and location of the field of view, laser pulse properties, and/or fan angle in response to internal and external sensors data.

Abstract: A light detection and ranging system includes synchronously scanning transmit and receive mirrors that scan a pulsed fanned laser beam in two dimensions. Imaging optics image a receive aperture onto an arrayed receiver that includes a plurality of light sensitive devices. A phase offset may be injected into a scanning trajectory to mitigate effects of interfering light sources.

Abstract: Embodiments described herein provide a system for analyzing a gameplay of a first video game. During operation, the system can obtain a stream of video frames associated with the gameplay. The system can then analyze the video frames to identify a set of features of the first video game. Here, a respective feature indicates the characteristics of a virtual object in a virtual environment of the first video game supported by a first game engine. Subsequently, the system can derive, based on the set of identified features, a set of parameters indicating one or more physical characteristics of one or more virtual objects in the virtual environment. The system can store the set of derived parameters in a file format readable by a second game engine different from the first game engine. This allows the second game engine to support a second video game that incorporates the physical characteristics.

Abstract: Depths of one or more objects in a scene may be measured with enhanced accuracy through the use of a light-field camera and a depth sensor. The light-field camera may capture a light-field image of the scene. The depth sensor may capture depth sensor data of the scene. Light-field depth data may be extracted from the light-field image and used, in combination with the sensor depth data, to generate a depth map indicative of distance between the light-field camera and one or more objects in the scene. The depth sensor may be an active depth sensor that transmits electromagnetic energy toward the scene; the electromagnetic energy may be reflected off of the scene and detected by the active depth sensor. The active depth sensor may have a 360° field of view; accordingly, one or more mirrors may be used to direct the electromagnetic energy between the active depth sensor and the scene.

Abstract: A light detection and ranging system includes synchronously scanning transmit and receive mirrors that scan a pulsed fanned laser beam in two dimensions. Imaging optics image a receive aperture onto an arrayed receiver that includes a plurality of light sensitive devices. A phase offset may be injected into a scanning trajectory to mitigate effects of interfering light sources.

Abstract: A light detection and ranging system includes synchronously scanning transmit and receive mirrors that scan a pulsed fanned laser beam in two dimensions. Imaging optics image a receive aperture onto an arrayed receiver that includes a plurality of light sensitive devices. Scanning mirror offsets may be applied to modify a fan angle of the pulsed fanned laser beam. Adaptive methods dynamically modify the size and location of the field of view, laser pulse properties, and/or fan angle in response to internal and external sensors data.

Abstract: A light detection and ranging system includes synchronously scanning transmit and receive mirrors that scan a pulsed fanned laser beam in two dimensions. Imaging optics image a receive aperture onto an arrayed receiver that includes a plurality of light sensitive devices. Adaptive methods dynamically modify the size and location of the field of view as well as laser pulse properties in response to internal and external sensors data.

Abstract: A light-field video stream may be processed to modify the camera pathway from which the light-field video stream is projected. A plurality of target pixels may be selected, in a plurality of key frames of the light-field video stream. The target pixels may be used to generate a camera pathway indicative of motion of the camera during generation of the light-field video stream. The camera pathway may be adjusted to generate an adjusted camera pathway. This may be done, for example, to carry out image stabilization. The light-field video stream may be projected to a viewpoint defined by the adjusted camera pathway to generate a projected video stream with the image stabilization.

Abstract: Dense light-field data can be generated from image data that does not include light-field data, or from image data that includes sparse light-field data. In at least one embodiment, the source light-field data may include one or more sub-aperture images that may be used to reconstruct the light-field in denser form. In other embodiments, the source data can take other forms. Examples include data derived from or ancillary to a set of sub-aperture images, synthetic data, or captured image data that does not include full light-field data. Interpolation, back-projection, and/or other techniques are used in connection with source sub-aperture images or their equivalents, to generate dense light-field data.

Abstract: A depth-based effect may be applied to a multi-view video stream to generate a modified multi-view video stream. User input may designate a boundary between a foreground region and a background region, at a different depth from the foreground region, of a reference image of the video stream. Based on the user input, a reference mask may be generated to indicate the foreground region and the background region. The reference mask may be used to generate one or more other masks that indicate the foreground and background regions for one or more different images, from different frames and/or different views from the reference image. The reference mask and other mask(s) may be used to apply the effect to the multi-view video stream to generate the modified multi-view video stream.

Abstract: A light-field video stream may be processed to modify the camera pathway from which the light-field video stream is projected. A plurality of target pixels may be selected, in a plurality of key frames of the light-field video stream. The target pixels may be used to generate a camera pathway indicative of motion of the camera during generation of the light-field video stream. The camera pathway may be adjusted to generate an adjusted camera pathway. This may be done, for example, to carry out image stabilization. The light-field video stream may be projected to a viewpoint defined by the adjusted camera pathway to generate a projected video stream with the image stabilization.

Abstract: Dense light-field data can be generated from image data that does not include light-field data, or from image data that includes sparse light-field data. In at least one embodiment, the source light-field data may include one or more sub-aperture images that may be used to reconstruct the light-field in denser form. In other embodiments, the source data can take other forms. Examples include data derived from or ancillary to a set of sub-aperture images, synthetic data, or captured image data that does not include full light-field data. Interpolation, back-projection, and/or other techniques are used in connection with source sub-aperture images or their equivalents, to generate dense light-field data.

Abstract: Motion blur may be applied to a light-field image. The light-field image may be captured with a light-field camera having a main lens, an image sensor, and a plurality of microlenses positioned between the main lens and the image sensor. The light-field image may have a plurality of lenslet images, each of which corresponds to one microlens of the microlens array. The light-field image may be used to generate a mosaic of subaperture images, each of which has pixels from the same location on each of the lenslet images. Motion vectors may be computed to indicate motion occurring within at least a primary subaperture image of the mosaic. The motion vectors may be used to carry out shutter reconstruction of the mosaic to generate a mosaic of blurred subaperture images, which may then be used to generate a motion-blurred light-field image.

Abstract: Depths of one or more objects in a scene may be measured with enhanced accuracy through the use of a light-field camera and a depth sensor. The light-field camera may capture a light-field image of the scene. The depth sensor may capture depth sensor data of the scene. Light-field depth data may be extracted from the light-field image and used, in combination with the sensor depth data, to generate a depth map indicative of distance between the light-field camera and one or more objects in the scene. The depth sensor may be an active depth sensor that transmits electromagnetic energy toward the scene; the electromagnetic energy may be reflected off of the scene and detected by the active depth sensor. The active depth sensor may have a 360° field of view; accordingly, one or more mirrors may be used to direct the electromagnetic energy between the active depth sensor and the scene.

Abstract: A depth-based effect may be applied to a multi-view video stream to generate a modified multi-view video stream. User input may designate a boundary between a foreground region and a background region, at a different depth from the foreground region, of a reference image of the video stream. Based on the user input, a reference mask may be generated to indicate the foreground region and the background region. The reference mask may be used to generate one or more other masks that indicate the foreground and background regions for one or more different images, from different frames and/or different views from the reference image. The reference mask and other mask(s) may be used to apply the effect to the multi-view video stream to generate the modified multi-view video stream.

Abstract: A depth map may be generated in conjunction with generation of a digital image such as a light-field image. A light pattern source may be used to project a light pattern into a scene with one or more objects. A camera may be used to capture first light and second light reflected from the one or more objects. The first light may be a reflection of light originating from one or more other light sources independent of the light pattern source. The second light may be a reflection of the light pattern from the one or more objects. In a processor, at least the first light may be used to generate an image such as a light-field image. Further, in the processor, at least the second light may be used to generate a depth map indicative of distance between the one or more objects and the camera.