Abstract: A platform gauge instrument and a platform gauge measuring method based on a photogrammetric principle are provided. According to the platform gauge instrument, measuring stations are arranged on both sides of a platform, and the measuring stations on both sides work together to ensure the acquisition of complete platform information. The measuring stations have automatic traveling capability to complete scanning of a whole platform, platform information obtained by the scanning is automatically resolved by a measuring system, and gauge dimensions such as a transverse dimension and a vertical dimension of a platform gauge are resolved through parameters such as object-space coordinates of platform edge points, a space equation of intersection lines of upper surfaces of rails and a measuring cross-section, and common tangent lines of the upper surfaces of two rails on the measuring cross-section, so that resident and real-time gauge high-precision detection of the platform is achieved.

Abstract: Various systems and methods for for clustering facial images in, for example, surveillance systems.

Abstract: The present disclosure discloses a container positioning method and apparatus based on multi-line laser data fusion, the method comprising: acquiring point cloud data of at least two multi-line laser radars, and performing point cloud data fusion according to a coordinate system relationship between the at least two laser radars; performing clustering of scanning lines according to the fused point cloud data, and acquiring an edge point of a top surface or a side surface of a target container according to the clustered scanning lines; acquiring a contour of the top surface or the side surface of the target container according to the edge point of the top surface or the side surface of the target container to determine a central point and a heading angle of the target container so as to determine a position of the target container.

Abstract: An electromagnetic wave detection apparatus (10) includes a switch (16), a first detector (19), and a second detector (20). The switch (16) includes an action surface (as) with a plurality of pixels (px) disposed thereon. The switch (16) is configured to switch each pixel (px) between the first state and the second state. In the first state, the pixels (px) cause electromagnetic waves incident on the action surface (as) to travel in a first direction (d1). In the second state, the pixels (px) cause the electromagnetic waves incident on the action surface (as) to travel in a second direction (d2). The first detector (19) detects the electromagnetic waves that travel in the first direction (d1). The second detector (20) detects the electromagnetic waves that travel in the second direction (d2).

Abstract: An electromagnetic wave detection apparatus (10) includes a switch (16), a first detector (19), and a second detector (20). The switch (16) includes an action surface (as) with a plurality of pixels (px) disposed thereon. The switch (16) is configured to switch each pixel (px) between the first state and the second state. In the first state, the pixels (px) cause electromagnetic waves incident on the action surface (as) to travel in a first direction (d1). In the second state, the pixels (px) cause the electromagnetic waves incident on the action surface (as) to travel in a second direction (d2). The first detector (19) detects the electromagnetic waves that travel in the first direction (d1). The second detector (20) detects the electromagnetic waves that travel in the second direction (d2).

Abstract: Embodiments are directed providing a stage studio for immersive 3-D video capture. A two-dimensional video of a scene may be captured with frame cameras oriented towards a center of the scene. Paths may be scanned across objects in the scene with signal beams oriented towards the center of the scene. Events may be generated based on signal beams that are reflected by the objects and detected by event cameras oriented towards the center of the scene. Trajectories may be generated based on the paths and the events. A scene that includes a representation of the objects based on the captured two-dimensional video and the trajectories may be generated such that a position and an orientation of the represented objects in the scene are based on the trajectories.

Abstract: An electromagnetic wave detection apparatus (10) includes a separation unit (16), a first detector (17), a switch (18), and a second detector (20). The separation unit (16) separates incident electromagnetic waves so that the electromagnetic waves propagate in a first direction (d1) and a second direction (d2). The first detector (17) detects the electromagnetic waves that propagate in the first direction (d1). The switch (18) includes a plurality of switching elements (se). The switching elements (se) are capable of switching the propagation direction of the electromagnetic waves that propagate in the second direction (d2) to a third direction (d3) and a fourth direction (d4). The second detector (20) detects the electromagnetic waves that propagate in the third direction (d3).

Abstract: This invention provides a system and method for runtime determination (self-diagnosis) of camera miscalibration (accuracy), typically related to camera extrinsics, based on historical statistics of runtime alignment scores for objects acquired in the scene, which are defined based on matching of observed and expected image data of trained object models. This arrangement avoids a need to cease runtime operation of the vision system and/or stop the production line that is served by the vision system to diagnose if the system's camera(s) remain calibrated. Under the assumption that objects or features inspected by the vision system over time are substantially the same, the vision system accumulates statistics of part alignment results and stores intermediate results to be used as indicator of current system accuracy. For multi-camera vision systems, cross validation is illustratively employed to identify individual problematic cameras.

Abstract: The present disclosure provides a video timing labeling method. The method includes: acquiring a video file to be labeled and text information to be inquired; acquiring a video segment matching the text information to be inquired based on a timing labeling network of a timing labeling model; acquiring a video feature of the video segment matching the text information to be inquired based on a feature extraction network of the timing labeling model; acquiring text information corresponding to the video segment labeled in the video file based on a visual text translation network of the timing labeling model; and outputting the video segment matching the text information to be inquired and the text information corresponding to the video segment labeled in the video file based on the timing labeling model.

Abstract: A recognition method executed by a processor, includes: acquiring positional relation between a plurality of sensors each of which senses a distance to an object; provisionally classifying an orientation of the object relative to each individual sensor included in the sensors into one of a plurality of classifications based on sensing data acquired by the individual sensor; calculating likelihood of each combination corresponding to the positional relation between the sensors based on a result of provisional classification of the orientation of the object relative to the individual sensor; and classifying the orientation of the object corresponding to each individual sensor in accordance with the calculated likelihood of each combination.

Abstract: Various systems and methods for for clustering facial images in, for example, surveillance systems.

Abstract: A surgical system used to determine a size of a vessel within a region proximate to a working end of a surgical instrument includes at least one light emitter disposed at the working end, an array of light sensors disposed opposite the at least one light emitter, the array comprising a least one row of light sensors, individual light sensors in the row adapted to generate a signal comprising a pulsatile and a non-pulsatile component, and a controller coupled to the array, the controller comprising a splitter to separate the pulsatile component from the non-pulsatile component, and an analyzer to determine the magnitudes of the pulsatile and non-pulsatile components at the individual light sensors, to determine a first peak magnitude and a second peak magnitude of the pulsatile components, and to determine a resting outer diameter of the vessel based on the first and second peak magnitudes.

Abstract: A laser detection and ranging device for detecting an object under a water surface, the laser detection and ranging device having a laser transmitter being configured to modulate a laser beam by a binary pseudo-random coding sequence to obtain a modulated laser beam, and to transmit the modulated laser beam towards the water surface, a laser detector for detecting a reflected laser beam, the reflected laser beam forming a reflected version of the transmitted laser beam, and a processor for detecting the object under the water surface upon the basis of the reflected laser beam.

Abstract: A motion capture tracking device comprising a base portion including a first alignment feature, a first magnetic element and an attachment mechanism operative to mechanically couple the base portion to a rod, a detachable end cap configured to be removably mated with the base portion, and a plurality of motion capture markers coupled to the end cap. The detachable end cap can include a second alignment feature and a second magnetic element, such that, during a mating event in which the detachable end cap is coupled to the base portion, the second alignment feature cooperates with the first alignment feature to ensure that the base portion and detachable end cap are mated in accordance with a unique registration and the second magnetic feature cooperates with the first magnetic feature to magnetically retain the detachable end cap in physical contact with the base portion upon completion of the mating event.

Abstract: An information processing device finds a position/orientation of an image capturing unit including first and second cameras whose image capturing fields are partially overlapped, the information processing device comprises an input unit that inputs first and second images from the first and second cameras a holding unit holding a learning model; a first estimating unit that estimates first provisional geometric information from the first and second images; a second estimating unit that estimates second provisional geometric information on the basis of the first image and the learning model; a third estimating unit that estimates third provisional geometric information on the basis of the second image and the learning model; and a generating unit that, on the basis of the first, second, and third provisional geometric information, generates the position/orientation information of the image capturing unit.

Abstract: A method for controlling a device, in particular a prosthetic hand or a robotic arm, includes using an operator-mounted camera to detect at least one marker positioned on or in relation to the device. Starting from the detection of the at least one marker, a predefined movement of the operator together with the camera is detected and is used to trigger a corresponding action of the device. The predefined movement of the operator is detected in the form of a line of sight by means of camera tracking. A system for controlling a device, in particular a prosthetic hand or a robotic arm, includes a pair of AR glasses adapted to detect the at least one marker and to detect the predefined movement of the operator.

Abstract: Provided is a method and system that includes an imaging device to be disposed in a lighting fixture to capture images, a remote computing device in communication with the imaging device, and comprising at least one processor. The processor is capable of processing data related to images from the at least one imaging device and from a satellite imagery system, performing comparison operation by detecting a first set of points of interest in an image from the at least one imaging device and corresponding second set of points of interest in an image of a same area from the satellite imagery system, and calculating a homography matrix by matching the first set of points of interests in the image from the at least one imaging device and the second set of points of interest in the image from the satellite imagery system, to determine latitude and longitude coordinates of the image from the imaging device.

Abstract: Mobile LiDAR platforms for vehicle tracking are provided. In various embodiments, a time-series of point clouds is received from a LiDAR sensor. Each point cloud of the time series of point clouds is projected onto a plane. The projected point clouds are provided to a convolutional neural network. At least one bounding box of a vehicle within each of the projected point clouds is received from the convolutional neural network. A relative speed of the vehicle is determined from the bounding boxes with the projected point clouds. A reference speed of the LiDAR sensor is determined from the GPS receiver. From the relative speed and the reference speed, an absolute speed of the vehicle is determined.

Abstract: The present disclosure relates to a collision control method and apparatus, an electronic device, and a storage medium. The method includes: detecting a target object in an image photographed by a traveling object; determining a forward collision hazard region of the traveling object; and executing collision control on the traveling object based on a relative relationship between the target object and the forward collision hazard region, where the collision control includes collision warning and/or driving control.

Abstract: A method for adjusting the damper hardness of a vibration damper of a wheel of a transportation vehicle, wherein the transportation vehicle body movement signal is generated by a control device of the transportation vehicle from a first sensor signal of the first sensor unit connected fixedly in to a transportation vehicle body, a wheel movement signal is generated from a second sensor signal of a second sensor unit which detects a wheel position of the wheel with respect to the body, a speed signal which describes a speed of the transportation vehicle body is generated based on the transportation vehicle body movement signal, and the wheel movement signal and an actuation signal for setting the damper hardness is generated based on the speed signal. The transportation vehicle body movement signal is filtered by a first filter unit and/or the wheel movement signal is filtered by a second filter unit.

Abstract: In described examples of a system for outputting a patterned light beam, the system includes: an illumination source; a positive optical element positioned to receive light from the illumination source and to output converging light; a reflective element positioned to receive the converging light from the positive optical element, the reflective element configured to reflect the converging light to form a scan beam; and a negative optical element to receive the scan beam from the reflective element, the negative optical element configured to output the scan beam to a field of view.

Abstract: A performance capture system is provided to detect one or more active marker units in a live action scene. Active marker units emanate at least one wavelength of light that is captured by the performance capture system and used to detect the active markers in the scene. The system detects the presence of the light as a light patch in a capture frames and determines if the light patch represents light from an active marker unit. In some implementations, various active markers in a scene may emanate different wavelengths of light. For example, wavelengths of light from multi-emitting active marker units may be changed due to various conditions in the scene.

Abstract: The present disclosure discloses an image surveillance system that includes an image recording host and IP cameras. Each of the IP cameras includes a storage circuit that stores identification information including identification codes, a communication circuit that performs network communication and a processing circuit. The processing circuit executes software and firmware executable commands to execute an image surveillance system establishing method that includes the steps outlined below. The other IP cameras are identified according to the identification information by using the communication circuit to perform network connection thereto to form a local area network that only includes the IP cameras. Within the local area network, a connection path is set to connect the image recording host either indirectly through at least one of the other IP cameras or directly. An image stream is transmitted to the image recording host through the connection path by using the communication circuit.

Abstract: An enhanced product recommendation service observes a user engaging in an activity to automatically recommend products that facilitate performance of the activity. Photographs and/or video of the user performing the activity may be analyzed to identify an output that results from the activity and/or an activity task sequence that includes multiple tasks associated with completing the activity. Then, the enhanced product recommendation service may identify a product that is usable to generate the output(s) of the activity and/or complete the activity without performing one or more individual tasks of the activity task sequence. The product may be an existing product. Alternatively, the product may be a customized product that is designed based on observing the user engage in the activity. Physical measurements of the customized product may be determined based on various measurements determined by analyzing the photographs and/or video of the user performing the activity.

Abstract: An approach is provided for using aerial drones for road and traffic monitoring. The approach, for example, involves navigating an aerial drone to a physical marker located on a road link. The approach also involves initiating a capture of sensor data of the physical marker by a sensor of the aerial drone. The approach further involves adjusting a position, an altitude, or a combination thereof of the aerial drone to a reference position, a reference altitude, or a combination thereof over the physical marker based on the sensor data. The approach further involves initiating a capture of one or more images of the road link by the aerial drone at the reference position, the reference altitude, or a combination thereof. By way of example, the captured images can be processed for road and traffic monitoring and/or other similar applications.

Abstract: Embodiments can enable motion capture cameras to be optimally placed in a set. For achieving this, a virtual set can be generated based on information regarding the set. Movement of a virtual actor or a virtual object may be controlled in the virtual set to simulate movement of the corresponding real actor and real object in the set. Based on such movement, camera aspects and obstructions in the set can be determined. Based on this determination, indication information indicating whether regions in the set may be viewable by one or more cameras placed in the physical set may be obtained. Based on the indication information, it can be determined an optimal placement of the motion capture cameras in the set. In some embodiments, an interface may be provided to show whether the markers attached to the actor can be captured by the motion capture cameras placed in a specific configuration.

Abstract: A projector includes a light source arranged along an optical axis, a reticle optically coupled to the light source by the optical axis, and a projection lens. The projection lens is optically coupled to the reticle by the optical axis and has a navigation feature defined thereon for displaying an image of the navigation feature projected along the optical axis on terrain disposed within a field of view of the projector. Projection systems and methods of navigating terrain using projected images are also described.

Abstract: A local video communication device, the device includes a local translucent display device configured to display remote video information received from a remote video communication device; and a local camera array configured to capture local video information of a plurality of local users; wherein the local translucent display device includes a naked-eye three-dimensional display, the local camera array comprises a plurality of cameras arranged in a two-dimensional array, the local camera array is placed on a back of the local translucent display device, and the local translucent display device further comprises a micro processing unit, wherein the micro processing unit includes: a micro processing unit, where the micro processing unit includes a video capture and processing module, a location acquisition module, a communication module and a display module.

Abstract: A system includes a polarization target having two or more surfaces, a polarization camera that captures an image of the polarization target and records polarization of light that formed the image, and a processor that determines an orientation of the polarization target based at least in part on the captured image and the determined polarization.

Abstract: Techniques are described with regard to determining and controlling a location and status of assets directly and/or indirectly. The techniques may be used to track and control the respective locations and status of any number of objects. Applications include but are not limited to tracking dry and refrigerated trailers and their status in a supply-chain yard; tracking pallets and boxes and their status in a warehouse; tracking items in a retail environment; tracking finished goods and work in progress in and around a manufacturing plant; tracking vehicles in a parking lot; tracking cargo and equipment at an airport; tracking equipment in a lay down yard; etc. In all cases the laborious and error prone data gathering is replaced with automated data collection methods reducing cost, increasing accuracy, and increasing efficiency.

Abstract: An image processing apparatus performs a first detection that detects motion information of an image sensor during a period in which the image sensor captures a first image and a second image based on an output of a sensor different from the image sensor, a second detection that detects a plurality of motion vectors between the first image and the second image, a determination of first reliability of the motion information detected by the first detection and second reliability of the motion vectors detected by the second detection, and an alignment based on either one of the motion vectors or a vector indicated by the motion information, which has higher reliability, or a vector obtained from the motion vectors and the motion information according to the reliability.

Abstract: Provided is a method and system that includes an imaging device to be disposed in a lighting fixture to capture images, a remote computing device in communication with the imaging device, and comprising at least one processor. The processor is capable of processing data related to images from the at least one imaging device and from a satellite imagery system, performing comparison operation by detecting a first set of points of interest in an image from the at least one imaging device and corresponding second set of points of interest in an image of a same area from the satellite imagery system, and calculating a homography matrix by matching the first set of points of interests in the image from the at least one imaging device and the second set of points of interest in the image from the satellite imagery system, to determine latitude and longitude coordinates of the image from the imaging device.

Abstract: Methods, systems, and techniques for projecting streamed video are provided. An Example Surround Video Projection System (SVPS) provides support for interacting with the displayed virtual reality environment, capturing a video of a user in the VR environment, and displaying the VR environment on deformations. Also, the SVPS may change the displayed VR environment responsive to attributes and/or characteristics of the user. In one example, the SVPS comprises a real time, interactive rendering system, a display system, and one or more display units. The rendering system comprises a high resolution graphics engine capable of generating high resolution video. The projection system comprises video capture cards to capture the generated video stream and forward it to a projection mapping engine. The projection mapping engine consolidates and stitches together the received video stream as appropriate to render the video stream over display units to the target viewing environment such as a dome/sphere.

Abstract: Provided is a periphery recognition device that makes it possible to: minimize the load from object recognition processing for recognizing an object moving between one region covered by a long-distance sensor and/or a wide-angle short-distance sensor to another such region; the periphery recognition device being able to reduce the proportion of non-recognition or erroneous recognition of objects moving from a region covered by the long-distance sensor or the wide-angle short-distance sensor to a boundary region.

Abstract: The described technology relates to a light detection and ranging (LIDAR) device. The LIDAR device can include a transmission unit configured to emit a first signal, a first lens unit configured to convert the first signal into parallel light, a reflection unit configured to adjust a direction of the converted first signal and a second lens unit configured to enable the first signal to have the same focal plane even when a reflection angle of the reflection unit changes. The LIDAR device can also include a third lens unit configured to convert the first signal passing through the second lens unit into parallel light, a fourth lens unit configured to increase an angle of the first signal passing through the third lens unit and a reception unit configured to receive a second signal reflected by an object after passing through the fourth lens unit.

Abstract: Techniques and systems for 3D printing using mirrors that are oriented at about 45 degrees from an X-axis and Y-axis are described. A technique includes receiving an object model; rotating the object model about 45 degrees around the Z-axis; generating cross-sectional images of the rotated object model; mapping pixels of the cross-sectional images to corresponding mirrors of a digital micromirror device of an additive manufacturing apparatus to form additive-manufacturing images, wherein edges of the mirrors are oriented about 45 degrees from the X-axis of the digital micromirror device and about 45 degrees from the Y-axis of the digital micromirror; and providing the additive manufacturing images to generate a build piece corresponding to the object model. Other implementations can include corresponding systems, apparatus, and computer program products.

Abstract: The described technology relates to a light detection and ranging (LIDAR) device. The LIDAR device can include a transmitter configured to emit an optical signal, a first lens section configured to convert the optical signal into collimated light, a reflector configured to adjust a direction of the converted optical signal, a second lens section configured to allow the adjusted optical signal to have the same focal plane even though a reflection angle of the reflector is varied and a third lens section configured to convert the optical signal passed through the second lens section into collimated light. The LIDAR device can also include a fourth lens section configured to allow the optical signal, and a receiver configured to receive the optical signal passed through the fourth lens section. The third lens section and the fourth lens section are positioned on the same line in a first direction.

Abstract: Technologies are generally described for concurrent activation of multiple illumination sources to analyze a sample. A controller may be configured to activate the illumination sources substantially simultaneously, where a current or voltage of each activated illumination source is modulated at a different frequency by respective circuit drivers of the controller. Each activated illumination source may be configured to illuminate the sample with light at a different emission wavelength, and one or more detectors may be configured to detect a composite signal from the sample in response to the illumination. The composite signal may include multiple returned signals, where each returned signal corresponds to light emitted from one of the activated illumination sources at a respective emission wavelength. One or more filters, each associated with a respective modulation frequency of one activated illumination source, may be configured to extract each returned signal from the composite signal for analysis.

Abstract: The present disclosure provides an indoor positioning system, which includes: N positioning lamps, M camera devices, and a processor, where N is a positive integer greater than 1 and M is a positive integer greater than or equal to 1. The N positioning lamps are arranged at different positions respectively in a room where a target to be positioned is located. The M camera devices are arranged at different positions in the room respectively, and are used for capturing a complete image of the room respectively at different angles and at the same time. The processor is configured to determine a position of the target to be positioned in the room according to the M images acquired by the M camera devices respectively at the same time.

Abstract: A method for detecting stereo images includes receiving an image and analyzing at least a portion of the image. The method further includes determining whether the image is a stereo image based on the analysis. The method may include determining if a portion of the image contains an expected icon, may determine if left and right halves of the image contain expected symmetry, may determine if histograms of the left and right halves are similar, or the like. The method further includes generating a confidence value related to the determination of whether the image is stereo or non-stereo, the confidence value indicating a likelihood that the determination is correct.

Abstract: Described are methods, systems, apparatus, and computer program products for determining the presence of an object on a target surface. A machine vision system includes a first image capture device configured to image a first portion of a target surface from a first viewpoint and a second image capture device configured to image a second portion of the target surface from a second viewpoint. The machine vision system is configured to acquire a first image from the first image capture device, a second image from the second image capture device, rectify the first image and second image, retrieve a disparity field, generate difference data by comparing, based on the mappings of the disparity field, image elements in the first rectified image and a second image elements in the second rectified image; and determine whether the difference data is indicative of an object on the target surface.

Abstract: A local video communication device includes a local translucent display device and a plurality of local cameras, the local translucent display device is configured to display remote video information from a remote video communication device; and the plurality of local cameras configured to capture a local video information; wherein the plurality of local cameras are placed on the back of the local translucent display device, and the plurality of local cameras are arranged in a two-dimensional camera array, and the local translucent display device further comprises a micro processing unit, wherein the micro processing unit comprises: a video capture and processing module, a location acquisition module configured to obtain the local user's face location, a communication module configured to communicate with the remote video communication device, and a display module configured to display the remote video information.

Abstract: In a display apparatus of an interception area, a first detection device scans a first area containing at least a part of a firing range of a first weapon to detect an obstacle. A first terminal calculates the first interception area in which the first weapon is possible to intercept, based on data of the detected obstacle and data of the first weapon; calculates a first display area showing the first interception area on a screen based on the first interception area; receives second area data generated by a second terminal, and calculates a second display area based on the second area data. The second display area shows on the screen an area in which a second weapon is possible to intercept. The first terminal displays the first display area and the second display area.

Abstract: A method for locating a vessel, the method comprising illuminating at least a portion of the vessel with a background light having a substantially high susceptibility to absorption by particles in said portion of the vessel; detecting backscattered light from said illuminated portion of the vessel; reproducing an image from said backscattered light; and identifying dark regions within said reproduced image.

Abstract: A head up display HUD can be a worn display, a helmet mounted display (HMD, or other display system. The HUD includes a projector including a light processor. The projector provides light to a projector path and a dump path. The HUD also includes a camera disposed to capture the light in the dump path and a processor. The processor is configured to process image data from the camera and image data associated with the light in the projection path to determine an error.

Abstract: Method and apparatus are disclosed for inter-vehicle cooperation for vehicle self imaging. An example vehicle includes an inter-vehicle communication module and a infotainment head unit. The infotainment head unit determines a pose of the vehicle and, in response to receiving an input to generate a composite image, broadcasts a request for images of the vehicle. The request message includes the pose. The infotainment head unit also generates the composite image of the vehicle based on the images and display the composite image on a display.

Abstract: A robot vision supervisor system for use with industrial robots being placed with average home consumers or at restaurants that is capable of guiding the robot to its homing position for initial homing or when a loss of reference has occurred. Further the robot vision supervisor is able to detect presence of unidentified foreign objects in the workspace and guide the robot to navigate around and prevent collisions. Image processing algorithms are used with primary, orthogonal and cross camera arrays to increase reliability and accuracy of the robot vision supervisor. Lookup tables of images are captured and stored by controller for discretized positions in the full robot workspace when robot is in known good calibration to compare with images during regular operation for detecting anomalies.

Abstract: Embodiments of the present invention may be used to perform measurement of surfaces, such as external and internal surfaces of the human body, in full-field and in 3-D. Embodiments of the present invention may include an electromagnetic radiation source, which may be configured to project electromagnetic radiation onto a surface. The electromagnetic radiation source may be configured to project the electromagnetic radiation in a pattern corresponding to a spatial signal modulation algorithm. The electromagnetic radiation source may also be configured to project the electromagnetic radiation at a frequency suitable for transmission through the media in which the radiation is projected. An image sensor may be configured to capture image data representing the projected pattern.

Abstract: A processing apparatus processes an image signal generated by pixels that have received light from an object irradiated with first wavelength light. The processing apparatus includes a processor having hardware. The processor is configured to: extract first and second image signals from the image signal of one frame generated by the pixels, the first image signal being generated by a pixel that has received the first wavelength light, the second image signal being generated by a pixel that has received second wavelength light that is fluorescence emitted in response to the first wavelength light; estimate an image signal to be generated by the pixel that has received the second wavelength light, based on the first image signal; and calculate a difference, on a corresponding image signal portion, between the second image signal and the estimated image signal, thereby to obtain a differential image signal.

Abstract: Methods, systems, and techniques for projecting streamed video are provided. An Example Surround Video Projection System (SVPS) provides support for interacting with the displayed virtual reality environment, capturing a video of a user in the VR environment, and displaying the VR environment on deformations. Also, the SVPS may change the displayed VR environment responsive to attributes and/or characteristics of the user. In one example, the SVPS comprises a real time, interactive rendering system, a display system, and one or more display units. The rendering system comprises a high resolution graphics engine capable of generating high resolution video. The projection system comprises video capture cards to capture the generated video stream and forward it to a projection mapping engine. The projection mapping engine consolidates and stitches together the received video stream as appropriate to render the video stream over display units to the target viewing environment such as a dome/sphere.