Abstract: This application is directed to controlling a camera that includes an electrochromic glass layer. The electrochromic glass layer is disposed in front of a sensor array of the camera and has optical transmission properties that are responsive to voltage applied to the electrochromic glass layer. In accordance with a determination to transition the camera mode to a Day mode, a camera controller generates a first voltage, which is then applied to the electrochromic glass layer to cause the lens assembly to enter a first transmission state. In response to the first voltage, the electrochromic glass layer removes a substantial portion of a predefined band of infrared wavelengths in ambient light incident on the camera, and simultaneously passes by the electrochromic glass layer a substantial portion of visible wavelengths in the ambient light, thereby exposing the sensor array to the substantial portion of the visible wavelengths of the ambient light.

Abstract: The present disclosure is directed to an augmented reality surgical system for viewing an augmented image of a region of interest during a surgical procedure. The system includes an image capture device that captures an image of the region of interest. A controller receives the image and applies at least one image processing filter to the image. The image processing filter includes a spatial decomposition filter that decomposes the image into spatial frequency bands. A temporal filter is applied to the spatial frequency bands to generate temporally filtered bands. An adder adds each band spatial frequency band to a corresponding temporally filtered band to generate augmented bands. A reconstruction filter generates an augmented image by collapsing the augmented bands. A display displays the augmented image to a user.

Abstract: A random grating based compressive sensing wideband hyperspectral imaging system comprising a front imaging component, an optical splitting component, more than two branches, and a computer, with each branch having an exit pupil transformation component and a compressive spectral imaging component. The system is based on compressive sensing theory, makes use of the correlation between spectra, increases compression rate on the spectral dimension, realizes three-dimensional compressive collection of wideband spectral image data, and greatly reduces data collection amount. The system is capable of measuring spectral image information on a wideband spectrum with a single exposure, and may obtain high spatial resolution and high spectral resolution by means of designing the random gratings on the various spitting paths.

Abstract: A flow meter includes a background pattern disposed behind a drip chamber, an image sensor, and a processor. The image sensor has a field of view and is configured to view the drip chamber within the field of view. The processor is coupled to the image sensor to receive image data therefrom and captures, using the image sensor, an image of the drip chamber and at least a portion of the background pattern, examines the image, and adjusts a flow rate of fluid flowing through a fluid line in accordance with the examination of the image.

Abstract: In various embodiments, methods and systems for reprojecting images based on a velocity depth late stage reprojection process are provided. A reprojection engine supports reprojecting images based on an optimized late stage reprojection process that is performed based on both depth data and velocity data. Image data and corresponding depth and velocity data of the image data is received. A determination of an adjustment to be made to the image is made. The determination is made based on motion data, the depth data and the velocity data. The motion data corresponds to a device associated with displaying the image data. The velocity data supports determining calculated correction distances for portions of the image data. The image data is adjusted based on the determined adjustment. Adjusting the image data is based on integrating depth-data-based translation and velocity-data-based motion correction, into a single pass implementation, to adjust the image data.

Abstract: Multiple Holocam Orbs observe a real-life environment and generate an artificial reality representation of the real-life environment. Depth image data is cleansed of error due to LED shadow by identifying the edge of a foreground object in an (near infrared light) intensity image, identifying an edge in a depth image, and taking the difference between the start of both edges. Depth data error due to parallax is identified noting when associated text data in a given pixel row that is progressing in a given row direction (left-to-right or right-to-left) reverses order. Sound sources are identified by comparing results of a blind audio source localization algorithm, with the spatial 3D model provided by the Holocam Orb. Sound sources that corresponding to identifying 3D objects are associated together. Additionally, types of data supported by a standard movie data container, such as an MPEG container, is expanding to incorporate free viewpoint data (FVD) model data.

Abstract: A system and method of capturing a stereoscopic pair of images for use in forming a 3-D image of an object at a desired perceived position in a scene projected onto a dome surface. The first one of the stereoscopic pair of images is captured when the object is offset to the right of the desired perceived position in the scene. The second one of the stereoscopic pair of images is captured when the object is offset to the left of the desired perceived position in the scene. In this manner, positive parallax can be captured in front of a viewer, upward in an arc through the zenith of the dome, and beyond to the back of the dome. The system and method allows scenes projected onto a dome surface to contain positive parallax, and therefore allows objects to appear to be located beyond the dome surface when viewed in 3-D stereo, which was previously not possible.

Abstract: An image pickup apparatus includes an image pickup unit for picking up an image of a subject and generating a plurality of pickup images, an orientation obtaining unit for setting an image pickup position at a time of picking up one pickup image among the plurality of generated pickup images as a reference and obtaining an orientation related to the pickup image, an image combining unit for combining the plurality of generated pickup images and generating a panoramic image, a representative position calculation unit for calculating a representative position in a horizontal direction in the generated panoramic image, an orientation calculation unit for calculating an orientation at the calculated representative position on the basis of characteristic information of the image pickup unit, the calculated representative position, and the obtained orientation, and a recording control unit for recording the calculated orientation while being associated with the generated panoramic image.

Abstract: Disclosed herein is a microscope. The microscope includes: a lens system receiving light emitted from a light source and containing image information of an observation object; turbid media interposed between the observation object and the lens system; and an image acquisition device acquiring the image information, wherein the image acquisition device comprises: an image sensor acquiring information of light passing through the lens system; a transmission matrix storage unit previously storing a transmission matrix indicating a transmission state of various light components entering the light entrance portion; and an image recovery unit recovering the image information from the information of light acquired by the image sensor through compressed sensing using a sparse representation based on the transmission matrix. The microscope can provide improved image quality and can acquire an image through simple operation.

Abstract: Disclosed herein is an endoscope. The endoscope includes a light source; an optical fiber having a light entrance portion and a light exit portion such that light containing image information on a site irradiated with light from the light source enters through the light entrance portion and light passing through the optical fiber exits through the light exit portion; and an image acquisition device acquiring the image information, wherein the image acquisition device includes: an image sensor acquiring information of light passing through the optical fiber; a transmission matrix storage unit previously storing a transmission matrix indicating a transmission state of various light components entering the light entrance portion; and an image recovery unit recovering the image information from the information of light acquired by the image sensor through compressed sensing using a sparse representation based on the transmission matrix.

Abstract: An endoscope system includes a light source unit, an image sensor, an image signal obtaining section, a vessel position signal generator, a vessel width signal generator, and a vessel image signal generator. The light source unit generates illumination light. The image sensor captures an image of an object of interest irradiated with the illumination light. The image signal obtaining section obtains an image signal, which represents the object, from the image sensor. The vessel position signal generator generates a vessel position signal, which represents the position of a blood vessel of the object, from the image signal. The vessel width signal generator generates a vessel width signal, which represents the width of the blood vessel, from the image signal. The vessel image signal generator generates a vessel image signal, which represents the blood vessel, from the vessel position signal and the vessel width signal.

Abstract: A visualization system is provided for permitting a driver of a vehicle to observe a 180 degree rearward view of his or her vehicle and surroundings. The visualization system can include a display device which provides a 180 degree substantially rearward view. The 180 degree substantially rearward view can be seamless and/or undistorted. The display device can be positioned within the vehicle in front of the driver. The display device can be mounted on the inside surface of a windshield of the vehicle. At least a portion of the display device can be positioned above the eyes of the driver of the vehicle when the driver is seated in the driver's seat of the vehicle.

Abstract: An endoscope system is provided with a light source unit for generating illumination light, an image sensor for imaging an object of interest irradiated with the illumination light, an image signal obtaining section, a calculated image signal generator, and an image generator. The image signal obtaining section obtains a B1 image signal corresponding to violet light and a B2 image signal corresponding to blue light. The calculated image signal generator generates a calculated image signal from the B1 and B2 image signals. The image generator generates an image in which one of the B1 image signal and the B2 image signal is assigned to a luminance channel or a green channel and the calculated image signal is assigned to a remaining channel.

Abstract: An information processing apparatus, an information processing method, a display control apparatus, a display controlling method, and a program may allow a provider subjectively to control the manner in which to display pictures using of a plurality of video streams. A transmission device generates video streams used for picture display of a single program. The video streams are multiplexed into a multiplexed stream to which compose information is added. The multiplexed information together with the added compose information is supplied to a reception device. The compose information includes information designating the video streams for displaying pictures in various positions on a screen. The reception device decodes the video streams included in the multiplexed stream. The pictures from the decoded video streams are displayed on the screen in accordance with information included in the compose information. This information can be applied to apparatuses handling a plurality of video streams.

Abstract: An exemplary depth capture system (“system”) emits, from a first fixed position with respect to a real-world scene and within a first frequency band, a first structured light pattern onto surfaces of objects included in a real-world scene. The system also emits, from a second fixed position with respect to the real-world scene and within a second frequency band, a second structured light pattern onto the surfaces of the objects. The system detects the first and second structured light patterns using one or more optical sensors by way of first and second optical filters, respectively. The first and second optical filters are each configured to only pass one of the structured light patterns and to block the other. Based on the detection of the structured light patterns, the system generates depth data representative of the surfaces of the objects included in the real-world scene.

Abstract: Provided is a visual vehicle speed estimation system based on camera output and calibration for such a vehicle speed estimation system. The calibration allows use of the system where the absolute camera position is unknown. Calibration determines an absolute-position-independent relationship between an image space placement and a physical space position relative to the camera. The calibration is done on the basis of camera output using vehicle features of known dimensions and some assumed physical constraints related thereto to provide a conversion relationship between image coordinates and physical space coordinates in a physical space defined in relation to the camera. This relationship is then used to estimate vehicle speeds based only on the visual information provided by the camera. Abstract is not to be interpreted as limiting.

Abstract: Solutions for object tracking problems are presented by gathering images using one or more cameras, processing the gathered images to generate a directed acyclic graph, using the directed acyclic graph to determine a path cover that achieves maximum weight and satisfies one or more positive or negative constraints, and using the path cover to solve the object tracking problem. A first set of solutions utilizes trellis graphs, a second set of solutions employs a greedy approach, and a third set of solutions uses search algorithms.

Abstract: A moving image distribution system for performing load balancing is provided. The system determines communication delay amounts between a user terminal and each of a plurality of moving image distribution servers. The system further determines whether a specified content, for distribution to the user terminal, requires a predetermined type of distribution. When the specified content requires the predetermined type of distribution, the system determines whether processing of the content requires a predetermined type of processing. The system specifies one of the plurality of moving image distribution servers for distributing the specified content to the user terminal based on a first determination of whether the specified content requires the predetermined type of distribution and a second determination of whether the content requires the predetermined type of processing.

Abstract: A video coding system, and a method of operation thereof, includes: a source input module for receiving a frame from a video source; and a picture process module, coupled to the source input module, for generating a reference coding unit in the frame; for generating an intra copy motion vector pointing to the reference coding unit within a search range, wherein the search range does not include an upper coding tree unit of the frame; for generating a current coding unit based on the intra copy motion vector; and for generating a video bitstream based on the current coding unit for a video decoder to receive and decode for displaying on a device.

Abstract: A video coding system, and a method of operation thereof, includes: a source input module for receiving a frame from a video source; and a picture process module, coupled to the source input module, for generating a neighboring coding unit in the frame, for generating an intra block motion vector with a constrained intra prediction flag enabled and the neighboring coding unit generated based on only an intra-picture prediction mode, for generating a current coding unit based on the intra block motion vector, the current coding unit adjacent the neighboring coding unit, and for generating a video bitstream based on the current coding unit for a video decoder to receive and decode for displaying on a device.