Abstract: A vehicle exterior environment recognition apparatus includes a stereo speed derivation unit, a monocular speed derivation unit, a predicted speed derivation unit, a mixture ratio derivation unit, and an object speed derivation unit. The stereo speed derivation unit derives a stereo speed indicating a speed of a three-dimensional object extracted from a distance image derived from luminance images of two image-capturing units. The monocular speed derivation unit derives a monocular speed indicating a speed of the three-dimensional object extracted from the luminance image of one of the image-capturing units. The predicted speed derivation unit derives a predicted speed based on a past speed of the three-dimensional object. The mixture ratio derivation unit derives a mixture ratio of the stereo, monocular, and predicted speeds. The object speed derivation unit mixes the stereo, monocular, and predicted speeds at the mixture ratio, to derive an object speed.

Abstract: A projection image automatic correction method and system based on binocular vision. The method includes: acquiring a depth map of a projection image on a projection plane; calculating a first transformation relationship between a source image and the projection image; acquiring a distortion image according to the depth map; acquiring a correction image after correcting the distortion image; calculating a second transformation relationship between the distortion image and the correction image; acquiring a correction relationship between the source image and the correction image according to the first transformation relationship and the second transformation relationship; and correcting the projection image according to the correction relationship. This disclosure is configured to realize the efficient automatic correction of the projection image without being limited by the projection area, and the correction flexibility is high.

Abstract: Aspects of the subject disclosure may include, for example, a method for spherical video streaming over a network by a processing system including a processor, the method including prefetching audio data for rendering the spherical video; determining whether there is a single source or a plurality of sources of audio in the audio data; responsive to a determination that there is only one dominant source of the audio in the audio data, prefetching video data in a field of view centered on spatial coordinates of the dominant source of audio; responsive to a determination that there is the plurality of sources of the audio in the audio data, sorting the plurality of sources of the audio according to an estimated sound source energy for each source in the plurality of sources, thereby creating a sorted list of the plurality of sources; and prefetching video data in plural fields of view centered on spatial coordinates of each audio source in the sorted list of the plurality of sources, wherein the prefetching is

Abstract: A tilted needle biopsy assembly is provided for mounting on an x-ray system. Because the biopsy needle is angled relative to at least one of the detector and the x-ray source, x-ray imaging may be performed during the biopsy procedure without interference by the biopsy device. The angled biopsy needle additionally allows improved access to the axilla and chest wall of the patient. The stereotactic biopsy device of the present invention may be coupled to any x-ray system, whether upright or prone, including but not limited to mammography systems, tomosynthesis systems, and combination mammography/tomosynthesis systems. The system flexibly supports the use of any mode of image capture (i.e., scout, two dimensional mammogram, three-dimensional reconstructed volume) for either or both target visualization and target localization. With such an arrangement, a needle biopsy assembly having improved patient coverage is provided for use with a variety of different x-ray imaging platforms.

Abstract: Configurations are disclosed for a health system to be used in various healthcare applications, e.g., for patient diagnostics, monitoring, and/or therapy. The health system may comprise a light generation module to transmit light or an image to a user, one or more sensors to detect a physiological parameter of the user's body, including their eyes, and processing circuitry to analyze an input received in response to the presented images to determine one or more health conditions or defects.

Abstract: A method for matching points between two images of a scene acquired by two cameras, the method including: extracting blobs from the reflection in the images and individually labelling the blobs with a unique identifier; selecting a selected epipolar plane and defining a conjugate epipolar line on each of the images; identifying plausible combinations including a light sheet label of the projected pattern and the unique identifier for a plausible blob selected from the blobs in each of the images; calculating a matching error for each of the plausible combinations; repeating the steps of selecting, identifying and calculating for at least some epipolar planes; determining a most probable combination by computing a figure of merit for the plausible combinations; identifying matching points in the frame from the most probable combination.

Abstract: Medical and/or robotic devices, systems and methods can provide an indicator associated with each manipulator assembly of a multi-arm telerobotic or telesurgical system. The exemplary indicator comprises a multi-color light emitting diode (LED) mounted to a manipulator moving an associated surgical instrument, allowing the indicator to display any of a wide variety of signals. The invention may provide an additional user interface to facilitate communications between the telesurgical system and/or members of a telesurgical team.

Abstract: A canvas generation system generates a canvas view of a scene based on a set of original camera views depicting the scene, for example to recreate a scene in virtual reality. Canvas views can be generated based on a set of synthetic views generated from a set of original camera views. Synthetic views can be generated, for example, by shifting and blending relevant original camera views based on an optical flow across multiple original camera views. An optical flow can be generated using an iterative method which individually optimizes the optical flow vector for each pixel of a camera view and propagates changes in the optical flow to neighboring optical flow vectors.

Abstract: Disclosed herein are primary and auxiliary image capture devices for image processing and related methods. According to an aspect, a method may include using primary and auxiliary image capture devices to perform image processing. The method may include using the primary image capture device to capture a first image of a scene, the first image having a first quality characteristic. Further, the method may include using the auxiliary image capture device to capture a second image of the scene. The second image may have a second quality characteristic. The second quality characteristic may be of lower quality than the first quality characteristic. The method may also include adjusting at least one parameter of one of the captured images to create a plurality of adjusted images for one of approximating and matching the first quality characteristic. Further, the method may include utilizing the adjusted images for image processing.

Abstract: In one aspect, an image processing method for processing images is provided, comprising the steps of: obtaining, from an optical sensor, at least two images, determining an image warping function at least partially compensating the distortion, applying the determined image warping function to the image including the distortion, and calculating by a processing unit, and outputting, a depth and/or disparity image from the at least two images.

Abstract: An image forming apparatus comprises a three-dimensional reader, a drawing data generator and a printer. The three-dimensional reading section includes an arrangement section, a sensor and a model data generator. The arrangement section is a position where a target object is arranged. The sensor acquires three-dimensional information relating to a three-dimensional shape of the object arranged on the arrangement section. The model data generator generates three-dimensional model data indicating the three-dimensional shape of the object on the basis of the three-dimensional information. The drawing data generator generates drawing data containing data of a two-dimensional drawing formed by projecting the object on a plane surface on the basis of the three-dimensional model data. The printer forms an image on a sheet on the basis of the drawing data.

Abstract: According to one aspect of the teachings herein, a method and apparatus detect mechanical misalignments in a machine vision system during run-time operation of the machine vision system, and compensate image processing based on the detected misalignments, unless the detected misalignments are excessive. Excessive misalignments may be detected by determining a worst-case error based on them. If the worst-case error exceeds a defined limit, the machine vision system transitions to a fault state. The fault state may include disrupting operation of a hazardous machine or performing one or more other fault-state operations. Among the detected misalignments are internal misalignments within individual cameras used for imaging, and relative misalignments between cameras. The method and apparatus may further perform run-time verifications of focus and transition the machine vision system to a fault state responsive to detecting insufficient focal quality.

Abstract: A method for monitoring a vehicle's surrounding region, includes reading in a distance image pertaining to the surrounding region, the distance image including distance values representing the result of a multiplicity of distance measurements, which are performed with a sensor for stereo image recording based on a method for calculating a stereo disparity map concerning the surrounding region sensed by the sensor. In a selecting, a cut-away portion from the distance image is selected, and in a detecting, an obstacle located in the surrounding region is detected using the distance values included in the cut-away portion. In an ascertaining, a number of relevant distance values is ascertained, which represent distance values included in the cut-away portion that are allocatable to the obstacle. In an ascertaining, a value of an existence measure for the existence of the obstacle is determined, based on the number and quality of relevant distance values.

Abstract: Representative implementations of devices and techniques provide adaptable settings for imaging devices and systems. Operating modes may be defined based on whether movement is detected within a predetermined area. One or more parameters of illumination or modulation may be dynamically adjusted based on the present operating mode.

Abstract: An image processing device, method and computer program product cooperate to make adjustments in detection area for image adjustment processing to when displacement adjustments have been made to a first or second imaging area. A detection area setting device sets a first detection area within a first imaging area and sets a second detection area in a second imaging area after a displacement adjustment is applied to at least one of the first imaging area and the second imaging area. The first detection area is an area used in image adjustment processing.

Abstract: The present application provides pedestrian detection system and method. A pedestrian detection method includes obtaining an image captured by a camera, and identifying a pedestrian candidate in the image. According to the method, the pedestrian candidate is confirmed by transforming the image into a top view image, calculating the actual height of the pedestrian candidate based on the top view image and extrinsic parameters of the camera, and determining whether the actual height of the pedestrian candidate is within a predetermined pedestrian height range.

Abstract: A method for high-resolution 3D-localization microscopy of a sample having fluorescence emitters, in which the fluorescence emitters are excited to emit fluorescent radiation and the sample is displayed with spatial resolution in wide-field microscopy. Excitation is caused such that at least some fluorescence emitters are isolated. A three-dimensional localization is determined in a localization analysis, which includes a z-coordinate, x-coordinate as well as a y-coordinate orthogonal thereto, for each isolated fluorescence emitter. A table of localization imprecision is provided. Localization imprecision being determined for each localized fluorescence emitter by accessing the table of localization imprecision.

Abstract: A communication terminal for communicating with a counterpart communication terminal includes a receiver that receives image data including an eye image of a user operating the counterpart communication terminal from the counterpart communication terminal, the eye image of the user being captured at the counterpart communication terminal, and circuitry that specifies a sightline position indicating a sightline of the user based on the received image data including the eye image and controls a display to display sightline information indicating the sightline position of the user at the specified position.

Abstract: Methods and systems for generating multi-resolution spherical videos, comprising receiving a plurality of video recordings recorded by a viewpoint, wherein the viewpoint is a camera array comprising a plurality of cameras arranged around a viewpoint center; and generating a spherical video from the plurality of video recordings by non-concentric spherical projection, wherein each of the plurality of video recordings is mapped to respective portions of a projection sphere, wherein a center of the projection sphere is positioned at a non-zero distance away from the viewpoint center, and wherein a visual resolution of the spherical video in a first portion of the projection sphere is higher than a visual resolution of the spherical video in a second portion of the projection sphere.

Abstract: The present application describes computer apparatus and software programs useful to the field of corrective spinal surgery. The apparatus and software implement and facilitate methods for assessing the degree of balance and alignment achieved through corrective measures applied to the spine prior to completing a surgical procedure. The apparatus and software facilitate pre-operative planning and virtual testing of the corrective measures to be applied. The apparatus and software further facilitate intra-operative reconciliation with the pre-operative plan prior to completing the surgery.

Abstract: An image processing system is designed to generate a canvas view that transitions between binocular views and monocular views. Initially, the image processing system receives top/bottom images and side images of a scene and calculates offsets to generate synthetic side images for left and right view of a user. To transition between binocular views and monocular views, the image processing system first warps top/bottom images onto corresponding synthetic side images to generate warped top/bottom images, which realizes the transition in terms of shape. The image processing system then morphs the warped top/bottom images onto the corresponding synthetic side images to generate blended images for left and right eye views with the blended images. The image processing system creates the canvas view which transitions between binocular views and monocular views in terms of image shape and color based on the blended images.

Abstract: A visual display unit creating a three-dimensional volumetric space. The display includes a first screen in a first focal plane, wherein the first screen displays a first image. The display includes a second screen in a second focal plane distinct from the first focal plane, wherein the second screen displays a second image, and wherein the second screen at least partially overlaps the first screen. The display includes a physical object located between the first screen and said second screen, wherein at least one of the first and second images is displayed in response to a placement of the physical object.

Abstract: Systems, devices and methods are described including determining a display type and a display mode, preparing stereoscopic image content in response to the display mode, where preparing the stereoscopic image content includes storing a full resolution left image and a full resolution right image in memory, and determining a display refresh rate in response to at least a content frame rate of the stereoscopic image content. The stereoscopic image content may then be processed for display according to the display type, the display refresh rate, and a power policy.

Abstract: A system and method for creating an enhanced virtual top-down view of an area in front of a vehicle, using images from left-front and right-front cameras. The enhanced virtual top-down view not only provides the driver with a top-down view perspective which is not directly available from raw camera images, but also removes the distortion and exaggerated perspective effects which are inherent in wide-angle lens images. The enhanced virtual top-down view also includes corrections for three types of problems which are typically present in de-warped images—including artificial protrusion of vehicle body parts into the image, low resolution and noise around the edges of the image, and a “double vision” effect for objects above ground level.

Abstract: Methods, systems, and storage media are disclosed herein for determining objects in image data that match a plurality of captured images, in which one or more of the captured images from among the plurality of captured images may depict only a portion of an object. A computing device may extract a first feature from at least one block of the plurality of blocks from a captured image; determine a second feature; and determine a third feature. The computing device may determine, as a matching image, a stored image from among a plurality of stored images including an object that has greatest maximum correlation with the third feature. The computing device may similarly determine a matching image for each of the captured images of the plurality of images; and determine a final matching image from among the candidate matching images that best matches the combination of the plurality of captured images.

Abstract: A breast tomography apparatus includes a gantry incorporating a radiation source and a radiation detector and a breast insert portion which is provided in the gantry and in which the breast as an imaging target is to be inserted. The breast tomography apparatus detects contact between an object and the gantry by using at least one contact detection sensor arranged on the gantry, and determines the insert condition of the breast into the breast insert portion based on the detection of contact between the object and the gantry by the contact detection sensor.

Abstract: A minimally-invasive surgical system includes a slave surgical instrument having a slave surgical instrument tip and a master grip. The slave surgical instrument tip has an alignment in a common frame of reference and the master grip, which is coupled to the slave surgical instrument, has an alignment in the common frame of reference. An alignment error, in the common frame of reference, is a difference in alignment between the alignment of the slave surgical instrument tip and the alignment of the master grip. A ratcheting system (i) coupled to the master grip to receive the alignment of the master grip and (ii) coupled to the slave surgical instrument, to control motion of the slave by continuously reducing the alignment error, as the master grip moves, without autonomous motion of the slave surgical instrument tip and without autonomous motion of the master grip.

Abstract: A disparity value deriving device includes an acquisition unit configured to acquire a degree of matching between a reference region in a reference image captured from a first imaging position and each of a plurality of region in a designated range including a corresponding region to the reference region in a comparison image captured from a second imaging position; a synthesizer configured to synthesize the degree of matching of a reference region in neighborhood of a predetermined reference region in the reference image and the degree of matching of the predetermined reference region in the reference image; and a deriving unit configured to derive a disparity value of an object whose image is being captured in the predetermined reference region and a corresponding region to the predetermined reference region, based on a synthesized degree of matching obtained by the synthesizer.

Abstract: A device and a method for calibrating the coordinate system of imaging systems having a tracking system prior or during image data acquisition, e.g. by way of magnetic resonance tomography.

Abstract: A camera and a vehicle including the same are disclosed. The camera includes a first camera, an image sensor to sense an image based on light acquired by the first camera, and a processor to control the exposure time of the image sensed by the image sensor to be changed based on a brightness level and a brightness distribution value of the image acquired by the image sensor. Consequently, it is possible to reduce motion blur in a low luminance environment.

Abstract: Image capture can be improved by capturing a sequence of images and analyzing the images to select the image with the least blur and/or an acceptable amount of blur. Gradients can be calculated for at least a portion of the images, and gradient histograms generated. Two or more component curves can be fit to each histogram, such as by using a Gaussian mixture model, and the curves can be compared to determine an amount of variation between the curves. The image with the smallest differences between component curves, or with differences less than a specified blur threshold, can be selected as a sufficiently sharp image and provided for viewing, processing, or another intended purpose of the image to be captured.

Abstract: Rendering a stereoscopic image of a 3-D environment, including: tracing a path of ray from a camera to a light source for every pixel in a view window; determining shading of all pixels in the view window; and adjusting the shading for all pixels to show horizontal displacement but substantially reduce vertical displacement in the stereoscopic image. Keywords include shading and horizontal displacement.

Abstract: A range is determined for a disparity search for images from an image sensor array. In one example, a method includes receiving a reference image and a second image of a scene from multiple cameras of a camera array, detecting feature points of the reference image, matching points of the detected features to points of the second image, determining a maximum disparity between the reference image and the second image, and determining disparities between the reference image and the second image by comparing points of the reference image to points of the second image wherein the points of the second image are limited to points within the maximum disparity.

Abstract: Provided is an image processing method and apparatus, the apparatus including an object separation unit to separate an object region from a background region using at least one of a color image and a depth image associated with the color image, a contrast calculating unit to calculate a contrast between the object region and the background region, and a depth adjusting unit to adjust a depth of the depth image based on the calculated contrast.

Abstract: A controller for a 3D observation apparatus performing 3D observation based on parallax using a plurality of optical systems includes the following sections. A start time acquisition section obtains a start time when energization of the 3D observation apparatus is started. An interrupted time acquisition section obtains an interrupted time when previous energization of the 3D observation apparatus is interrupted. A non-active time calculation section calculates a non-active time which is a period of time between the interrupted time and the start time. A determination section determines whether or not misalignment correction to correct misalignment of optical axes of the optical systems is necessary based on the non-active time.

Abstract: An image measurement device calculates a disparity value from image data of images having disparity, acquires three-dimensional position information at the time of capturing the image data by using the disparity value, and calculates a three-dimensional plane from a region on an image serving as a same plane as a designated measurement region. Three-dimensional positions of the measurement region are acquired from the calculated three-dimensional plane to calculate a length. Accordingly, by using captured images having disparity, it is possible to measure a length of any part even in a region that the disparity value is hard to be acquired.

Abstract: An image processing apparatus and method take as input a pre-op reference image (OP) and a stream (A) of angiographic images (A1-A3). Based on multiple pre-defined regions of interest (ROIa-c) in the pre-op reference image (PO), the angiographic image best showing when displayed a respective one of the regions of interest (ROIa-c) is detected from among the stream (A) of angiographic images (A1-A3). The detected angiographic image is associated with the region of interest to form an associative data structure (DS). A graphical user interface (GUI) is generated that allows based on the associative data structure (DS) to retrieve the associated angiography upon a user selecting any one of the regions of interest (ROIa-c) on the graphical user interface (GUI).

Abstract: An image processing device in which a high-resolution viewpoint image and a disparity map is obtained with a simple configuration. A resolution of a viewpoint image imaged at a central viewpoint at first resolution is converted to a resolution of a viewpoint image imaged at a peripheral viewpoint at second resolution which is lower than the first resolution, and the viewpoint image at the central viewpoint and the viewpoint image at the peripheral viewpoint both having a same resolution are generated. Further, a disparity map based on a correlation value between the viewpoint image at the central viewpoint and the viewpoint image at the peripheral viewpoint both having the same resolution is generated.

Abstract: A minimally-invasive surgical system includes a slave surgical instrument having a slave surgical instrument tip and a master grip. The slave surgical instrument tip has an alignment in a common frame of reference and the master grip, which is coupled to the slave surgical instrument, has an alignment in the common frame of reference. An alignment error, in the common frame of reference, is a difference in alignment between the alignment of the slave surgical instrument tip and the alignment of the master grip. A ratcheting system (i) coupled to the master grip to receive the alignment of the master grip and (ii) coupled to the slave surgical instrument, to control motion of the slave by continuously reducing the alignment error, as the master grip moves, without autonomous motion of the slave surgical instrument tip and without autonomous motion of the master grip.

Abstract: The image processing apparatus processes an image signal obtained from an image pickup element using an image pickup optical system arranged to obtain directional traveling information of object image light corresponding to a pupil division area of a photographing lens. The apparatus includes: a unit of setting a focal position at which the refocused image is generated; and a unit of correcting an image signal of a defect pixel of the image pickup element using an image signal of other pixel. The apparatus determines the other pixel to be used for correcting the image signal of the defect pixel on the basis of the set focal position and the directional traveling information of the object image light.

Abstract: This invention focuses specifically on the use of epipolar lines and the use of matrix transformations to coordinate cameras. This invention organizes cameras in a manner which is intuitive and effective in perceiving perspectives which are not normally possible; to calculate range precisely; to allow redundancy; to corroborate feature recognition; and to allow perspectives from angles from which no cameras exist. By enabling remote scene reconstruction with a limited set of images, transmission bandwidth is greatly conserved.

Abstract: The image recording device includes: an image information obtaining unit obtaining a first image of the object viewed from a first viewpoint, a second image of the object viewed from a second viewpoint, and viewpoint positions each for one of the viewpoints; a depth information generating unit generating depth information items each indicating a depth of the object included in the first and second images; an image generating unit generating a third image and a viewpoint position of the third image, using the depth information items, the first image, and the second image, the third image being of the object viewed from a third viewpoint different from the first and second viewpoints; and a recording unit recording on the image file the first, second and third images in association with the viewpoint positions each for one of the first, second, and third images.

Abstract: An document camera used by being connected to a display apparatus is provided. The document camera includes a plurality of imagers, an image processing unit that produces two sets of image data by using two of the plurality of imagers to capture images of a single target object from different imaging positions, a parameter acquisition unit that acquires a parameter for determining an inter-image distance between the two sets of image data to be displayed by the display apparatus, and an output unit that outputs the two sets of image data and the parameter or the inter-image distance to the display apparatus.

Abstract: A monitor/display is used to display a vision test. A patient is spaced a predetermined distance from the monitor/display during the testing procedure, and individual, multiple LED housings are equally spaced about a center point of the monitor/display to direct light toward the patient during at least a portion of the test procedure. The light emanating from the individual housings is a diffuse, unfocused light to simulate glare, and the intensity of the light may be selectively altered. Conducting vision testing under glare conditions determines if there is any reduction or fall off in the patient's vision under such circumstances and provides an indication of whether the patient may require cataract surgery or has another ocular problem. An assembly allows an existing vision testing system to be easily modified to provide glare light testing capabilities.

Abstract: Equipment of surgical instruments suitable for minimally invasive surgery, comprised by a multivalve device with adjustable separator to enter the patient's body and with at least one access simultaneous port for a number of components which includes an operative surgical device comprised by a control, a movement transmission element and an operative mounting clamp of a needle plier comprised by a control, a head connecting sheath, with a connecting needle lodged in its interior and the operative head; and a cauterization device comprised by a control, a movement transmitting element and the cautery.

Abstract: Provided is an excitation light synthesizing unit capable of emitting, in one direction, excitation light incident from a plurality of difference directions. The excitation light synthesizing unit includes polarization splitter film (15), first and second ¼ wavelength plates (13 and 14), and reflection member (19). Polarization splitter film (15) transmits excitation light that is P-polarized light while reflecting excitation light that is S-polarized light. First and second ¼ wavelength plates (13 and 14) are arranged on the path along which first excitation light (L1), which is directed toward polarization splitter film (15), travels. Reflection member (19) disposed between first and second ¼ wavelength plates (13 and 14). Reflection member (19) reflects second excitation light (L2) incident via polarization splitter film (15) toward polarization splitter film (15). Reflection member (19) includes hole (20) formed to pass first excitation light (L1).

Abstract: A detector (110) for determining a position of at least one object (112) is proposed.

Abstract: A method and an apparatus are used for detecting a road partition, the method comprising: a step of obtaining a disparity top view having a road area; and a step of detecting parallel lines as the road partitions from the disparity top view.

Abstract: A minimally-invasive surgical system includes a slave surgical instrument having a slave surgical instrument tip and a master grip. The slave surgical instrument tip has an alignment in a common frame of reference and the master grip, which is coupled to the slave surgical instrument, has an alignment in the common frame of reference. An alignment error, in the common frame of reference, is a difference in alignment between the alignment of the slave surgical instrument tip and the alignment of the master grip. A ratcheting system (i) coupled to the master grip to receive the alignment of the master grip and (ii) coupled to the slave surgical instrument, to control motion of the slave by continuously reducing the alignment error, as the master grip moves, without autonomous motion of the slave surgical instrument tip and without autonomous motion of the master grip.

Abstract: Systems and approaches are provided for tracking an object of interest using depth or disparity information, such as obtained by calculating stereo disparity between a pair of images. The depth or disparity information can be used as an additional signature for a template of the object of interest for tracking the object. A template that includes depth, distance, or disparity information for an object of interest may be invariant to the effects of lighting, such as shadows and changes in illumination conditions. Depth, distance, or disparity information can also provide information regarding shape and size that can be used to differentiate foreground objects. Depth, distance, or disparity information can also better handle occlusion. Depth, distance, or disparity information can also provide an additional disambiguating dimension for tracking an object.