Abstract: An obstacle determination unit determines whether or not an obstacle is within a detection range being a detection target of the obstacle. A notification unit gives notification indicating the obstacle when determined as the obstacle being present. An operation input unit receives an operation to the display unit for changing the detection range. A change unit changes the size of the detection range based on the operation.

Abstract: An apparatus includes a first camera configured to capture a first image being displayed, a second camera configured to capture a second image being displayed, and a processor configured to generate a pair-wise homography transform for the first camera and the second camera, and map, based on the pair-wise homography transform, the second image from a second frame of reference of the second camera to a first frame of reference of the first camera. The processor is further configured to determine a first corrected quadrilateral for the first image and a second corrected quadrilateral for the second image in the first frame of reference, and project, based on the pair-wise homography transform, the second corrected quadrilateral from the first frame of reference to the second frame of reference. The quadrilaterals are then processed to warp respective images for geometric correction before projecting the images by respective projectors.

Abstract: A frame correction method includes the following steps. Firstly, a correction frame is projected, wherein the correction frame has a number of original-boundary contour points. Then, in the first boundary contour adjustment, in response to a position adjustment of the first contour-adjusted one of the original-boundary contour points, correspondingly adjust the position of at least one symmetrical one of the original-boundary contour points, wherein at least one symmetrical one and the first contour-adjusted one are symmetrically disposed. Then, in response to the position adjustment of the first contour-adjusted one, a number of first new boundary contour points and a number of first open correction points are added.

Abstract: A surgery visualization theatre comprising: an augmented/extended reality (AXR) headset; a digital viewport mounted on a cobotic arm; a monitor mounted on a monitor cobotic arm; a camera subsystem mounted on a camera cobotic arm; and a frame with cobotic arms featuring intelligence and command and control for the system and visualization methodologies, where the digital viewport cobotic arm, the monitor cobotic arm, and the camera cobotic arm are mounted on the frame and the AXR headset is connected thereto.

Abstract: An image relay device that projects laser light representing an image emitted from a projection device onto the retina is provided. The image relay device includes a projection device, a first optical member, and a second optical member. The projection device includes a light source configured to emit laser light and a scan unit configured to scan the laser light based on image data. The first optical member receives an image light from the projection device and converts the image light which is a parallel light, to light beams of convergent light. The second optical member converts the light beams output from the first optical member into parallel light.

Abstract: A direct retinal projector system that provides dynamic focusing for virtual reality (VR) and/or augmented reality (AR) is described. A direct retinal projector system scans images, pixel by pixel, directly onto the subject's retinas. This allows individual pixels to be optically affected dynamically as the images are scanned to the subject's retinas. Dynamic focusing components and techniques are described that may be used in a direct retinal projector system to dynamically and correctly focus each pixel in VR images as the images are being scanned to a subject's eyes. This allows objects, surfaces, etc. that are intended to appear at different distances in a scene to be projected to the subject's eyes at the correct depths.

Abstract: Provided are an output unit configured to output an image or distribution information of evaluation values corresponding to a plurality of regions of the image, an operation unit configured to accept a first action and a second action different from the first action; and a control unit configured to execute, when the output unit outputs a first image, output control such that the output unit outputs a second image if the operation unit accepts the first action, and that the output unit outputs distribution information of the evaluation values corresponding to the first image if the operation unit accepts the second action.

Abstract: A projection method, which is executed by a projection device, for projecting drawing data for a building onto a projection plane of the building under construction includes: measuring a distance from each of three or more points which are not aligned in a straight line and are on either of two non-parallel straight lines on the projection plane to the projection device using a distance meter included in the projection device; and projecting the drawing data onto a projection position on the projection plane which is determined based on the distance measured and the angle of the distance meter at the time at which the distance is measured.

Abstract: A method for correcting distorted image and apparatus thereof are provided. In the method, an image device acquires a first pattern image and a controller generates a relationship table between the first pattern image and an original pattern image. The image device acquires a second pattern image. The controller corrects each pixel content of the second pattern image based on the relationship table to create a correction image corresponding to the second pattern image.

Abstract: A display system for displaying a panoramic image and an operation method thereof are provided. The display system for displaying a panoramic image includes N projectors and a controller. The N projectors project N sub-images according to N image data and form a panoramic image. Each sub-image has a sub-image overlapping area, so that two adjacent sub-images of the N sub-images partially overlap, and that a first sub-image and an Nth sub-image of the N sub-images partially overlap. The controller copies a first edge image corresponding to a first edge of an original image and connects the first edge image to a second edge of the original image that is opposite to the first edge, so as to generate an extended image corresponding to the sub-image overlapping area. The controller slices an adjusted image containing the original image and the extended image to generate the N image data.

Abstract: A display device includes a display configured to display a video, a concave mirror configured to reflect a video display light of the video displayed on the display toward a reflection part that is formed in a curved shape and that faces a viewer, and a housing in which the display and the concave mirror are assembled, wherein an angle of the concave mirror with respect to the housing is adjustable by rotating the concave mirror on a reference plane of the housing in accordance with a relative positional relationship among the housing, the reflection part, and the viewer.

Abstract: One variation of method includes: serving setup frames to a projector facing a scene; at a peripheral control module comprising a camera facing the scene, recording a set of images during projection of corresponding setup frames onto the scene by the projector and a baseline image depicting the scene in the field of view of the camera; calculating a pixel correspondence map based on the set of images and the setup frames; transforming the baseline image into a corrected color image—depicting the scene in the field of view of the camera—based on the pixel correspondence map; linking visual assets to discrete regions in the corrected color image; generating augmented reality frames depicting the visual assets aligned with these discrete regions; and serving the augmented reality frames to the projector to cast depictions of the visual assets onto surfaces, in the scene, corresponding to these discrete regions.

Abstract: There are provided a medical image processing apparatus and a medical image processing method making it possible to reduce metal artifacts with no loss of a detailed structure in a metallic region. The medical image processing apparatus is configured to reconstruct a tomographic image from projection data of a subject in which metal material is included and includes a projection space correction section which corrects the projection data and thereby generates corrected projection data, an image space correction section which corrects the tomographic image by using the corrected projection data, and a coefficient setting section which sets a projection space coefficient which is used in the projection space correction section and an image space coefficient which is used in the image space correction section.

Abstract: The present disclosure relates to a method for calibrating a projector. In one example, the method includes receiving by a processing element light field data corresponding to a calibration image projected by a projector and captured by a light field capturing device, and modeling by a processing element one or more intrinsic properties of the projector using the light field data and the calibration image. The calibration image may be projected by the projector directly into the light field capturing device.

Abstract: A projection display apparatus for projecting and displaying image light onto a projection plane includes an image light generator that generates the image light, a projection optical system including a projection lens that projects the image light onto the projection plane, a focus controller that controls focusing of the projection lens, and a temperature sensor that detects a temperature of the projection display apparatus. The focus controller operates to, calculate a plurality of focus deviation amounts which correspond respectively to a plurality of component groups based on first information obtained from the image light generator and second information obtained from the temperature sensor, the plurality of component groups being classified depending on kinds of components constructing the projection optical system, calculate a focus correction amount according to the plurality of focus deviation amounts calculated, and control the focusing based on the focus correction amount calculated.

Abstract: A machine receives, for a given target in a given image, a plurality of annotations, each annotation indicating a range of pixels corresponding to the given target. The machine computes a number of pixels in an intersection of the plurality of annotations. The machine computes an average pixels on target (APOT) for the given target by computing, for each annotation, a number of pixels that corresponds to the given target and taking a mean of those numbers. The machine computes a precision value of the plurality of annotations as the number of pixels in the intersection divided by the APOT. The machine provides an output representing the precision value.

Abstract: A control method for an image projection system including a plurality of projectors includes a determining step of determining, based on a stack number indicating the number of the projectors, projected images of which are superimposed one another, colors of pattern images projected by the respective projectors equivalent to the stack number and a projecting step of causing the respective projectors equivalent to the stack number to project the pattern images having the colors determined in the determining step. In the determining step, when the pattern images equivalent to the stack number are superimposed, the colors of the pattern images projected by the respective projectors equivalent to the stack number are determined such that the superimposed pattern images equivalent to the stack number have a specific color.

Abstract: A projector includes a lens, a displacement adjusting unit, an imaging unit, a temperature sensing unit, a storage unit and a processing unit. The displacement adjusting unit is connected to the lens. The temperature sensing unit senses a current temperature. The storage unit stores a plurality of temperature ranges and a plurality of displacement variations corresponding to the temperature ranges. The processing unit receives a current image. The processing unit compares the current temperature with the temperature ranges to determine a current displacement variation corresponding to the current temperature from the displacement variations. The processing unit performs at least one of following steps according to the current displacement variation: controlling the displacement adjusting unit to adjust a displacement of the lens; adjusting a displacement of the current image on the imaging unit; and performing an image adjusting process for the current image.

Abstract: A projection position detection device includes: a spectroscopic camera receiving light from an image pickup range including a projection image projected onto a projection target, and picking up a plurality of spectral images corresponding to different wavelengths from each other; a spectrum computation unit computing an optical spectrum of each pixel, based on the plurality of spectral images; a feature point detector detecting a feature point in the image pickup range, based on the optical spectrum of the pixel; and a projection position calculator calculating a relative position of the projection image to the feature point.

Abstract: There is provided an information processing apparatus, an information processing method, and a program capable of reducing a decrease in resolution in overlapping areas of multiple projection in cases where a plurality of projectors is used to perform the multiple projection onto an object. An information processing apparatus according to one aspect of the present technology generates, in regard to a plurality of projectors irradiating an object serving as a projection target with projection light rays as superimposing light rays depicting a projection image having pixels, mask information for regulating intensity of the corresponding light ray of each pixel of the projection image. The mask information includes information indicating, in regard to the object having a surface including a predetermined position, that the position is irradiated by a predetermined projector. The present technology can be applied to computers each of which causes a plurality of projectors to project images.

Abstract: There is provided an image processing device, an image processing method, a program, and a projection system that reduce processing in a case where images based on an equidistant cylindrical image are projected using a plurality of projectors. The image processing device of an aspect of the present technology generates a second equidistant cylindrical image whose center pixel is equal to a center pixel of each of projection regions of a plurality of projectors in a first equidistant cylindrical image and that includes pixels within an angle range including the each of the projection regions, as an image used to generate each of projection images that are projected from the plurality of projectors. The present technology is applicable to a computer that causes the plurality of projectors to project images.

Abstract: An augmented reality display system includes a pair of variable focus lens elements that sandwich a waveguide stack. One of the lens elements is positioned between the waveguide stack and a user's eye to correct for refractive errors in the focusing of light projected from the waveguide stack to that eye. The lens elements may also be configured to provide appropriate optical power to place displayed virtual content on a desired depth plane. The other lens element is between the ambient environment and the waveguide stack, and is configured to provide optical power to compensate for aberrations in the transmission of ambient light through the waveguide stack and the lens element closest to the eye. In addition, an eye-tracking system monitors the vergence of the user's eyes and automatically and continuously adjusts the optical powers of the pair of lens elements based on the determined vergence of those eyes.

Abstract: The disclosure provides an image blending method. The method includes projecting a plurality of images onto a projection surface, respectively, wherein an image of the first portion of the first image and an image of the first portion of the second image projected onto the projection surface overlap each other in the first overlapping area on the projection surface; the image parameters of all pixels of the first non-overlapping area and the second non-overlapping area are adjusted according to the position of the first non-overlapping area and the position of the second non-overlapping area, such that the black-level brightness of the first non-overlapping image in the first non-overlapping area of the first image and the black-level brightness of the second non-overlapping image in the second non-overlapping area of the second image are close to the black-level brightness of the first overlapping image in the first overlapping area.

Abstract: A wearable heads-up display has stored therein two or more distortion models for use in generating distorted source images that when projected by the wearable heads-up display into a target eye space form virtual images are aligned in the target eye space. A method and system for determining the distortion models are disclosed.

Abstract: The projection display device includes an imaging element, a light valve, and an image-forming optical system that projects an optical image according to light emitted from the light valve onto a magnification side imaging surface and forms an image of light incident from a magnification side on an imaging element. The image-forming optical system includes a first optical system that comprises at least one lens and is used in common in projection and imaging, and a separation member that separates an optical path from the light valve toward the first optical system from an optical path from the first optical system toward the imaging element. An antireflection layer is comprised in at least one of antireflection target surfaces having a significant influence of ghost light.

Abstract: Provided are an image correction device, an image correction method, and a program capable of canceling accumulated error at the time of connection from a wide field-of-view image in which a plurality of partial images are connected. An image correction device includes an image acquisition unit 22 that acquires a combined image including a plurality of partial images obtained by performing division imaging on a rectangular area in a real space using an imaging device 12, an area specifying unit 34 that specifies a correction target area in the combined image corresponding to the rectangular area in the real space, a division unit 36 that divides the correction target area into a plurality of divided areas, and a geometric conversion unit 40 that converts each of the plurality of divided areas into a rectangle.

Abstract: A projection system and a projection method thereof are provided. The projection system includes a projection device, a memory, an image capturing device, and a processor. The memory records a corresponding relationship between a plurality of test patterns and a plurality of sets of image capturing parameters. The projection device projects the plurality of test patterns toward a projected area. The processor controls, according to the corresponding relationship recorded in the memory, the image capturing device to shoot the projected area with the plurality of sets of image capturing parameters to obtain a plurality of first reference images corresponding to the plurality of test patterns, and controls, according to the plurality of test patterns and the corresponding plurality of first reference images, the projection device to project a projection image.

Abstract: An image projection apparatus configured to project a projection image on a projected surface via a projection optical system that includes a first optical system capable of adjusting a curvature amount of an image plane and is interchangeably attached to the image projection apparatus includes an acquirer configured to acquire information on a reference position of the first optical system, and a controller configured to move the first optical system to the reference position when detecting an interchange of the projection optical system or when accepting an instruction from a user.

Abstract: A projector includes: a projection unit projecting a projection image onto a projection surface where an object is located, the object defining a projection area where the projection image should be projected; a distortion correction unit correcting a distortion of the projection image; and a projection control unit causing the projection unit to project a guide image showing a range within which a predetermined site of the projection image can move according to the correction of the distortion, the projection control unit thus prompting a user to adjust a positional relation between the object and the range.

Abstract: A method for setting up a projector (10) for a passenger cabin (4) of an aeroplane (2), wherein the passenger cabin (4) comprises a projection surface (14) with a known configuration (G) and the projector (10) in the passenger cabin (4) is in a known relative position (RP) with respect to the projection surface (14) in a mounting position (M), geometrical data (16) relating to the configuration (G) and relative position (RP) are received by the projector (10), and predistortion data (22) are determined from the geometrical data (16) according to an imaging rule (18) in order to predistort the images (12) and represent them as rectified images (12?) on the projection surface, and the projector (10) is set up by storing the predistortion data (22) in the projector (10).

Abstract: Embodiments describing an approach to generating, a calibration slide for a presentation. Receiving, a first image of the calibration slide. Receiving, a second image of the calibration slide, wherein the second image of the calibration slide is associated with the projector component. Analyzing, the first image of the calibration slide and the second image of the calibration slide, wherein the analysis comprises: comparing, display attributes between the first and second image of the calibration slide, and identifying, distortions in the second image of the calibration slide. Responsive to the analysis, calibrating, the display attributes of the presentation based on a preset user threshold of acceptance.

Abstract: An optical module includes a light modulator that modulates light and includes a plurality of pixels, and a pixel shift mechanism. The pixels of the light modulator each include a first sub-pixel on which a first color light flux is incident, a second sub-pixel on which a second color light flux is incident, a third sub-pixel on which a third color light flux is incident, and a fourth sub-pixel on which one of the first color light flux, the second color light flux, and third color light flux is incident. The pixel shift mechanism includes a first state, a second state, and a third state. The first color light flux is incident on the fourth sub-pixel in the first state. The second color light flux is incident on the fourth sub-pixel in the second state. The third color light flux is incident on the fourth sub-pixel in the third state.

Abstract: The present disclosure relates to an image processing device and method capable of suppressing a reduction in the accuracy of corresponding point detection. A homography transformation is applied to a captured pattern image obtained as a result of an imaging unit capturing an image of a predetermined structured light pattern projected by a projection unit, and using the captured pattern image with the homography transformation applied to detect corresponding points between the projected image projected by the projection unit and the captured image captured by the imaging unit. The present disclosure can be applied to, for example, an image processing device, an image projection device, a control device, an information processing device, a projection imaging system, an image processing method, a program, and the like.

Abstract: A projection display apparatus includes a controller provided inside a projection optical system that projects an image on a projection surface and configured to control driving of a focus unit that provides focusing of a projection image on the projection surface, a shifter configured to move the projection optical system on a plane orthogonal to an optical axis of the projection optical system, and an acquirer configured to acquire positional information of the shift unit. The controller sets a driving condition of the focus unit using positional information of the shift unit and a relationship between an image height and a depth of field of the projection optical system.

Abstract: An image projection apparatus includes a light source unit including a plurality of laser light sources, a light modulation element configured to modulate illumination light generated using a laser beam from the light source unit and to generate image light projected onto a projection surface, and a controller configured to control driving of the plurality of laser light sources. The controller controls a luminance of the illumination light by selecting a first laser light source that emits the laser beam and a second laser light source that does not emit the laser beam among the plurality of laser light sources.

Abstract: The invention provides a projection device, comprising an illumination system, a light valve, a light guide element, an optical module and a projection lens. The optical module comprises a fixed portion, a first frame body, at least one first driving element and an optical element. The first frame body is pivoted to the fixed portion and comprises a first side and other three second sides. The first driving element is configured on at least one of the other three second sides and configured to drive the first frame body to oscillate back and forth. A first virtual plane of the projection lens intersects with a second virtual plane of the light valve to form a virtual line segment. The distance between the first side and the virtual line segment is shorter than the distance between the other three second sides and the virtual line segment.

Abstract: A method of rendering geometry of a 3D scene for display on a non-standard projection display projects geometry of the 3D scene into a 2D projection plane, wherein image regions are defined in the projection plane, maps the geometry from the projection plane into an image space using transformations, wherein a respective transformation is defined for each image region, and renders the geometry in the image space to determine image values of an image to be displayed on the non-standard projection display. The transformations are configured for mapping the geometry into the image space so as to counteract distortion introduced by an optical arrangement of the non-standard projection display.

Abstract: The evaluation of multiple virtual camera representations at the same point-of-view within a three-dimensional environment without recalculating a light travel transform that represents how light travels and reflects within the three-dimensional environment. These virtual camera representations may include a light capture transform that represents a transform from camera input to camera output. The virtual camera representation may also include a vision algorithm for interpreting the camera output. Thus, different virtual camera representations at the same point-of-view may be used to obtain a variety of representations of the three-dimensional environment at the same point-of-view.

Abstract: An additive manufacturing system includes a laser device, a build plate, a first scanning device, and an alignment system. The laser device is configured to generate a laser beam. The build plate has a position relative to the laser device. The first scanning device is configured to selectively direct the laser beam across the build plate. The laser beam generates a melt pool on the build plate. The alignment system includes a fiducial marks projector configured to project a plurality of fiducial marks across the build plate. Each fiducial mark has a location on the build plate. The alignment system also includes an optical detector configured to detect the location of each of the fiducial marks on the build plate. The alignment system is configured to detect the position of the build plate relative to the laser device.

Abstract: A sensor unit used in an ADV includes a sensor interface that can be coupled to cameras mounted on the ADV. The sensor unit further includes a host interface that can be coupled to a host system. The host system is configured to perceive a driving environment surrounding the ADV based on at least image data obtained from the cameras and to plan a path to autonomously drive the ADV. The sensor unit further includes one or more data acquisition modules corresponding to the cameras. Each data acquisition module includes a pixel alignment module and a frame processing module. The pixel alignment module is configured to reformat pixels of image data from an original format associated with the corresponding camera to a predetermined format. The frame processing module is configured to generate an image frame based on the image data and to transmit the image frame to the host system.

Abstract: A method includes running a computer simulation that is controlled at least in part by a handheld controller, displaying images generated by the computer simulation on a display, and projecting at least one image generated by the computer simulation from an image projector coupled to the handheld controller. A system includes a display, a handheld controller, an image projector coupled to the handheld controller, and a processor based apparatus. Another system includes a display, a handheld controller, an image projector that is housed in a unit configured to be releasably docked to the handheld controller, and a processor based apparatus. Storage mediums storing one or more computer programs are also provided.

Abstract: To display easily-seen display information on any display area regardless of an installation location, a display system (1) includes: a projection device (10) that switches and projects emitted light from a spatial light modulator element onto a plurality of display areas; and a control device (20) that controls the projection device to switch a projection direction of projected light from the projection device (10), based on a display condition of display information to be displayed on the display areas. The projection device (10) has: a reflecting mirror that is put in and out of a light path of emitted light from the spatial light modulator element; and a light path switching means that switches the projection direction of projected light by putting the reflecting mirror in and out of the light path of emitted light from the spatial light modulator element in response to control of the control device.

Abstract: A projector includes a projection section, a light transmissive member, an illuminator, a diffusion member, and an enclosure, and the enclosure is hung via a support member that supports the enclosure in a plurality of directions.

Abstract: A depth sensing apparatus with self-calibration and a self-calibration method thereof are provided. The depth sensing apparatus includes a projection apparatus, an image capturing apparatus and a calibration module. The projection apparatus projects a calibration pattern and a depth computation pattern to a reference plane based on a predefined calibration pattern and a predefined depth computation pattern. The image capturing apparatus captures an image including the calibration pattern and the depth computation pattern. The calibration module coupled to the image capturing apparatus adjusts apparatus parameters of the depth sensing apparatus to calibrate a depth computation deviation according to the calibration pattern of the image, the predefined calibration pattern and a predefined lookup table corresponding to the predefined calibration pattern.

Abstract: A projection display device includes a light source module, a switch unit, and micro-scanning mirrors. The light source module provides a light beam. The switch unit receives the light beam and switches a transmission direction of the light beam to the corresponding one of the micro-scanning mirrors during each of periods. The micro-scanning mirrors cause the light beam to scan over projection surfaces to form images. The projection display device can project the images on the projection surfaces without image brightness loss.

Abstract: One variation of method includes: serving setup frames to a projector facing a scene; at a peripheral control module comprising a camera facing the scene, recording a set of images during projection of corresponding setup frames onto the scene by the projector and a baseline image depicting the scene in the field of view of the camera; calculating a pixel correspondence map based on the set of images and the setup frames; transforming the baseline image into a corrected color image—depicting the scene in the field of view of the camera—based on the pixel correspondence map; linking visual assets to discrete regions in the corrected color image; generating augmented reality frames depicting the visual assets aligned with these discrete regions; and serving the augmented reality frames to the projector to cast depictions of the visual assets onto surfaces, in the scene, corresponding to these discrete regions.

Abstract: Projectors include a first projector that projects a first image and a second projector that projects a second image. The first projector includes a first control section that corrects the first image based on a first captured image produced by capturing an image of the range containing at least part of the first image and part of the second image and with reference to a target area contained in the range over which the first captured image is captured, and the second projector includes a second control section that corrects the second image based on a second captured image produced by capturing an image of the range containing part of the first image and at least part of the second image and with reference to the target area contained in the range over which the second captured image is captured.

Abstract: Methods and apparatus relating to encoding and decoding stereoscopic (3D) image data, e.g., left and right eye images, are described. Various pre-encoding and post-decoding operations are described in conjunction with difference based encoding and decoding techniques. In some embodiments left and right eye image data is subject to scaling, transform operation(s) and cropping prior to encoding. In addition, in some embodiments decoded left and right eye image data is subject to scaling, transform operations(s) and filling operations prior to being output to a display device. Transform information and/or scaling information may be included in a bitstream communicating encoded left and right eye images. The amount of scaling can be the same for an entire scene and/or program.

Abstract: An apparatus may include a base configured to be connected to a light socket, a projector supported by the base to project a projection field and a three-dimensional sensor supported by the base to output a three-dimensional field measurement of the projection field.

Abstract: A device, system and method for generating updated camera-projector correspondences from a reduced set of test patterns is provided. When a predetermined correspondences between projector points and camera points in an initial relative position of a projector and a camera have been previously determined, a recalibration therebetween may occur by projecting a single test pattern derived from the predetermined correspondences to estimate movement therebetween. When the movement is too great to be estimated by a single test pattern, another test pattern may be projected to determine an estimation function for the movement and in particular, estimate movement of one or more camera points in the projected images due to relative movement of the projector and the camera from the initial relative position to a current relative position.