Abstract: Method and apparatus are provided for image based positioning comprising capturing a first image with an image capturing device. Wherein said first image includes at least one object. Moving the platform and capturing a second image with the image capturing device. The second image including the at least one object. Capturing in the first image an image of a surface; capturing in the second image a second image of the surface. Processing the plurality of images of the object and the surface using a combined feature based process and surface tracking process to track the location of the surface. Finally, determining the location of the platform by processing the combined feature based process and surface based process.

Abstract: A lighting apparatus includes a structured light generation unit and a controlling unit. The structured light generation unit includes plural light sources and an optical element group. After plural light beams from the plural light sources pass through the optical element group, a first structured light pattern corresponding to a first light source is projected on a first position of the projection surface and a second structured light pattern corresponding to a second light source is projected on a second position of the projection surface. The first position and the second position are different. The controlling unit controls the first light source and the second light source to emit the light beams according to a time sequence. Consequently, the first structured light pattern and the second structured light pattern are projected on the projection surface according to the time sequence.

Abstract: An image encoding method for an encoding system includes receiving a first image captured by a main camera and a second image captured by a sub camera provided in the same plane; comparing pixel values of pixels at first coordinates of each of the first and second images to obtain a first difference value; determining the first coordinates are in surface or back region in case of the first difference value is not more than or more than a first threshold value; pixel-shifting the second image by a first shift amount; and comparing the pixel value at the first coordinates of the first image with that of the second image after the pixel shift to obtain a second difference value, determining whether the first coordinates are in the surface or back region based on the second difference value, and recording into a second frame different from the first frame.

Abstract: Video encoding and decoding accompanying inter prediction and motion compensation in a multi-view video prediction structure. A multi-view video prediction restoring method includes receiving a base view image stream and additional view image streams for two or more additional views; restoring base view images including base view anchor pictures that are I-picture type images by performing motion compensation referring to the base view images by using the base view image stream; and restoring images of a first additional view by performing at least one of disparity compensation referring to the restored base view images and motion compensation referring to images except for an anchor picture having a preceding reproduction order among the images of the first additional view by using an image stream of the first additional view among the additional view image streams.

Abstract: Data visualization systems and methods for generating 3D visualizations of a multidimensional data space are described. In one embodiment a 3D data visualization application directs a processing system to: load a set of multidimensional data points into a visualization table; create representations of a set of 3D objects corresponding to the set of data points; receive mappings of data dimensions to visualization attributes; determine the visualization attributes of the set of 3D objects based upon the selected mappings of data dimensions to 3D object attributes; update a visibility dimension in the visualization table for each of the plurality of 3D object to reflect the visibility of each 3D object based upon the selected mappings of data dimensions to visualization attributes; and interactively render 3D data visualizations of the 3D objects within the virtual space from viewpoints determined based upon received user input.

Abstract: A method for determining a depth of a target object in an environment is disclosed. The method comprises sensing a depth of objects within the environment with a depth sensing apparatus (1 10), identifying a disocclusion gap caused by the target object (120), detecting a position of edge contours of the disocclusion gap (1 30), and calculating a depth of the target object from the position of the disocclusion gap edge contours and a position of the depth sensing apparatus (140). Also disclosed are a computer program product for carrying out a method for determining a depth of a target object in an environment and an apparatus (300) for determining a depth of a target object in an environment.

Abstract: A system and a method for monitoring subject's eyes are disclosed. In one embodiment, spectral profiles of a frame substantially around a subject's eye are received from an image capturing device. Further, a state of the subject's eye in the frame is detected using the spectral profiles received from the image capturing device.

Abstract: A method for displaying a three-dimensional (“3D”) image, wherein the method includes; sequentially displaying a left frame image corresponding to a left eye and a right frame image corresponding to a right eye on a display panel, blocking a light provided to a display block of the display panel when the display block displays a mixed image which includes a left eye image of the left frame image corresponding to the left eye and a right eye image of the right frame image corresponding to the right eye, and providing the light to the display block of the display panel when the display block displays only one of the left eye image and the right eye image.

Abstract: A video processor includes: a judgement section configured to judge whether an input is a 2D or 3D image signal; an LR synthesis section configured to embed left and right image signals into an image signal in a side-by-side format to output the signal if the input is the 3D image signal and configured to embed a 2D image signal into a position corresponding to one of the left and right in an image signal in a side-by-side format to output the signal if the input is the 2D image signal; and an image processing section configured to apply image processing to the image signal in the side-by-side format.

Abstract: One variation of a method for dynamically displaying multiple virtual and augmented reality scenes on a single display includes determining a set of global transform parameters from a combination of user-defined inputs, user-measured inputs, and device orientation and position derived from sensor inputs; calculating a projection from a configurable function of the global transform parameters, context provided by the user and context specific to a virtual and augmented reality scene; rendering a virtual and augmented reality scene with the calculated projection on a subframe of the display; and repeating the previous two steps to render additional virtual and augmented reality scenes.

Abstract: System and methods for controlling a user experience are described. In an aspect, an interface can comprise an interface device for rendering content to a user, a sensor having a gesture zone associated therewith configured to detect a dexterous gesture of a user within the gesture zone and generate a sensor signal representing the dexterous gesture. A processor may be provided in communication with the sensor and the interface device, wherein the processor receives the sensor signal, analyzes the sensor signal to determine a control action associated with the detected dexterous gesture of the user, and configures the user interface based upon the determined control action of the user.

Abstract: The present technique relates to an image processing apparatus and an image processing method capable of generating a color image of a display viewpoint using a color image and a depth image of a predetermined viewpoint. The viewpoint generation information generation unit generates viewpoint generation information used to generate a color image of a display viewpoint in accordance with a generation method of the color image of the display viewpoint obtained by performing warping processing using multi-viewpoint corrected color images and multi-viewpoint depth images. The multi-viewpoint image encoding unit encodes the multi-viewpoint corrected color images and the multi-viewpoint depth images, and transmits them with the viewpoint generation information. The present technique can be applied to, for example, a multi-viewpoint image processing apparatus.

Abstract: The absolute position of a target object point is determined using a series of images of the scene with overlapping fields of view captured by a camera in positions arranged in at least two dimensions across the scene and position data representing the absolute positions of the camera on capture of the respective images. The images are analyzed to identify sets of image points corresponding to common object points in the scene. A bundle adjustment is performed on the sets of image points that estimates parameters representing the positions of the object points relative to the positions of the camera associated with each image, but without using input orientation data representing the orientation of the camera. The absolute position of the target object point is derived on the basis of the results of the bundle adjustment and the absolute positions of the camera represented by the position data.

Abstract: A depolarizer, including: a photoalignment layer deposited on the substrate; and a birefringent layer deposited on the photoalignment layer; wherein the photoalignment layer includes a plurality of segments, each segment with a different fast axis orientation and a different pretilt angle, such that each segment of the birefringent layer over the corresponding segment of the photoalignment layer has a different fast axis angle and a different birefringent value.

Abstract: A node device in a distributed virtual environment captures locational signals projected by another node device into a capture area of the node device and reflected from the capture area to a capture device of the node device. The location of the node device relative to the other node device is determined based on the captured locational signals. The determined location can be based on an angular relationship determined between the node device and the other node device based on the captured locational signals. The determined location can also be based on a relative distance determined between the node device and the other node device based on the captured locational signals. Topology of the capture area can also be detected by the node device, and topologies of multiple capture areas can be combined to define one or more surfaces in a virtual environment.

Abstract: An object tracking system has an inertial orientation sensor attached to a camera. The sensor uses a rigid body position and orientation (with or without markers) visible to the camera for determining the orientation and the position of the object in the global reference frame, when the camera is not rigidly fixed. Another orientation sensor is attached to the object in order to keep tracking of its orientation when a valid tracking of the object cannot be obtained from the camera. The data from the orientation sensor attached to the object and the data from the orientation sensor attached to the camera is used to increase the accuracy of the optical tracking of the object.

Abstract: A disparity deriving apparatus for deriving disparity of an object based on a captured reference image of the object and a captured comparison image of the object includes a calculator to calculate costs between a first reference area in the reference image and each one of corresponding areas in the comparison image, and costs between a second reference area and each one of corresponding areas corresponding to the second reference area in the comparison image; a synthesizer to synthesize the costs of the first reference area, and the costs of the second reference area as synthesis costs; a deriving unit to derive a disparity value of the object captured in the first reference area based on the synthesized synthesis cost; and an output unit to output the derived disparity value and a specific cost of the first reference area identified by the derived disparity value.

Abstract: A source of television programming sends the TV programming into a geographic region. The source also sends enhanced programming for transmission. The enhanced signals result in transforming 2D video in the TV programming signals into 3D signals and/or replacing 2D video in the TV programming signals with 3D video. The enhanced programming is tied to the TV programming signals to limit useful display of the enhanced programming to the geographic region.

Abstract: There is provided an image processing method including acquiring an original image and a disparity map, the disparity map indicating distribution of disparity values associated with respective pixels in the original image, causing a processor to decide a dynamic range of disparity on the basis of the acquired original image and the acquired disparity map, and converting the disparity map in a manner that each disparity in the disparity map is distributed within the decided dynamic range of the disparity.

Abstract: An image correction apparatus for correcting distortion of an image, the image being obtained by photographing a subject, which is provided with a specifying unit for specifying a relationship in position between points on the subject in a three-dimensional space based on both a relationship in position between the points on the subject in the image in a two-dimensional space and a photographing angle relative to a surface of the subject, an obtaining unit for obtaining information of distortion of the image that is reflected by the relationship in position between the points on the subject in the three-dimensional space, specified by the specifying unit, and a correcting unit for correcting the distortion of the image based on the information of distortion of the image obtained by the obtaining unit.

Abstract: Disclosed is a display device and a display method. The display device includes: an image processor which is capable of processing a plurality of images comprising a first image and auxiliary images that may be selectively displayed together with the first image; a display which displays the plurality of images thereon by making the auxiliary images visible corresponding to viewing angles; and a controller which controls the plurality of images to comprise at least one of a first auxiliary image, a second auxiliary image that is different from the first auxiliary image and a third auxiliary image that is used to reduce an interference between the first and second auxiliary image.

Abstract: A autostereoscopic display system includes an autostereoscopic display configured to project images representing a left-eye view and a right-eye view of an image, an emitter configured to emit a tracer beam having a directional relationship to that of the projected images, a sensor configured to detect reflections of the tracer beam, and a processing circuit. The processing circuit is configured to control an emission of the tracer beam, receive feedback data from the sensor, use the feedback data to determine an impact site on the viewer corresponding to the tracer beam and adjust a direction of the tracer beam based on the impact site.

Abstract: Disclosed is an object detection method used to detect an object in an image pair corresponding to a current frame. The image pair includes an original image of the current frame and a disparity map of the same current frame. The original image of the current frame includes at least one of a grayscale image and a color image of the current frame. The object detection method comprises steps of obtaining a first detection object detected in the disparity map of the current frame; acquiring an original detection object detected in the original image of the current frame; correcting, based on the original detection object, the first detection object so as to obtain a second detection object; and outputting the second detection object.

Abstract: The present invention relates to a playback device, a playback method, a program, and a recording medium that enable 3D playback in accordance with the capabilities of the playback device. A storage unit 24 stores a one-plane offset capability flag indicating whether or not 3D playback is possible in a one-plane offset mode, which is a mode in which one of two images obtained by shifting an image recorded on a disc 11 in a horizontal direction is output as a left-eye image and the other is output as a right-eye image, and a two-plane capability flag indicating whether or not 3D playback is possible in a two-plane mode, which is a mode in which a left-eye image and a right-eye image that are recorded on the disc are output as they are. A control unit 22 sets a playback mode for 3D playback in accordance with the one-plane offset capability flag and the two-plane capability flag stored in the storage unit 24. The present invention can be applied to, for example, a playback device.

Abstract: A method for clustering images includes acquiring initial image data including a scene of interest. A 3D model is constructed of the scene of interest based on the acquired initial image data. Additional image data including the scene of interest is acquired. The additional image data is fitted to the 3D model. A line-of-sight of the additional image data is estimated based on the fitting to the 3D model. The additional image data is clustered according to the estimated line-of-sight.

Abstract: Visual discomfort from depth jumps in 3D video content is reduced or avoided by detecting the occurrence of a depth jump and by changing the disparity of a group of received image frames including the frames at the depth jump in order to adjust the perceived depth in a smooth transition across the group of image frames from a first disparity value to a second disparity value. Depth jumps may be detected, for instance, when content is switched from one 3D shot to another 3D shot.

Abstract: The present application relates to a device and method for processing digital broadcast signals comprising three-dimensional images. According to one embodiment of the present invention, the digital broadcast signal processing method comprises the steps of: encoding a video stream of a two dimensional reference image; encoding a video stream of an additional image, for generating a binocular-disparity three-dimensional image together with the encoded two dimensional reference image; generating signaling information such that the video stream of the encoded additional image is processed only in a three-dimensional image signal receiver; generating a first broadcast signal comprising the video stream of the encoded reference image; generating a second broadcast signal comprising the video stream of the encoded additional image and the signaling information; and respectively sending the first broadcast signal and the second broadcast signal over different channels.

Abstract: An information processing apparatus comprising first and second display units for respectively displaying first and a second composite images for the two eyes of a user, comprising: a moving unit configured to move positions of the first and second display units; a detecting unit configured to detect moving amounts of the first and second display units; first and second image capturing units configured to respectively obtain first and second captured images; an extracting unit configured to generate first and second extracted images by respectively extracting portions of the first and second captured images in extraction ranges associated with the moving amounts; and a composite image generating unit configured to generate the first and second composite images by respectively compositing first and second CG images with the first and second extracted images.

Abstract: Input can be provided to a computing device based upon relative movement of a user or other object with respect to the device. In some embodiments, infrared radiation is used to determine measurable aspects of the eyes or other of a user. Since the human retina is a retro-reflector for certain wavelengths, using two different wavelengths or two measurement angles can allow user pupils to be quickly located and measured without requiring resource-intensive analysis of full color images captured using ambient light, which can be important for portable, low power, or relatively inexpensive computing devices. Various embodiments provide differing levels of precision and design that can be used with different devices.

Abstract: The present invention relates to a broadcast signal processing method and device for 3D broadcasting service. The broadcast signal processing method according to an embodiment of the present invention includes: encoding 3D video broadcast data that includes left image broadcast data having a left image and right image broadcast data having a right image to provide 3D effects; encoding signaling information for signaling the encoded 3D video broadcast data; generating a broadcast signal including the encoded 3D video broadcast data and the encoded signaling information; and transmitting the generated broadcast signal.

Abstract: Disclosed is a light guiding valve apparatus including an imaging directional backlight, an illuminator array and an observer tracking system arranged to achieve control of an array of illuminators which may provide a directional display to an observer over a wide lateral and longitudinal viewing range, wherein the number of optical windows presented to the observer as viewing windows is controlled dependent on the lateral and longitudinal position or speed of an observer.

Abstract: A three-dimensional (3D) video codec encodes multiple views of a 3D video, each including texture and depth components. The encoders of the codec encode video blocks of their respective views based on a set of prediction parameters, such as quad-tree split flags, prediction modes, partition sizes, motion fields, inter directions, reference indices, luma intra modes, and chroma intra modes. The prediction parameters may be inherited across different views and different ones of the texture and depth components.

Abstract: A method of providing a panoramic image and an imaging device thereof. The method may include: extracting at least one panoramic section, which is to generate a panoramic image, from moving picture data; displaying at least one thumbnail image respectively corresponding to the at least one panoramic section on a display screen; and if one of the at least one thumbnail image is selected, generating a panoramic section corresponding to the selected thumbnail image as a panoramic image. Therefore, even if a user performs capturing without the aim of acquiring a panoramic image at a capturing time, the user can aquire a panoramic image later by using moving picture data.

Abstract: An image processing apparatus and method in which not only a partial image in a stereo image but also an image in a large range of near and far sides can be viewed are provided. First to twelfth viewpoint images are generated so that no disparity occurs in a portion specified as a principal object image. First to third viewpoint images viewed at a left end of viewing positions among the first to twelfth viewpoint images are shifted to set disparity of the object image specified as a sub target point at “0”. The tenth to twelfth viewpoint images viewed at a right end of the viewing positions are shifted to set disparity of the object image specified as a sub target point at “0”. The viewing positions are moved in a horizontal direction, to change an object distance of a stereo view image viewed on a lenticular sheet.

Abstract: A display device is connected in communication with a mobile electronic device. The display control device detects a movement information of a control object in a first two-dimensional space, and the mobile electronic device detects a movement information of the control object in a second two-dimensional space. The display control device works out at a current three-dimensional coordinates of the control object according to the movement information of the control object in the first two-dimensional space, and a movement information of the control object in the second two-dimensional space and the initial three-dimensional coordinates of the control object.

Abstract: An analysis master control can be configured to derive contextual information of visual media that includes extracted information and extrapolated information. The analysis master control can receive the extracted information characterizing visual media from a recognizer. An information finder can be configured to query a plurality of information sources for information based on the extracted information. The analysis master control can also be configured to match information received from the information sources with the extracted information to form the extrapolated information that characterizes the visual media.

Abstract: An image transfer apparatus comprises an input operable to receive a signal comprising two images for different respective non-stereoscopic viewpoints of a virtual environment, a first output operable to transmit a signal comprising the two images formatted as a stereoscopic image to at least a first display, and a transmitter operable to transmit control signals to at least two active shutter glasses, the control signals arranged to allow respective wearers of the glasses to only view a respective one of the two images.

Abstract: An optical imaging apparatus 10 disposing the first and the second reflective components 12, 14 abutting to or in proximity to each other when reflective surfaces 11, 13 of the first and the second reflective components 12, 14 are crossed when viewed from thereabove, the first and the second reflective components 12, 14 composed of the transparent material with a plurality of belt-shaped reflective surfaces 11, 13 vertically disposed in parallel, wherein the first and the second reflective components 12, 14 are formed with a plurality of reflectors 15-18 laminated respectively and the places of the reflective surfaces 11, 13 of each reflector 15-18 of the first and the second reflective components 12, 14 are shifted in parallel. Thus, high definition three-dimensional real image is formed inexpensively in a space a plurality of observers gaze simultaneously.

Abstract: A representation of a user can move with respect to a graphical user interface based on input of a user. The graphical user interface comprises a central region and interaction elements disposed outside of the central region. The interaction elements are not shown until the representation of the user is aligned with the central region. A gesture of the user is recognized, and, based on the recognized gesture, the display of the graphical user interface is altered and an application control is outputted.

Abstract: In an image processing apparatus, images that can be comfortably viewed by a viewer with less eyestrain can be displayed on a display device. In the image processing apparatus in which a three-dimensional image and a two-dimensional image can be simultaneously displayed on a multi-screen, if the three-dimensional image and the two-dimensional image are simultaneously displayed on a display device, the three-dimensional image is converted into two dimensions, and is output to be displayed on the same screen in the same dimensions. Alternatively, in the image processing apparatus in which a three-dimensional image and a two-dimensional image can be simultaneously displayed on a multi-screen, if the three-dimensional image and the two-dimensional image are simultaneously displayed on a display device, the two-dimensional image is converted into three dimensions, and is output to be displayed on the same screen in the same dimensions.

Abstract: An object of the present invention is to provide an image processing device and the like that can generate a composite image in a desired focusing condition. In a smartphone 1, an edge detecting section 107 detects an edge as a feature from a plurality of input images taken with different focusing distances, and detects the intensity of the edge as a feature value. A depth estimating section 111 then estimates the depth of a target pixel, which is information representing which of the plurality of input images is in focus at the target pixel, by using the edge intensity detected by the edge detecting section 107. A depth map generating section 113 then generates a depth map based on the estimation results by the depth estimating section 111.

Abstract: According to one aspect of the teachings presented herein, a projective volume monitoring apparatus is configured to detect objects intruding into a monitoring zone. The projective volume monitoring apparatus is configured to detect the intrusion of objects of a minimum object size relative to a protection boundary, based on an advantageous processing technique that represents range pixels obtained from stereo correlation processing in spherical coordinates and maps those range pixels to a two-dimensional histogram that is defined over the projective coordinate space associated with capturing the stereo images used in correlation processing. The histogram quantizes the horizontal and vertical solid angle ranges of the projective coordinate space into a grid of cells. The apparatus flags range pixels that are within the protection boundary and accumulates them into corresponding cells of the histogram, and then performs clustering on the histogram cells to detect object intrusions.

Abstract: The present invention relates to a method for using interlaced video signal of a base layer in interlayer texture prediction. The present method separates interaced video signal of a base layer into even-field and odd-field components, interpolates the even-field and the odd-field components respectively in vertical and/or horizontal direction, and constructs a combined video data by interleaving the interpolated even-field and odd-field components.

Abstract: An image synchronization method for a three-dimensional (3D) display apparatus is provided. The method includes steps of: receiving a plurality of first-eye image frames and a plurality of second-eye image frames; selecting a first image frame from the first-eye image frames according to a system time; selecting a second image frame from the second-eye image frames according to a timestamp of the first image frame; and outputting the first image frame and the second image frame.

Abstract: A stereoscopic measurement system captures stereo images and determines measurement information for user-designated points within stereo images. The system comprises an image capture device for capturing stereo images of an object. A processing system communicates with the capture device to receive stereo images. The processing system displays the stereo images and allows a user to select one or more points within the stereo image. The processing system processes the designated points within the stereo images to determine measurement information for the designated points.

Abstract: Techniques are described for modal sub-bitstream extraction. For example, a network entity may select a sub-bitstream extraction mode from a plurality of sub-bitstream extraction modes. Each sub-bitstream extraction mode may define a particular manner in which to extract coded pictures from views or layers to allow a video decoder to decode target output views or layers for display. In this manner, the network entity may adaptively select the appropriate sub-bitstream extraction technique, rather than a rigid, fixed sub-bitstream extraction technique.

Abstract: A method for performing point-to-point measurements includes (i) determining a distance to a first point and obtaining an image at a first pose, and (ii) determining a distance to a second point and obtaining an image at a second pose. The images have an overlapping portion. A change in pose between the first pose and the second pose is determined using observed changes between common features in the overlapping portion of the images and a scale associated with the images. A distance between the first point and the second point is determined based on the first distance, the second distance, and the change in pose between the first pose and the second pose.

Abstract: A high resolution 3D Image may be encoded into a reduced resolution image in a base layer and a full resolution unfiltered image in one or more enhancement layers. Encoded asymmetric-resolution image data for the 3D image may be distributed to a wide variety of devices for 3D image processing and rendering. A recipient device may reconstruct the reduced resolution image and the full resolution unfiltered image for 3D image rendering with high subjective perceptual quality due to interocular masking. Full resolution unfiltered images may be alternating between left and right eyes.

Abstract: Disclosed herein are transparent color displays with nanoparticles made with nonlinear materials and/or designed to exhibit optical resonances. These nanoparticles are embedded in or hosted on a transparent substrate, such as a flexible piece of clear plastic or acrylic. Illuminating the nanoparticles with invisible light (e.g., infrared or ultraviolet light) causes them to emit visible light. For example, a rare-earth doped nanoparticle may emit visible light when illuminated simultaneoulsy with a first infrared beam at a first wavelength ?1 and a second infrared beam at a second wavelength ?2. And a frequency-doubling nanoparticle may emit visible light when illuminated with a single infrared beam at the nanoparticle's resonant frequency. Selectively addressing these nanoparticles with appropiately selected pump beams yields visible light emitted from the nanoparticles hosted by the transparent substrate in a desired pattern.

Abstract: After AE/AF/AWB operation, a subject distance is calculated for each pixel, and a histogram which shows the distance distribution is created based thereon. The class with the highest frequency which is the peak at the side nearer than the focus distance is searched based on the histogram and a rectangular area Ln which includes pixels which have a subject distance within the searched range is set. The average parallax amount Pn which is included in the rectangular area Ln is calculated and it is confirmed whether Pn is within a range of parallax amounts a and a?t1. In a case where Pn is not within a range of parallax amounts a and a?t1 which is set in advance, the aperture value is adjusted such that Pn is within the range of the parallax amounts a and a?t1.