Abstract: Systems and methods are provided for implementing inter-coded resolution-adaptive video coding supported by resizing motion information of a current frame during motion prediction, reducing extensive computational costs and computing time that would be incurred as a result of extensive application of interpolation filters to generate picture information of a reference frame to sub-pixel granularity, and thus reducing computational cost and computing time of decoding as a whole.

Abstract: Reconstructing a second component signal relating to a second component of a multi-component picture from a spatially corresponding portion of a reconstructed first component signal and a correction signal derived from a data stream for the second component promises increased coding efficiency over a broader range of multi-component picture content. By including the spatially corresponding portion of the reconstructed first component signal into the reconstruction of the second component signal, any remaining inter-component redundancies/correlations present such as still present despite a possibly a priori performed component space transformation, or present because of having been introduced by such a priori performed component space transformation, for example, may readily be removed by way of the inter-component redundancy/correlation reduction of the second component signal.

Abstract: The present disclosure relates to method and apparatus for the estimation of an accurate multiplane image from a set of posed images. The accuracy of an MPI representation is measured by the performance of the views generated by it through inverse homography sampling and alpha compositing. A variable number of posed images at a possibly different resolution representative of scenes with arbitrary geometry are used as input of the system. A first level of three modules, possibly trained based on deep learning methods, is built for extracting view and scene features and color scores. Numerous levels of the same three modules may be built and organized in a structure where a level deals with down-scaled version of the posed images.

Abstract: The present disclosure provides methods, systems, and devices for coregistering imaging data to form three-dimensional superimposed images of a biological target such as a wound, a tumor, or a surgical bed. A three-dimensional map can be generated by projecting infrared radiation at a target area, receiving reflected infrared radiation, and measuring depth of the target area. A three-dimensional white light image can be created from a captured two-dimensional white light image and the three-dimensional map. A three-dimensional fluorescence image can be created from a captured two-dimensional fluorescence image and the three-dimensional map. The three-dimensional white light image and the three-dimensional fluorescence image can be aligned using one or more fiducial markers to form a three-dimensional superimposed image. The superimposed image can be used to track wound healing and to excise cancerous tissues, for example, breast tumors. Images can be in the form of videos.

Abstract: An encoder, decoder, encoding method and decoding method for 3DoF+ video are disclosed. The encoding method comprises receiving (110) multi-view image or video data comprising a basic view and at least a first additional view of a scene. The method proceeds by identifying (220) pixels in the first additional view that need to be encoded because they contain scene-content that is not visible in the basic view. The first additional view is divided (230) into a plurality of first blocks of pixels. First blocks containing at least one of the identified pixels are retained (240); and first blocks that contain none of the identified pixels are discarded. The retained blocks are rearranged (250) so that they are contiguous in at least one dimension. A packed additional view is generated (260) from the rearranged first retained blocks and encoded (264).

Abstract: A technique for geospatial tracking includes receiving live video from a first source, rendering a map that encompasses a geographical region imaged by the live video, and displaying the map along with the live video, thereby enabling a human user or computer to associate objects in the video with geographical features on the map. The technique further includes receiving geotagged content from a second source and displaying a representation of the geotagged content along with the video and the map.

Abstract: An image processing system configured to receive an input time-of-flight depth map representing the distance of objects in an image from a camera at a plurality of locations of pixels in the respective image, and in dependence on that map to generate an improved time-of-flight depth map for the image, the input time-of-flight depth map having been generated from at least one correlation image representing the overlap between emitted and reflected light signals at the plurality of locations of pixels at a given phase shift, the system being configured to generate the improved time-of-flight depth map from the input time-of-flight depth map in dependence on a colour representation of the respective image and at least one correlation image.

Abstract: Systems and methods for inserting supplemental content into presentations of two-dimensional video content are disclosed. Exemplary implementations may: obtain two-dimensional video content depicting a three-dimensional space; obtain supplemental content; obtain a model of the three-dimensional space defining the one or more visible physical features within the three-dimensional space; determine the camera position of the two-dimensional video content; identify a presentation location within the two-dimensional video content; determine integration information; modify the two-dimensional video content to include the supplemental content at the identified presentation locations in accordance with the integration information and/or perform other operations.

Abstract: The present application provides a method for game object control in a game map, a mobile terminal and a computer readable storage medium. The method for game object control includes: constructing a game map; creating a random path in each map layer to connect the map units within each map layer; configuring an attribute threshold value for the each map layer, wherein an attribute threshold value of a subsequent map layer is greater than or equal to an attribute threshold value of a preceding map layer; controlling a game object to move along any map unit connected on the random path from the map starting point to the jump unit in any map layer, and granting the game object an attribute bonus with an attribute point when the game object falls into the any map unit; and freely adding the attribute bonus for the game object to improve an attribute, wherein a sum of the attribute point of the attribute bonus added is less than or equal to an attribute threshold value for a current map layer.

Abstract: Provided are an image sensor with one or more image receivers for image combining, and an imaging system and method therefor. The image sensor includes an image sensor array to generate first image data for a first image; a receiver to receive, into the image sensor, second image data for a second image; an image combination circuit coupled to the image sensor array and the receiver to receive the first image data and the second image data and combine the first image data and the second image data into combined image data for a single combined image, according to one or more image combination criteria, and at least one of the first image data and the second image data; and a transmitter coupled to the image combination circuit to transmit the combined image data for the combined image from the image sensor.

Abstract: Examples of video encoding methods and apparatus and video decoding methods and apparatus are described. An example method of video processing includes performing a conversion between a video and a bitstream of the video, wherein the bitstream comprises one or more supplemental enhancement information, SEI, network abstraction layer (NAL) units according to a rule, wherein the rule specifies that, responsive to an SEI NAL unit including a non-scalable-nested SEI message of a first payload type, the SEI NAL unit is disallowed to include another SEI message of a second payload type.

Abstract: The present disclosure relates to a method for a smooth screen switch between image cloud streaming (ICS) of receiving a screen in an image mode and video cloud streaming (VCS) of receiving a screen in a video mode in a cloud streaming service.

Abstract: In accordance with a first aspect, the intra prediction direction of a neighboring, intra-predicted block is used in order to predict the extension direction of the wedgelet separation line of a current block, thereby reducing the side information rate necessitated in order to convey the partitioning information. In accordance with a second aspect, the idea is that previously reconstructed samples, i.e. reconstructed values of blocks preceding the current block in accordance with the coding/decoding order allow for at least a prediction of a correct placement of a starting point of the wedgelet separation line, namely by placing the starting point of the wedgelet separation line at a position of a maximum change between consecutive ones of a sequence of reconstructed values of samples of a line of samples extending adjacent to the current block along a circumference thereof. Both aspects may be used individually or in combination.

Abstract: The present invention relates to a display device comprising: a communication unit for communicating with a cloud server; an interface unit for obtaining an image of the periphery of a vehicle by means of a camera, and receiving sensing information collected from at least one sensor; an MR module for rendering MR information, comprising a virtual object, on the basis of the sensing information and map information received from the cloud server; and a processor extracting an image, corresponding to a lateral surface of a building around the vehicle, from the obtained image, generating a texture image corresponding to the lateral surface of the building from the extracted image and transmitting same to the cloud server, receiving, from the cloud server, map information comprising models of buildings to which building textures on the basis of texture images are mapped, and displaying MR information rendered on the basis of the map information on a display provided in the vehicle.

Abstract: An encoding device evaluates a plurality of processing and/or post-processing algorithms and/or methods to be applied to a video stream, and signals a selected method, algorithm, class or category of methods/algorithms either in an encoded bitstream or as side information related to the encoded bitstream. A decoding device or post-processor utilizes the signaled algorithm or selects an algorithm/method based on the signaled method or algorithm. The selection is based, for example, on availability of the algorithm/method at the decoder/post-processor and/or cost of implementation. The video stream may comprise, for example, downsampled multiplexed stereoscopic images and the selected algorithm may include any of upconversion and/or error correction techniques that contribute to a restoration of the downsampled images.

Abstract: An encoding device evaluates a plurality of processing and/or post-processing algorithms and/or methods to be applied to a video stream, and signals a selected method, algorithm, class or category of methods/algorithms either in an encoded bitstream or as side information related to the encoded bitstream. A decoding device or post-processor utilizes the signaled algorithm or selects an algorithm/method based on the signaled method or algorithm. The selection is based, for example, on availability of the algorithm/method at the decoder/post-processor and/or cost of implementation. The video stream may comprise, for example, downsampled multiplexed stereoscopic images and the selected algorithm may include any of upconversion and/or error correction techniques that contribute to a restoration of the downsampled images.

Abstract: There is included a method and apparatus comprising computer code configured to cause a processor or processors to perform parsing at least one video parameter set comprising at least one syntax element indicating whether at least one layer in the scalable bitstream is one of a dependent layer of the scalable bitstream and an independent layer of the scalable bitstream, determining a number of dependent layers, including the dependent layer, of the scalable bitstream based on a plurality of flags included in the VPS, decoding a picture in the dependent layer by parsing and interpreting an inter-layer reference picture list, and decoding a picture in an independent layer without parsing and interpreting the inter-layer reference picture list.

Abstract: Systems and methods are provided for implementing inter-coded resolution-adaptive video coding supported by resizing motion information of a current frame during motion prediction, reducing extensive computational costs and computing time that would be incurred as a result of extensive application of interpolation filters to generate picture information of a reference frame to sub-pixel granularity, and thus reducing computational cost and computing time of decoding as a whole.

Abstract: An optical sensor comprises foreoptics configured to receive an image signal, an image optic operable to focus the image signal, at least one focal plane array (FPA) configured to detect the image signal, and a jitter stabilization system. The jitter stabilization system can comprise a transmitter configured to transmit a jitter source signal to the foreoptics and a position sensor configured to receive a jitter return signal. The position sensor can be positioned at a shared focus with the at least one FPA. The optical sensor further comprises a diffraction grating operable to reflect and diffract at least a portion of the jitter source signal. The jitter return signal received at the position sensor comprises at least a portion of the reflected and diffracted jitter source signal.

Abstract: An image is divided into rectangular regions each including at least one block row, and the image is divided into rectangular slices or slices to be processed in raster order. In a case where the image is divided into the rectangular slices, based on first information for specifying a rectangular region to be processed first and second information for specifying a rectangular region to be processed last, the rectangular regions in the rectangular slice is specified. Based on the number of blocks in a vertical direction in each of the specified rectangular regions, the number of pieces of information for specifying a start position of coded data of the block row in the rectangular slice is specified. A bitstream in which at least the pieces of information, the first and second information, and the coded data are multiplexed is generated.

Abstract: An encoding device evaluates a plurality of processing and/or post-processing algorithms and/or methods to be applied to a video stream, and signals a selected method, algorithm, class or category of methods/algorithms either in an encoded bitstream or as side information related to the encoded bitstream. A decoding device or post-processor utilizes the signaled algorithm or selects an algorithm/method based on the signaled method or algorithm. The selection is based, for example, on availability of the algorithm/method at the decoder/post-processor and/or cost of implementation. The video stream may comprise, for example, downsampled multiplexed stereoscopic images and the selected algorithm may include any of upconversion and/or error correction techniques that contribute to a restoration of the downsampled images.

Abstract: In some examples, a system detects an accident involving a first vehicle, where the detecting is based on an accident indication received by the service over a network from a second vehicle not involved in the accident, the second vehicle different from the first vehicle, and where the accident indication from the second vehicle is responsive to messages received by the second vehicle from other vehicles. In response to the detecting of the accident, the system verifies that the accident occurred by sending, from the service, queries to a roadside unit and a third vehicle, and receiving, at the service, responses to the queries from the roadside unit and the third vehicle, the responses containing event data collected by the roadside unit and the third vehicle of events in a vicinity of the accident.

Abstract: A method includes encoding a first message including first parameters for a first color transform that transforms a video signal into a first color-mapped video signal; encoding a second message including second parameters for a second color transform that transforms the video signal into a second color-mapped video signal; and encoding the video signal, the first message, and the second message in a video bitstream. A method includes decoding the video bitstream into the video signal, the first message including the first parameters, and the second message including the second parameters, and performing at least one of the following: displaying the video signal; transforming the video signal into the first color-mapped video signal by applying the first color transform and displaying the first color-mapped video signal; and transforming the video signal into the second color-mapped video signal by applying the second color transform and displaying the second color-mapped video signal.

Abstract: A method includes causing background content to be displayed on a display device with a first virtual object and a second virtual object; causing augmented reality (AR) content to be rendered based on a location of an AR device relative to the display device; determining that the AR content is in front of the first virtual object in the scene when viewed through the AR device and rendering the background content with a cutout in the first virtual object when the first virtual object overlaps with the AR content; and determining that the AR content is behind the second virtual object in the scene when viewed through the AR device and rendering the AR content with a cutout in the AR content when the AR content overlaps with the second virtual object.

Abstract: The invention advances the ratio method of phosphor thermography using two machine vision cameras for full-field temperature measurements of a solid surface. As an example, algorithms from digital image correlation (DIC) can be used to determine the stereoscopic imaging system intrinsic and extrinsic parameters, and accurately register material points on the sample to subpixel locations in each image with 0.07 px or better accuracy. A phosphor calibration sample fabricated using aerosol deposition can be used for in situ determination of the temperature-versus-intensity ratio relationship. The full calibration methodology and several improvements on two-color phosphor thermography open the door for full-field temperature measurements in dynamic tests with deforming test specimens.

Abstract: The present invention provides a generation method for a 3D asteroid dynamic map and a portable terminal. The method comprises: obtaining a panorama image; identifying the panorama image and segmenting into a sky region, a human body region, and a ground region; calculating a panoramic depth map for the sky region, the human body region, and the ground region; respectively transforming the panorama image and the panoramic depth map to generate an asteroid image and an asteroid depth map; generating an asteroid view under a virtual viewpoint; and rendering to generate a 3D asteroid dynamic map. By automatically generating the asteroid view under the virtual viewpoint, and synthesizing and rendering same, the technical solution of the present invention generates the asteroid dynamic map having a 3D effect from the panorama image.

Abstract: A pixel-level object detection system that detects an object at a pixel level, includes: an imaging unit that acquires an inference image that is an image that captures a detection target; an area detection unit that detects an area including a detection target from the inference image; a detail detection unit that detects the detection target using only local information from the inference image; and a result integration processing unit that integrates an output of the area detection unit with an output of the detail detection unit to output a segmentation map indicating, as a probability map, which pixel in the image corresponds to the detection object.

Abstract: An image processing method includes displaying a first screen on a display surface, the first screen including at least a part of a drawing area in which at least one object image drawn by a user is arranged, excluding an area in which at least a part of an object image included in the first screen is arranged from the drawing area when an operation of erasing the at least a part of the object is received, and displaying a reduced screen on the display surface when an operation is received, the reduced screen being obtained by reducing a whole of the drawing area into a size of the display surface.

Abstract: A method and apparatus for a low complexity transform unit partitioning structure for High Efficiency Video Coding (HEVC). The method includes determining prediction unit size of a coding unit, and setting the size of transform unit size of Y, U and V according to the prediction unit size of the coding unit.

Abstract: This disclosure provides methods, devices, and systems for video coding. The present implementations more specifically relate to hybrid coding techniques that combine aspects of inter-frame coding with aspects of intra-frame coding. In some aspects, a video encoder may perform inter-frame coding in a weighted manner so that the coded video frames (also referred to as “residual frames”) may include contributions from the current video frame to be transmitted over a communication channel and also may include contributions from the previous video frame transmitted over the communication channel. More specifically, any pixel value (r(n)) in the residual frame can be expressed as a weighted combination of a respective pixel value (x(n)) in the current video frame and a co-located pixel value (x(n?1)) in the previous video frame, where r(n)=x(n)??·x(n?1) and where 0???1 is a scaling factor representing the degree of contribution by the previous video frame.

Abstract: A system and methods for a CODEC driving a real-time light field display for multi-dimensional video streaming, interactive gaming and other light field display applications is provided applying a layered scene decomposition strategy. Multi-dimensional scene data is divided into a plurality of data layers of increasing depths as the distance between a given layer and the plane of the display increases. Data layers are sampled using a plenoptic sampling scheme and rendered using hybrid rendering, such as perspective and oblique rendering, to encode light fields corresponding to each data layer. The resulting compressed, (layered) core representation of the multi-dimensional scene data is produced at predictable rates, reconstructed and merged at the light field display in real-time by applying view synthesis protocols, including edge adaptive interpolation, to reconstruct pixel arrays in stages (e.g. columns then rows) from reference elemental images.

Abstract: A method of video processing includes performing a conversion between a video including a picture and a bitstream of the video, wherein the bitstream conforms to a format rule, wherein the format rule specifies that an indication of whether a first flag is signalled at a beginning of a picture header associated with the picture, wherein the first flag is indicative of whether the picture is an intra random access point (IRAP) picture or a gradual decoding refresh (GDR) picture.

Abstract: Provided are a depth image processing method, a depth image processing apparatus, an electronic device and a readable storage medium. The method includes: (101) obtaining consecutive n depth image frames; (102) determining a trusted pixel and determining a smoothing factor corresponding to the trusted pixel; (103) determining a time similarity weight; (104) determining a content similarity; (105) determining a content similarity weight based on the content similarity and the smoothing factor; and (106) performing filtering processing on a depth value of the trusted pixel based on all time similarity weights and all content similarity weights.

Abstract: A method and apparatus for encoding a video stream using video point cloud coding, the decoding including obtaining an input point cloud; dividing the input point cloud into a plurality of chunks, including a first chunk including a first plurality of points and a second chunk including a second plurality of points; generating a first plurality of patches based on the first plurality of points; generating a second plurality of patches based on the second plurality of points; packing the first plurality of patches and the second plurality of patches into an image; and generating the video stream based on the image.

Abstract: Video coding tools can be controlled by including syntax in a video bitstream that makes better use of video decoding resources. An encoder inserts syntax into a video bitstream to enable a decoder to parse the bitstream and easily control which tools combinations are enabled, which combinations are not permitted, and which tools are activated for various components in a multiple component bitstream, leading to potential parallelization of bitstream decoding.

Abstract: A method of decoding a coded video bitstream is provided. The method includes parsing a slice header of a current slice represented in the coded video bitstream. The slice header includes a reference picture list structure. The method also includes deriving, based on the reference picture list structure, a reference picture list of the current slice; and obtaining, based on the reference picture list, at least one reconstructed block of the current slice.

Abstract: An image signal processor includes a register and a disparity correction unit. The register stores disparity data obtained from a pattern image data that an image senor generates, and the image sensor includes a plurality of pixels, and each of the pixel includes at least a first photoelectric conversion element and a second photoelectric conversion element. The image sensor generates the pattern image data in response to a pattern image located at a first distance from the image sensor. The disparity correction unit corrects a disparity distortion of an image data based on the disparity data to generate a result image data, and the image senor generates the image data by capturing an object.

Abstract: Disclosed here is a method of generating a dental recommendation based on image processing. Further, the method may include receiving at least one patient data comprising at least one image from at least one patient device. Further, the method may include retrieving at least one dental dataset. Further, the method may include analyzing the at least one patient data and the at least one dental dataset. Further, the method may include generating at least one landmark based on the analyzing. Further, the method may include retrieving at least one dental reference dataset. Further, the method may include processing the at least one landmark and the at least one dental reference dataset, determining at least one dental recommendation based on the processing, transmitting the at least one dental recommendation to at least one external device and storing the at least one dental recommendation.

Abstract: At least one embodiment relates to a method for padding a first depth image representative of depth values of nearer points of a point cloud frame and a second depth image representative of depth values of farther points of a point cloud frame. The method also comprises encoding a video stream including a time-interleaving of said encoded first and second images. There is also provided a method comprising decoding a video stream to provide a first depth image representative of depth values of nearer points of a point cloud frame and a second depth image representative of depth values of farther points of a point cloud frame; and filtering pixel values of the second depth image by using pixel values of the first depth image.

Abstract: During operation of a machine, an understanding of terrain features is critical. Accordingly, disclosed embodiments augment a video stream, captured by a camera mounted on the machine, with terrain information. In particular, an overlay is generated on at least one image frame. The overlay, which may comprise one or more semi-transparent bands, may cyclically recede from a foreground to a background of the image frame(s), cyclically advance from a background to a foreground of the image frame(s), or cyclically move horizontally across the image frame(s). The overlay may be colorized to illustrate the height of the terrain underneath the overlay.

Abstract: Various methods are provided for generating motion vectors in the context of 3D computer-generated images. An example method includes generating, for each pixel of one or more objects to be rendered in a current frame, a 1-phase motion vector (MV1) and a 0-phase motion vector (MV0), each MV1 and MV0 having an associated depth value, to thereby form an MV1 texture and an MV0 texture; converting the MV1 texture to a set of MV1 blocks and converting the MV0 texture to a set of MV0 blocks; and outputting the set of MV1 blocks and the set of MV0 blocks for image processing.

Abstract: Aspects of the disclosure provide a method, an apparatus, and non-transitory computer-readable storage medium for video decoding. The apparatus includes processing circuitry that is configured to decode a current picture based on a bitstream. The processing circuitry can determine, from a supplemental enhancement information (SEI) message, a first flag indicating whether a warping process is applied to the current decoded picture. Based on the first flag indicating that the warping process is applied to the current decoded picture, the processing circuitry can determine warping information of the warping process based on the SEI message. The processing circuitry can determine a warped picture from the current decoded picture based on the warping information.

Abstract: An apparatus to facilitate real-time playback of point cloud sequence data is disclosed. The apparatus comprises one or more processors to receive point cloud data of a captured scene, decompose the point cloud data into a plurality of point cloud patches, wherein each point cloud patch is associated with an object in the scene and includes contextual information regarding the point cloud patch, encode each of the point cloud patches via a deep-learning based algorithm to generate encoded point cloud patches, receive a viewpoint selection from a client, assign a priority to data chunks within each encoded point cloud patch based on the viewpoint selection and the contextual information and transmit the data chunks to the client based on the assigned priority.

Abstract: Aspects of the disclosure provide a method and an apparatus for video encoding. The apparatus includes processing circuitry configured to generate an initial feature representation from an input image to be encoded and perform an iterative update of values of a plurality of elements in the initial feature representation. The iterative update includes generate a coded representation corresponding to a final feature representation based on the final feature representation that has been updated from the initial feature representation by a number of iterations of the iterative update. A reconstructed image corresponding to the final feature representation is generated based on the coded representation. An encoded image corresponding to the final feature representation having updated values of the plurality of elements is generated. One of (i) a rate-distortion loss corresponding to the final feature representation or (ii) the number of iterations of the iterative update satisfies a pre-determined condition.

Abstract: Several techniques for video encoding and video decoding are described. An example method of processing video data includes performing a conversion between a video including one or more subpictures and a bitstream of the video according to a format rule, wherein the format rule specifies that a first syntax element in a scalable nesting supplemental enhancement information message in the bitstream is set to a particular value in response to the scalable nesting supplemental enhancement information message including one or more subpicture level information supplemental enhancement information messages, and wherein the particular value of the first syntax element indicates that the scalable nesting supplemental enhancement information message includes one or more scalable-nested supplemental enhancement information messages that apply to a specific output video layer set.

Abstract: A method of decoding an image can includes constructing an advanced motion vector predication (AMVP) candidate list using available motion vector candidates of a left motion vector candidate, an above motion vector candidate and a temporal motion vector candidate; selecting a motion vector predictor among motion vector candidates of the AMVP candidates list using an AMVP index, and generating a motion vector using the motion vector predictor and a differential motion vector, generating a prediction block using the motion vector and a reference picture index; inversely quantizing a quantized block using a quantization parameter to generate a transformed block and inversely transforming the transformed block to generate a residual block; and generating a reconstructed block using the prediction block and the residual block, in which the quantization parameter is generated per quantization unit, and a minimum size of the quantization unit is adjusted per picture.

Abstract: To enhance a mono-output-only controller such as a mobile OS to support selective mono/stereo/mixed output, a stereo controller is instantiated in communication with the mono controller. The stereo controller coordinates stereo output, but calls and adapts functions already present in the mono controller for creating surface and image buffers, rendering, compositing, and/or merging. For content designated for 2D display, left and right surfaces are rendered from a mono perspective; for content designated for 3D display, left and right surfaces are rendered from left and right stereo perspectives, respectively. Some, all, or none of available content may be delivered to a stereo display in 3D, with a remainder delivered in 2D, and with comparable content still delivered in 2D to the mono display. The stereo controller is an add-on; the mono controller need not be replaced, removed, deactivated, or modified, facilitating transparency and backward compatibility.

Abstract: The present disclosure relates to providing a computer-generated reality (CGR) platform for generating CGR environments including virtual and augmented reality environments. In some embodiments, information related to an object to be simulated and rendered in the CGR environment is provided to the CGR platform, and a three-dimensional representation of the object is displayed in the CGR environment.

Abstract: To enhance a mono-output-only controller such as a mobile OS to support selective mono/stereo/mixed output, a stereo controller is instantiated in communication with the mono controller. The stereo controller coordinates stereo output, but calls and adapts functions already present in the mono controller for creating surface and image buffers, rendering, compositing, and/or merging. For content designated for 2D display, left and right surfaces are rendered from a mono perspective; for content designated for 3D display, left and right surfaces are rendered from left and right stereo perspectives, respectively. Some, all, or none of available content may be delivered to a stereo display in 3D, with a remainder delivered in 2D, and with comparable content still delivered in 2D to the mono display. The stereo controller is an add-on; the mono controller need not be replaced, removed, deactivated, or modified, facilitating transparency and backward compatibility.

Abstract: According to some embodiments, an imaging processing method for extracting a plurality of planar surfaces from a depth map includes computing a depth change indication map (DCI) from a depth map in accordance with a smoothness threshold. The imaging processing method further includes recursively extracting a plurality of planar region from the depth map, wherein the size of each planar region is dynamically adjusted according to the DCI. The imaging processing method further includes clustering the extracted planar regions into a plurality of groups in accordance with a distance function; and growing each group to generate pixel-wise segmentation results and inlier points statistics simultaneously.