Abstract: In a 3D imaging method using scanning-type coherent diffraction, a 2D photodetector detects diffraction of a coherent beam emitted from a light source that moves in a scanning manner toward a sample object to obtain multiple 2D diffraction data distributions; and a processor converts the 2D diffraction data distributions into multiple 3D intensity distributions in a reciprocal space, performs one or more iterations based on a sample function, a light source function and the 3D intensity distributions to obtain a phase-retrieval sample function, and generates a 3D reconstruction image of the sample object based on the phase-retrieval sample function.

Abstract: A method and system for aligning exposure center points of multiple cameras in a VR system are provided. The method includes: acquiring image data of a first type frame according to a preset frame rate; adjusting VTS data of the first type frame, the VTS data changing with the change of the exposure parameters so as to fix a time interval between an exposure center point of the first type frame and an FSIN synchronization signal in a VR system; acquiring image data of a second type frame according to the preset frame rate; and adjusting VTS data of the second type frame according to the VTS data of the first type frame, and fixing a time interval between an exposure center point of the second type frame and the FSIN synchronization signal so as to complete the alignment of exposure center points of the cameras.

Abstract: A method and apparatus for encoding a video stream using video point cloud coding, the decoding including obtaining an input point cloud; dividing the input point cloud into a plurality of chunks, including a first chunk including a first plurality of points and a second chunk including a second plurality of points; generating a first plurality of patches based on the first plurality of points; generating a second plurality of patches based on the second plurality of points; packing the first plurality of patches and the second plurality of patches into an image; and generating the video stream based on the image.

Abstract: A method of selecting a reference sample used to encode a current block in an encoded video bitstream using at least one processor includes determining that a constrained intra prediction (CIP) mode is enabled; determining that a neighboring sample of the current block belongs to a coding block that is coded using intra block copy (IBC) coding; based on the determining that the neighboring sample belongs to the coding block that is coded using the IBC coding, selecting the neighboring sample as the reference sample; and encoding the current block using intra prediction coding based on the reference sample.

Abstract: A picture coding device includes: a block vector candidate derivation unit that derives block vector candidates of a target block in a target picture from coding information stored in coding information storage memory; a selector that selects a selected block vector from the block vector candidates; and a reference position correction unit that performs a correction regarding a reference block to be referred to by the selected block vector so that a reference position of the reference block is to be corrected to refer to an inside of a referenceable region, in which a decoded sample in the target picture is acquired from decoded picture memory as a prediction value of the target block based on the reference position of the reference block.

Abstract: An apparatus for video decoding, includes processing circuitry configured to determine an affine model for a current block coded with an interweaved affine mode. Based on the affine model, a first prediction block corresponding to a first pattern for partitioning the current block into first sub-blocks and a second prediction block corresponding to a second pattern for partitioning the current block into second sub-blocks can be generated. The first and second prediction blocks include interpolated samples having an intermediate bit-depth larger than an input bit-depth of the current block. Co-located first and samples in the first and second prediction blocks with a precision corresponding to the intermediate bit-depth are weighted averaged to obtain averaged samples. The averaged samples are rounded to the input bit-depth to obtain corresponding third samples in a final prediction block of the current block.

Abstract: A method for generating content includes receiving information regarding electronic devices respectively capturing content associated with an event. The method also includes identifying, based on the received information, one or more parameters for the electronic devices to use in capturing the content, the one or more parameters identified to assist in generating multi-view content for the event from the captured content. The method further includes identifying, based on the received information, a common resolution for the electronic devices to use in capturing the content. Additionally, the method includes identifying, based on the received information, a common frame rate for the electronic devices to use in capturing the content. The method also includes sending information indicating the one or more parameters, the common resolution, and the common frame rate to the electronic devices.

Abstract: An inventive device includes a multi-aperture imaging device having an image sensor; an array of adjacently arranged optical channels, each optical channel including optics for projecting at least one partial field of view of a total field of view on an image sensor area of the image sensor, a beam deflector for deflecting a beam path of the optical channels, and focusing means for setting a focal position of the multi-aperture imaging device.

Abstract: An endoscope includes a first subassembly, a second subassembly, a third subassembly, and a fourth subassembly, which are sequentially assembled and tested in making the endoscope. The first subassembly includes a pressure-sealed electrical cable connected to an image capture unit. The second subassembly includes the first subassembly, a shell, a light pipe, and a lid. The third subassembly includes the second subassembly, a central tube, and a flange. The fourth subassembly includes the third subassembly, a base, a shaft, and optionally an articulating assembly.

Abstract: Eyewear including a sensor integrated into frame of eyewear. In one example, the sensor comprises a strain gauge, such as a metallic foil gauge, that is configured to sense and measure distortion of the frame when worn by a user and under different force profiles, by measuring a strain in the frame when bent. The measured strain by strain gauge is sensed by a processor, and the processor performs dynamic calibration of image processing based on the measured strain. The distortion measured by the strain gauge is used by the processor to correct calibration of the cameras, and the displays.

Abstract: A display apparatus and a controlling method thereof are provided. The display apparatus includes a display comprising a first display panel, a lens array disposed on the first display panel, and a second display panel disposed on the lens array; and a processor to, based on a plurality of light field (LF) images, obtain a left (L) image and a right (R) image to drive the display by time-multiplexing, correct a second L image to drive the second display panel among the L images based on a first R image to drive the first display panel among the R images, and correct a second R image to drive the second display panel among the R images based on the first L image to drive the first display panel among the L images, and display a stereoscopic image by driving the display by time-multiplexing based on the L image which includes the corrected second L image and the R image which includes the corrected second R image.

Abstract: A system to capture a plurality of two dimensional digital source images of a scene by a user, including a smart device having a memory device for storing an instruction, a processor in communication with the memory and configured to execute the instruction, a plurality of digital image capture devices in communication with the processor and each image capture device configured to capture a digital image of the scene, the plurality of digital image capture devices positioned linearly in series within approximately an interpupillary distance, wherein a first digital image capture devices is centered proximate a first end of the interpupillary distance, a second digital image capture devices is centered on a second end of the interpupillary distance, and any remaining the plurality of digital image capture devices are evenly spaced therebetween, and a display in communication with the processor, the display configured to display a multidimensional digital image.

Abstract: An information processing apparatus (100) includes: a calculation unit (163) that calculates an index value related to display of stereoscopic image content including a stereoscopic image based on a relative position of a viewer with respect to a position of a display unit (150) that displays the stereoscopic image; and a display control unit (164) that controls display processing performed by the display unit (150) based on the index value calculated by the calculation unit (163).

Abstract: A display panel, a display method thereof and a display device are provided. The display panel includes cylindrical lens array on light emitting side of display substrate. The display substrate includes back plate, pixel definition layer and sub-pixel unit array on back plate. Each sub-pixel unit is in pixel region defined by pixel definition layer and includes at least two secondary sub-pixels; and cylindrical lenses are corresponding to sub-pixel units, each cylindrical lens has cylindrical surface away from back plate, and focus point on surface of a sub-pixel unit away from back plate. In the display panel, multi-viewpoints parallax 3D display compatible with near-to-eye light field display and 2D display with sub-pixels of same gray scale is achieved, effectively reducing the crosstalk, improving Moire phenomenon and increasing stereo perception of the parallax 3D display and solving visual fatigue due to conflict between monocular focusing and binocular convergence.

Abstract: A light field (LF) display system presents holographic content to one or more viewers in a public setting for digital signage applications. In some embodiments, the LF display system includes a sensory feedback assembly, a tracking system and/or a viewer profiling module. The sensory feedback assembly may comprise sensory feedback devices that provide sensory feedback to viewers of the LF display system in tandem with the presented holographic content. The tracking system may comprise cameras used to track the viewers of the LF display system. Based on a viewer's tracked position and/or tracked gaze, the LF display system may generate holographic content that is perceivable by certain viewers but not viewable by others. The viewer profiling module may identify each viewer for providing personalized holographic content and may further monitor and record behavior of viewers for informing subsequent presentations of holographic content by the LF display system.

Abstract: Frames from an image stream or streams are processed by independently operating digital signal processors (DSPs), with only frame checking microprocessors operating in a lockstep mode. In one example, two DSP are operating on alternate frames. Each DSP processes the frames and produces prediction values for the next frame. The lockstep microprocessors develop their own next frame prediction. The lockstep processors compare issued frames and previously developed predicted frames for consistency. If the predictions are close enough, the issued frame passes the test. The lockstep processors then compare the issued frame to the preceding two frames for a similar consistency check. If the prior frames are also close enough, the issued frame is acceptable. In another example, hardware checkers are provided to compare the present frame with a larger number of prior frames. The hardware checkers provide comparison results to the lockstep processors to compare against allowable variation limits.

Abstract: A fusion method and a fusion system for multiple depth information are provided. A first depth information is obtained by a first image capturing module. A second depth information is obtained by a second image capturing module. Through a non-linear transformation, the first depth information is transformed into a first transformation information, and the second depth information is processed according to the first transformation information to generate a transformed information; or the first depth information and the second depth information are merged to be a fusion information, which is then transformed into the transformed information through the nonlinear transformation.

Abstract: Exemplary video processing methods and apparatuses for encoding or decoding a current block by bi-directional prediction are disclosed. L0 and L1 reference blocks are determined for the current block, and a motion vector refinement is applied to refine the L0 and L1 reference blocks using a motion estimation search performed on each processing unit in the current block. A bi-directional optical flow operation is early terminated according to a cost of each processing unit in the current block. The processing units for cost calculation in the motion vector refinement and the bi-directional optical flow early termination are unified. The bi-directional optical flow operation is applied to the current block to further refine the L0 and L1 reference blocks if the bi-directional optical flow operation is not early terminated. A final inter predictor is derived from the refined L0 and L1 reference blocks for encoding or decoding the current block.

Abstract: An optical network includes a transmitting portion configured to (i) encode an input digitized sequence of data samples into a quantized sequence of data samples having a first number of digits per sample, (ii) map the quantized sequence of data samples into a compressed sequence of data samples having a second number of digits per sample, the second number being lower than the first number, and (iii) modulate the compressed sequence of data samples and transmit the modulated sequence over a digital optical link. The optical network further includes a receiving portion configured to (i) receive and demodulate the modulated sequence from the digital optical link, (ii) map the demodulated sequence from the second number of digits per sample into a decompressed sequence having the first number of digits per sample, and (iii) decode the decompressed sequence.

Abstract: A video image processing method includes binarizing a chrominance prediction mode of the image block of a to-be-encoded/decoded image to obtain a bit string, the bit string including two adjacent bits, the to-be-encoded/decoded image being permitted to use a CCLM and/or a regular intra-frame chrominance prediction mode, and the CCLM including a first mode, a second mode, and a third mode, and using mutually independent probability models to encode/decode a first bit and a second bit. The first bit of the adjacent bits indicates whether the CCLM is used, the second bit indicates whether to use the first mode of the CCLM when the first bit indicates to use the CCLM, the third bit indicates whether the second mode or the third mode of the CCLM is used when the second bit indicates that the first mode of the CCLM is not used.