Abstract: An apparatus for point cloud decoding includes processing circuitry. The processing circuitry receives, from a coded bitstream for a point cloud, encoded occupancy codes for nodes in an octree structure for the point cloud. The nodes in the octree structure correspond to three dimensional (3D) partitions of a space of the point cloud. Sizes of the nodes are associated with sizes of the corresponding 3D partitions. Further, the processing circuitry decodes, from the encoded occupancy codes, occupancy codes for the nodes. At least a first occupancy code for a child node of a first node is decoded without waiting for a decoding of a second occupancy code for a second node having a same node size as the first node. Then, the processing circuitry reconstructs the octree structure based on the decoded occupancy codes for the nodes, and reconstructs the point cloud based on the octree structure.

Abstract: Techniques for generating three-dimensional content from the recordings of multiple independently operated cameras that are not constrained to fixed positions and orientations are disclosed. In some embodiments, data from a plurality of cameras configured to capture a scene is received; a relative pose of each camera with respect to the scene is determined based at least in part on a first estimate and a second estimate, wherein the first estimate is based on image data and the second estimate is based on sensor data; relative poses of cameras with respect to one or more other cameras are determined based on determined relative poses of individual cameras with respect to the scene; and a three-dimensional reconstruction of at least a portion of the scene is generated based on the received data and determined relative poses.

Abstract: Imaging systems and methods are disclosed that use multiple illumination pulses to irradiate a scene of interest. An example system includes optics to receive a sequence of returned light pulse portions scattered or reflected from the scene. A modulator is configured to modulate the intensity of the returned light pulse portions to form a sequence of modulated light pulse portions. A means of selectively exposing a sensor during a sequence of exposure periods is also included, so that each modulated light pulse portion is received by the sensor during one of the exposure periods, respectively. The sensor is configured to generate a sequence of sensor signals as a result of receiving the modulated light pulse portions and to accumulate the sensor signals to form a sensor output signal. A processor may read the sensor output signal and process the image based on that signal.

Abstract: Techniques are disclosed for conversion of panoramas between different panoramic projections, including stereoscopic panoramic projections. The pixels of one panoramic image are mapped to the pixels of another panoramic image using ray tracing so that the images can be combined without introducing visual distortions caused by mismatches in the optics of each image. The conversion is performed using a process for mapping one or more pixels of an output image to pixels of an input image by tracing a ray between the UV coordinates corresponding to each pixel in the images. The conversion process accounts for arbitrary projections and for arbitrary stereo camera rig configurations by using metadata that describe the projection and positioning of each image being combined. The origin of each ray is offset to account for the interpupillary distance between left and right images and to account for any rotation of the scene.

Abstract: A video encoder may be put in a starve mode during a low latency operation in which the video encoder may be operated in a mode that allows video frames to be encoded without any interdependencies such as motion compensation. At least one encoding parameter of the video encoding is selected such that, for each resulting encoded video frame, the video frame fits in exactly one application layer packet.

Abstract: A game system that is a non-limiting example information processing system is attached to a goggle device, and generates and displays a left-eye image and a right-eye image on a display. When starting a game application that a plurality of individual games can be selectively played, a menu image is displayed on the display. A plurality of icons each relating to each of the plurality of individual games are arranged at predetermined positions in a virtual space for displaying the menu image. A virtual camera arranged at a predetermined position in the virtual space changes a posture thereof so as to correspond to a posture change of a main body apparatus in a real space, thereby to control a direction of a line-of-sight of the virtual camera. If an icon is included in a field of view of the virtual camera when a user depresses a predetermined button, predetermined processing relevant to the icon is performed.

Abstract: Methods and apparatuses of determining an alignment level between motion compensated reference patches for reducing motion vector refinement steps are provided. According to one method, obtaining, by a decoder, motion compensated interpolated samples based on sub-pixel accurate merge motion vectors from a bilinear motion compensated interpolation; computing, by the decoder, a sum of absolute differences (SAD) between two motion compensated reference patches using a subset of the motion compensated interpolated samples; determining, by the decoder, whether the SAD is less than a coding unit (CU) size-dependent threshold value; when the SAD is less than the CU size-dependent threshold value: skipping remaining decoder-side motion vector refinement (DMVR) process steps; and performing final motion compensation; and when the SAD is not less than the CU size-dependent threshold value: performing the remaining DMVR process steps; and performing the final motion compensation.

Abstract: An endoscope device includes a signal processing unit that processes a captured image signal, which is obtained by imaging a subject through an imaging optical system including an objective lens of an endoscope, to generates captured image, an auxiliary measurement light emitting unit that emits planar auxiliary measurement light from the distal end part, a display control unit that causes a display unit to display the captured image including an intersection line formed in a portion where a plane formed by the auxiliary measurement light intersects the subject. The auxiliary measurement light emitting unit emits the auxiliary measurement light in a state where the plane and an optical axis intersects each light at one specific point on the optical axis of the objective lens. A distance from a distal end part of the objective lens of the one specific point is 5 mm or more and 20 mm or less.

Abstract: An imaging device, including: a main body; a detector including: an imager that images an object; and a distance measurer that detects a distance from each point on a surface of the object; an information calculator that is provided in the main body and uses a detection result of the detector to calculate at least one of shape information or texture information on the object; and a communicator that transmits a calculation result of the information calculator.

Abstract: Methods and apparatuses of determining an alignment level between motion compensated reference patches for reducing motion vector refinement steps are provided. According to one method, obtaining, by a decoder, motion compensated interpolated samples based on sub-pixel accurate merge motion vectors from a bilinear motion compensated interpolation; computing, by the decoder, a sum of absolute differences (SAD) between two motion compensated reference patches using a subset of the motion compensated interpolated samples; determining, by the decoder, whether the SAD is less than a coding unit (CU) size-dependent threshold value; when the SAD is less than the CU size-dependent threshold value: skipping remaining decoder-side motion vector refinement (DMVR) process steps; and performing final motion compensation; and when the SAD is not less than the CU size-dependent threshold value: performing the remaining DMVR process steps; and performing the final motion compensation.

Abstract: An imaging system includes an imaging device and a frame assembly. The imaging device includes a first housing containing an optical unit and a second housing separated from the first housing and containing a non-optical unit. The non-optical unit is configured to communicate with the optical unit. The non-optical unit includes a memory device configured to store images captured by the optical unit. The frame assembly supports the optical unit and does not support the non-optical unit. The non-optical unit does not rotate with the optical unit when the frame assembly rotates the optical unit about at least one rotational axis.

Abstract: Method and apparatus of using Bi-directional optical flow (BIO) for a true bi-direction predicted block are disclosed. According to one method of the present invention, a division-free BIO process is disclosed, where the x-motion offset and y-motion offset are derived using operations including right-shifting without any division operation. According to another method, a refined predictor is generated for the current block by applying BIO process to the reference blocks, where said applying the BIO process comprises applying a boundary-condition-dependent BIO process conditionally to boundary pixels associated with the reference blocks.

Abstract: A digital PSF for use in a dual modulation display. The invention allows the use of less than optimal point spread (PSF) functions in the optics between the pre-modulator and primary modulator of a dual modulation projection system. This technique uses multiple halftones per frame in the pre-modulator synchronized with a modified bit sequence in the primary modulator to produce a compensation image that reduces the errors produced by the sub-optimal PSF. The invention includes the application to dual modulation and dual modulated 3D viewing systems.

Abstract: According to one embodiment of the present invention, a video information encoding method comprises: a step of predicting information of the current coding unit to generate prediction information; and a step of determining whether the information of the current coding unit coincides with the prediction information. If the information of the current coding unit coincides with the prediction information, a flag indicating that the information of the current coding unit coincides with the prediction information is encoded and transmitted. If the information of the current coding unit does not coincide with the prediction information, a flag indicating that the information of the current coding unit does not coincide with the prediction information is encoded and transmitted and the information of the current coding unit is encoded and transmitted.

Abstract: A method of decoding video data in merge mode can include constructing a merge candidate list using available spatial and temporal merge candidates; deriving motion information using a merge index and the merge candidate list; generating a prediction block using the motion information; generating a residual block by inverse-quantizing a quantized block using a quantization parameter and a quantization matrix and by inverse-transforming the inverse quantized block; and generating a reconstructed block using the residual block and the prediction block, wherein the quantization parameter is generated per quantization unit and a minimum size of the quantization unit is adjusted per picture by using a parameter which specifies the depth between the quantization unit having the minimum size and a largest coding unit, and the quantization parameter is generated using a quantization parameter predictor and a differential quantization parameter.

Abstract: A lidar sensor may include: a transmitter configured to transmit laser; a receiver configured to receive reflected laser; a mirror rotating unit configured to rotate a mirror in a designated direction, the mirror serving to reflect the transmitted or received laser; a cleaning device driving unit configured to drive a cleaning device to remove foreign matters adhering to the cover of the lidar sensor; a signal processing unit configured to determine when or where the lidar sensor is covered and calculate a distance to an object; and a control unit configured to control the transmitter not to transmit a laser signal or control a rotational velocity or rotation time of the mirror at a point of time that the lidar sensor is covered by the cleaning device, and control detection or utilization of the received signal when the distance to the object is calculated.

Abstract: According to one embodiment of the present invention, a video information encoding method comprises: a step of predicting information of the current coding unit to generate prediction information; and a step of determining whether the information of the current coding unit coincides with the prediction information. If the information of the current coding unit coincides with the prediction information, a flag indicating that the information of the current coding unit coincides with the prediction information is encoded and transmitted. If the information of the current coding unit does not coincide with the prediction information, a flag indicating that the information of the current coding unit does not coincide with the prediction information is encoded and transmitted and the information of the current coding unit is encoded and transmitted.

Abstract: A method for coding image information includes generating prediction information by predicting information on a current coding unit, and determining whether the information on the current coding unit is the same as the prediction information. When the information on the current coding unit is the same as the prediction information, a flag indicating that the information on the current coding unit is the same as the prediction information is coded and transmitted. When the information on the current coding unit is not the same as the prediction information, a flag indicating that the information on the current coding unit is not the same as the prediction information and the information on the current coding unit are coded and transmitted. At the generating of the prediction information, the prediction information is generated by using the information on the coding unit neighboring to the current coding unit.

Abstract: An electronic device and method are herein disclosed. The electronic device includes a first camera with a first field of view (FOV), a second camera with a second FOV that is narrower than the first FOV, and a processor configured to capture a first image with the first camera, the first image having a union FOV, capture a second image with the second camera, determine an overlapping FOV between the first image and the second image, generate a disparity estimate based on the overlapping FOV, generate a union FOV disparity estimate, and merge the union FOV disparity estimate with the overlapping FOV disparity estimate.

Abstract: Provided is an image decompression method of decompressing an image including a first frame and at least one second frame following the first frame, based on the first frame and landmark location information of the at least one second frame, the image decompression method including: obtaining the first frame; setting at least one landmark of the first frame; obtaining the landmark location information of the at least one second frame; and generating the at least one second frame from the first frame, based on the landmark location information of the at least one second frame, wherein the landmark location information of the at least one second frame is location information of the set at least one landmark of the first frame, in the at least one second frame.