Abstract: Methods, processes, and systems are presented for combining signal reshaping (also referred to as luma mapping chroma residuals scaling) with local illumination compensation (LIC) in video coding. Examples and trade-offs when the LIC model parameters are computed in the original domain, the reshaped domain, or a mixed domain, are presented.

Abstract: A motion vector determination employs template matching. At first, an initial motion vector is obtained. If the initial motion vector points to a position that is fractional, and thus, requires interpolation from the integer sample positions, the initial motion vector is rounded to a closest integer sample position. The rounded position is then used to define the search space for the template matching to define a refinement of the initial motion vector.

Abstract: A 3D play system which includes a head-mounted/headset device. The head-mounted device includes a supporting structure, a first lens, and a second lens. The supporting structure is configured to support two display devices. The first lens is configured to zoom an image displayed by a first display device and project the zoomed image onto a left eye. The second lens is configured to zoom an image displayed by a second display device and project the zoomed image onto a right eye.

Abstract: A vibrometric signature for a vehicle, or a set of one or more frequencies where vibration of the vehicle is naturally observed in the presence of excitation, may be generated and used to make one or more determinations regarding the integrity or suitability of the vehicle for one or more missions. When the vehicle is subjected to excitation over a range of frequencies, images of the vehicle are captured, and power levels of vibrations of the vehicle are calculated based on the images. A vibrometric signature is generated based on the power levels of the vibrations, and compared to vibrometric signatures previously generated for the aerial vehicle, or to vibrometric signatures associated with one or more other vehicles, or anomalies experienced by such other vehicles, to determine whether the vehicle may be cleared for the performance of one or more missions, or whether maintenance or inspections are required.

Abstract: Pixel values of a current video coding block are intra predicted on the basis of a plurality of reference pixel values. A pixel value of a current pixel is intra predicted on the basis of: a first reference pixel value, wherein the first reference pixel is located in a first neighboring video coding block, a second reference pixel value, wherein the second reference pixel is located in a second neighboring video coding block, a distance between the current pixel and the first reference pixel, and a distance between the current pixel and the second reference pixel.

Abstract: A method of registering three-dimensional (3D) point clouds may include obtaining a first 3D point cloud acquired at a first location; obtaining a second 3D point cloud acquired at a second location; calculating a first normal vector for each point of the first 3D point cloud to create a plurality of normal vectors; calculating, for each point of the first 3D point cloud, a normal deviation amount of the corresponding normal vector to other normal vectors in a predetermined neighborhood of the point; selecting, from the first 3D point cloud, a first registration region based on whether the normal deviation amount of each point meets a deviation threshold; and registering the first 3D point cloud and the second 3D point cloud to create the composite 3D point cloud, the registration utilizing the first registration region in place of the first 3D point cloud.

Abstract: Systems, apparatuses, and methods for calculating multi-pass histograms for palette table derivation include an encoder that calculates a first histogram for a first portion of most significant bits (MSBs) of pixel component values of a block of an image or video frame. Then, the encoder selects a given number of the highest pixel count bins from the first histogram. The encoder then increases the granularity of these selected highest pixel count bins by evaluating one or more additional bits from the pixel component values. A second histogram is calculated for the concatenation of the original first portion MSBs from the highest pixel count bins and the one or more additional bits, and the highest pixel count bins are selected from the second histogram. A palette table is derived based on these highest pixel count bins selected from the second histogram, and the block is encoded using the palette table.

Abstract: A further coding efficiency increase is achieved by, in hybrid video coding, additionally predicting the residual signal of a current frame by motion-compensated prediction using a reference residual signal of a previous frame. In other words, in order to further reduce the energy of the final residual signal, i.e. the one finally transmitted, and thus increase the coding efficiency, it is proposed to additionally predict the residual signal by motion-compensated prediction using the reconstructed residual signals of previously coded frames.

Abstract: An encoder includes circuitry and memory. Using the memory, the circuitry, in inter prediction processing: derives a first motion vector of a current block to be processed, using a motion vector of a previous block which has been previously processed; derives a second motion vector of the current block by performing motion estimation in the vicinity of the first motion vector; and generates a prediction image of the current block by performing motion compensation using the second motion vector.

Abstract: An information processing apparatus sets a plurality of key frames that each indicate a position of a virtual viewpoint that corresponds to a virtual viewpoint image, the plurality of key frames corresponding to different times, the virtual viewpoint image being generated based on images of an image capture region captured by a plurality of image capturing apparatuses from different directions. The information processing apparatus determines, based on a position of a virtual viewpoint indicated by a set first key frame and a position of a virtual viewpoint indicated by a set second key frame, a moving path of the virtual viewpoints during a time period between time that corresponds to the first key frame and time that corresponds to the second key frame, and outputs viewpoint information that indicates the determined moving path of the virtual viewpoints.

Abstract: Techniques for aligning images generated by an integrated camera physically mounted to an HMD with images generated by a detached camera physically unmounted from the HMD are disclosed. A 3D feature map is generated and shared with the detached camera. Both the integrated camera and the detached camera use the 3D feature map to relocalize themselves and to determine their respective 6 DOF poses. The HMD receives the detached camera's image of the environment and the 6 DOF pose of the detached camera. A depth map of the environment is accessed. An overlaid image is generated by reprojecting a perspective of the detached camera's image to align with a perspective of the integrated camera and by overlaying the reprojected detached camera's image onto the integrated camera's image.

Abstract: A movable carrier auxiliary system includes a first transparent assembly, a second transparent assembly, an electro-optic medium layer, a transparent electrode, a reflective layer, a transparent conductive layer, an electrical connector, a control member, and an optical image capturing module. A gap is formed between the second transparent assembly and the first transparent assembly. The electro-optic medium layer is disposed in the gap. The transparent electrode is disposed between the first transparent assembly and the electro-optic medium layer. The electro-optic medium layer is disposed between the first transparent assembly and the at least one reflective layer. The transparent conductive layer is disposed between the electro-optic medium layer and the at least one reflective layer. The electrical connector is electrically connected to the electro-optic medium layer, and transmits an electrical energy to the electro-optic medium layer to change a transparency of the electro-optic medium layer.

Abstract: In some examples, an apparatus for video decoding includes processing circuitry. The processing circuitry decodes prediction information of a current block from a coded video bitstream. The prediction information is indicative of an inter prediction mode that performs inter prediction based on a motion vector predictor selected from a list of candidates and a motion vector difference. Then, the processing circuitry decodes precision information of the motion vector difference and derives the motion vector predictor from a subset of the list of candidates when the precision information is indicative of a specific precision. Then, the processing circuitry reconstructs a sample of the current block according to the motion vector predictor and the motion vector difference.

Abstract: A machine-learned image compression model includes a first encoder configured to generate a first image code based at least in part on first image data. The first encoder includes a first series of convolutional layers configured to generate a first series of respective feature maps based at least in part on the first image. A second encoder is configured to generate a second image code based at least in part on second image data and includes a second series of convolutional layers configured to generate a second series of respective feature maps based at least in part on the second image and disparity-warped feature data. Respective parametric skip functions associated convolutional layers of the second series are configured to generate disparity-warped feature data based at least in part on disparity associated with the first series of respective feature maps and the second series of respective feature maps.

Abstract: An image processing apparatus including a storage unit, a correction unit, and an output unit. The storage unit stores moving-image data including a plurality of frames captured by an image-capturing device communicable with the image processing apparatus, time-series data of an inclination angle with reference to a reference direction of the image-capturing device, and time-series data of an angle velocity of the image-capturing device. The correction unit, based on the time-series data of the angle velocity, rotates an image of each of the plurality of frames of the moving-image data to reduce a rotational distortion around the reference direction within a prescribed frequency range. The output unit outputs image data of the rotated image of each of the plurality of frames to an external device communicable with the image processing apparatus.

Abstract: A wearable environmental monitoring device monitors a traveler's environment for objects stored in a database. The device includes a camera and a microcontroller. The microcontroller scans images recorded by the camera in real time and compares it to images stored in a database of objects or dangerous objects. A dangerous object may also be scanned for using a remote computer having a more extensive database of dangerous objects, such as sex offenders and violent criminals. Dangerous objects may also include animals such as panthers or other dangerous object. The camera may be facing toward the reader of the wearer to monitor persons and objects outside the wearer's field of view. The device also measures the distance, direction and velocity of the traveler and generates a return trip guide allowing a traveler to retrace his or her path to avoid becoming lost.

Abstract: A non-transitory computer-readable recording medium having stored therein a video generation program for causing a computer to execute a process comprising: tracking a position of a three-dimensional model of each of a plurality of subjects in a three-dimensional space generated by combining, for the subjects, a plurality of imaging frames captured by a plurality of cameras in a plurality of directions; obtaining positional information of the subjects included in the three-dimensional space; obtaining information related to the subjects; and generating synthesized video by combining the information related to the subjects with a background area near the subjects based on the positional information of the subjects among areas of free viewpoint video generated on the basis of the three-dimensional model of each of the subjects.

Abstract: Monitoring apparatus 2 for person recognition in a monitoring region 7, having at least one camera 3 for recording an image sequence of a portion 10 of the monitoring region 7, wherein the image sequence comprises a plurality of monitoring images, having a person recognition module 6, wherein the person recognition module 6 has at least one recognition feature of a person that is to be located and is configured to search for the person to be recognized based on the monitoring images and the recognition feature, wherein the camera 3 has a fisheye lens 4.

Abstract: A method of interframe point cloud attribute coding is performed by at least one processor and includes obtaining, as a motion estimation unreliability measure of motion estimation of a target frame, a value inversely proportional to a ratio of a number of first point cloud samples of the target frame respectively with second point cloud samples of an interframe reference frame, to a number of point cloud samples in the target frame. The method further includes identifying whether the obtained motion estimation unreliability measure is greater than a predetermined threshold, based on the obtained motion estimation unreliability measure being identified to be greater than the predetermined threshold, skipping motion compensation of the target frame, and based on the obtained motion estimation unreliability measure being identified to be less than or equal to the predetermined threshold, performing the motion compensation of the target frame.

Abstract: A vibrometric signature for a vehicle, or a set of one or more frequencies where vibration of the vehicle is naturally observed in the presence of excitation, may be generated and used to make one or more determinations regarding the integrity or suitability of the vehicle for one or more missions. When the vehicle is subjected to excitation over a range of frequencies, images of the vehicle are captured, and power levels of vibrations of the vehicle are calculated based on the images. A vibrometric signature is generated based on the power levels of the vibrations, and compared to vibrometric signatures previously generated for the aerial vehicle, or to vibrometric signatures associated with one or more other vehicles, or anomalies experienced by such other vehicles, to determine whether the vehicle may be cleared for the performance of one or more missions, or whether maintenance or inspections are required.