Abstract: A method and apparatus to improve compression efficiency in a video compression scheme enables use of new tools with multiple transform selection. In one embodiment, transform pair selection is based on a flag indicative of low-frequency non-separable transforms. In another embodiment, transform pair selection is based on a flag indicative of low-frequency non-separable transforms and on a flag indicative of matrix-based intra prediction. In another embodiment, when an implicit multiple transform selection mode is used, transform pair selection is based on a flag indicative of low-frequency non-separable transforms. Bitstream syntax is used to convey the flags.

Abstract: A spatial indexing system receives a video that is a sequence of frames depicting an environment, such as a floor of a construction site, and performs a spatial indexing process to automatically identify the spatial locations at which each of the images were captured. The spatial indexing system also generates an immersive model of the environment and provides a visualization interface that allows a user to view each of the images at its corresponding location within the model.

Abstract: An object detection device according to the present disclosure, installed in a vehicle, includes a plurality of ranging sensors and each including a transmitter configured to transmit ultrasonic waves and a receiver configured to receive reflected waves of the ultrasonic waves transmitted by the transmitter and reflected by an object around the vehicle, and processing circuitry configured to detect the object around the vehicle based on the reflected waves received by the receiver during a wave receiving period until a predetermined period of time elapses from transmission of the ultrasonic waves by the transmitter. The processing circuitry is configured to acquire an imaged image imaged by an in-vehicle camera that images surroundings of the vehicle. The processing circuitry is configured to determine whether a specific object is contained based on the imaged image.

Abstract: A device may be configured to perform filtering based on information included in a neural network post-filter characteristics message. In one example, the neural network post-filter characteristics message includes a syntax element indicating whether the post-processing filter accepts as input a patch size having a width equal to horizontal sample counts indicated by a syntax element and a height equal to vertical sample counts indicated by a syntax element, or a patch size having a width equal to a multiple of horizontal sample counts indicated by a syntax element and a height equal to a multiple of vertical sample counts indicated by a syntax element.

Abstract: A method for tracking a trailer end in an image using a controller includes receiving an image from at least one camera, identifying a trailer end in the image and tracking a motion of the trailer end through the image for a period of time using a controller. A motion model is generated based on the motion of the trailer end through the image using the controller. The controller responds to the trailer end exiting the image by maintaining motion of the trailer end per the motion model for a delay time period and establishing an estimated trailer end position dictated by the motion model at the end of the delay time period in response to the time period elapsing and the trailer end not being visible using the controller.

Abstract: A system and method for surround view egress assistance that includes detecting, by a sensor in a vehicle, an obstacle in a swing path of a vehicle door. The method includes predicting, based on a geometrical analysis, one or more potential collision zones between the obstacle and the vehicle door. The predicting also includes determining a bank angle of the vehicle in the predicting of one or more potential collision zones. The method further includes estimating, based on data from an inertial measurement unit, a severity of an impact of the vehicle door with the obstacle. The method also includes detecting a color and height of a curb and potential collisions with a vehicle door.

Abstract: A control device includes circuitry configured to: obtain an external environment recognition image representing a recognition result of a surrounding area of a moving body; obtain obstacle information representing a detection result of an obstacle in the surrounding area of the moving body; and display the obstacle information on a display device in a superimposed manner on the external environment recognition image. The obstacle information indicates a region in which the obstacle is detected among a plurality of fan-shaped detection regions centered at the moving body when viewed from above the moving body, and a size of a central angle of the fan-shaped detection region is set according to a distance from the moving body.

Abstract: A point cloud data processing method according to embodiments may comprise: encoding point cloud data; and transmitting the point cloud data. A point cloud data processing method according to embodiments may comprise: receiving point cloud data; and decoding the point cloud data.

Abstract: The present disclosure relates to an image processing device, an image processing method, a program, and an image presentation system capable of presenting a more suitable image to the interior of a vehicle. An image processing unit generates a presentation image to be presented to the interior of a second vehicle that is traveling, on the basis of a vehicle external image obtained by capturing an environment outside a first vehicle that is traveling. The present disclosure can be applied to, for example, a projector type presentation device.

Abstract: A method of decoding of a video or picture bitstream implemented by a decoding device, the bitstream including a current sequence parameter set (SPS) comprising syntax elements that apply to a video sequence, the method comprising: obtaining a first syntax element used to determine a maximum number of temporal sublayers that is allowed to be present in each coded layer video sequence) referring to the current SPS, wherein a value of the first syntax element is in a range of 0 to a first value, wherein the first value is a value of a second syntax element used to determine the maximum number of temporal sublayers that is allowed to present in a layer in each coded video sequence referring to a video parameter set, when the second syntax element is referred to by the SPS; decoding the bitstream based on the value of the first syntax element.

Abstract: A testing device and a testing method for detecting a stitching defect of a panoramic camera are provided. The testing method includes: accessing the panoramic camera to obtain a stitched image, wherein the stitched image includes a chart image corresponding to a chart, wherein the chart includes multiple black stripes and multiple white stripes; generating a defect image marked with the stitching defect according to the chart image; and outputting the defect image.

Abstract: A point cloud data processing method according to embodiments can encode and transmit point cloud data. A point cloud data processing method according to embodiments can receive and decode point cloud data.

Abstract: Disclosed are an apparatus and method with video processing. A computing apparatus includes one or more processors and storage storing instructions configured to, when executed by the one or more processors, cause the one or more processors to: generate cluster maps using clusters generated by performing clustering, wherein the generating the cluster maps performed based on a reference frame of a video generated based on a previous point in time of the video, generate a predicted frame by performing motion compensation based on the cluster maps, and generate a decoded frame by performing decoding based on the current frame and the predicted frame.

Abstract: In one implementation, KLT transform matrices are derived during the encoding or decoding process. In particular, the KLT transform matrices can be derived for either the primary transforming stage or the secondary transforming stage, or both. Because the KLT transform matrices can be derived at both the encoder and decoder sides, the KLT transform matrices do not need to be signaled in the bitstream. To derive the KLT transform matrix for a current block to be encoded or decoded, a template for the current block is defined, and is used to search in reconstructed regions multiple blocks with templates similar to the current template. Those multiple blocks are used to train the KLT transform matrix.

Abstract: Various embodiments relate to a video coding system in which some elements required for decoding are generated according to a process that not specified within the video coding system. This process is hereafter referenced to as being the “external” process. This external process may generate “external” reference pictures to be used by a decoder that is adapted to use these external pictures. Encoding method, decoding method, encoding apparatus, decoding apparatus based on this post-processing method are proposed.

Abstract: A method for providing a panoramic view (152) of an environment behind a trailer (106) of a vehicle-trailer system (100). The method includes receiving a first image (133, 133b) from a rear trailer camera (132, 132b), a second image (133, 133c) from a right-side trailer camera (132, 132c), and a third image (133, 133d) from a left-side trailer camera (132, 132d). The method includes determining a panoramic view (152) based on the first image (133, 133b), the second image (133, 133c), and the third image (133, 133d). Additionally, the method includes determining a trailer angle (?) based on sensor system data (131) received from a sensor system (130). The method includes determining a viewing area (154) within the panoramic view (152) based on the trailer angle (?) and sending instructions (156) to a display (122) to display the viewing area (154).

Abstract: An imaging apparatus is disclosed. The imaging apparatus includes an imaging element and an optical system. On the imaging element, a plurality of pixels is arranged in a two-dimensional manner. The imaging element generates image data on the basis of output of the plurality of pixels. The optical system forms, on an imaging plane of the imaging element, an image of light from a field at a magnification factor varying with a field angle. An optical axis of the optical system on the imaging plane is positioned away from a center of the imaging plane.

Abstract: Systems, methods, and other embodiments described herein relate to a system for facilitating reverse travel of a vehicle convoy. In one embodiment, a system includes a processor and a memory storing machine-readable instructions. The machine-readable instructions, when executed by the processor, cause the processor to detect a rotational position of a steering wheel of a lead vehicle of a convoy when the lead vehicle is in a reverse mode. The machine-readable instructions, when executed by the processor, also cause the processor to select a camera of a following vehicle of the convoy based on the rotational position of the steering wheel. The machine-readable instructions, when executed by the processor, also cause the processor to display an image captured by the camera of the following vehicle on a display device of the lead vehicle.

Abstract: A system and method for limited rate context-based eye gaze encoding includes generating, based on an outward looking camera situated in a vehicle, a first video stream of a surrounding environment to a controller. The controller generates a scene description based on the first video stream and selects a corresponding scene from a predefined list of known scenes. Further, the controller, based on the selected corresponding scene, selects a codebook of encoding and decoding parameters from a plurality of predefined codebooks. Based on an inward looking camera situated in the vehicle, a second video stream of a face of a driver to an eye tracker controller is generated, where the eye tracker controller estimates a gaze direction of the driver. Encoded data comprising the estimated gaze direction of the driver is transmitted over a bandwidth limited channel to a decoder, based on the selected codebook, the encoded data.

Abstract: A vehicle includes a first camera mounted on the vehicle to have a first field of view facing a front or rear of the vehicle and configured to acquire first image data, a second camera mounted on the vehicle to have a second field of view facing a left or right side of the vehicle and configured to acquire second image data, and a display. The vehicle also has a controller configured to display first around-view data in which the first image data and the second image data are combined so that a boundary between the first image data and the second image data becomes a first reference angle on the display. The controller is also configured to combine the first image data and the second image data so that an angle between the boundary and a driving direction of the vehicle becomes a second reference angle greater than the first reference angle based on an opening of a door or trunk lid or gate of the vehicle.