Abstract: There is provided mechanisms for AD, or at least ADAS, aided manoeuvring of a vehicle. A method includes selecting between using a CRLS based positioning system and a GNSS based positioning system for aiding manoeuvring of the vehicle. Which positioning system to select is based on comparing a first error determined for the CRLS based positioning system to a second error determined for the GNSS based positioning system. The positioning system with smallest error is selected. The method comprises aiding the manoeuvring of the vehicle using the selected positioning system. The manoeuvring pertains to reversing of the vehicle.

Abstract: A computer-implemented method for controlling a vehicle includes receiving, via a processor, from two or more IX control devices disposed at a two or more stationary positions having known latitudes longitudes and orientations, first sensory data identifying the position and dimensions of a feature in a mapped region. The processor generates a plurality of IX nodes based on the first sensory data received from the IX control devices, and receives LiDAR point cloud that includes LiDAR and other vehicle sensory device data such as Inertial Measurement Unit (IMU) data received from a Vehicle (AV) driving in the mapped region. The LiDAR point cloud includes a simultaneous localization and mapping (SLAM) map having second dimension information and second position information associated with the feature in the mapped region. The processor generates, without GPS and/or real-time kinematics information, an optimized High-Definition (HD) map having Absolute accuracy using batch optimization and map smoothing.

Abstract: Disclosed are methods and apparatuses for image data encoding/decoding. A method of decoding an image includes receiving a bitstream in which the image is encoded; obtaining index information for specifying a block division type of a current block in the image; and determining the block division type of the current block from a candidate group pre-defined in the decoding apparatus. The candidate group includes a plurality of candidate division types, including at least one of a non-division, a first quad-division, a second quad-division, a binary-division or a triple-division. The method also includes dividing the current block into a plurality of sub-blocks; and decoding each of the sub-blocks with reference to syntax information obtained from the bitstream.

Abstract: A method includes the steps of obtaining a frame from an image sensor, the frame comprising a number of pixel values, detecting a change in a first subset of the pixel values, detecting a change in the second subset of the pixel values near the first subset of the pixel values, and determining an occupancy state based on a relationship between the change in the first subset of the pixel values and the second subset of the pixel values. The occupancy state may be determined to be occupied when the change in the first subset of the pixel values is in a first direction and the change in the second subset of the pixel values is in a second direction opposite the first direction.

Abstract: A favorable merging or grouping of simply connected regions into which the array of information samples is sub-divided, is coded with a reduced amount of data. To this end, a predetermined relative locational relationship is defined enabling an identifying, for a predetermined simply connected region, of simply connected regions within the plurality of simply connected regions which have the predetermined relative locational relationship to the predetermined simply connected region. Namely, if the number is zero, a merge indicator for the predetermined simply connected region may be absent within the data stream. In other embodiments, spatial sub-division is performed depending on a first subset of syntax elements, followed by combining spatially neighboring simply connected regions depending on a second subset of syntax elements, to obtain an intermediate sub-division.

Abstract: A moving picture coding method includes: coding a coding target block using a motion vector; generating motion vector predictors; and coding the motion vector using one of the motion vector predictors generated in the generating of the motion vector predictors. In the generating of the motion vector predictors, a replacement vector which replaces a temporal motion vector predictor is added to the motion vector predictors when it is impossible to obtain the temporal motion vector predictor from a block which is included in a coded picture different from the coding target picture and corresponds to the coding target block.

Abstract: A moving picture coding apparatus includes: an inter prediction control unit which determines to code a motion vector using, among candidate predicted motion vectors, a candidate predicted motion vector having the least error with relative to a motion vector derived by motion estimation; a picture type determination unit which generates picture type information; a temporal direction vector calculation unit which derives a candidate predicted motion vector in temporal direct; and a co-located reference direction determination unit which generates, for each picture, a co-located reference direction flag.

Abstract: A favorable merging or grouping of simply connected regions into which the array of information samples is sub-divided, is coded with a reduced amount of data. To this end, a predetermined relative locational relationship is defined enabling an identifying, for a predetermined simply connected region, of simply connected regions within the plurality of simply connected regions which have the predetermined relative locational relationship to the predetermined simply connected region. Namely, if the number is zero, a merge indicator for the predetermined simply connected region may be absent within the data stream. In other embodiments, spatial sub-division is performed depending on a first subset of syntax elements, followed by combining spatially neighboring simply connected regions depending on a second subset of syntax elements, to obtain an intermediate sub-division.

Abstract: A favorable merging or grouping of simply connected regions into which the array of information samples is sub-divided, is coded with a reduced amount of data. To this end, a predetermined relative locational relationship is defined enabling an identifying, for a predetermined simply connected region, of simply connected regions within the plurality of simply connected regions which have the predetermined relative locational relationship to the predetermined simply connected region. Namely, if the number is zero, a merge indicator for the predetermined simply connected region may be absent within the data stream. In other embodiments, spatial sub-division is performed depending on a first subset of syntax elements, followed by combining spatially neighboring simply connected regions depending on a second subset of syntax elements, to obtain an intermediate sub-division.

Abstract: A favorable merging or grouping of simply connected regions into which the array of information samples is sub-divided, is coded with a reduced amount of data. To this end, a predetermined relative locational relationship is defined enabling an identifying, for a predetermined simply connected region, of simply connected regions within the plurality of simply connected regions which have the predetermined relative locational relationship to the predetermined simply connected region. Namely, if the number is zero, a merge indicator for the predetermined simply connected region may be absent within the data stream. In other embodiments, spatial sub-division is performed depending on a first subset of syntax elements, followed by combining spatially neighboring simply connected regions depending on a second subset of syntax elements, to obtain an intermediate sub-division.

Abstract: A favorable merging or grouping of simply connected regions into which the array of information samples is sub-divided, is coded with a reduced amount of data. To this end, a predetermined relative locational relationship is defined enabling an identifying, for a predetermined simply connected region, of simply connected regions within the plurality of simply connected regions which have the predetermined relative locational relationship to the predetermined simply connected region. Namely, if the number is zero, a merge indicator for the predetermined simply connected region may be absent within the data stream. In other embodiments, spatial sub-division is performed depending on a first subset of syntax elements, followed by combining spatially neighboring simply connected regions depending on a second subset of syntax elements, to obtain an intermediate sub-division.

Abstract: Various embodiments of the present invention relate generally to mechanisms and processes relating to artificially rendering images using viewpoint interpolation and extrapolation. According to particular embodiments, a method includes applying a transform to estimate a path outside the trajectory between a first frame and a second frame, where the first frame includes a first image captured from a first location and the second frame includes a second image captured from a second location. The process also includes generating an artificially rendered image corresponding to a third location positioned on the path.

Abstract: Systems and methods for foreground/background separation and for studio production of a FVV. A method includes projecting, onto objects in a filming area within a studio, a predefined pattern including a large set of features; generating, based on signals reflected off of the objects and captured by a plurality of depth cameras deployed in proximity to the filming area, a local point cloud for each depth camera; separating, based on the local point clouds, between a background and a foreground of the filming area; creating, based on the local point clouds, a unified point cloud; meshing points in the unified point cloud to generate a 3D model of the objects; texturing the 3D model based on the separation and images captured by the depth cameras; and rendering the textured 3D model as a FVV including a series of video frames with respect to at least one viewpoint.

Abstract: A favorable merging or grouping of simply connected regions into which the array of information samples is sub-divided, is coded with a reduced amount of data. To this end, a predetermined relative locational relationship is defined enabling an identifying, for a predetermined simply connected region, of simply connected regions within the plurality of simply connected regions which have the predetermined relative locational relationship to the predetermined simply connected region. Namely, if the number is zero, a merge indicator for the predetermined simply connected region may be absent within the data stream. In other embodiments, spatial sub-division is performed depending on a first subset of syntax elements, followed by combining spatially neighboring simply connected regions depending on a second subset of syntax elements, to obtain an intermediate sub-division.

Abstract: Methods, systems, apparatus and articles of manufacture to identify features within an image are disclosed herein. An example apparatus includes a horizontal cost (HCOST) engine to apply a first row of pixels of a macroblock to an input of a first HCOST unit, the first HCOST unit including a number of difference calculators; and a difference calculator engine to apply corresponding rows of pixels of a search window of a source image to corresponding ones of the number of difference calculators of the first HCOST unit, the corresponding ones of the number of difference calculators to calculate respective sums of absolute difference (SAD) values between (a) the first row of pixels of the macroblock and (b) the corresponding rows of pixels of the search window.

Abstract: Provided is an image encoding/decoding apparatus and method. The image encoding apparatus may include a motion vector prediction unit to perform a prediction with respect to an arbitrary motion vector of a current block within an image, using at least one of vector information of a motion vector corresponding to an adjacent block and vector information of a previous motion vector of the current block, and a differential determination unit to determine differential information of a motion vector of the current block based on the motion vector predicted in the motion vector prediction unit and an actual motion vector of the current block.

Abstract: Methods and systems for improving coding decoding efficiency of video by providing a syntax modeler, a buffer, and a decoder. The syntax modeler may associate a first sequence of symbols with syntax elements. The buffer may store tables, each represented by a symbol in the first sequence, and each used to associate a respective symbol in a second sequence of symbols with encoded data. The decoder decodes the data into a bitstream using the second sequence retrieved from a table.

Abstract: An optical flow accelerator (OFA) which provides hardware-based acceleration of optical flow and stereo disparity determination is described. A system is described which includes an OFA configured to determine a first optical flow using a first disparity search technique, and to determine a second optical flow using a second disparity search technique that is different from the first disparity search technique. The system also includes a processor configured to combine the first optical flow and the second optical flow to generate a third optical flow. In some implementations, the first and second disparity search techniques are based upon Semi-Global Matching (SGM). In some implementations, the OFA is further configurable to determine stereo disparity.

Abstract: A moving picture coding method includes: coding a coding target block using a motion vector; generating motion vector predictors; and coding the motion vector using one of the motion vector predictors generated in the generating of the motion vector predictors. In the generating of the motion vector predictors, a replacement vector which replaces a temporal motion vector predictor is added to the motion vector predictors when it is impossible to obtain the temporal motion vector predictor from a block which is included in a coded picture different from the coding target picture and corresponds to the coding target block.

Abstract: A face authentication apparatus includes a face image acquisition unit that acquires, as a first face image, a face image of a user who moves from a first area to a second area via a gate provided between the first area and the second area, a collation unit that performs face authentication, a flow rate measurement unit that measures a flow rate of users who move from the first area to the second area via the gate and a flow rate of users who move from the second area to the first area via the gate, and a security level determination unit that determines the security level of the first area and the security level of the second area on the basis of the flow rates measured.

Abstract: A method and apparatus for enhancing motion estimation based on user input are provided. The motion estimation apparatus used for video encoding comprises a receiver operable to receive a user based input and an input analysis module operable to analyzed the user based input. The apparatus also comprises an encoder that is operable to compute displacement coordinates from the analyzed user based input for a current block in a target frame of a video stream and operable to determine a search area in a reference frame to search for a best match for the current block using the displacement coordinates. The encoder can also comprise a block match module operable to find a best match block for the current block in the search area of the reference frame using a block matching procedure.

Abstract: A technique is disclosed for automating tracking of annotated objects and improves the throughput and efficiency of existing methods while maintaining a degree of accuracy comparable to a human annotator. In particular, the disclosed technique provides an automated annotated object tracking tool that allows machine-learning teams to annotate an object within a frame and have that annotation persist across frames as the annotated object is tracked within a series of frames, still ensuring that every frame is accurately reviewed by a human where high quality annotation is required. This technique incorporates human feedback via a user adjustment that allows the tool to adapt and improve its accuracy in tracking an annotated object across a sequence of frames.

Abstract: Techniques related to frame re-ordering for video coding are described herein.

Abstract: A video encoder and/or video decoder are configured to apply an adaptive loop filter to a reconstructed block of video data. The video encoder and/or video decoder may be configured to determine gradient values for a window that covers the reconstructed block of video data, determine a scaling factor for the gradient values based on a number of available pixels in the window that are on a same side of a virtual boundary as the reconstructed block, and scale the gradient values based on the scaling factor. The video encoder and/or video decoder may determine a class of adaptive loop filter based on the scaled gradient values.

Abstract: A method and system for video coding by integrating frame data and time data may be described. The method and system can include a video coding non-transitory storage media that integrates reference data and time data. More specifically, the video coding non-transitory storage media can produce one or more luma vectors and one or more chroma vectors within a video plane, the one or more luma vectors and one or more chroma vectors may be extended into time vectors that can be utilized for compression or reconstruction of the frame rate, define luma vector across time as a contiguous function and perform video compression across a time dimension.

Abstract: Motion characteristics related to foreground objects and background regions bordering the foreground objects in images are determined. A frame rate conversion (FRC)-related metadata portion is generated based on the motion characteristics. The FRC-related metadata portion is to be used for determining an optimal FRC operational mode with a downstream device for the images. The images are encoded into a video stream. The FRC-related metadata portion is encoded into the video stream as a part of image metadata. The video stream is caused to be transmitted to the downstream device.

Abstract: Systems and methods for encoding a video stream at multiple bit rates is disclosed herein. An encoder divides each frame of a video stream into a plurality of portions and allocates an available number of bits between the plurality of portions based on user preference information. Portions having one or more objects of interest to the viewer determined based on the user preference information are allocated a higher number of available bits while portions of the frames that do not include one or more objects of interest are allocated a minimum number of bits from the available bits.

Abstract: A moving picture coding apparatus includes: an inter prediction control unit which determines to code a motion vector using, among candidate predicted motion vectors, a candidate predicted motion vector having the least error with relative to a motion vector derived by motion estimation; a picture type determination unit which generates picture type information; a temporal direction vector calculation unit which derives a candidate predicted motion vector in temporal direct; and a co-located reference direction determination unit which generates, for each picture, a co-located reference direction flag.

Abstract: A motion information storing method and a TMVP deriving method using the motion information storing method are provided. The motion information storing method includes a step of determining a representative block out of blocks of a motion data storage unit in a co-located picture with a current picture and a step of storing motion information of the representative block as motion information of the motion data storage unit, wherein the motion information of the representative block is used as motion information of the blocks included in the motion data storage unit.

Abstract: A method and an apparatus for encoding a picture are disclosed. Such method comprises: —determining a rate-distortion cost (41) for a current block of said picture when said current block is not split into subblocks, taking into account quantization parameters assigned to the subblocks of said current block, —determining (42) whether said current block is split or not according at least to the determined rate-distortion cost, —encoding (43) the current block according to the result of determining whether a current block is split or not into subblocks.

Abstract: A motion information calculation unit acquires motion information between a plurality of target images. An occlusion information calculation unit generates occlusion information between the target images. An image interpolation processing unit determines priority of the motion information based on the motion information and the occlusion information, and performs predetermined image processing for the target images by using motion information that is weighted based on the priority.

Abstract: Various embodiments of the present invention relate generally to systems and methods for artificially rendering images using viewpoint interpolation and/or extrapolation. According to particular embodiments, a transformation between a first frame and a second frame is estimated, where the first frame includes a first image captured from a first location and the second frame includes a second image captured from a second location.

Abstract: A method and apparatus for enhancing motion estimation based on user input are provided. The motion estimation apparatus used for video encoding comprises a receiver operable to receive a user based input and an input analysis module operable to analyzed the user based input. The apparatus also comprises an encoder that is operable to compute displacement coordinates from the analyzed user based input for a current block in a target frame of a video stream and operable to determine a search area in a reference frame to search for a best match for the current block using the displacement coordinates. The encoder can also comprise a block match module operable to find a best match block for the current block in the search area of the reference frame using a block matching procedure.

Abstract: A motion information storing method and a TMVP deriving method using the motion information storing method are provided. The motion information storing method includes a step of determining a representative block out of blocks of a motion data storage unit in a co-located picture with a current picture and a step of storing motion information of the representative block as motion information of the motion data storage unit, wherein the motion information of the representative block is used as motion information of the blocks included in the motion data storage unit.

Abstract: A method of estimating motion between a pair of image frames of a given scene comprises calculating respective integral images for each of the image frames and selecting at least one corresponding region of interest within each frame. For each region of interest, an integral image profile from each integral image is calculated, each profile comprising an array of elements, each element comprising a sum of pixel intensities from successive swaths of the region of interest for the frame. Integral image profiles are correlated to determine a relative displacement of the region of interest between the pair of frames. Each region of interest is divided into a plurality of further regions of interest before repeating until a required hierarchy of estimated motion for successively divided regions of interest is provided.

Abstract: A method and apparatus for adaptive denoising of source video in a video conference application is provided. Source video frames received from a video capture device are divided into a plurality of 16×16 blocks. For each source block, a moving object detection process and a noise estimation process are performed. Then temporal denoising is adaptively applied to the blocks of the source frame based on the noise estimation and moving object detection. The adaptively filtered blocks are provided to an output frame and forwarded to a coding module for encoding.

Abstract: Video syntax elements are coded using a context tree. Context information used for coding previously-coded syntax elements is identified. A context tree is produced by separating the previously-coded syntax elements into data groups based on the context information. The context tree includes nodes representing the data groups. Separating the previously-coded syntax elements can include applying separation criteria against values of the context information to produce at least some of the nodes. Context information is then identified for another set of syntax elements to be coded. One of the nodes of the context tree is identified based on values of the context information associated with one of the other set of syntax elements. That syntax element is then coded according to a probability model associated with the identified node. The context tree can be used to encode or decode syntax elements.

Abstract: A technique is disclosed for automating tracking of annotated objects and improves the throughput and efficiency of existing methods while maintaining a degree of accuracy comparable to a human annotator. In particular, the disclosed technique provides an automated annotated object tracking tool that allows machine-learning teams to annotate an object within a frame and have that annotation persist across frames as the annotated object is tracked within a series of frames, still ensuring that every frame is accurately reviewed by a human where high quality annotation is required. This technique incorporates human feedback via a user adjustment that allows the tool to adapt and improve its accuracy in tracking an annotated object across a sequence of frames.

Abstract: A video coder may determine a search region for coding a current block of video data using Intra Block Copy (Intra BC). In some examples, the video coder determines a central point for the search region, and determines the search region for the current block based on the central point and a defined size for the search region. The video coder stores reconstructed blocks of the video data from a current picture that includes the current block in a memory based on the determined search region. The video coder codes information from which to identify one of the reconstructed blocks within the search region, and codes the current block based on the identified one of the reconstructed blocks according to Intra BC.

Abstract: A motion information storing method and a TMVP deriving method using the motion information storing method are provided. The motion information storing method includes a step of determining a representative block out of blocks of a motion data storage unit in a co-located picture with a current picture and a step of storing motion information of the representative block as motion information of the motion data storage unit, wherein the motion information of the representative block is used as motion information of the blocks included in the motion data storage unit.

Abstract: Video composition is performed by filling a portion of the composed video data steam by collecting and copying, and another portion added synthetically by referencing, via motion-compensated temporal prediction, the other portion of the composed video data stream, obtained by collecting and copying.

Abstract: A motion vector coding unit executes processing including a neighboring block specification step of specifying a neighboring block which is located in the neighborhood of a current block; a judgment step of judging whether or not the neighboring block has been coded using a motion vector of another block; a prediction step of deriving a predictive motion vector of the current block using a motion vector calculated from the motion vector of the other block as a motion vector of the neighboring block; and a coding step of coding the motion vector of the current block using the predictive motion vector.

Abstract: A computer executing: a vector search process for determining motion information for each of the smallest blocks, which are the blocks in a predetermined deepest layer; a block size determination process for determining the block size, which is the unit in which the motion information is to be held; and a block integration process for determining whether to integrate mutually adjacent sub-blocks with a single block having a single piece of motion information, based on integration conditions including at least the motion information of the sub-blocks which are the blocks in a layer one layer deeper than the layer currently being considered; wherein the block size determination process determines the block size by carrying out the block integration process in layers, in a sequence from the blocks in a layer one level shallower than the smallest blocks, to the largest blocks, which are the blocks in a predetermined shallowest layer.

Abstract: A cartoon data generating system includes a receiving unit configured to receive a layer selection signal for selecting at least one layer from cartoon data including a cut generated from a combination of at least one layer including different stories and an effect application signal for applying a predetermined effect to the at least one selected layer; a determination unit configured to determine a layer satisfying an expansion condition among the at least one selected layer; and a controller configured to expand the layer satisfying the expansion condition to a predetermined size and generate an effect cut from a combination of the expanded layer to which the predetermined effect is applied and another layer.

Abstract: A motion vector coding unit executes processing including a neighboring block specification step of specifying a neighboring block which is located in the neighborhood of a current block; a judgment step of judging whether or not the neighboring block has been coded using a motion vector of another block; a prediction step of deriving a predictive motion vector of the current block using a motion vector calculated from the motion vector of the other block as a motion vector of the neighboring block; and a coding step of coding the motion vector of the current block using the predictive motion vector.

Abstract: A video frame fade-in/fade-out detection method is provided, the detection method includes: before motion search, performing inter-frame comparison on block direct current components in some rows of a picture or performing inter-frame comparison on block direct current components in a partial area of a picture; collecting statistics on an inter-frame comparison result; determining whether fade-in/fade-out exists, to choose whether prediction is in a weighted mode; and if it is detected, by means of inter-frame comparison on block direct current components on some rows, that no global fade-in/fade-out exists, selecting a partial area within a range of some detected rows to perform inter-frame comparison on block direct current components again, and detecting local fade-in/fade-out.

Abstract: A moving picture coding apparatus includes: an inter prediction control unit which determines to code a motion vector using, among candidate predicted motion vectors, a candidate predicted motion vector having the least error with relative to a motion vector derived by motion estimation; a picture type determination unit which generates picture type information; a temporal direction vector calculation unit which derives a candidate predicted motion vector in temporal direct; and a co-located reference direction determination unit which generates, for each picture, a co-located reference direction flag.

Abstract: A method of estimating motion between a pair of image frames of a given scene comprises calculating respective integral images for each of the image frames and selecting at least one corresponding region of interest within each frame. For each region of interest, an integral image profile from each integral image is calculated, each profile comprising an array of elements, each element comprising a sum of pixel intensities from successive swaths of the region of interest for the frame. Integral image profiles are correlated to determine a relative displacement of the region of interest between the pair of frames. Each region of interest is divided into a plurality of further regions of interest before repeating until a required hierarchy of estimated motion for successively divided regions of interest is provided.

Abstract: Coding techniques for a video image compression system involve improving an image quality of a sequence of two or more bi-directionally predicted intermediate frames, where each of the frames includes multiple pixels. One method involves determining a brightness value of at least one pixel of each bi-directionally predicted intermediate frame in the sequence as an equal average of brightness values of pixels in non-bidirectionally predicted frames bracketing the sequence of bi-directionally predicted intermediate frames. The brightness values of the pixels in at least one of the non-bidirectionally predicted frames is converted from a non-linear representation.

Abstract: The present technology relates to an image processing device and a method capable of improving encoding efficiency. In a weighted prediction process performed in an image encoding process or in an image decoding process, a motion compensation unit that performs motion compensation of sub-pixel accuracy for each of L0 and L1, a weighted addition unit that applies weighted addition to arithmetic operation results by the motion compensation unit, and a rounding processing unit that suppresses a decrease in arithmetic operation accuracy by performing a necessary rounding process once with respect to an arithmetic operation result by the weighted addition unit are provided. The present disclosure can be applied to an image processing device.