Abstract: Techniques and systems are provided for generating a video from texture images, and for reconstructing the texture images from the video. For example, a texture image can be divided into a number of tiles, and the number of tiles can be sorted into a sequence of ordered tiles. The sequence of ordered tiles can be provided to a video coder for generating a coded video. The number of tiles can be encoded based on the sequence of ordered tiles. The encoded video including the encoded sequence of ordered tiles can be decoded. At least a portion of the decoded video can include the number of tiles sorted into a sequence of ordered tiles. A data file associated with at least the portion of the decoded video can be used to reconstruct the texture image using the tiles.

Abstract: An example method for coding video data includes determining, for a current block of a current picture of video data, the current block coded using an intra block copy (IBC) mode, whether a motion vector (MV) for identifying a prediction block for the current block is a legal MV. The example method further includes, responsive to determining that the MV is not a legal MV, reconstructing samples of the current block using an alternative processing method.

Abstract: Systems and methods of automatically extracting summaries of video content are described herein. A data processing system can access, from a video database, a first video content element including a first plurality of frame. The data processing system can select an intervallic subset of the first plurality of frames of the first video content element. The data processing system can calculate, for each of a plurality of further subsets comprising a predetermined number of frames from the intervallic subset, a score for the further subset. The data processing system can identify, from the plurality of further subsets, a further subset having a highest score. The data processing system can select a portion of the first video content element comprising the frames of the further subset having the highest score. The data processing system can generate a second video content element comprising the selected portion of the first video content element.

Abstract: An encoder includes circuitry and memory connected to the circuitry. In operation, the circuitry: corrects a base motion vector using a correction value for correcting the base motion vector in a predetermined direction; and encodes a current partition to be encoded in an image of a video, using the base motion vector corrected. The correction value is specified by a first parameter and a second parameter, the first parameter indicating a table to be selected from among a plurality of tables each including values, the second parameter indicating one of the values included in the table to be selected indicated by the first parameter. In each of the plurality of tables, a smaller value among the values is assigned a smaller index. Each of the plurality of tables includes a different minimum value among the values.

Abstract: A system, comprising a computer that includes a processor and a memory, the memory storing instructions executable by the processor to determine an object location prediction based on a video data stream, wherein the object location prediction is based on processing cropped TEDA data with a neural network. The processor can be further programmed to download the object location prediction to a vehicle based on a location of the vehicle.

Abstract: Aspects of the disclosure provide methods and apparatuses for video coding. In some examples, an apparatus includes processing circuitry. The processing circuitry determines first and second reference motion vectors for decoding a current block based on coding information of at least one previously decoded block, offsets a first component to obtain a shifted first component, and offsets a second component to obtain a shifted second component. The processing circuitry generates a third component, on the first coordinate axis, of a first averaged reference motion vector by adding the shifted first component and the shifted second component, and constructs a list of reference motion vectors incorporating the first and second reference motion vectors and the first averaged reference motion vector. The processing circuitry also determines a motion vector predictor using the list of reference motion vectors, and decodes the current block for output based on the determined motion vector predictor.

Abstract: According to one embodiment of the present invention, a video information encoding method comprises: a step of predicting information of the current coding unit to generate prediction information; and a step of determining whether the information of the current coding unit coincides with the prediction information. If the information of the current coding unit coincides with the prediction information, a flag indicating that the information of the current coding unit coincides with the prediction information is encoded and transmitted. If the information of the current coding unit does not coincide with the prediction information, a flag indicating that the information of the current coding unit does not coincide with the prediction information is encoded and transmitted and the information of the current coding unit is encoded and transmitted.

Abstract: A method of video decoding in a decoder is described. A coded video bit stream is received. The coded video bit stream includes a block. An integer value p1 of a first motion vector component and an integer value p2 of a second motion vector component are received. The integer value p1 is associated with a corner of the block and the integer value p2 is associated with another corner of the block. The first motion vector component and the second motion vector component are of a same type of motion vector component. A motion vector predictor of the block is interpolated from the integer value p1 and the integer value p2 based on a lookup table and one or more of operations that only include addition, subtraction, and multiplication. A sample of the block is reconstructed based on the interpolated motion vector predictor of the block.

Abstract: An encoder includes circuitry and memory connected to the circuitry. In operation, the circuitry: selects a first table to be used for a current partition to be encoded in an image of a video, from among tables that are used to correct a base motion vector in a predetermined direction using a correction value specified by an index, the tables including correction values having varying differences between indexes; writes a parameter indicating a first index to be selected from among indexes included in the first table; and encodes the current partition using the base motion vector corrected using a correction value specified by the first index.

Abstract: Objects in a facility, such as users or totes, may be tracked as the object moves within the facility. An object representation of the object may be detected using image data. Apparent motion of the object representation may also be detected based on changes within the image data over time, which can help determine movement data for the object representation. However, the identity of the object representation may not be known. Using data from motion sensors in a device, movement data for the device can be generated. Thereafter, the movement data determined using the image data and the movement data determined using the data from the motion sensors in the device are compared for a possible match. If a match is found, an identifier of the device may then be associated with the object representation in the image data for tracking purposes.

Abstract: In general, the subject matter can be embodied in methods, systems, and program products for identifying, by a computing system and using first and second frames of a video, a transformation that indicates movement of a camera with respect to the frames. The computing system generates a modified transformation so that the transformation is less representative of recent movement. The computing system uses the transformation and the modified transformation to generate a second transformation. The computing system identifies an anticipated distortion that would be present in a stabilized version of the second frame. The computing system determines an amount by which to reduce a stabilizing effect. The computing system applies the second transformation to the second frame to stabilize the second frame, where the stabilizing effect has been reduced based on the determined amount by which to reduce the stabilizing effect.

Abstract: A visual tracker may track an object by identifying the object in a frame, and the visual tracker by identify the object in the frame within a search region. The search region may be provided by a motion modeling system that independently models the motion of the object and models the motion of the camera. For example, an object motion model of the motion modeling system may first model the motion of the object, assuming the camera is not in motion, in order to identify the expected position of the object. A camera motion model of the motion modeling system may then update the expected position of the object, obtained from the object motion model, based on the motion of the camera.

Abstract: A quantized subset of set of image data is obtained. One or more iterations of inverse quantization are performed on the quantized subset until a de-quantized subset is produced that meets specified criteria. A block of an image frame is determined based at least in part on the de-quantized subset. The block is stored in a region of the memory allocated for storage of the block. A set of blocks that includes the block is output from the memory.

Abstract: Aspects of the disclosure provide methods and a decoder device for video decoding. In some embodiments, the decoder device for video decoding includes processing circuitry. The processing circuitry selects a motion vector of a neighboring sub-block that is a neighbor of a current block under reconstruction. The current block is in a coded picture that is a part of a coded video bitstream. The processing circuitry determines, from the motion vector, motion vector predictors for a plurality of sub-blocks included in the current block. The neighboring sub-block and the plurality of sub-blocks are in a first one of a single row and a single column of the coded picture.

Abstract: When carrying out an average prediction, an intra predictor carries out a filtering process on target pixels of the intra prediction located at an upper end and a left end of the block, the filtering process using an intermediate prediction value, which is an average value of adjacent pixels of the block, and at least one adjacent pixel of the target pixel. The intra predictor also sets a filter coefficient to ¾, associated with the intermediate prediction value for a target pixel at the left end of the block other than the target pixel at an upper left corner of the block, and sets a filter coefficient to ¼, associated with the adjacent pixel adjacent to the left side of the target pixel at the left end of the block. As a result, prediction errors locally occurring can be reduced, and the image quality can be improved.

Abstract: The present invention relates to an image processing device and method, which realize improvement in encoding efficiency for color difference signals and reduction in address calculations for memory access. In a case where a block size of orthogonal transform is 4×4, and a macroblock of luminance signals is configured of four 4×4 pixel blocks appended with 0 through 1, the four luminance signal blocks are corresponded with one color difference signal 4×4 block appended with C. At this time, there exist four motion vector information of mv0, mv1, mv2, and mv3, as to the four luminance signal blocks. The motion vector information mvc of the one color difference signal 4×4 block is calculated by averaging processing using these four motion vector information. The present invention can be applied to an image encoding device which performed encoding based on the H.264/AVC format, for example.

Abstract: A method and apparatus for adaptive denoising of source video in a video conference application is provided. Source video frames received from a video capture device are divided into a plurality of 16×16 blocks. For each source block, a moving object detection process and a noise estimation process are performed. Then temporal denoising is adaptively applied to the blocks of the source frame based on the noise estimation and moving object detection. The adaptively filtered blocks are provided to an output frame and forwarded to a coding module for encoding.

Abstract: An image processing apparatus includes a memory that stores instructions, and a processor in communication with the memory. The processor executes the instructions to set a plurality of image sets according to a predetermined rule using a plurality of images obtained by continuous photography, to generate a first conversion coefficient corresponding to a moving amount of an object between images in each of the plurality of image sets, and to generate a second conversion coefficient used for an alignment process of a base image and a correction target image other than the base image by using a plurality of first conversion coefficients. The base image and the correction target image are included in the plurality of images.

Abstract: A method and an apparatus of providing content using a web-based virtual desktop protocol are provided. The method of providing content by the apparatus of using a web-based virtual desktop protocol includes monitoring a network status of a client, adjusting encoding quality of content based on the network status of the client, and providing the content of the adjusted encoding quality to the client, wherein the content of the adjusted encoding quality is applied through a web browser of the client.

Abstract: Aspects of the disclosure provide methods and apparatuses for video coding. In some examples, an apparatus includes processing circuitry that stores reconstructed samples of a reconstructed block in a memory. When a current sub-block in a current block is to be reconstructed using intra block copy (IBC) based on a reference sub-block in the reconstructed block, the processing circuitry determines whether the reconstructed samples of the reference sub-block stored in the memory are indicated as overwritten based on a position of the current sub-block, generates reconstructed samples of the current sub-block based on the reconstructed samples of the reference sub-block when the reconstructed samples of the reference sub-block stored in the memory are determined to be indicated as not overwritten, and overwrites the reconstructed samples of a collocated sub-block in the reconstructed block stored in the memory with the generated reconstructed samples of the current sub-block.

Abstract: There is provided a terminal device capable of efficiently performing communication in a communication system in which a base station device and the terminal device communicate with each other. The terminal device that communicates with the base station device by using a plurality of aggregated cells recognizes that a serving cell is stopped in a first state, recognizes that the serving cell is started in a second state, and switches from the first state to the second state based on a received PDCCH.

Abstract: An apparatus and a method for encoding a video signal. A segment of a reference frame and an extension region generated from another segment are used for encoding a current frame by inter-prediction. An apparatus and a method for decoding are also disclosed.

Abstract: An information processing apparatus includes a memory and a processor which changes a frame rate in a period of moving picture data to a first set value of the frame rate, codes respective pictures in the period to obtain a code amount according to the first set value, calculates a cumulative value of a code amount of each kind of pictures different in applicable coding processing regarding the respective pictures included in the period, calculates a ratio of the cumulative value, estimates a change tendency of a difficulty level of coding of respective pictures in a next period after the period based on transition of the frame rate and transition of the ratio of the cumulative value, and obtains a second set value of the frame rate and a third set value of a bit rate applied to the next period according to the change tendency of the difficulty level.

Abstract: A displacement field relating positions of pixels between at least two images having an initial displacement field is adjusted. Each pixel of the first image and the second image is associated with a label. A first pixel in the first image maps to a second pixel in the second image based on a vector of the initial displacement field. A set of third pixels includes the second pixel and a plurality of adjacent pixels to the second pixel, the third pixels being associated with labels and a candidate shift vector with respect to the second pixel. A covariance score is determined for each of the third pixels, the covariance score defining a statistical dependence between the first label of the first pixel and each of the third labels. An adjustment shift vector is then determined based on the covariance scores and the candidate shift vectors of the third pixels.

Abstract: A method of combining content from multiple frames with overlapping field of views is described. The method comprises identifying corresponding blocks between a first frame and a second frame of an image; and determining whether to replace at least a portion of the first frame with a corresponding portion of the second frame based on whether there is a match between the first frame and the second frame.

Abstract: A method and apparatus for video encoding or decoding used by a video encoder or decoder respectively. In one method, input data associated with a video sequence are received. A current sequence header for a current picture is determined. Whether the current sequence header corresponds to a first sequence header or a second sequence header is determined. If the current sequence header corresponds to the second sequence header, one or more syntax values of a syntax set associated with the first sequence header are assigned to corresponding one or more syntax values of the syntax set associated with the current sequence header. The current picture is then encoded or decoded according to the current sequence header.

Abstract: A method for encoding a video sequence is provided that includes signaling in the compressed bit stream that a subset of a plurality of partitioning modes is used for inter-prediction of a portion of the video sequence, using only the subset of partitioning modes for prediction of the portion of the video sequence, and entropy encoding partitioning mode syntax elements corresponding to the portion of the video sequence, wherein at least one partitioning mode syntax element is binarized according to a pre-determined binarization corresponding to the subset of partitioning modes, wherein the pre-determined binarization differs from a pre-determined binarization for the least one partitioning mode syntax element that would be used if the plurality of partitioning modes is used for inter-prediction.

Abstract: A method and apparatus for controlling a motion vector buffer for encoding or decoding of a video sequence includes identifying a set of motion vectors associated with an above coding tree unit (CTU), wherein each motion vector is associated with a P×Q grid, and the set of motion vectors is associated with an N×M grid. A motion vector is determined based on the set of motion vectors. The motion vector, in the motion vector buffer, is accessed based on a candidate block including a position associated with the N×M grid. A current CU can search from each 4×4 position for a current block. When the search range is beyond the current CTU, the motion vector (MV) data from the last row of the above CTU is used.

Abstract: Encoding and decoding architectures for 3D video delivery are described, such as 2D compatible 3D video delivery and frame compatible 3D video delivery. The architectures include pre-processing stages to pre-process the output of a base layer video encoder and/or decoder and input the pre-processed output into an enhancement layer video encoder and/or decoder of one or more enhancement layers. Multiplexing methods of how to combine the base and enhancement layer videos are also described.

Abstract: A radiation imaging apparatus includes a pixel array in which a plurality of pixels are arrayed and a processing unit configured to process pixel signals non-destructively read out from the respective pixels. The processing unit performs a first process of obtaining image data of a plurality of frames by repeatedly reading out image data while the pixel array is irradiated with radiation, with a group of pixel signals from the plurality of pixels corresponding to image data of one frame, and a second process of generating data for a radiation image based on data differences between the image data of the plurality of frames.

Abstract: A method for decoding video includes creating a first list of motion vectors from at least one neighboring block in a current frame of the video and creating a second list of motion vectors from at least one previous block in a temporally earlier frame of the video. A third list of motion vectors is created based upon the first list and the second list. Based upon receiving a motion vector competition control parameter selecting one of the motion vectors from the third list, wherein the second list of motion vectors is further based upon a flooring function.

Abstract: An apparatus and method of five dimensional (5D) video stabilization with camera and gyroscope fusion. According to one embodiment, an apparatus includes a feature matcher configured to receive an image sequence and determine feature pairs in the image sequence; a residual two-dimensional (2D) translation estimator connected to the feature matcher and configured to determine a raw 2D translation path; a residual 2D translation smoother connected to the residual 2D translation estimator and configured to determine a 2D smoothed translation path; a distortion calculator connected to the residual 2D translation estimator and the residual 2D translation smoother and configured to determine a distortion grid; and a distortion compensator connected to the distortion calculator and configured to compensate for distortion in the image sequence.

Abstract: Described in detail herein are systems and methods a data repository for an Electronic Document Interchange (EDI) system. A data repository management system can receive from a party system, at least one EDI document type, information associated with the third party system, a first set of data requests and a first set of data responses. The data repository management system can be operatively coupled to a data repository including a master self-referential table defining a hierarchy for the data repository. The data repository can further include a child table, a first sub-child table and a second sub-child table. The data repository management system can generate a rows in the master self-relational table, child table, first sub-child table and second sub-child table to store the information associated with the third party system and an associated EDI document.

Abstract: A motion estimation technique finds first and second candidate bi-directional motion vectors for a first region of an interpolated frame of video content by performing double ended vector motion estimation on the first region. One of these candidate bi-directional motion vectors is selected, and used to identify a remote region of the interpolated frame. This remote region is located at an off-set location from the first region, and is found based on an endpoint of the selected candidate bi-directional motion vector. A remote motion vector for the remote region of the interpolated frame is obtained, and one or more properties of this remote motion vector are used to bias a selection between the first and second candidate vectors.

Abstract: An example method of filtering a reconstructed block of video data includes obtaining, by one or more processors, reconstructed samples of a current block of the video data; and selectively bilaterally filtering, by the one or more processors, the reconstructed samples of the current block to generate a filtered current block. In this example, selectively bilaterally filtering the reconstructed samples of the current block comprises refraining from bilaterally filtering at least one reconstructed sample of the current block such that the filtered current block includes at least one non-bilaterally filtered sample.

Abstract: Systems and methods for predicting object motion and controlling autonomous vehicles are provided. In one example embodiment, a computer implemented method includes obtaining state data indicative of at least a current or a past state of an object that is within a surrounding environment of an autonomous vehicle. The method includes obtaining data associated with a geographic area in which the object is located. The method includes generating a combined data set associated with the object based at least in part on a fusion of the state data and the data associated with the geographic area in which the object is located. The method includes obtaining data indicative of a machine-learned model. The method includes inputting the combined data set into the machine-learned model. The method includes receiving an output from the machine-learned model. The output can be indicative of a predicted trajectory of the object.

Abstract: A wireless field device for use in an industrial process control or monitoring system includes a controller configured to control operation of the wireless field device. Wireless communication circuitry is configured to wirelessly communicate with a remote location. An internal power source powers the wireless field device. An image capture device is coupled to the controller and configured to capture an image of an environment of the wireless field device. The controller is adapted to receive image information from the image capture device and transmit compressed image information to the remote location.

Abstract: A system and method for coding a block of video data in block prediction mode for display stream compression (DSC) is disclosed. In one aspect, the method includes determining a candidate block to be used for predicting a current block in a current slice. The candidate block may be within a range of locations defined by one or more block prediction parameters. The method further includes determining, based on the candidate block and the current block, a prediction vector identifying a location of the candidate block with respect to the current block, and coding the current block in block prediction mode at least in part via signaling the prediction vector identifying the location of the candidate block with respect to the current block.

Abstract: A head mounted display device includes a head mounted display panel, a motion tracker which tracks a movement of the head mounted display panel according to a head movement of a user and outputs sensing data, an image corrector which shifts and outputs entire image data based on the sensing data when the head mounted display panel rotates, a data driver which converts the entire image data output from the image corrector into a data signal and provides the data signal to the head mounted display panel, and a scan driver which provides a scan signal to the head mounted display panel.

Abstract: An image processing method and an apparatus are provided. The image processing method includes acquiring first image data including a plurality of target pixels, acquiring synthesis information by which a relationship, between each of the plurality of target pixels included in the first image data and at least one background pixel included in different image data to be synthesized with the first image data, is determined, and synthesizing a target pixel of the first image data with the at least one background pixel of second image data, based on the synthesis information according to determination of the second image data. The second image data includes the different image data to be synthesized with the first image data.

Abstract: A system and method for improving the coding efficiency of motion vector information in video coding. According to various embodiments, a list of motion vector predictor candidates is arranged according to predefined rules. Each motion vector also has a reference index associated with it. One of the motion vector candidates is then selected as a predictor based on predefined rules, or the selection is explicitly signaled in the bitstream. The reference index associated with the selected motion vector is used as a reference index for the current block. The reference index is predicted along with the motion vector. Such embodiments can improve the compression efficiency of modern video codecs.

Abstract: Systems, methods, and instrumentalities are disclosed for encoder and/or decoder optimization using a multi-threaded parallel processing framework. An encoding and/or decoding device may receive a video sequence that includes a plurality of first-temporal level pictures associated with a first temporal level and a plurality of second-temporal level pictures associated with a second temporal level. The encoding and/or decoding device may allocate a first number of parallel processing threads for encoding and/or decoding the first-temporal level pictures and a second number of parallel processing threads for encoding and/or decoding the second-temporal level pictures. The device may perform this allocation based on temporal level priority, for example. The encoding and/or decoding device may encode and/or decode the first-temporal level pictures and the second-temporal level pictures.

Abstract: A motion estimation method for video data including frames and an apparatus therefor are provided. The motion estimation method includes determining whether a current frame unit for which motion estimation is to be performed corresponds to a double block, when the current frame unit corresponds to a double block, acquiring a candidate vector set corresponding to a first single block included in the double block, as a candidate vector set of the double block, individually calculating a confidence function value of each candidate vector included in the candidate vector set of the double block, for the first single block and a second single block included in the double block, and acquiring an estimated motion vector of the first single block and an estimated motion vector of the second single block, based on the calculated confidence function value of each candidate vector.

Abstract: An encoding device that performs an encoding process on a moving image by using motion estimation according to the present invention includes: an acquisition unit that acquires a framerate of the moving image; a setting unit that performs setting of the number of reference frames on each frame of the moving image in accordance with the framerate; and an estimation unit that performs the motion estimation by using a frame to be encoded and a reference frame acquired based on the setting, and the setting unit performs the setting such that the number of reference frames is smaller when the framerate is higher.

Abstract: Image-based object representation (OR) tracking of users or other objects in a facility may occasionally lose the identity associated with a particular OR. For example, in a crowded aisle the respective ORs for individual users may merge, resulting in a loss of identity of the particular OR. As the crowd dissipates, confidence in the identity of a particular OR may be low. In one implementation, image processing is used to determine OR movement data descriptive of the time(s) when the OR is in motion or stopped. Device movement based on data acquired by sensors on a mobile device carried by a user is descriptive of when the mobile device is in motion or stopped. A match between the particular OR movement data and the particular device movement data allows the identity of the particular OR to be determined as an identity associated with the mobile device.

Abstract: The present invention relates to a quadtree-based bandwidth compression prediction method and a system thereof. The bandwidth compression prediction method for example includes: dividing a to-be-predicted macroblock; obtaining a first prediction residual and a second prediction residual; judging whether re-dividing is performed on the to-be-predicted macroblock; and outputting the prediction residual and pixel component minimum values of the final sub-macroblocks divided from the to-be-predicted macroblock. According to the quadtree-based bandwidth compression prediction method and system, during the processing of complex texture images, the prediction effect is good, the processing efficiency is high, and the theoretical limit entropy can be reduced.

Abstract: A coding method including dividing pixels of a chrominance component of an input image into blocks having a predetermined size; selecting one among a direct current prediction method, a vertical prediction method, a horizontal prediction method, and a hybrid prediction method according to a user's input; generating a prediction value of each pixel in a current block to be predictively coded, using at least one pixel value among pixel values in an upper reference block adjacent to the current block and in a side reference block adjacent to the current block, according to the selected prediction method; generating a differential value between the prediction value and a corresponding real pixel value in the current block; and coding the differential value and information on the selected prediction method using a predetermined coding method.

Abstract: A retrieval information generation device includes a determination unit that determines retrieval document information for retrieving a phrase in an original document from an original document file which is created by reading the original document by an image reading device and is identified on the basis of identification information, an extraction unit that extracts retrieval image information for visually specifying the original document from the original document file, and a generation unit that associates the retrieval document information and the retrieval image information with the identification information of the original document file to generate a retrieval file.

Abstract: Provided is an information compression device or the like which is capable of compressing information required for encoding processing to a smaller size. The information compression device calculates a number of non-zero blocks having a value equal or greater than a predetermined value, determine a position for storing the non-zero blocks in a memory, and store only the non-zero blocks to a memory area in accordance with the determined position.

Abstract: A motion vector coding unit 117 executes processing including a neighboring block specification step (S100) of specifying a neighboring block which is located in the neighborhood of a current block; a judgment step (Steps S102, S104) of judging whether or not the neighboring block has been coded using a motion vector of another block; a prediction step (S106, S108) of deriving a predictive motion vector of the current block using a motion vector calculated from the motion vector of the other block as a motion vector of the neighboring block; and a coding step (S110) of coding the motion vector of the current block using the predictive motion vector.