Abstract: This disclosure describes filtering techniques applied by an encoder and a decoder during the prediction stage of a video encoding and/or decoding process. The filtering techniques may enhance the accuracy of predictive data used during fractional interpolation, and may improve predictive data of integer blocks of pixels. There are several aspects to this disclosure, including a useful twelve-pixel filter support that may be used for interpolation, techniques that use coefficient symmetry and pixel symmetry to reduce the amount of data needed to be sent between an encoder and a decoder to configure the filter support for interpolation, and techniques for filtering data at integer pixel locations in a manner that is similar to sub-pixel interpolation. Other aspects of this disclosure concern techniques for encoding information in the bitstream to convey the type of filter used, and possibly the filter coefficients used. Predictive coding of filter coefficients is also described.

Abstract: A method and apparatus for matching stereo images including calculating a data cost of at least one image, calculating a smoothness cost of the image, and matching pixels among pixels of a plurality of images based on the data cost and the smoothness cost.

Abstract: This application provides an image block matching method performed at a computing device, the method including: obtaining a target image block and an image; identifying a candidate image block within the image and multiple search points in the candidate image block; calculating a plurality of differences between the target image block and the candidate image block, each difference corresponding to a respective search point; choosing, among the plurality of differences, a smallest value and a corresponding smallest-value search point; and when the smallest-value search point is at the center of the target image block, choosing the candidate image block as a match of the target image block.

Abstract: Provided are an image encoding method and device. When carrying out image encoding for a block within a slice, at least one block in a restored block of the slice is set as a reference block. When this is done, the encoding parameters of the reference block are distinguished, and the block to be encoded is encoded adaptively based on the encoding parameters.

Abstract: Logging events in a media file, including: providing a logger tool to allow a user to view media in multiple ways and to capture and validate key events within the media file; and tracking and logging events in the media file by adding information to the media file including locations of bars and tone, slates, content, logos, commercial blacks, quality control issues, subtitles, and captions.

Abstract: A method for decoding video includes creating a first list of motion vectors from at least one neighboring block in a current frame of the video and creating a second list of motion vectors from at least one previous block in a temporally earlier frame of the video. A third list of motion vectors is created based upon the first list and the second list. Based upon receiving a motion vector competition control parameter selecting one of the motion vectors from the third list, wherein the second list of motion vectors is further based upon a flooring function.

Abstract: Image data representing a desktop image for a client device that is accessing the desktop remotely is compressed according to a method that preserves image fidelity in selected non-text regions. The method, which is carried out in a remote server, includes the steps of generating image data for the remote desktop image and analyzing different regions of the remote desktop image, identifying those regions of the remote desktop image that are text regions, selecting non-text regions of the remote desktop image for lossless compression based on a spatial relationship between the non-text regions and the text regions, compressing the image data using a lossless compression protocol for a portion of the image data corresponding to the selected non-text regions, and transmitting the compressed image data to the client device.

Abstract: Encoding and decoding using advanced motion estimation includes generating a first encoded frame by encoding a first frame from the input video stream, generating a reconstructed frame based on the first encoded frame, generating an encoded reference frame by encoding the reconstructed frame, wherein encoding the reconstructed frame includes storing the encoded reference frame in an external memory such that respective blocks from the encoded reference frame are directly accessible, generating a second encoded frame by encoding a second frame from the input video stream, and transmitting or storing the second encoded frame. Encoding the second frame includes generating reconstructed reference frame data, wherein generating the reconstructed reference frame data includes directly retrieving a block from the encoded reference frame from the external memory, and encoding the second frame using the reconstructed reference frame data.

Abstract: The invention generally relates to a method of providing random access for video data in which a P-frame of the video data is configured to be random accessible in addition to I-frames. More specifically, the invention relates to a method of providing random access for video data in which a P-frame is configured to be random accessible based on a random access reference frame which is provided via a separate channel such as header area of video data packets or a metadata file, whereby the random access for video data may be effectively provided with overcoming the conventional video random access technology depending on the I-frame only. The invention makes it possible to configure a P-frame random accessible simply by accompanying a random access reference frame of small datasize, whereby video compression ratio may be improved due to smaller numbers of I-frames being included in video data than conventional arts.

Abstract: Methods and devices are disclosed for panoramic video coding and decoding based on multi-mode boundary fill. If a predicted image block of a current image block is obtained by inter-frame prediction. The inter-frame prediction includes a boundary fill step of adaptively selecting a boundary fill method according to coordinates of a reference sample when the reference sample of a pixel in the current image block is outside the boundary of a corresponding reference image, to obtain a sample value of the reference sample. The panoramic video encoding and decoding method and device based on multi-mode boundary fill in the present invention make full use of the characteristic that horizontal image contents in a panoramic video are cyclically connected to optimize an image boundary fill method, such that the encoding can adaptively select a more reasonable boundary fill method according to the coordinates of a reference sample, thereby improving compression efficiency.

Abstract: An image device capable of compensating image variation includes at least one image capturer and a compensator. The compensator is electrically connected to the at least one image capturer for generating a 360 degree image, projecting the 360 degree image according to a view angle to generate a plane image corresponding to the view angle, detecting image position variation of at least one object of the plane image, and compensating the image position variation of the at least one object of the plane image, wherein position variation of the image device makes an image position of the at least one object be changed.

Abstract: A motion estimation technique finds first and second candidate bi-directional motion vectors for a first region of an interpolated frame of video content by performing double ended vector motion estimation on the first region. One of these candidate bi-directional motion vectors is selected, and used to identify a remote region of the interpolated frame. This remote region is located at an off-set location from the first region, and is found based on an endpoint of the selected candidate bi-directional motion vector. A remote motion vector for the remote region of the interpolated frame is obtained, and one or more properties of this remote motion vector are used to bias a selection between the first and second candidate vectors.

Abstract: Methods of recognizing motions of an object in a video clip or an image sequence are disclosed. A plurality of frames are selected out of a video clip or an image sequence of interest. A text category is associated with each frame by applying an image classification technique with a trained deep-learning model for a set of categories containing various poses of an object within each frame. A “super-character” is formed by embedding respective text categories of the frames as corresponding ideograms in a 2-D symbol having multiple ideograms contained therein. Particular motion of the object is recognized by obtaining the meaning of the “super-character” with image classification of the 2-D symbol via a trained convolutional neural networks model for various motions of the object derived from specific sequential combinations of text categories. Ideograms may contain imagery data instead of text categories, e.g., detailed images or reduced-size images.

Abstract: A P frame-based multi-hypothesis motion compensation method includes: taking an encoded image block adjacent to a current image block as a reference image block and obtaining a first motion vector of the current image block by using a motion vector of the reference image block, the first motion vector pointing to a first prediction block; taking the first motion vector as a reference value and performing joint motion estimation on the current image block to obtain a second motion vector of the current image block, the second motion vector pointing to a second prediction block; and performing weighted averaging on the first prediction block and the second prediction block to obtain a final prediction block of the current image block. The method increases the accuracy of the obtained prediction block of the current image block without increasing the code rate.

Abstract: An image processing apparatus (100) includes a synthesizer (101a) that synthesizes a first image (image A) with a second image (image B) having a parallax relative to the first image to generate a synthetic image, the first image and the second image being based on outputs of a single image sensor (7), and a filter (101b) that performs filtering processing on the synthetic image, the filtering processing being based on a point spread function of an image pickup optical system (1) that is used to generate the first image and the second image.

Abstract: The present disclosure generally relates to a method and device for encoding a frame. The method includes the steps of determining a backlight frame from the frame, calculating a residual frame responsive to the frame and the backlight frame, and predictive-encoding of the residual frame using a predictor of the residual frame calculated from an imposed frame (IMF), where the imposed frame is a low-dynamic version of the frame to be encoded. The disclosure relates also a method and device for decoding at least one bitstream representing a frame.

Abstract: A self-contained, low-cost, low-weight guidance system for vehicles is provided. The guidance system can include an optical camera, a case, a processor, a connection between the processor and an on-board control system, and computer algorithms running on the processor. The guidance system can be integrated with a vehicle control system through “plug and play” functionality or a more open Software Development Kit. The computer algorithms re-create 3D structures as the vehicle travels and continuously updates a 3D model of the environment. The guidance system continuously identifies and tracks terrain, static objects, and dynamic objects through real-time camera images. The guidance system can receive inputs from the camera and the onboard control system. The guidance system can be used to assist vehicle navigation and to avoid possible collisions. The guidance system can communicate with the control system and provide navigational direction to the control system.

Abstract: In one respect, there is provided a system for training a neural network adapted for classifying one or more scripts. The system may include at least one processor and at least one memory. The memory may include program code which when executed by the at least one memory provides operations including: receiving a disassembled binary file that includes a plurality of instructions; processing the disassembled binary file with a convolutional neural network configured to detect a presence of one or more sequences of instructions amongst the plurality of instructions and determine a classification for the disassembled binary file based at least in part on the presence of the one or more sequences of instructions; and providing, as an output, the classification of the disassembled binary file. Related computer-implemented methods are also disclosed.

Abstract: An approach is provided to detecting motion using statistical noise analysis. In the approach, reference statistics are calculated that relate to one or more noise characteristics that correspond to pixels in a first set of video images of an area being monitored. Current noise characteristics are received that correspond to the same pixels in a second set of video images of the area being monitored, with the first set of video images being captured before the second set of video images. Motion is detected in the area being monitored by comparing the reference statistics to the current noise characteristics.

Abstract: A method for streaming data corresponding to a video, each of a plurality of frames of the video being divided into n spatial tiles, the method includes transmitting, a description file to a client device, the description file including data about a spatial position of each of the n spatial tiles and including data about at least n URLs corresponding to the n spatial tiles, determining by the client device one or more URLs according to the data about the spatial position included in the description file, receiving from the client device, by a server, one or more request messages for requesting one or more spatial tiles, each request message comprising one of the URLs determined by the client device, and transmitting to the client device, by the server, video data corresponding to the one or more spatial tiles, in response to one or more the request messages.

Abstract: A design method of LED freeform surface illumination system based on XY-polynomial obtains a plurality of data points of a freeform surface, wherein each data point includes a coordinate value Qi and a normal vector Ni. A sum of squares e1(P) of coordinate differences in z direction between the coordinate value Qi and the freeform surface is applied, and by a sum of squares e2(P) between the normal vector Ni of the data points and normal vector ni of the freeform surface a modulus of vector differences is acquired. An evaluation function ƒ(p)=e1(P)+we2(P) is proposed and a plurality of freeform surface shapes obtained by selecting different weightings. The freeform surface shape which has the best imaging quality is achieved as a final shape, and a freeform surface lens based on the final shape is constructed to establish an LED freeform surface illumination system.

Abstract: An object detection method and apparatus are provided. The object detection method may include adaptively generating a pyramid image corresponding to a current frame based on information associated with a target object detected from a previous frame.

Abstract: A graphics pipeline with components that process frames by portions (e.g., pixels or rows) or slices to reduce end-to-end latency. Components of a pipeline process portions of a same frame at the same time. For example, as graphics data for a frame is being generated and fills a framebuffer, once a certain portion of video data less than the whole frame (slice or sub-frame) becomes available, before the corresponding frame is finished filling the framebuffer, the next pipeline component after the framebuffer, for instance a video processor for color conversion or an encoder, begins to process the portion of the frame. While one portion of a frame is accumulating in the frame buffer, another portion of the same frame is being encoded by an encoder, and another portion of the frame might be being packaged by a multiplexer, and a network socket might start streaming the multiplexed portion.

Abstract: An electronic device, a system and a method for diet management based on image analysis are provided. The system includes a computer and a database. The computer comprises a processor for performing the following operations: capturing at least one diet image via an image capture device; pre-processing the at least one diet image so as to obtain at least one diet region from the at least one diet image and obtain at least one detailed food segment from the diet region; extracting at least one diet image feature from the at least one detailed food segment; determining a diet type of the at least one detailed food segment based on the at least one diet image feature; and providing a personal diet characteristic analysis based on the diet type and an area of the at least one detailed food segment.

Abstract: This disclosure describes filtering techniques applied by an encoder and a decoder during the prediction stage of a video encoding and/or decoding process. The filtering techniques may enhance the accuracy of predictive data used during fractional interpolation, and may improve predictive data of integer blocks of pixels. There are several aspects to this disclosure, including a useful twelve-pixel filter support that may be used for interpolation, techniques that use coefficient symmetry and pixel symmetry to reduce the amount of data needed to be sent between an encoder and a decoder to configure the filter support for interpolation, and techniques for filtering data at integer pixel locations in a manner that is similar to sub-pixel interpolation. Other aspects of this disclosure concern techniques for encoding information in the bitstream to convey the type of filter used, and possibly the filter coefficients used. Predictive coding of filter coefficients is also described.

Abstract: Provided is an image processing apparatus including: area determination unit configured to determine whether or not an area of a control block functioning as control unit for filtering of an image includes a processing-target slice area of a plurality of slices formed in a frame of an encoded image; control information creation unit configured to create filter control information representing whether or not the filtering is performed for the area of the control block including a processing-target slice for each area of the control block including the processing-target slice when the area determination unit determines that the area of the control block includes the area of the processing-target slice; and filter unit configured to perform filtering for the image based on the filter control information created by the control information creation unit.

Abstract: An image processing method and device are provided. The method includes: choosing content-associated sub pixels in an image to be processed; obtaining an initial color level value of each of the content-associated sub pixels in the image to be processed; adding to least one digit to an end of the initial color level value and assigning a preset value to each added digit so as to obtain a processed color level value; and replacing the initial color level value with the processed color level value.

Abstract: A circuit for decoding a video, comprising: at least one entropy transcoder configured to perform at least one entropy transcoding on a received bit stream, to generate transcoded streams, wherein the entropy transcoding includes transcoding syntax for the bit stream; at least one main decoding unit configured to perform at least one transcoded stream decompression and pixel decodings on a frame of the transcoded streams.

Abstract: A system and method for improving the coding efficiency of motion vector information in video coding. According to various embodiments, a list of motion vector predictor candidates is arranged according to predefined rules. Each motion vector also has a reference index associated with it. One of the motion vector candidates is then selected as a predictor based on predefined rules, or the selection is explicitly signaled in the bitstream. The reference index associated with the selected motion vector is used as a reference index for the current block. The reference index is predicted along with the motion vector. Such embodiments can improve the compression efficiency of modern video codecs.

Abstract: A video codec for encoding a sequence of video frames divides a video frame area into number of row segments. The Video encoder selects a different set of row segments in each video frame in a set of video frames and encodes the selected set of row segments by intra-prediction. As a result, the selected part of the frame is intra-refreshed. The video codec limits the maximum value of the vertical global motion vector GMVy to zero and video codec adjust the number of row segments in the select set of row segments based on the height of the search range configured for the motion estimation. As a result, the video codec may not refer to a un-refreshed portion in the previous frame for encoding an already refreshed area of the current frame.

Abstract: A scene change is determined using a first and a second video signal, each representing the same scene or content, but at a different color grade (such as dynamic range). A set of prediction coefficients is generated to generate prediction signals approximating the first signal based on the second signal and a prediction model. A set of prediction error signals is generated based on the prediction signals and the first signal. Then, a scene change is detected based on the characteristics of the prediction error signals. Alternatively, a set of entropy values of the difference signals between the first and second video signals are computed, and a scene change is detected based on the characteristics of the entropy values.

Abstract: An information processing apparatus includes a first acquiring unit, an addition unit, a second acquiring unit, and an extraction unit. The first acquiring unit acquires a first group of elements included in a first image generated by reading a document. The addition unit generates multiple second images by adding noises that differ from each other to the first image. The second acquiring unit acquires second groups of elements included in the respective multiple second images. The extraction unit extracts an element representing characteristics of the document from the first group of elements in accordance with the degrees of similarity between elements included in the first group of elements and elements included in the multiple second groups of elements.

Abstract: A coefficient presence/absence flag decoding unit, included in a quantized residual information decoding unit which reduces a processing amount related to coding and decoding of a transform coefficient, splits a target frequency domain or a target pixel domain into sub-blocks, and derives different context indexes with respect to each transform coefficient in a pixel domain, obtained through a transform skip or a transform/quantization bypass, and each transform coefficient which is obtained for each frequency component through frequency transform.

Abstract: Various techniques are disclosed to suppress distortion in images (e.g., video or still images), such as distortion caused by atmospheric turbulence. For example, similar image blocks from a sequence of images may be identified and tracked along motion trajectories to construct spatiotemporal volumes. The motion trajectories are smoothed to estimate the true positions of the image blocks without random displacements/shifts due to the distortion, and the smoothed trajectories are used to aggregate the image blocks in their new estimated positions to reconstruct the sequence of images with the random displacements/shifts suppressed. Blurring that may remain within each image block of the spatiotemporal volumes may be suppressed by modifying the spatiotemporal volumes in a collaborative fashion.

Abstract: During a video encoding or decoding process, a predicted prediction block is generated for a CU. The CU may have two or more prediction units (PUs). A computing device selects a neighbor region size. After the computing device selects the neighbor region size, samples in a transition zone of the prediction block are identified. Samples associated with a first PU are in the transition zone if neighbor regions that contain the samples also contain samples associated with a second PU. Samples associated with the second PU may be in the transition zone if neighbor regions that contain the samples also contain samples associated with the first PU. The neighbor regions have the selected neighbor region size. A smoothing operation is then performed on the samples in the transition zone.

Abstract: There is provided a terminal device capable of efficiently performing communication in a communication system in which a base station device and the terminal device communicate with each other. The terminal device that communicates with the base station device by using a plurality of aggregated cells recognizes that a serving cell is stopped in a first state, recognizes that the serving cell is started in a second state, and switches from the first state to the second state based on a received PDCCH.

Abstract: An optical image stabilizer including an angular velocity calculator configured to receive an angular velocity signal from an angular velocity sensor and output a corrected angular velocity signal and an angular position signal; a state detector configured to calculate an autocorrelation value according to the corrected angular velocity signal, compare the autocorrelation value with a threshold value to determine a stopped state or a moving state of a camera module, and output a corrected angular position signal and control coefficients; and a lens controller configured to control a lens module according to the corrected angular position signal and the control coefficients.

Abstract: A read command is received from a host requesting data from a portion of a first memory of a data storage system and it is determined whether one or more sections of the first memory including the portion have previously been written to by the host. If it is determined that the one or more sections have not previously been written to by the host, predetermined data is sent to the host in response to the read command without reading the portion of the first memory. According to another aspect, the requested data from the read command is cached in a second memory of the data storage system based on whether the one or more sections of the first memory have previously been written to by the host.

Abstract: An image encoding method including: a constraint information generating step of generating tile constraint information indicating whether or not there is a constraint in filtering on boundaries between adjacent tiles among a plurality of tiles obtained by dividing a picture, and storing the tile constraint information into a sequence parameter set; and a filter information generating step of generating, for each of the boundaries, one of a plurality of filter information items respectively indicating whether or not filtering is executed on the boundaries, and storing the plurality of filter information items into a plurality of picture parameter sets, wherein, in the filter information generating step, the plurality of filter information items which indicate identical content are generated when the tile constraint information indicates that there is the constraint in the filtering.

Abstract: Scalable motion estimation is provided for macroblocks of a picture with the macroblocks being subdividable into partitions of different shapes and sizes. One embodiment of a method for performing motion estimation includes setting a target complexity for a macroblock of a source frame and performing motion estimation for one or more partitions of the macroblock until the target complexity is met. The macroblock partitions can be rectangular, square or a combination of rectangular and square.

Abstract: An image processing apparatus includes a division unit configured to divide an input image into a plurality of subblocks subjected to quantization control a subblock quantization parameter calculation unit configured to calculate a quantization parameter of each of the subblocks, a basic block quantization parameter calculation unit configured to set a basic block including at least two subblocks and to calculate a quantization parameter of the basic block, a difference value calculation unit configured to calculate a difference value between the quantization parameter of the basic block and the quantization parameter of each subblock included in the basic block, and a difference value coding unit configured to code the difference value.

Abstract: An image decoding method includes: dividing a current block into sub-blocks; deriving, for each sub-block, one or more prediction information candidates; obtaining an index; and decoding the current block using the prediction information candidate selected by the index.

Abstract: Systems, methods, and instrumentalities are disclosed relating to intra prediction of a video signal based on mode-dependent subsampling. A block of coefficients associated with a first sub block of a video block, one or more blocks of coefficients associated with one or more remaining sub blocks of the video block, and an indication of a prediction mode for the video block may be received. One or more interpolating techniques, a predicted first sub block, and the predicted sub blocks of the one or more remaining sub blocks may be determined. A reconstructed first sub block and one or more reconstructed remaining sub blocks may be generated. A reconstructed video block may be formed based on the prediction mode, the reconstructed first sub block, and the one or more reconstructed remaining sub blocks.

Abstract: There is provided a terminal device capable of efficiently performing communication in a communication system in which a base station device and the terminal device communicate with each other. The terminal device that communicates with the base station device by using a plurality of aggregated cells recognizes that a serving cell is stopped in a first state, recognizes that the serving cell is started in a second state, and switches from the first state to the second state based on a received PDCCH.

Abstract: A receiving device performs an action that results in a corrective measure being taken to address a picture quality issue detected in real time in the frames currently being displayed on a television or other device. The receiving device or a remote system compares indications of video frames currently being displayed to stored video frames for that program to detect macroblocking or a frozen video frame. The macroblocking or a frozen video frame may also or instead be detected by image analysis of the frames currently being displayed. If macroblocking or a frozen video frame is detected in the frames currently being displayed, the set-top box may switch to an alternative video source, change to a standard definition channel broadcasting the same video program or perform other corrective actions.

Abstract: A video encoder generates an encoded video bitstream comprising a plurality of layers. At least one access unit of the encoded video bitstream includes one or more Instantaneous Decoding Refresh (IDR) pictures and one or more non-IDR pictures. The IDR pictures include only slices that are decoded using intra prediction only. The video encoder outputs the encoded video bitstream. A video decoder decodes the encoded video bitstream.

Abstract: An information processing apparatus includes, a storage unit that stores an image to be transmitted, an update-frequency setter that sets, for respective sections set in the image to be transmitted, update frequencies of images stored for the sections in a predetermined period of time, an association-degree setter that sets association degrees to indicate degrees of association between the sections based on the update frequencies, a priority setter that identifies the section on which an operation is performed and sets a higher priority for the identified section and the section having a highest degree of association with the identified section than priorities for other sections, and a transmitter that transmits the image, stored by the storage unit, in sequence with the images stored for the sections whose set priority is higher first.

Abstract: Method and apparatus for deriving a motion vector at a video decoder. A block-based motion vector may be produced at the video decoder by utilizing motion estimation among available pixels relative to blocks in one or more reference frames. The available pixels could be, for example, spatially neighboring blocks in the sequential scan coding order of a current frame, blocks in a previously decoded frame, or blocks in a downsampled frame in a lower pyramid when layered coding has been used.

Abstract: A motion vector coding unit 117 executes processing including a neighboring block specification step (S100) of specifying a neighboring block which is located in the neighborhood of a current block; a judgment step (Steps S102, S104) of judging whether or not the neighboring block has been coded using a motion vector of another block; a prediction step (S106, S108) of deriving a predictive motion vector of the current block using a motion vector calculated from the motion vector of the other block as a motion vector of the neighboring block; and a coding step (S110) of coding the motion vector of the current block using the predictive motion vector.

Abstract: In the method for predicting a bi-predictive block of a moving picture, first and second distinct motion-compensated blocks are obtained using first and second motion vectors respectively. The bi-predictive block of the moving picture is predicted using first and second variable weight factors associated with the first and second distinct motion-compensated blocks, respectively.