Abstract: An imaging element incorporates a reading portion, a storage portion, a processing portion, and an output portion. The reading portion reads out image data obtained by imaging from a photoelectric conversion element at a first frame rate. The storage portion stores the image data read out from the photoelectric conversion element. The processing portion processes the image data. The output portion outputs the image data processed by the processing portion at a second frame rate. The processing portion detects first image data indicating a specific image from the image data stored in the storage portion. The output portion outputs second image data based on image data different from the first image data detected by the processing portion in the image data of a plurality of frames. The second frame rate is a frame rate lower than the first frame rate.

Abstract: An image decoding method performed by a decoding apparatus according to the present disclosure includes receiving a bitstream including residual information; deriving quantized transform coefficients for a current block based on the residual information included in the bitstream; deriving transform coefficients for the current block from the quantized transform coefficients based on an inverse quantization process; deriving residual samples for the current block by applying inverse transform to the derived transform coefficients; and generating a reconstructed picture based on the residual samples for the current block.

Abstract: A computer-implemented system and method distilling three-dimensional structure to a two-dimensional raster with multiple discrete planes for purposes of safe and accurate route planning including a map generator, pixel encoder, map transformer, and route generator. The map generator generates a raster map by populating a blank map canvas with raster and vector data on a per-pixel basis and obtains values for pixels from the pixel encoder. The pixel encoder encodes type, plane, and elevator information of features into pixels. The map transformer converts the map produced by the map generator into a weighted graph of nodes and edges suitable for route generation. The route generator generates routes using the graph produced by the map transformer.

Abstract: A method for encoding including executing game logic built on a game engine of a video game at a cloud gaming server to generate video frames. The method including executing scene change logic to predict a scene change in the video frames based on game state collected during execution of the game logic. The method including identifying a range of video frames that is predicted to include the scene change. The method including generating a scene change hint using the scene change logic, wherein the scene change hint identifies the range of video frames, wherein the range of video frames includes a first video frame. The method including delivering the first video frame to an encoder. The method including sending the scene change hint from the scene change logic to the encoder. The method including encoding the first video frame as an I-frame based on the scene change hint.

Abstract: Aspects of the subject disclosure may include, for example, identifying a field of view (FoV) within a first frame of a video that occupies a sub-portion of the frame. A size is determined by subdividing a portion of the video according to a tiling scenario. Tiles overlapping the FoV are detected, and an updated size is determined based on an encoded version of the tiles and compared to a reference size. Responsive to the updated size being less than the reference size, the reference size is adjusted to the updated size, the tiling scenario is adjusted according to an adjusted tiling scenario, and the determining of the size is repeated based on the adjusted tiling scenario. Responsive to the updated size not being less than the reference size, a preferred tiling scenario is identified based on the adjusted tiling scenario for tiling the video. Other embodiments are disclosed.

Abstract: A transcoder for transcoding a basic representation of a videostream into one or more arbitrary representations comprises: a receiver adapted for receiving the basic representation and at least one frame information set comprising one or more frame information packets; a decoder adapted for decoding the basic representation; a re-encoder adapted for selecting at least one frame information set and for selecting one or more frame information packets from this at least one frame information set for forming a arbitrary representation, the re-encoder is adapted for extracting coding information from the frame information packets, and for re-encoding the decoded basic representation using the coding information thereby obtaining the one or more arbitrary representations.

Abstract: A method for compressing an image with bit rate control includes: compressing data of a current block with a compression level to produce compression data of the current block; in response to compression of the current block, accumulating a data size of compressed data of blocks that have been compressed to obtain an accumulated real size; in response to the compression of the current block, accumulating a target block size according to a number of blocks that have been compressed to obtain an accumulated target size; and adjusting the compression level for a next block according to at least the accumulated real size and the accumulated target size.

Abstract: Apparatus for data communications includes a host interface, which is configured to be connected to a bus of a host computer having a processor and a memory. Processing circuitry, which is coupled to the host interface, is configured to receive video data with respect to a sequence of pixels, the video data including data words of more than eight bits per pixel for at least one pixel component of the pixels, and to write the video data, via the host interface, to at least one buffer in the memory while justifying the video data in the memory so that the successive pixels in the sequence are byte-aligned in the at least one buffer.

Abstract: A device for processing video data includes a memory configured to store video data and one or more processors implemented in circuitry. The one or more processors are configured to generate a first weighting factor for a first reference picture in a first picture list using a second weighting factor for a second reference picture in a second picture list. The one or more processors are further configured to generate prediction information for a current block of video data using the first weighting factor and the second weighting factor.

Abstract: A method for increasing the quality of a section of visual data communicated over a network from a first node to a second node, the method at the second node including receiving a lower-quality visual data via a network, receiving a corresponding reference to an algorithm operable to increase a quality of the lower-quality visual data, the algorithm selected based on a higher-quality visual data from which the lower-quality visual data was generated, and using the algorithm to increase the quality of the lower-quality visual data to recreate the higher-quality visual data.

Abstract: A method for enhancing one or more sections of lower-quality visual data using a hierarchical algorithm, the method comprising receiving one or more sections of lower-quality visual data. The one or more sections of lower-quality visual data are enhanced to one or more sections of higher-quality visual data using the hierarchical algorithm. Additionally, at least the first step of the hierarchical algorithm is performed in a lower-quality domain; and wherein the hierarchical algorithm operates in both a higher-quality domain and the lower-quality domain.

Abstract: A data processing device according to an embodiment includes a sub-vector group generating unit, a codebook generating unit, and a converting unit. The sub-vector group generating unit generates, from a feature vector set of N number of D-dimensional feature vectors, M number of sub-vector groups (where M<D holds true). Each of the M number of sub-vector groups includes N number of dimension-variable sub-vectors obtained from the N number of D-dimensional feature vectors. For each of the M number of sub-vector groups, the codebook generating unit performs clustering of the N number of dimension-variable sub-vectors, and generates a codebook in which the representative vector of each cluster is associated with an index. The converting unit performs product quantization using the codebook and converts each of the N number of D-dimensional feature vectors into a compressed code made of a combination of M number of indexes.

Abstract: Methods and systems of determining a quantization step for encoding video based on motion data are provided. Video captured by an image capture device is received. The video comprises a video frame component. Additionally, motion data associated with the video frame component is received. Further, a quantization step for encoding the video frame component is determined based on the motion data.

Abstract: With a field sequential method, image display having sufficiently high color reproduction is performed, and an occurrence of color breakup is more reliably suppressed. In a field sequential liquid crystal display apparatus in which a plurality of subframes including a red subframe, a green subframe, a blue subframe, and a white (common color) subframe constitutes each frame, an image data conversion unit (30) converts input image data (D1) corresponding to red, green, and blue into driving image data (D2) corresponding to the plurality of subframes, based on an adjustment coefficient (Ks) and a distribution ratio (WRs) for the white subframe, for each pixel. Two distribution ratios are selectively used as the distribution ratio (WRs). A function of obtaining a second distribution ratio (WRsv2) of the two distribution ratios is set such that the distribution ratio (WRsv2) increases as the adjusted brightness (brightness after amplification and compression processing) (V) for an input image becomes smaller.

Abstract: A method of processing video data including receiving video data, determining luma scale parameters for each of a plurality of ranges of codeword values for luminance components of the video data, performing a dynamic range adjustment process on the luminance components using the luma scale parameters, determining chroma scale parameters for chrominance components of the video data using a function of the luma scale parameters, and performing a dynamic range adjustment process on the chrominance components of the video data using the chroma scale parameters.

Abstract: In some embodiments, a method receives sub-bitstreams from a multi-pass transcoding process of a video. A target quality is received based on a characteristic of transcoding of the video. Then, the method generates a combination of sub-bitstream chunks from the sub-bitstreams for the video. A set of exchange rates is calculated where each exchange rate defines how much bitrate will be reduced in relation to quality if an anchor sub-bitstream chunk from the combination of sub-bitstream chunks is replaced with another sub-bitstream chunk from other sub-bitstreams. Then method iteratively exchanges one of the anchor sub-bitstream chunks in the combination of sub-bitstream chunks with another sub-bitstream chunk based on the exchange rate of the anchor sub-bitstream chunk in the combination of sub-bitstream chunks until the quality measurement of the combination meets the target quality. Then, the combination of sub-bitstream chunks is recorded as a transcoded bitstream.

Abstract: An example method can comprise receiving an encoding parameter associated with a first content transmission. The encoding parameter can indicate a level of complexity to encode the first content transmission. The method can comprise selecting, based on the encoding parameter, a second content transmission. The second content transmission can be encoded at a second bit rate that is different than a first bit rate of the first content transmission. The method can also comprise generating a third content transmission. The third content transmission can comprise the second content transmission.

Abstract: An embodiment of a semiconductor package apparatus may include technology to store a block of self-contained data including one or more time sequential frames of image data from two or more camera positions, and access a portion of the image data based on a start location and offset information from a header of the block. Other embodiments are disclosed and claimed.

Abstract: Techniques to output a media stream, capture a media stream, or synchronize the output or capture of the media stream at a specified time are described. A media stream output or capture apparatus may include a media processor to receive a media stream to output or a request to capture a media stream and a start time. A buffer generator may be included to generate an input or an output buffer and a media mixer may be included to mix the media stream into the output buffer at the start time or capture the media stream from the input buffer at the start time.

Abstract: Data compression schemes may indicate the length of the compressed data block in a header or in the compressed data itself. If the start and end of the data block are known before the decoding process has completed by the decoding stage, a header processing stage can ‘skip ahead’ to the start of the next block to begin processing the header of the next block while the current block is still being decoded. Thus, the header processing stage and the decoding stage are operated concurrently. If the end of the compressed block is indicated in the compressed data itself the end of the data block is not known until the end of the compressed data block is reached. For these types of compressed data blocks, the header processing stage waits until the decoding stage finishes with the preceding block before processing the header of the current block.

Abstract: A sequence of picture slices is encoded as reference slices and non-reference slices, wherein the reference slices include B slices, by forming, for each B slice, at least one data packet containing data values derived from brightness and color information pertaining to the slice. The data packet for each B slice includes a header element indicating whether the B slice is a reference slice. The header element of each reference B slice has a value that depends on depth of the reference B slice in a hierarchy of discardability.

Abstract: Disclosed aspects may include, for example, maximizing a quality of experience when selecting encoding bitrates for downloading dynamically adaptive 360-degree panoramic video. Some embodiments include predicting a future orientation of a display region based on a first display region of the video, identifying predicted list of tiles for rendering the second display region, calculating a quality of experience from a plurality of encoding bitrates for the tiles in the second display region and one or more tiles in a margin area so that downloading the plurality of tiles at one or more bitrates is within estimated available embodiments, and downloading tiles for display.

Abstract: Systems and methods of adaptive streaming are discussed. Transcoded copies of a source stream may be aligned with one another such that the independently specified portions of each transcoded stream occur at the same locations within the content. These transcoded copies may be produced by one or more transcoders, whose outputs are synchronized by a delay adjuster. A fragmenter may use the synchronized and aligned streams to efficiently produce fragments suitable for use in adaptive streaming.

Abstract: A method for enhancing at least a section of lower-quality visual data using a hierarchical algorithm, the method comprising receiving at least a plurality of neighbouring sections of lower-quality visual data. A plurality of input sections from the received plurality of neighbouring sections of lower quality visual data are selected and features are extracted from those plurality of input sections of lower-quality visual data. A target section based on the extracted features from the plurality of input sections of lower-quality visual data is then enhanced.

Abstract: A method for enhancing at least a section of lower-quality visual data, the method comprising at least a section of the lower-quality visual data being received. A hierarchical algorithm is then selected from a plurality of hierarchical algorithms, wherein the step of selection is based on a predetermined metric and wherein the hierarchical algorithms were developed using a learned approach and at least one of the hierarchical algorithms is operable to increase the quality of the lower-quality visual data. The selected hierarchical algorithm is then used to increase the quality of the lower-quality visual data to create a higher-quality visual data.

Abstract: A method for training learned hierarchical algorithms, the method comprising the steps of receiving input data and generating metrics from the input data. At least one hierarchical algorithm is then selected from a plurality of predetermined hierarchical algorithms based on comparing the generated metrics from the input data and like metrics for each of the plurality of predetermined hierarchical algorithms. The selected hierarchical algorithm is developed based on the input data and the developed hierarchical algorithm is outputted.

Abstract: A method for enhancing visual data when communicating visual data over a network from a first node to a second node. The method at the first node comprises developing at least one modified hierarchical algorithm from a known hierarchical algorithm operable to substantially recreate at least one section of higher-quality visual data. References to one or more known hierarchical algorithms from which the modified hierarchical algorithms were developed are transmitted to the second node along with one or more modifications to the one or more known hierarchical algorithms operable to reproduce the one or more modified hierarchical algorithms from the known hierarchical algorithms. The second node is able to recreate substantially the higher-quality video using the modified hierarchical algorithm.

Abstract: A method and device for distorted compression of images displayed over a head mounted display (HMD) are provided. The method includes receiving, at a sink device, an image from a source device over a transport medium; determining, based on the optical means of the HMD, a circumscribed circle of the received image; determining a compression ratio based on at least radial attributes of the received image; and compressing, using a compression process, pixels inside the circumscribed circle of the received image, wherein the compression is based on the determined compression ratio.

Abstract: Provided are systems and methods, including an integrated circuit, for data decompression of data encoded using a fixed-length encoding technique. For a data set where some symbols appear more frequently than others, the frequent symbols can be encoded into a short encoded symbol, and the remaining symbols can be encoded into a long encoded symbol. A decompression circuit can include decoder circuits that, upon receiving a set of input bits, can determine whether the set of input bits include one long encoded symbol or one or more short encoded symbols. The decoder circuit can then decode the one long encoded symbol or the one or more short encoded symbol. The fixed length of the encoded symbols can enable the decompression circuit to output decoded symbols at a same rate at which the circuit receives encoded symbols.

Abstract: A computer-implemented system and method distilling three-dimensional structure to a two-dimensional raster with multiple discrete planes for purposes of safe and accurate route planning including a map generator (100), pixel encoder (102), map transformer (106), and route generator (108). The map generator (100) generates a raster map by populating a blank map canvas with raster and vector data on a per-pixel basis and obtains values for pixels from the pixel encoder (102). The pixel encoder (102) encodes type, plane, and elevator information of features into pixels. The map transformer (106) converts the map produced by the map generator (100) into a weighted graph of nodes and edges suitable for route generation. The route generator (108) generates routes using the graph produced by the map transformer (106).

Abstract: An image providing apparatus includes: a communication interface configured to perform communication with a display apparatus in a predetermined communication interface method; and a processor configured to acquire specification information of the display apparatus, to encode a first image signal to correspond to the predetermined communication interface method by applying at least one of a frame rate and a resolution corresponding to the acquired specification information, and to control the communication interface to transmit the encoded first image signal to the display apparatus.

Abstract: A system for providing visual content to a user, the system includes: a memory unit for storing information representative of a large image; an input for receiving a request to view a first portion of the large image; an encoder for processing the large image in order to generate macro-blocks and for generating an MPEG compliant video stream representative of the first portion of the large image; wherein the generating includes processing the macro-blocks that form the first portion; and a transmitter for transmitting over a cable network to the user the MPEG compliant video stream.

Abstract: An efficient demosaicing method includes reconstructing missing green pixels after estimating green-red color difference signals and green-blue color difference signals that are used in the reconstruction, and then constructing missing red and blue pixels using the color difference signals. This method creates a full resolution frame of red, green and blue pixels. The full resolution frame of pixels is sent to a display unit for display. In an efficient demosaicing process that includes local contrast enhancement, image contrast is enhanced to build and boost a brightness component from the green pixels, and to build chromatic components from all of the red, green, and blue pixels. Color difference signals are used in place of the red and blue pixels in building the chromatic components.

Abstract: A media table can be created by searching a digital document to identify media content within the digital document in a format associated with a client device and creating a media table containing a view of each of the identified media content.

Abstract: Techniques are disclosed for a client device to stream a user-selected media file from a content server. The client device may create a playlist of dynamic virtual chunks to represent a single media stream file on a streaming media server. The playlist itself may be generated from an index in the header of a given stream defining what chunks, or segments of multiplexed audiovisual content, are present within that stream. The playlist of dynamic virtual chunks provides the playback engine on the client device with a list of individual files that may be requested from the streaming server independently of one another, despite the stream being stored on the server as a single media stream file.

Abstract: An image capturing apparatus has an encoding unit that encodes by generating a plane of each of color components that configure image data, and independently for each of the planes of the color components, performing frequency conversion processing, quantization processing, and entropy encoding, and a control unit that controls the encoding unit. The control unit decide whether or not to correct a quantization coefficient that is used in quantization processing for a plane of each color component obtained by the image sensor based on an ISO sensitivity or exposure information for a time of capturing; and in a case when it decides that a quantization coefficient will be corrected, determines, based on a distribution of a histogram of a plane of each color component, a quantization coefficient used in quantization processing for the respective color component.

Abstract: The invention provides a video codec. In one embodiment, the video codec is coupled to an outer memory storing a reference frame, and comprises an interface circuit, an in-chip memory, a motion estimation circuit, and a controller. The interface circuit obtains in-chip data from the reference frame stored in the outer memory. The in-chip memory stores the in-chip data. The motion estimation circuit retrieves search window data from the in-chip data with a search window, and performs a motion estimation process on a current macroblock according to the search-window data. The controller shifts the location of the search window when the current macroblock is shifted, marks a macroblock shifted out from the search window as an empty macroblock, and controls the interface circuit to obtain an updated macroblock for replacing the empty macroblock in the in-chip memory from the reference frame stored in the outer memory.

Abstract: Systems, methods, and computer media for implementing convolutional neural networks efficiently in hardware are disclosed herein. A memory is configured to store a sparse, frequency domain representation of a convolutional weighting kernel. A time-domain-to-frequency-domain converter is configured to generate a frequency domain representation of an input image. A feature extractor is configured to access the memory and, by a processor, extract features based on the sparse, frequency domain representation of the convolutional weighting kernel and the frequency domain representation of the input image. The feature extractor includes convolutional layers and fully connected layers. A classifier is configured to determine, based on extracted features, whether the input image contains an object of interest. Various types of memory can be used to store different information, allowing information-dense data to be stored in faster (e.g., faster access time) memory and sparse data to be stored in slower memory.

Abstract: A transmitting device encodes information bits of a first type of information and a second type of information into a codeword. The transmitting device interleaves the encoded information bits of the first type of information according to a first interleaving pattern and the encoded information bits of the second type of information according to a second interleaving pattern, thereby changing an order of the encoded information bits of at least one of the first type of information and the second type of information in the codeword and generating an interleaved encoded information bit sequence. At least one of the first and the second interleaving pattern is designed to allow the information bits of a first type of information to be decoded without knowing a length of the codeword. The transmitting device then transmits the interleaved encoded information bit sequence to a receiving device.

Abstract: Disclosed are various embodiments that facilitate recording to a storage medium in a personal video recorder (PVR) system. In one embodiment, a transport stream is received. The transport stream is stored into a memory. An index table is generated that provides information for locating particular frames recorded in the memory.

Abstract: A system and a method for simultaneous transmission of multiple media streams in a fixed bandwidth network are disclosed herein. The system is comprised of a central gateway media server and a plurality of client receiver units. The input media streams arrive from an external source and are then transmitted to the client receiver units in a compressed format. A state machine on the gateway media server detects if the network bandwidth is close to saturation. In one embodiment, the potential bandwidth saturation is measured by matching the time when the start of unit of media for each stream against the estimated transmission time for that unit. When any one actual transmission time exceeds its estimated transmission time by a predetermined threshold value, the network is deemed to be close to saturation, or already saturated, and the state machine executes a process of selecting at least one stream as a target for lowering total bandwidth usage.

Abstract: An information processing system that acquires image data; distorts the acquired image data according to a predetermined distortion criterion; acquires an object image corresponding to an object that is at least partially obstructed in the acquired image; combines the object image with the distorted image data; and outputs the distorted image data combined with the object image.

Abstract: A data transmission method, which can improve an error correction capability during decoding, includes: determining, by a transmit end, a target code length L and an original code length K; generating an initial code block according to the original code length K, where the initial code block includes 2K initial code words; generating a superposition code block according to the target code length and an arrangement order of the 2K initial code words in the initial code block, and superposing the initial code words and the corresponding superposition code words to generate the block code words in the block code set, so that a difference between feature code distances in the block code set is ±1 or 0, where the feature code distance is a code distance between the block code words.

Abstract: A method of transmitting image data from a first node to a second node during a communication event, wherein the second node comprises a display for displaying image data at the second node, includes receiving at the first node, information indicating at least one display characteristic with which image data received at the second node will be displayed on the display; inputting image data at the first node; determining a processing step to be applied to the inputted image data to generate adapted image data, such that at least one characteristic of the adapted image data is optimized for the at least one display characteristic; applying the processing step to generate the adapted image data; and transmitting the adapted image data to the second terminal.

Abstract: A method for processing a plurality of multilayer bit streams includes receiving a plurality of multilayer bit streams each having a base layer and at least one enhancement layer. One or more of the enhancement layers are extracted in whole or in part from at least one of the multilayer bit streams so that the plurality of multilayer bit streams are collectively reduced in their total bandwidth. Each of the multilayer bit streams are rewritten to a single layer bit stream. The single layer bit streams are multiplexed to form a multiplexed single layer bit stream.

Abstract: Methods and apparatus to audio watermarking and watermark detection and extracted are described herein. According to an example method, an identifier is encoded in media content when a different identifier has been previously encoded. According to another example method, messages decoded from media content are validated to provide improved decoding accuracy. In another example method, decoded symbols are stored in memory and synchronization symbols are located to detect a message encoded in media content.

Abstract: A method, wireless communication device, and computer readable medium, are disclosed, for encoding real-time media for wireless transmission from a source to a sink over a wireless transmission channel. The wireless device initiates a peer-to-peer communication session between the sink and the source, then determines based on a time-allocation for the wireless transmission, an available bandwidth for the wireless transmission. The wireless device then encodes the real-time media for the wireless transmission based on the available bandwidth or a throughput constraint.

Abstract: A method and apparatus for implementing dimming are disclosed. The method includes: at an MAC layer, dividing an MSDU into two or more sub-MSDUs with a same length; encapsulating each sub-MSDU obtained after dividing into a separate MPDU, and generating a compensation frame for each MPDU; and aggregating the MPDUs and the compensation frames with the same addresses into a PSDU part of a PPDU and transmitting a physical frame.

Abstract: A video device includes a codec engine to process video data to generate a stream of pixel blocks representing a picture of a sequence of pictures represented by the video data, an image processing module to receive the stream of pixel blocks via a local path between the codec engine and the image processing module and to perform at least one image processing function for the picture using pixel blocks of the stream of pixel blocks received via the local path to generate image processing result data representative of the picture. The video device further includes a storage interface coupleable to a storage component, the storage interface to provide the image processing result data for storage at the storage component.

Abstract: Provided is an image processing device including a rearrangement processing unit configured to rearrange compressed image data, which is compressed by performing a wavelet transform, quantization in a predetermined unit that is based on a reference unit, and variable length encoding on image data, in wavelet levels in a frame unit.