Abstract: There is provided an optical sensor including a pixel matrix and a readout circuit. The pixel matrix includes multiple pixels arranged in a matrix, and each of the multiple pixels outputs temporal difference pixel data. The readout circuit sequentially reads the pixel matrix using a readout block, and performs the hybrid difference calculation on the temporal difference pixel data of pixels within the readout block. Accordingly, the output of the readout circuit is the data accomplishing temporal difference and spatial difference.

Abstract: An image processing apparatus includes a processor configured to display boundaries each of which encloses a respective one of multiple candidate regions that correspond to foreground objects in an image, detect a single selecting operation, and extract a target region corresponding to one of the foreground objects from one or more candidate regions of the multiple candidate regions. The one or more candidate regions are selected by the single selecting operation.

Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that generate refined segmentation masks for digital visual media items. For example, in one or more embodiments, the disclosed systems utilize a segmentation refinement neural network to generate an initial segmentation mask for a digital visual media item. The disclosed systems further utilize the segmentation refinement neural network to generate one or more refined segmentation masks based on uncertainly classified pixels identified from the initial segmentation mask. To illustrate, in some implementations, the disclosed systems utilize the segmentation refinement neural network to redetermine whether a set of uncertain pixels corresponds to one or more objects depicted in the digital visual media item based on low-level (e.g., local) feature values extracted from feature maps generated for the digital visual media item.

Abstract: Disclosed herein is a machine learning application for automatically reading filled-in forms. There are multiple steps involved in using a computer to accurately read a handwritten form. First, the system identifies the form. Second, the system identifies what parts of the form are important. Third, the important parts are extracted as image data (known as shreds). Finally, fourth, the system interprets the shreds. This application is focused on steps two and three of that overall process. The disclosed techniques relate to training a machine learning system on a given series of forms such that when provided future filled-in forms within that series, the system is able to extract the portions of the filled-in form that are important/relevant.

Abstract: Advanced automotive active-safety systems, in general, and autonomous vehicles, in particular, rely heavily on visual data to classify and localize objects, most notably pedestrians and other nearby cars, to assist the corresponding vehicles maneuver safely in their environment. However, the performance of object detection methods is anticipated to degrade under challenging rainy conditions. Nevertheless, and despite major advancements in the development of deraining approaches, the impact of rain on object detection has largely been understudied, especially in the context of autonomous systems. This disclosure analyzes this problem space and presents an improved system for detecting objects under rainy conditions.

Abstract: Techniques are described for controlling operation of a pixel conversion ADC in a manner that enforces strict timing and synchronization of ramp and clock signaling. Synchronizing techniques can be applied to generate a corrected ramp start signal based on synchronizing a received ramp start signal to an input clocking signal, and to generate a controller clock signal based on synchronizing an input clocking signal to the corrected ramp start signal. The corrected ramp start signal and the controller clock signal can be used to control generation of a ramp enable signal for controlling timing of pixel ramp voltage generation digital pixel conversion counting, and to control generation of an output clocking signal used by the digital pixel conversion counting.

Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that generate refined segmentation masks for digital visual media items. For example, in one or more embodiments, the disclosed systems utilize a segmentation refinement neural network to generate an initial segmentation mask for a digital visual media item. The disclosed systems further utilize the segmentation refinement neural network to generate one or more refined segmentation masks based on uncertainly classified pixels identified from the initial segmentation mask. To illustrate, in some implementations, the disclosed systems utilize the segmentation refinement neural network to redetermine whether a set of uncertain pixels corresponds to one or more objects depicted in the digital visual media item based on low-level (e.g., local) feature values extracted from feature maps generated for the digital visual media item.

Abstract: Systems and methods in accordance with the invention allow automatic recording, sharing, and communicating of different parameters associated with images and their imager to define a specific system behavior of a display device or an algorithm unit. Examples of information include imager parameters, environment parameters, image processing and enhancement parameters, coordinates of a section of wide-angle scene image content, display parameters, defined user experience, defined system behavior or any information to be recorded, shared, and communicated. To avoid loss of information, the information is encoded directly in the picture using a marker. This way, the information is robustly transferred from the imager to the display unit. According to the information, the final image can be automatically corrected and enhanced before display, different associated parameters can be displayed on final image or be used with another output.

Abstract: An image processing system or electronic device may implement processing circuitry. The processing circuitry may receive an image, such as financial document image. The processing circuitry may determine a character count for the financial document image or particular portions of the financial document image without recognizing any particular character in the financial document image. In that regard, the processing circuitry may determine a top left score for pixels in the financial document, the top left score indicating or representing a likelihood that a particular pixel corresponds to a top left corner of a text character. The processing circuitry may also determine top right score for image pixels. Then, the processing circuitry may identify one or more text chunks using the top left and top rights scores for pixels in the financial document image. The processing circuitry may determine a character count for the identified text chunks.

Abstract: An image processing apparatus includes a setting unit, a detection unit, a matrix calculation unit, a calculation unit, an obtaining unit, a deriving unit, a patch correction unit, and a generation unit. The setting unit sets a target patch in an input image. The detection unit detects a plurality of similar patches in the input image. The matrix calculation unit calculates a covariance matrix representing correlation between pixels based on the plurality of similar patches. The calculation unit calculates eigenvalues and eigenvectors of the covariance matrix. The obtaining unit obtains a noise amount in the input image. The deriving unit derives a correction matrix based on the eigenvalues, the eigenvectors, the noise amount, and the number of similar patches. The patch correction unit corrects values of pixels in the similar patches based on the correction matrix. The generation unit generates an output image by combining the corrected similar patches.

Abstract: A system includes a computer programmed to detect a first and a second object in received image data, determine a mesh of cells on each of the first and second object surface, upon identifying a cell of the mesh on the first object mismatched to a corresponding cell on the second object to refine the mismatched cell to a plurality of cells, wherein identifying the mismatch is based on a at least one of a mismatch in a color, texture, shape, and dimensions, stop refining the cell upon determining that a refinement of the refined cell of the first object results in a refined cell that is matched to a corresponding refined cell of the second object, and output location data of mismatched cells of the first and second objects. A mismatched cell has at least one of a color mismatch, texture mismatch, and shape mismatch.

Abstract: Systems and methods in accordance with the invention allow automatic recording, sharing, and communicating of different parameters associated with images and their imager to define a specific system behavior of a display device or an algorithm unit. Examples of information include imager parameters, environment parameters, image processing and enhancement parameters, coordinates of a section of wide-angle scene image content, display parameters, defined user experience, defined system behavior or any information to be recorded, shared, and communicated. To avoid loss of information, the information is encoded directly in the picture using a marker. This way, the information is robustly transferred from the imager to the display unit. According to the information, the final image can be automatically corrected and enhanced before display, different associated parameters can be displayed on final image or be used with another output.

Abstract: An apparatus displays a plurality of lines representing a plurality of cracks occurring in a structure on a display unit, accepts an instruction to change a display state of the plurality of lines on the display unit, assigns order in which the display state is changed based on the instruction to each of a plurality of lines constituting one connecting point among the plurality of lines, and changes the display state of each of the plurality of lines constituting the one connecting point based on the order assigned by the assignment unit in response to acceptance of the instruction.

Abstract: The bit depth of the pixels in a camera image are reduced. In one embodiment, the number of pixels for each of a set of multiple bit intensity values is counted. A pixel intensity value with a lowest count is selected and a mapping function is generated that combines the pixels with the lowest count with pixels having an adjacent pixel intensity value. This is repeated until a total number of pixel intensity value counts is reduced to a predetermined number. A reduced bit depth image is generated using the predetermined number of pixel intensity value counts by assigning a new pixel intensity value to each of the pixels using the mapping function and the reduced bit depth image is sent to an image analysis system.

Abstract: A method for splitting a wide angle view of a scene into a plurality of display views is provided. The wide angle view is captured by a wide angle lens camera. The method comprises detecting, over time, objects in the scene; determining positions of the detected objects; determining one or more areas of interest within the scene based on the determined positions of the objects; and determining splitting boundaries for the plurality of display views in the wide angle view such that the splitting boundaries avoids the one or more areas of interest. A monitoring camera having a wide angle lens is also provided.

Abstract: Systems and methods of operation for an image processor system to process images to locate two-dimensional regions which are likely to contain machine-readable symbol data or text. Such regions of interest (ROIs) may be preserved at full resolution, whilst the contents of non-ROIs are averaged into a single pixel value. Transition densities in an image may be converted into a numeric value. Such transition densities may be indicative of the presence of data of interest, such as textual data and/or machine-readable symbol data. The pixels values for the pixels in the ROIs may be sent to a decoder unchanged (i.e., full resolution), which absolves the decoder from having to perform any ROI location computations. Modified or altered images may be compressed to much smaller size files while maintaining lossless ROIs, which allows for transmission of such images to processor-based devices over a data communications channel in real time.

Abstract: Systems and methods are disclosed for non-local means denoising of images. For example, methods may include receiving an image from an image sensor; determining a set of non-local means weights for the image; applying the set of non-local means weights to the image to obtain a first denoised image; applying the set of non-local means weights to the first denoised image to obtain a second denoised image; and storing, displaying, or transmitting an output image based on the second denoised image.

Abstract: A method for computer-aided recognition of a transport container being empty is provided. The method includes capturing image data of a region of the transport container; determining a contour pattern, which represents the transport container, using the image data; determining a deviation variable, which represents a deviation of the contour pattern from at least one reference pattern, wherein the at least one reference pattern represents an empty transport container; and outputting a signal if the deviation variable satisfies a predefined criterion.

Abstract: To digitize an object, a camera captures images of different sides of the object with color and depth data. At least two different sides of the object are identified from the images, and constructions are created of the sides of the object from the images. Points of the constructions to connect to one another are determined and used to align the constructions. The construction are merged to generate a rendition of the object. Various techniques are applied to extrapolate edges, remove seams, extend color intelligently, filter noise, apply skeletal structure to the object, and optimize the digitization further. The rendition of the object can be provided for display as a digital representation of the object and potentially used in different applications (e.g., games, Web, etc.).

Abstract: Techniques for motion detection are presented. An image sensor for motion detection includes a plurality of analog comparators and a two-dimensional pixel array including a plurality of rows of pixels and a plurality of columns of pixels. Each pixel is configured to convert an optical signal on the pixel into an analog signal. The two-dimensional pixel array is organized into a plurality of groups of pixels each associated with a combined group signal determined based on the analog signals from pixels in the group of pixels. Each analog comparator includes two inputs and is used to compare combined group signals generated by two groups of pixels of the plurality of groups of pixels during a same time period to generate a 1-bit inter-pixel digital signal, where each of the two groups of pixels is coupled to a corresponding input of the two inputs of the each analog comparator.

Abstract: Digitizing objects in a picture is discussed herein. A user presents the object to a camera, which captures the image comprising color and depth data for the front and back of the object. For both front and back images, the closest point to the camera is determined by analyzing the depth data. From the closest points, edges of the object are found by noting large differences in depth data. The depth data is also used to construct point cloud constructions of the front and back of the object. Various techniques are applied to extrapolate edges, remove seams, extend color intelligently, filter noise, apply skeletal structure to the object, and optimize the digitization further. Eventually, a digital representation is presented to the user and potentially used in different applications (e.g., games, Web, etc.).

Abstract: A saliency information acquisition device has a local saliency acquisition unit configured to calculate a saliency measure for each pixel in an input image on the basis of information obtained from a local region surrounding each pixel, a candidate-region setting unit configured to set a plurality of candidate regions in the input image, a global saliency acquisition unit configured to calculate a saliency measure for each candidate region in the plurality of candidate regions on the basis of information including a local saliency feature representing an attribute of the saliency measure for each pixel within a candidate region, and a global feature representing an attribute of the candidate regions in relation to the entire input image, and an integration unit configured to combine the saliency measure for each candidate region in the plurality of candidate regions obtained by the global saliency acquisition unit to generate saliency information.

Abstract: Techniques are disclosed for segmenting an image frame of a live camera feed. A biasing scheme can be used to initially localize pixels within the image that are likely to contain the object being segmented. An optimization algorithm for an energy optimization function, such as a graph cut algorithm, can be used with a non-localized neighborhood graph structure and the initial location bias for localizing pixels in the image frame representing the object. Subsequently, a matting algorithm can be used to define a pixel mask surrounding at least a portion of the object boundary. The bias and the pixel mask can be continuously updated and refined as the image frame changes with the live camera feed.

Abstract: Plural block images are generated by dividing an input image into blocks each of which has a predetermined size. Clustering of pixels contained in the plural block images is performed based on a representative point associated with each of those block images to apply region segmentation to those block images. The representative point is a part of plural representative points disposed in the input image. The clustering in a target block image of the region segmentation is performed by referring to a representative point in the target block image, a representative point of a processed block image, and a representative point of an unprocessed block image. The processed and unprocessed block images are adjacent to the target block image.

Abstract: The present disclosure relates to a method and a device for detecting a straight line. The method includes: acquiring a Histogram of Oriented Gradients (HOG) feature set for each respective pixel point in an image, wherein the HOG feature set is configured to reflect straight line characteristics of a localized portion where the pixel point locates; determining at least one candidate direction of a straight line to be detected according to the HOG feature sets of the respective pixel points; and detecting a direction and a position of the straight line precisely according to the candidate direction. The present disclosure efficiently avoids the errors caused by binarization, and increases the accuracy of the detection of straight line.

Abstract: Methods and apparatus for detecting labels included in a document or other binarized image, and for extracting and/or using information associated with a label, are described. A nodal structure modeling objects, e.g., characters, character strings or words, which make up various label aliases are described. The nodal structure is used to generate a score for portions of a binarized document with the scores being used to determine the presence or absence of one or more label aliases. When a label alias is determined to be present, information is extracted from the document and used as information corresponding to a label to which the identified label alias corresponds. Multiple different label aliases may correspond to a single label allowing multiple different aliases to be used to identify the same information. The label aliases and information extraction can be and sometimes used to extract information from scanned forms.

Abstract: Methods and apparatus to count persons in a monitored environment are disclosed. An example apparatus to count the number of people in a monitored environment is described, which includes an image sensor to collect a plurality of pixels, a pseudorandom number generator to pseudorandomly select at least one of a row of the pixels or a column of the pixels, a reader to read first pixel data generated by first pixels of the image sensor at a first time, the first pixels located in at least one of the row of the pixels or the column of the pixels, a comparator to compare the first pixel data with second pixel data generated by the first pixels at a second time different than the first time to generate first change values, and a counter to generate a count of persons based on the first change values.

Abstract: Provided is a method of transforming an integrated circuit (IC) pattern into one or more patterns suitable for subsequent processing, such as mask fabrication. The method includes receiving an IC pattern that has an arbitrary shape, and using a computer, deriving an approximation IC pattern, wherein the approximation IC pattern is in a shape that is a user-defined fabrication-friendly shape, such as a rectangle or an ellipse. The method further includes calculating a pattern approximation error between the IC pattern and the approximation IC pattern. The method further includes checking whether the pattern approximation error is less than a user-defined threshold. If it is, the method further includes outputting the approximation IC pattern for subsequent fabrication. Otherwise, the method further includes splitting the IC pattern into a plurality of subparts, and recursively transforming each of the plurality of subparts.

Abstract: Digitizing objects in a picture is discussed herein. A user presents the object to a camera, which captures the image comprising color and depth data for the front and back of the object. For both front and back images, the closest point to the camera is determined by analyzing the depth data. From the closest points, edges of the object are found by noting large differences in depth data. The depth data is also used to construct point cloud constructions of the front and back of the object. Various techniques are applied to extrapolate edges, remove seams, extend color intelligently, filter noise, apply skeletal structure to the object, and optimize the digitization further. Eventually, a digital representation is presented to the user and potentially used in different applications (e.g., games, Web, etc.).

Abstract: The invention provides the ability to count symbols within drawings in an automated fashion using a computer processor. This may be accomplished by identifying a particular symbol (representing a drawing part) and then permitting the computer to search for the identified symbol in the drawing. Following the initial search, a secondary search may be performed to increase the accuracy of an initial automated count, and obtaining refined searches results representing similar parts (represented by the same symbol) but being a part type as indicated by an identifier associated with the initial symbol.

Abstract: In the conventional technology for edge detection by normalizing brightness value of a target pixel C for edge determination and brightness of peripheral blocks of the target pixel C, an effect on an image due to a camera lens has not been considered. Specifically, the camera lens has a circular shape and the photographed image is basically formed by circularly collected light. In the conventional technology, however, it has been difficult to carry out high-precision edge detection due to rectangular shape of the peripheral blocks. In order to solve the above deficiency, in an aspect of the present invention provides an edge detection apparatus having a function of weighting the pixel values in the ‘peripheral area’ to be compared with the target pixel C for edge determination, such that the peripheral area has the circular shape.

Abstract: A method of providing a unique identifier for a manufactured part includes defining a boundary area on at least one surface of the manufactured part, recording surface properties within a portion of the boundary area, interpreting the recorded surface properties with a pattern recognition algorithm to create the unique identifier, and storing the unique identifier in a database.

Abstract: An image processing device includes an image-modification processing unit and an adjustment unit. The image-modification processing unit executes first image-modification processing wherein pixels are inserted to or deleted from a subject image in a first direction or pixels in the subject image are shifted in the first direction and second image modification processing wherein pixels in the subject image are shifted in a second direction. The adjustment unit adjusts a position of a shift-border along which the pixels are shifted in the second image-modification processing on the basis of a position of each step in an image caused in the first image-modification processing.

Abstract: A system for automatically extracting or isolating structures or areas of interest (e.g., built-up structures such as buildings, houses, shelters, tents; agricultural areas; etc.) from HR/VHR overhead imagery data by way of making as little as a single pass through a hierarchical data structure of input image components (where pixels are grouped into components based on any appropriate definition or measure of dissimilarity between adjacent pixels of the input image) to identify candidate components (e.g., possible structures of interest) free of necessarily having to re-iterate the same operator configured with different threshold parameters for a plurality of values.

Abstract: A method and apparatus are provided for detecting banding noise in a digital signal representative of an image. The method includes determining, by a banding noise detector, a count of increment steps in pixel values and a count of decrement steps in pixel values along a filter direction in a neighborhood of a current pixel of the image, checking, by the banding noise detector, if the count of increment steps or the count of decrement steps in the neighborhood of a current pixel exceeds a step threshold value, and classifying, by the banding noise detector, the current pixel as being located in the banding noise zone if the count of increment steps or the count of decrement steps does not exceed the step threshold value.

Abstract: A difference in intensities of a pair of pixels in an image is repeatedly compared to a threshold, with the pair of pixels being separated by at least one pixel (“skipped pixel”). When the threshold is found to be exceeded, a selected position of a selected pixel in the pair, and at least one additional position adjacent to the selected position are added to a set of positions. The comparing and adding are performed multiple times to generate multiple such sets, each set identifying a region in the image, e.g. an MSER. Sets of positions, identifying regions whose attributes satisfy a test, are merged to obtain a merged set. Intensities of pixels identified in the merged set are used to generate binary values for the region, followed by classification of the region as text/non-text. Regions classified as text are supplied to an optical character recognition (OCR) system.

Abstract: The present invention is a method including: correcting difference between a pixel statistical value of a specific layer and a pixel statistical value of a layer that is wider than the specific layer using an edge information of a layer that is wider than the specific layer; correcting the pixel statistical value of the specific layer using post-correction difference and the pixel statistical value of layer that is wider than the specific layer; recorrecting the post-correction pixel statistical value of the specific layer using difference between a pre-correction pixel statistical value of the specific layer and the post-correction pixel statistical value of the specific layer and the edge information of a layer that is wider than the specific layer; and correcting the target pixel by repeating correction and recorrection until the layer reduces its range from the maximum range to the minimum range.

Abstract: In the image processing apparatus, image data is divided into large blocks of a prescribed size and the large blocks are subdivided into small blocks by the dividing unit. The number of isolated points in each large block is then calculated by the large block isolated point calculation unit, and the number of isolated points in each small block is then calculated by the small block isolated point calculation units. It is then determined by the halftone-dot region determination unit whether or not the large block is a halftone-dot region. This determination considers both the number of isolated points in the large block and the number of isolated points in each small block.

Abstract: According to one embodiment, an image processing apparatus includes following units. The correlation calculation unit calculates correlations between a first region and predetermined first basis vectors. The distance calculation unit calculates distances between the first region and second regions on a subspace generated by the second basis vectors selected from the first basis vectors. The feature quantity calculation unit calculates a feature quantity based on the correlations. The weight calculation unit calculates weights based on the distances and the feature quantity. The pixel value calculation unit calculates a weighted average of pixel values according to the weights to generate an output pixel value.

Abstract: An information processing apparatus includes a determination unit configured to determine whether or not a region having at least one pixel of an image includes a predetermined number of anomalous pixels, and a creation unit configured to create information indicating the determination result for the region.

Abstract: The systems and methods described herein include, among other things, a technique for calibrating the outputs of multiple sensors, such as CCD devices, that have overlapping fields of view and mapping the pixels of those outputs to the pixels of a display screen by means of a lookup table so that a user can see a selected field of view within the larger fields of view that are seen by the sensors.

Abstract: In an imaging device having an objective and a stage for holding a sample to be imaged, a method for autofocusing is presented. The method includes determining a measured focus value corresponding to at least a first of a plurality of logical image segments. Further, the method includes imaging the first logical image segment using the measured focus value. The method also includes determining a predicted focus value for a second of the plurality of logical image segments using the measured focus value and a stored focus variation parameter. In addition, the method includes imaging the second logical image segment using the predicted focus value.

Abstract: Systems and methods for evaluating a quantity of text in an image determine rows in an image that include spikes, wherein determining that a row includes a spike includes determining that a difference between the value of an earlier pixel in the row and a subsequent adjacent pixel exceeds a first threshold, and determining that a difference between a value of a later pixel in the row that is within a first predetermined range of the earlier pixel and a value of a pixel subsequent to the later pixel exceeds the first threshold; determine a number of hits in the image, wherein determining a hit includes determining that a number of rows within a predetermined row range each include a spike; determine if the number of hits exceeds a second threshold; and select an image encoder based on whether or not the number of hits exceeds the threshold.

Abstract: A method for converting a 2D image into a 3D image includes receiving the 2D image; determining whether the received 2D image is a portrait, wherein the portrait can be a face portrait or a non-face portrait; if the received 2D image is determined to be a portrait, creating a disparity between a left eye image and a right eye image based on a local gradient and a spatial location; generating the 3D image based on the created disparity; and outputting the generated 3D image.

Abstract: Image stabilization devices, methods, and systems are described herein. One image stabilization device includes a sensor having an array of pixels, wherein the sensor is configured to track a moving object using a number of the pixels, wherein the number of the pixels track only a particular portion of the moving object, and form an image of the moving object using the number of the pixels and their neighboring pixels that were not used to track the moving object.

Abstract: Unique encoding of each of a substantial number of distribution video copies of a program such as a motion picture is produced by altering the images slightly at several pre-selected locations in the program in a uniquely coded pattern. Suspected counterfeits can be compared with an unaltered master video to determine the encoded number for the copy which was counterfeited to enable tracking the source of the counterfeit. Preferably, each frame of several whole scenes is altered at each location by shifting an image so as to make the alterations largely undetectable by counterfeiters but easily detected by comparison with an unaltered master video. Artifacts are inserted in patterns representing a unique number for the program. These supplement the encoding by alteration of images and gives added means to aid in tracing counterfeit copies.

Abstract: An adaptive interface for a programmable system, for predicting a desired user function, based on user history, as well as machine internal status and context. The apparatus receives an input from the user and other data. A predicted input is presented for confirmation by the user, and the predictive mechanism is updated based on this feedback. Also provided is a pattern recognition system for a multimedia device, wherein a user input is matched to a video stream on a conceptual basis, allowing inexact programming of a multimedia device. The system analyzes a data stream for correspondence with a data pattern for processing and storage. The data stream is subjected to adaptive pattern recognition to extract features of interest to provide a highly compressed representation which may be efficiently processed to determine correspondence.

Abstract: An adaptive interface for a programmable system, for predicting a desired user function, based on user history, as well as machine internal status and context. The apparatus receives an input from the user and other data. A predicted input is presented for confirmation by the user, and the predictive mechanism is updated based on this feedback. Also provided is a pattern recognition system for a multimedia device, wherein a user input is matched to a video stream on a conceptual basis, allowing inexact programming of a multimedia device. The system analyzes a data stream for correspondence with a data pattern for processing and storage. The data stream is subjected to adaptive pattern recognition to extract features of interest to provide a highly compressed representation which may be efficiently processed to determine correspondence.

Abstract: An adaptive interface for a programmable system, for predicting a desired user function, based on user history, as well as machine internal status and context. The apparatus receives an input from the user and other data. A predicted input is presented for confirmation by the user, and the predictive mechanism is updated based on this feedback. Also provided is a pattern recognition system for a multimedia device, wherein a user input is matched to a video stream on a conceptual basis, allowing inexact programming of a multimedia device. The system analyzes a data stream for correspondence with a data pattern for processing and storage. The data stream is subjected to adaptive pattern recognition to extract features of interest to provide a highly compressed representation which may be efficiently processed to determine correspondence.

Abstract: An adaptive interface for a programmable system, for predicting a desired user function, based on user history, as well as machine internal status and context. The apparatus receives an input from the user and other data. A predicted input is presented for confirmation by the user, and the predictive mechanism is updated based on this feedback. Also provided is a pattern recognition system for a multimedia device, wherein a user input is matched to a video stream on a conceptual basis, allowing inexact programming of a multimedia device. The system analyzes a data stream for correspondence with a data pattern for processing and storage. The data stream is subjected to adaptive pattern recognition to extract features of interest to provide a highly compressed representation which may be efficiently processed to determine correspondence.