Abstract: The invention provides a system and method that transforms a set of still/motion media (i.e., a series of related or unrelated still frames, web-pages rendered as images, or video clips) or other multimedia, into a video stream that is suitable for delivery over a display medium, such as TV, cable TV, computer displays, wireless display devices, etc. The video data stream may be presented and displayed in real time or stored and later presented through a set-top box, for example. Because these media are transformed into coded video streams (e.g. MPEG-2, MPEG-4, etc.), a user can watch them on a display screen without the need to connect to the Internet through a service provider. The user may request and interact with the desired media through a simple telephone interface, for example. Moreover, several wireless and cable-based services can be developed on the top of this system.

Abstract: Methods and systems for interactive image analysis include receiving a selection of a region of an image and a request for analysis of the selection at an interface layer, transferring the selection and the request to an interpretation layer for analysis, dividing the selected region of the image into a plurality of sub-sections optimized for parallel computation to provide an analysis result that minimizes perceptible delay between receiving the request and receipt of results, analyzing the sub-sections using one or more execution nodes using a copy of the image stored in a shared memory, and providing combined analysis results to the interface layer for display.

Abstract: A method and systems for cloud-based digital pathology include scanning received slides that include a pathology sample to produce a sample image in a shared memory, analyzing the sample image using one or more execution nodes, each including one or more processors, according to one or more analysis types to produce intermediate results, transmitting some or all of the sample image to a client device, further analyzing the sample image responsive to a request from the client device to produce a final analysis based on the intermediate results, and transmitting the final analysis to the client device.

Abstract: Methods and systems for digital pathology with low-latency analytics include determining potential regions of interest within an image in accordance with one or more high-priority analyses, dividing the potential regions of interest into a plurality of sub-sections optimized for parallel computation, analyzing the sub-sections using one or more execution nodes, each including one or more processors, using a copy of the image stored in a shared memory according to the one or more high-priority analyses, and storing an intermediate analysis result based on analysis results from the one or more execution nodes in a shared memory.

Abstract: Systems and methods are disclosed for classifying histological tissues or specimens with two phases. In a first phase, the method includes providing off-line training using a processor during which one or more classifiers are trained based on examples, including: finding a split of features into sets of increasing computational cost, assigning a computational cost to each set; training for each set of features a classifier using training examples; training for each classifier, a utility function that scores a usefulness of extracting the next feature set for a given tissue unit using the training examples.

Abstract: A method for training a classifier to be operative as an epithelial texture classifier, includes obtaining a plurality of training micrograph areas of biopsy tissue and for each of the training micrograph areas, identifying probable locations of nuclei that form epithelia, generating a skeleton graph from the probable locations of the nuclei that form the epithelia, manually drawing walls on the skeleton graph outside of the epithelia to divide the epithelia from one another, and manually selecting points that lie entirely inside the epithelia to generate open and/or closed geodesic paths in the skeleton graph between pairs of the selected points. Data is obtained from points selected from the walls and the paths and applied to a classifier to train the classifier as the epithelial texture classifier.

Abstract: Systems and methods for encoding/decoding a video stream. Animated talking heads are coded using partial offline encoding, multiple video streams, and multiple reference frames. The content of a face animation video that is known beforehand is encoded offline and the remaining content is encoded online and included in the video stream. To reduce bit rate, a server can stream multiple video sequences to the client and the video sequences are stored in the client's frame store. The server sends instructions to play a particular video sequence instead of streaming the particular video sequence. Multiple video streams can also be streamed to the client. Positional data and blending data are also sent to properly position one video stream relative to another video stream and to blend one video stream into another video stream.

Abstract: A method of improving the lighting conditions of a real scene or video sequence. Digitally generated light is added to a scene for video conferencing over telecommunication networks. A virtual illumination equation takes into account light attenuation, lambertian and specular reflection. An image of an object is captured, a virtual light source illuminates the object within the image. In addition, the object can be the head of the user. The position of the head of the user is dynamically tracked so that an three-dimensional model is generated which is representative of the head of the user. Synthetic light is applied to a position on the model to form an illuminated model.

Abstract: A detector and method for automatically detecting signet ring cells in an image of a biopsy tissue sample, includes finding in the image, points about which cell membranes appear in radial symmetry; selecting as candidate points, at least ones of the points that have an adjacent nuclei with a predetermined shape feature; and applying a convolutional neural network to the candidate points to determine which of the candidate points are signet ring cells.

Abstract: A method of improving the lighting conditions of a real scene or video sequence. Digitally generated light is added to a scene for video conferencing over telecommunication networks. A virtual illumination equation takes into account light attenuation, lambertian and specular reflection. An image of an object is captured, a virtual light source illuminates the object within the image. In addition, the object can be the head of the user. The position of the head of the user is dynamically tracked so that an three-dimensional model is generated which is representative of the head of the user. Synthetic light is applied to a position on the model to form an illuminated model.

Abstract: Systems and methods for extracting a radial contour around a given point in an image includes providing an image including a point about which a radial contour is to be extracted around. A plurality of directions around the point and a plurality of radius lengths for each direction are provided. Local costs are determined for all radius lengths for each direction by comparing texture variances at each radius length with the texture variance at a further radius length. A radius length is determined, using a processor, for each direction based on the accumulated value of the local costs to provide a radial contour.

Abstract: A method and system for detecting and counting mitotic figures in an image of a biopsy sample stained with at least one dye, includes color filtering the image in a computer process to identify pixels in the image that have a color which is indicative a mitotic figure; extracting the mitotic pixels in the image that are connected to one another in a computer process, thereby producing blobs of mitotic pixels; shape-filtering and clustering the blobs of mitotic pixels in a computer process to produce mitotic figure candidates; extracting sub-images of mitotic figures by cropping the biopsy sample image at the location of the blobs; extracting two sets of features from the mitotic figure candidates in two separate computer processes; determining which of the mitotic figure candidates are mitotic figures in a computer classification process based on the extracted sets of features; and counting the number of mitotic figures per square unit of biopsy sample tissue.

Abstract: Methods and systems for interactive image analysis include receiving a selection of a region of an image and a request for analysis of the selection at an interface layer, transferring the selection and the request to an interpretation layer for analysis, dividing the selected region of the image into a plurality of sub-sections optimized for parallel computation to provide an analysis result that minimizes perceptible delay between receiving the request and receipt of results, analyzing the sub-sections using one or more execution nodes using a copy of the image stored in a shared memory, and providing combined analysis results to the interface layer for display.

Abstract: Methods and systems for digital pathology with low-latency analytics include determining potential regions of interest within an image in accordance with one or more high-priority analyses, dividing the potential regions of interest into a plurality of sub-sections optimized for parallel computation, analyzing the sub-sections using one or more execution nodes, each including one or more processors, using a copy of the image stored in a shared memory according to the one or more high-priority analyses, and storing an intermediate analysis result based on analysis results from the one or more execution nodes in a shared memory.

Abstract: A method and systems for cloud-based digital pathology include scanning received slides that include a pathology sample to produce a sample image in a shared memory, analyzing the sample image using one or more execution nodes, each including one or more processors, according to one or more analysis types to produce intermediate results, transmitting some or all of the sample image to a client device, further analyzing the sample image responsive to a request from the client device to produce a final analysis based on the intermediate results, and transmitting the final analysis to the client device.

Abstract: A method system for training an apparatus to recognize a pattern includes providing the apparatus with a host processor executing steps of a machine learning process; providing the apparatus with an accelerator including at least two processors; inputting training pattern data into the host processor; determining coefficient changes in the machine learning process with the host processor using the training pattern data; transferring the training data to the accelerator; determining kernel dot-products with the at least two processors of the accelerator using the training data; and transferring the dot-products back to the host processor.

Abstract: Systems and methods for extracting a radial contour around a given point in an image includes providing an image including a point about which a radial contour is to be extracted around. A plurality of directions around the point and a plurality of radius lengths for each direction are provided. Local costs are determined for all radius lengths for each direction by comparing texture variances at each radius length with the texture variance at a further radius length. A radius length is determined, using a processor, for each direction based on the accumulated value of the local costs to provide a radial contour.

Abstract: A system and method of controlling the movement of a virtual agent while the agent is listening to a human user during a conversation are disclosed. The method includes receiving speech data from the user to yield received speech data and analyzing the received speech data according to a prosodic characterization of the speech data to yield the speech data analysis. The method further includes controlling listening movement of the agent according to the speech data analysis, wherein the listening movement of the agent occurs while the user is speaking the received speech data to the agent such that the agent appears to respond to the specific received speech data.

Abstract: A method of improving the lighting conditions of a real scene or video sequence. Digitally generated light is added to a scene for video conferencing over telecommunication networks. A virtual illumination equation takes into account light attenuation, lambertian and specular reflection. An image of an object is captured, a virtual light source illuminates the object within the image. In addition, the object can be the head of the user. The position of the head of the user is dynamically tracked so that an three-dimensional model is generated which is representative of the head of the user. Synthetic light is applied to a position on the model to form an illuminated model.

Abstract: An automated method and system for analyzing a digital image of a biopsy to determine whether the biopsy is normal or abnormal, i.e., exhibits some type of disease such as, but not limited to, cancer. In the method and system, a classifier is trained to recognize well formed nuclei outlines from imperfect nuclei outlines in digital biopsy images. The trained classifier may then be used to filter nuclei outlines from one or more digital biopsy images to be analyzed, to obtain the well formed nuclei outlines. The well formed nuclei outlines may then be used to obtain statistics on the size or area of the nuclei for use in determining whether the biopsy is normal or abnormal.