Abstract: A device that can be used for in vivo fluorescence measurements by endoscopy or laparoscopy, including: an excitation light source illuminating an object, for example biological tissue, and inducing emission of emission light by the examined object, the emission light is, for example, a fluorescence light; a telemetry sensor emitting a telemetry light beam towards the object; a projector element to project the excitation beam and the telemetry beam directly on the object. The telemetry sensor can estimate a distance between the projector element and the object, which distance makes it possible to modulate intensity of the excitation light emitted by the object. When the object is biological tissue, this makes it possible to comply with illumination thresholds of biological tissue and to maintain an illumination of constant intensity. The projector element can be included at the end of a laparoscope or of an endoscope.

Abstract: Multi-modal differential search with real-time focus adaptation techniques are described that overcome the challenges of conventional techniques in a variety of ways. In one example, a model is trained to support a visually guided machine-learning embedding space that supports visual intuition as to “what” is represented by text. The visually guided language embedding space supported by the model, once trained, may then be used to support visual intuition as part of a variety of functionality. In one such example, the visually guided language embedding space as implemented by the model may be leveraged as part of a multi-modal differential search to support search of digital images and other digital content with real-time focus adaptation which overcomes the challenges of conventional techniques.

Abstract: A system and a method for automatic video and/or audio redaction are provided herein. The method may include the following steps: obtaining an input video; obtaining at least one prespecified object, being a visual or an acoustic object or a descriptor thereof; analyzing the input video, to detect a matched object, being an object having descriptors similar to the descriptors of the at least one prespecified object; and generating a redacted video by removing or replacing the matched objects therefrom.

Abstract: Method and system for determining frame rate of multimedia content streaming on a client device are presented herein. The method includes selecting a region within a screen of a computing display device displaying a video stream. One or more image frames of the video stream in the region are recorded. Changes in the color composition between the recorded image frames are detected. Based on the changes in the color composition, the frame rate of the video stream is determined.

Abstract: The disclosure provides technology for generating a photo realistic multi-dimensional computer generated model of a physical environment. An example method involves accessing a model that comprises a set of spatial values; aligning image data with a surface of the model, wherein the image data corresponds to an image value; updating, by a processing device, the model to comprise the image value at a point on the model that is absent a spatial value; analyzing the model and the image value to determine the spatial value for the point on the model; and updating the model to comprise the spatial value at the point on the model.

Abstract: An electronic device and method are disclosed herein. The electronic device includes a display and processor. The processor implements the method including executing an application, and based on detecting a frame drop, identifying an insertion position of an interpolation image for a plurality of images generated by execution of the application. An interpolation image is generated based on the identified insertion position and the interpolation image is inserted into the plurality of images at the identified insertion position.

Abstract: Disclosed is a method for processing a video stream including a set of images liable to contain a transition effect, the method including the following steps: detecting a fade-type transition effect within the set of images of the video stream and, where appropriate, calculating minimum and maximum brightnesses LMIN and LMAX for each image of the set of images containing the fade; estimating minimum and maximum brightnesses EMIN and EMAX for all of the images not containing the detected transition effect; determining minimum and maximum brightnesses SMIN and SMAX for a standard dynamic range; calculating minimum and maximum brightnesses TMIN and TMAX depending on the minimum and maximum brightnesses LMIN, LMAX, EMIN, EMAX, SMIN and SMAX calculated and determined beforehand; transmitting the calculated minimum and maximum brightnesses TMIN and TMAX with a view to dynamic range compression.

Abstract: An electronic device may include a display for displaying image content to a user and dynamic image stabilization circuitry for dynamically compensating the image content if the device is moving unpredictably to help keep the image content aligned with the user's gaze. The electronic device may include sensors for detecting the displacement of the device. The dynamic image stabilization circuitry may include a usage scenario detection circuit and a content displacement compensation calculation circuit. The usage scenario detection circuit receives data from the sensors and infers a usage scenario based on the sensor data. The content displacement compensation calculation circuit uses the inferred usage scenario to compute a displacement amount by which to adjust image content. When motion stops, the image content may gradually drift back to the center of the display.

Abstract: Systems, methods, and computer readable media to improve the operation of a display system are disclosed. Techniques disclosed herein selectively darken a region of an image so that when text or other information is rendered into that region, the contrast between the text or other information and the underlying image in that area is sufficient to ensure the text or other information is visible and readable. In one embodiment, a region into which information is to be rendered may be combined or blended with tone mapped values of those same pixels in accordance with a given function, where the function gives more weight to the tone mapped pixel values the closer those pixels are to the midline of the region and more weight to untone-mapped image pixel values the further those pixels are from the midline of the region.

Abstract: A frame interpolation method for a video processor includes the steps of: determining whether a first input frame is received following a long-term cadence; generating interpolated frames by applying phase coefficients in a regular phase table corresponding to the long-term cadence when the first input frame is received following the long-term cadence; and generating interpolated frames by applying phase coefficients in a bad edit phase table corresponding to a bad edit cadence when the first input frame is received without following the long-term cadence.

Abstract: Methods and systems for building an optimized image for an application are provided. An operating system is decomposed into granular modules. An initial configuration file to a build system is provided. The build system builds an initial image including initial modules for the application based on the initial configuration file. A monitoring system monitors performance indicators for the initial image. Using a machine learning algorithm, a subsequent configuration file based on the performance indicators is derived. The build system, builds a subsequent image for the application.

Abstract: Provided are devices, computer-program products, and methods related to removing redundant data associated with frames. For example, a method can include storing a plurality of reference data sets in a reference database, where a reference data set is associated with a media segment. The method can further include receiving, by a server, cue data for a frame. The cue data includes a plurality of pixel data samples from the frame, and the frame is associated with an unidentified media segment. The method can further include identifying an absence of a pixel data sample from the cue data for the frame, and matching the cue data for the frame to a reference data set. The matching can include using a previous pixel data sample from a previous frame. The previous pixel data sample corresponds to the pixel data sample absent from the frame, and the reference data set is associated with a media segment. The method can further include determining the unidentified media segment is the media segment.

Abstract: One or more memory systems, architectural structures, and/or methods of storing information in memory devices is disclosed to improve the data bandwidth and or to reduce the load on the communications links in a memory system. The system may include one or more memory devices, one or more memory control circuits and one or more data buffer circuits. In one embodiment, the Host only transmits data over its communications link with the data buffer circuit. In one aspect, the memory control circuit does not send a control signal to the data buffer circuits. In one aspect, the memory control circuit and the data buffer circuits each maintain a separate state machine-driven address pointer or local address sequencer, which contains the same tags in the same sequence. In another aspect, a resynchronization method is disclosed.

Abstract: Provided is an imaging device that includes an imaging element that reads out, in a first readout period that is part of a first subframe period, first electric charge signals of pixels, read out, in a second readout period that is part of a second subframe period, second electric charge signals of the pixels, generate a first subframe image based on the first electric charge signals, and generate a second subframe image based on the second electric charge signals, an irradiation control unit that controls such that, in an irradiation period, infrared light is radiated and, in a period other than the irradiation period, infrared light is not radiated, and a color image generation unit that generates a color image at the predetermined frame rate based on the first subframe image and the second subframe image.

Abstract: Automated video correction techniques are disclosed. In some examples, an example method may include identifying features in each video frame of the multiple video frames in a video, and identifying one or more major scenes in the video based on a matching of the features in each video frame. The method may also include, for each identified major scene, identifying a key reference frame based on the features in each video frame, identifying one or more bad video frames based on a comparison with the key reference frame, and identifying one or more sequences of bad video frames based on the identified one or more bad video frames. The video may then be corrected by removing the identified one or more sequences of bad video frames from the video.

Abstract: A fallback performing method including: calculating unreliability of a motion vector in a block included in a moving object in two frames classified in terms of time; calculating discontinuity of the motion vector for a predetermined time; calculating a fallback level from the unreliability and the discontinuity; and performing fallback based on the calculated fallback level.

Abstract: Methods, systems, and computer-storage media having computer-usable instructions embodied thereon for identifying related entities are provided. One or more entities may be identified from a search query. The one or more entities may include any identifiable term having related information associated therewith. An entity store may be referenced to identify one or more related entities related to the entity. The one or more related entities, along with their relationship(s) to the entity (and one another, perhaps) may then be ranked and displayed to a user.

Abstract: The present invention relates to step roller monitoring and maintenance personnel monitoring of a passenger conveyor, and belongs to the field of passenger conveyor technologies. In the monitoring system and monitoring method of the present invention, an imaging sensor and/or a depth sensing sensor is used to sense the step roller/maintenance personnel of the passenger conveyor to acquire data frames, and the data frames are analyzed and processed to monitor whether the movement or position of the step roller/activity or position of the maintenance personnel is in a normal state.

Abstract: Provided are devices, computer-program products, and methods for removing redundant data associated with frames. For example, a method can include receiving an initial frame, determining initial cue data for the initial frame, and sending the initial cue data to a server. The method can further include receiving a new frame and determining new cue data for the new frame. The method can further include identifying a pixel value range. The method can further include determining a pixel value difference between an initial pixel data sample and a new pixel data sample. The method can further include determining the pixel value difference is within the pixel value range and updating the new cue data by removing the new pixel data sample from the new cue data when the pixel value difference is within the pixel value range. The method can further include sending the updated new cue data to the server.

Abstract: Method of differential compression of the values of a matrix, in which the reference cell is chosen in such a way that the difference between the initial value, contained in a cell to be compressed, and the decompressed value of the reference cell is a minimum.

Abstract: The present invention relates to computation of digital fingerprint of a video sequence. The invention presents systems and methods for quick identification of shot boundaries and extraction of fingerprints by processing one or more specific frames. The systems and methods are applied on uncompressed video or compressed video having inter-frame or intra-frame compression. The methods comprises of comparing two frames of the video having a gap in between and identifying a specific frame present in between the two frames such that the specific frame may have a shot boundary. Shot boundaries are calculated for the entire video and then a fingerprint is generated using all the shot boundaries present in the video.

Abstract: A circuit and method for detecting a vertical cut in a sequence of digital video images. Each pixel of a video frame is filtered then compared to a filter threshold. If the threshold is met, a current pixel bit is set as active. A delayed pixel bit is generated from the current pixel bit, and a changed pixel bit is generated if either but not both of the current pixel bit and the delayed pixel bit is active. Active pixels are counted. The count of active pixels in the current image and the count of active pixels in the delayed image are used to weight the active pixel count of the changed image. The counts are used to determine a change value for the current image. The change value may be a large positive value, a large negative value, or neither. A predefined pattern of the change values over a sequence of frames indicates a vertical cut in the sequence.

Abstract: A video sequence having a plurality of frames is received. A feature in a first frame from the plurality of frames and a first position of the feature in the first frame are detected. The position of the feature in a second frame from the plurality of frames is estimated to determine a second position. A displacement vector between the first position and the second position is also computed. A plurality of content characteristics is determined for the first frame and the second frame. The displacement vector is spatially diffused with a spatial filter over a frame from the plurality of frames to generate a spatially diffused displacement vector field. The spatial filter utilizes the plurality of content characteristics. A temporal filter temporally diffuses over a video volume the spatially diffused displacement vector field to generate a spatiotemporal vector field. The temporal filter utilizes the plurality of content characteristics.

Abstract: Methods, apparatus, and computer-readable storage media for video completion that may be applied to restore missing content, for example holes or border regions, in video sequences. A video completion technique applies a subspace constraint technique that finds and tracks feature points in the video, which are used to form a model of the camera motion and to predict locations of background scene points in frames where the background is occluded. Another frame where those points were visible is found, and that frame is warped using the predicted points. A content-preserving warp technique may be used. Image consistency constraints may be applied to modify the warp so that it fills the hole seamlessly. A compositing technique is applied to composite the warped image into the hole. This process may be repeated until the missing content is filled on all frames.

Abstract: An image display device includes: an interpolation phase generator that generates an interpolation phase on the basis of downsampling frame information representing a downsampling timing at which at least one frame image of the image signal is thinned, and an interpolation frame generator that generates an interpolation frame image corresponding to the interpolation phase. The interpolation phase generator generates the interpolation phase such that a phase distance between a first interpolation frame image from among a plurality of interpolation frame images within one period of downsampling periods, and a second interpolation frame image that follows the first interpolation frame image becomes equal to a phase distance between mutually adjacent interpolation frame images obtained when phase distances between a plurality of interpolation frame images are equalized within one period of the downsampling periods.

Abstract: A method for estimating signal-dependent noise includes defining a plurality of pixel groups from among the image pixels. The method further includes computing, for one or more signal levels of the image, a difference value between two pixel groups, whereby a respective one or more difference values are computed collectively. The method determines an estimated noise response of the image as a function of the one or more computed difference values.

Abstract: A method and apparatus for measuring the quality of a video is provided. The method comprises: generating a frame loss pattern of the video by indicating whether each frame in the video is lost or successfully transmitted; and evaluating the quality of the video as a function of the generated t came loss pattern.

Abstract: A method and system for real time processing of a sequence of video frames. A current frame in the sequence and at least one frame in the sequence occurring prior to the current frame is analyzed. Each frame includes a two-dimensional array of pixels. The sequence of video frames is received in synchronization with a recording of the video frames in real time. The analyzing includes performing a background subtraction on the at least one frame, which determines a background image and a static region mask associated with a static region consisting of a contiguous distribution of pixels in the current frame. The static region mask identifies each pixel in the static region upon the static region mask being superimposed on the current frame. The background image includes the array of pixels and a background model of the at least one frame and does not include any moving object.

Abstract: A method of operating a computer system to reduce structured noise in a video is described. Patches in a frame of a sequence of video frames are selected using a modified non-local means (NLM) search algorithm with a reduced search complexity compared to conventional NLM search algorithms. The set of spatial neighboring patches in a frame is extended to include patches in adjacent frames of the video sequence. Patches in the adjacent frames are selected based, at least in part, on a projection of a location of a pixel in the frame into the adjacent frames using a motion estimation algorithm. An average value determined from the combined set of patches is used to replace the pixel currently being processed.

Abstract: An activity recognition method, for recognizing continuous activities of several moving objects in the foreground of a video, includes: capturing and processing a training video to get a contour of a moving object; extracting a minimum bounding box of the contour in order to get parameters then transfer to feature vectors; constructing a decision tree model based on support vector machines (SVMs), for classifying the activities of the moving object according to the parameter and the feature vector of the training video; capturing and processing a testing video to get other parameters and using several formulas to generate feature vectors, and executing an algorithm for recognizing the activities of several moving objects in the foreground of the testing video. Said feature vectors are transformed from the parameters that in the testing and training videos. Via above descriptions, the method can recognize activities of foreground objects in the testing video.

Abstract: A motion detection method is adapted for an image display circuit including a motion detection circuit and an arbitration circuit. In this motion detection method, a number of motion quality observation windows are defined. Each motion quality observation window includes a start point and an ending point. In the motion quality observation windows, a write frame count value is adjusted according to a write frame command. At the end point of each motion quality observation window, if the write frame count value is equal to or bigger than a preset count value, an enable signal is outputted to the arbitration circuit to determine whether the image display circuit performs motion display. In the motion quality observation windows, the end point of the i-th motion quality observation window is located between the start point and the end point of the (i+1)-th motion quality observation window, where i is a positive integer.

Abstract: A method and apparatus are provided for categorizing pre-processing video information derived from video content prior to processing the video content. The apparatus includes a categorizer for identifying at least one of scenes and shots in the video content that have a likelihood of causing errors during subsequent processing based on at least the pre-processing video information. Moreover, the categorizer is for categorizing the identified scenes and shots into one or more respective categories based on at least the pre-processing video information.

Abstract: Various implementations address distortion and quality measurements. Certain implementations relate to distortions resulting in a freeze-with-skip and/or a freeze-without-skip. In one implementation, a pause term provides an indication of distortion associated with a pause arising from not displaying one or more consecutive pictures that are not to be displayed. A motion term provides an indication of distortion associated with a related change in motion. A combined indicator is based on an addition of the pause term and the motion term. In another particular implementation, a first indicator indicates distortion across one or more types of distortive effects that results from not displaying a first set of pictures. A second indicator indicates corresponding distortion with respect to a second set of pictures. The first indicator and the second indicator are combined in a non-linear manner.

Abstract: A method of determining a motion value for a missing pixel in an interlaced video field using an adaptive window. The method includes computing a first mean absolute difference (MAD) value for a pixel based on a 1×5 window, computing a second MAD value for the pixel using a 3×5 window, and selectively blending the first and second MAD values to form a resultant motion value.

Abstract: Techniques are presented for analyzing audio-video segments, usually from multiple sources. A combined similarity measure is determined from text similarities and video similarities. The text and video similarities measure similarity between audio-video scenes for text and video, respectively. The combined similarity measure is then used to determine similar scenes in the audio-video segments. When the audio-video segments are from multiple audio-video sources, the similar scenes are common scenes in the audio-video segments. Similarities may be converted to or measured by distance. Distance matrices may be determined by using the similarity matrices. The text and video distance matrices are normalized before the combined similarity matrix is determined. Clustering is performed using distance values determined from the combined similarity matrix.

Abstract: According to one embodiment, a method is disclosed. The method includes performing a local content analysis on video data to classify pixels into singular pixels, motion pixels and static pixels.

Abstract: A method and apparatus are disclosed for providing a video signature representative of a content of a video signal. A method and apparatus are further disclosed for providing an audio signature representative of a content of an audio signal. A method and apparatus for detecting lip sync are further disclosed and take advantage of the method and apparatus disclosed for providing a video signature and an audio signature.

Abstract: A data processing device includes a clock converter, a data converter, and an error detector. The clock converter is configured to receive a first clock signal, convert the first clock signal into a second clock signal, and output the second clock signal. The data converter is configured to receive first data, convert the first data into second data using the second clock signal, and output the second data. The error detector is configured to check whether the first clock signal is in a first clock state or a second clock state upon the first data transitioning to a first data state, and output an enable signal to the clock converter upon determining that the first clock signal has transitioned to the first clock state from the second clock state.

Abstract: Embodiments of the present invention provides a method and device for processing a source video. The method and device may provide computing an artifact estimation from differences among pixels selected from spatially-distributed sampling patterns in the source video; filtering the source video to produce a filtered version of the source video, computing a blending factor based on the artifact estimation in the source video, and computing an output video by blending the source video and the filtered version of the source video based on the blending factor.

Abstract: A TV or monitor with a sensor sensing radiation or light from the surroundings, where a controlling unit, on the basis of the sensed radiation or parameters of a video signal, frame rate converts an original video signal to an up converted video signal by determining additional images for the video signal, the additional images being determined on the basis of the determined radiation/light or parameter of the video signal in order to relatively reduce frame rate conversion generated artifacts when the radiation or light intensity is higher.

Abstract: Systems and methods for detecting chroma dropout errors in one or more fields associated with various video frames are provided. Pixels associated with a current field are divided into a set of pixel pairs. Co-occurrences matrices are calculated for previous and subsequent fields. A first pixel pair associated with the current field is selected. First and second set of entries are selected from the co-occurrence matrices corresponding to the previous and subsequent fields. The first pixel pair is searched in the first and second set of entries. An absence of the first pixel pair in the first and second set of entries satisfies a first criterion of chroma dropout error. Other criteria in addition to the first criterion are evaluated to label the first pixel pair as erroneous.

Abstract: Systems and methods are provided for reducing motion blur in a video display. A system for reducing motion blur in a video display may include a motion detection circuit and a luminance control circuit. The motion detection circuit may be used to compare a plurality of frames in a video signal to generate a motion detection output signal that indicates whether the video signal includes an image that is in motion or a still image. The luminance control circuit may be used to vary luminance levels between two or more consecutive frames of the video signal when the motion detection output signal indicates that the video signal includes an image that is in motion. The luminance control circuit further may also be used to discontinue varying the luminance levels of the video signal when the motion detection output signal indicates that the video signal includes a still image.

Abstract: Method and apparatus for reducing random noise in digital video streams are described. In one innovative aspect, the device includes a noise estimator. The device also includes a motion detector configured to determine a motion value indicative of motion between two frames of the video stream, the motion value based at least in part on the noise value. The device further includes a spatial noise reducer configured to filter the image data based at least in part on a blending factor and the noise value. The device also includes a temporal noise reducer configured to filter the video data based on the motion value and the noise value. The device also includes a blender configured to blend the spatial and temporal filtered values to provide a weighted composite filtered output image.

Abstract: A method for de-interlacing interlaced video includes receiving a first video field and a second video field of an interlaced video frame, generating a first video frame from the first video field and a first synthesized video field, where video data of the first synthesized video field is based exclusively on video data of the first and second video fields, generating a second video frame from the second video field and a second synthesized video field, where video data of the second synthesized video field is based exclusively on the video data of the first and second video fields, and outputting two de-interlaced video frames for every received interlaced video frame. The first (second) synthesized video field is generated by combining image data from the second (first) video field with image data from corresponding lines of an up-scaled first (second) field generated by a scaler.

Abstract: A method for identifying state of macro block of de-interlacing computing and an image processing apparatus are provided, the method is as follows. A video frame is divided into a plurality of regions, where each of the regions includes a plurality of macro blocks. Then, a basic threshold corresponding to each of the regions is provided according to a position of each of the regions in the video frame, and a first macro block is identified to be a first type macro block or a second type macro block according to the basic threshold corresponding to one of the regions where the first macro block of the macro blocks locates. Then, a corresponding de-interlacing computing step is performed on the first macro block according to an result that the first macro block is identified as the first type macro block or the second type macro block.

Abstract: Some embodiments allow a video editor to remove unwanted camera motion from a sequence of video images (e.g., video frames). Some embodiments are implemented in a video editing application. Some of these embodiments distinguish unwanted camera motion from the intended underlying motion of a camera (e.g., panning and zooming) and/or motion of objects within the video sequence.

Abstract: A motion judder cancellation system may convert a source frame rate to an output frame rate. A repetition pattern within a sequence of source frames may be determined. Temporal position for output frames within a sequence may be based on a source frame position and a source frame interval fraction. An image blend mode such as motion vector interpolation may be determined for each output frame. Temporal position and/or image blend mode may be modified. Accordingly, motion judder and/or visible interpolation artifacts may be modified. Output frames may be generated based on the determined or modified image blend mode and/or the determined or modified temporal position of output frames. The output frames may be spaced temporally at even intervals or spacing. Frame rate may be increased and one or more repeated frames within a sequence of frames may be inserted. Generation of output frames may be programmed.

Abstract: A video sequence having a plurality of frames is received. A feature in a first frame from the plurality of frames and a first position of the feature in the first frame are detected. The position of the feature in a second frame from the plurality of frames is estimated to determine a second position. A displacement vector between the first position and the second position is also computed. A plurality of content characteristics is determined for the first frame and the second frame. The displacement vector is spatially diffused with a spatial filter over a frame from the plurality of frames to generate a spatially diffused displacement vector field. The spatial filter utilizes the plurality of content characteristics. A temporal filter temporally diffuses over a video volume the spatially diffused displacement vector field to generate a spatiotemporal vector field. The temporal filter utilizes the plurality of content characteristics.

Abstract: The present invention relates to an endoscope system including: a real time clock; an interface for receiving medical information output from a peripheral device; and a control unit that adjusts clock information added to the received medical information into clock information of the real time clock when the peripheral device adds the clock information to the medical information, and adds clock information of the real time clock at a time of receiving to the received medical information when the peripheral device does not add the clock information to the medical information. According to the invention, even the medical information obtained from the different devices can be reproduced with data from the respective devices synchronized by associating the clock information based on the identical real time clock therewith. Consequently, even after the surgical operation, the contents of treatment performed during the surgical operation can be accurately reproduced.

Abstract: An image processing method and device thereof are provided. The device includes a capture device and a processor. The capture device is adopted for receiving a plurality of frames and comparing at least two adjacent frames to obtain an area selection signal according to a differential value there-between. The processor is connected to the capture device for receiving the area selection signal and to separate each of the adjacent frames into at least two areas. Each of the areas of the adjacent frames is performed by an image processing step respectively, and then the images of the areas are combined to obtain a resulted frame.