Abstract: Touch control surfaces for electronic user devices are disclosed herein. An example electronic device includes a microphone array, a touch event identifier to analyze signal data generated by microphones of the microphone array to detect a first touch on a surface of the electronic device, a gesture detector to correlate the first touch with a gesture, a user input mapper to map the gesture to a user input and a processor to cause the electronic device to respond to the user input.

Abstract: An example method includes using a plurality of switches corresponding to a plurality of capacitors to select a first set of capacitors for charging at a first time. Charging the first set of capacitors corresponds to sampling from a first set of adjacent light detectors. The method includes using the plurality of switches to select a second set of capacitors from the plurality of capacitors for discharging at a second time. The method includes using a sampling switch to sample an output of the second set of capacitors as they discharge. The output of the second set of capacitors corresponds to the first set of adjacent light detectors. The method includes determining, based on sampling the output of the second set of capacitors, a collective intensity of light received by the first set of adjacent light detectors.

Abstract: Multimedia content may be obtained and an object may be identified in a first frame of video content. The object may be tracked through a plurality of frames, and the object may be identified in a second frame of the video content only if the object is no longer substantially identifiable.

Abstract: The present disclosure discusses smart glasses. The smart glasses may capture an image and then identify one or more objects in the image. The object located at a predefined position or region in the image is informed to a user. With the method, rather than all of the objects in the image, the object at the predefined position or region is informed to a user, such that the informing efficiency of the smart glasses and user experience are improved.

Abstract: The technology disclosed can provide methods and systems for identifying users while capturing motion and/or determining the path of a portion of the user with one or more optical, acoustic or vibrational sensors. Implementations can enable use of security aware devices, e.g., automated teller machines (ATMs), cash registers and banking machines, other secure vending or service machines, security screening apparatus, secure terminals, airplanes, automobiles and so forth that comprise sensors and processors employing optical, audio or vibrational detection mechanisms suitable for providing gesture detection, personal identification, user recognition, authorization of control inputs, and other machine control and/or machine communications applications. A virtual experience can be provided to the user in some implementations by the addition of haptic, audio and/or other sensory information projectors.

Abstract: A shape recognition device, a shape recognition program, and a shape recognition method that can obtain more precise information for recognizing an external shape of an object are provided. A shape recognition device of the present invention includes an external-shape detecting unit that detects an external shape of an object, a first extracting unit that extracts a first feature point on the external shape based on the external shape detected by the external-shape detecting unit, and a second extracting unit that extracts a second feature point that exists on the external shape or in the external shape and differs from the first feature point. As a result, more precise information for recognizing the external shape of the object can be obtained.

Abstract: Provided is a hand gesture recognition technique. A hand gesture recognition system according to one aspect of the present invention includes an image capturing unit that captures an image of a gesture recognition region to acquire a depth image; a hand region extractor that extracts a hand region from the depth image; and a hand gesture recognizer that analyzes the extracted hand region to recognize a hand gesture included in the depth image as a grasp gesture or a release gesture.

Abstract: An image processing method and apparatus are provided. The image processing method may include determining whether stereoscopic objects that are included in an image pair and that correspond to each other are aligned on the same horizontal line. The method includes determining whether the image pair includes target objects having different geometric features from those of the stereoscopic objects if the stereoscopic objects are not aligned on the same horizontal line. The method includes performing image processing differently for the stereoscopic objects and for the target objects if the image pair includes the target objects.

Abstract: An apparatus comprising: a depth map estimator configured to determine, associated with at least one visual image, a depth map comprising at least one distance value in a direction relative to an apparatus; a direction of arrival estimator configured to determine, using at least two microphones, at least one audio source signal with a direction; and an audio signal processor configured to process the at least one audio source signal based on the at least one distance value in the direction of the at least one audio source signal.

Abstract: A method for operating a motor vehicle control panel having a camera system and a gesture recognition device. includes filming a person gesticulating using at least one arm in the inside of the vehicle. Description data relating to a position and/or a sequence of movements of the at least one gesticulating arm is determined by the gesture recognition device and is associated with a control gesture. At least one situation parameter, which describes a gesticulation context of the person, is determined by a plausibility device which decides whether the person has performed a possible control gesture or only a gesture which is to be ignored. If it is determined that it is a possible control gesture, a control command is generated for the control gesture.

Abstract: Speech generating devices, communication systems, and methods for communicating using the devices and systems are disclosed herein. In certain examples, the speech generating device includes: a first display device positioned in a first direction, the first display device configured to face a user of the speech generating device; an input device configured to generate a communication to be displayed on the first display device; and a second display device positioned in a second direction different from the first direction, wherein the second display device is configured to display a social cue proxy or an emotional proxy of the generated communication.

Abstract: A method includes obtaining an image of an eye in a bright-pupil imaging mode in which a retinal retro-reflection complements the image of the eye in the bright-pupil mode, and obtaining an image of the eye in a dark-pupil imaging mode in which a cornea-scleral retro-reflection complements the image of the eye in the dark-pupil mode. One of the bright-pupil imaging mode and the dark-pupil imaging mode is selected based on quality of obtained images.

Abstract: Methods and system are provided for managing speech processing in an environment having at least two speech enabled systems. In one embodiment, a method includes: recording first user data that indicates an action of a user; determining, by a processor, a selection of a first speech enabled system based on the recorded user data; and generating, by the processor, a signal to at least one of activate and deactivate speech processing based on the first speech enabled system.

Abstract: A method for operator control of a motor vehicle component by a gesture includes: detecting the gesture being executed by an input unit of an operator in a three-dimensional operator control space, which is part of an interior of a motor vehicle; executing an operator control function associated with the identified gesture; and outputting a feedback signal as soon as the input unit enters or has entered the three-dimensional operator control space from outside the three-dimensional operator control space.

Abstract: A surveillance system and method for detecting a foreign object, debris, or damage (FOD) on a runway. The system comprises one or more cameras for capturing images of the runway; and an image processing system for detecting the FOD on the runway based on adaptive image processing of the images captured by the cameras; wherein the surveillance system is adaptively operable for FOD detection under both day and night ambient light conditions without assisted illumination such as infrared or laser illuminators.

Abstract: A method and system for managing an aircraft's flight path by identifying and categorizing potential threats in the aircraft's original flight path and determining an alternate flight path. The alternate flight path is selected from potential flight paths and has a threat value lower than any of the potential flight paths. The potential flight path candidates are generated from combinations of the original flight path coordinates, and coordinates that vary from the original coordinates by a set range.

Abstract: A sound source localization apparatus for localizing a sound source using an eigenvector, includes, a sound signal input unit inputting a sound signal, a correlation matrix calculation unit calculating a correlation matrix of the input sound signal, and an eigenvector calculation unit calculating an eigenvalue of the correlation matrix using the calculated correlation matrix, wherein the eigenvector calculation unit calculates the eigenvector using the correlation matrix of the input sound signal and one or more predetermined correlation matrices.

Abstract: An image-classification apparatus includes: a first feature extraction unit to acquire a feature value of each of block images obtained by segmenting an input image; an area-segmentation unit to assign each of the block images to any one of K areas based on the feature value; a second feature extraction unit to acquire, based on an area-segmentation result, a feature vector whose elements including, the number of adjacent spots, each including two block images adjacent to each other in the input image, for each combination of the areas whereto the two block images are assigned; or a ratio of the number of block images assigned to each of the K areas to all the number of block images adjacent to a block image assigned to each of the K areas; and a classification unit to classify to which of a plurality of categories the input image belongs.

Abstract: A method of recommending media content for a media playing system includes identifying a user in a viewing area; determining whether personal information of the user is stored in a database; and generating information related to a first media content recommendation according to the personal information when the personal information of the user is stored in the database.

Abstract: A method for automatically detecting and tracking multiple targets in a multi-camera surveillance zone and system thereof. In each camera view of the system only a simple object detection algorithm is needed. The detection results from multiple cameras are fused into a posterior distribution, named TDP, based on the Bayesian rule. This TDP distribution represents a likelihood of presence of some moving targets on the ground plane. To properly handle the tracking of multiple moving targets with time, a sample-based framework which combines Markov Chain Monte Carlo (MCMC), Sequential Monte Carlo (SMC), and Mean-Shift Clustering, is provided. The detection and tracking accuracy is evaluated by both synthesized videos and real videos. The experimental results show that this method and system can accurately track a varying number of targets.

Abstract: A detection area is decided in a case where a target has gone out-of-frame. If a target is being imaged by a camera continuously, it is determined whether the target has gone out-of-frame. If the target has gone out-of-frame, then the magnitude and direction of motion of the camera are detected. If camera motion is large, it can be concluded that the camera user is imaging the target while tracking it. Accordingly, it can be concluded that the target will again be imaged at the center of the imaging zone. An area defined as a region in which the target will be detected is set at the center of the imaging zone. If camera motion is small in a case where the target goes out-of-frame, it can be concluded that the user is waiting for the target to re-enter the imaging zone and therefore the edge of the imaging zone is set as the detection area.

Abstract: Determination whether a moving object appearing in input video is an object tracked and captured by a cameraman is enabled. It is determined that a moving object is a subject image to which a cameraman pays attention based on a time difference between time when a movement state determined by a motion vector of the moving object changes and time when a shooting state determined by a motion vector of a camera motion changes.

Abstract: Time-lapsing mirror methods and related systems.

Abstract: A video surveillance system includes at least one of a camera or a streamer. A data base server is coupled to the camera and can store metadata for a video clip from the camera or streamer. A media storage server is coupled to both the camera or, the streamer, and to the data base server to store the clip in the absence of any network video recorders.

Abstract: Segments of interest within video footage are identified automatically. Such segments of interest include portions of the footage which were taken using a hand held camera and which show a static subject, portions which track the motion of a moving subject, and portions which show an abrupt event. Methods are presented for identifying such segments, based on motion and/or colour analysis of the video footage or based on observations of discontinuities in the video footage following a period of stability.

Abstract: An image recognition device includes: an image sensor that captures an image via an image forming optical system and outputs image information repeatedly; a detector that detects differences between reference image information related to a reference image and a plurality of sets of partial information included in the image information; a recognition circuit that includes a microprocessor and recognizes a set of partial information, for which a smallest difference value among a plurality of differences detected in correspondence to the plurality of sets of partial information is calculated, as information matching the reference image information if the smallest value is smaller than a threshold value; and a controller that includes a microprocessor and sets the threshold value in correspondence to a color indicated in the reference image information.

Abstract: According to one embodiment, a display device includes an image data generating unit and a display unit. The image data generating unit generates image data on an image. The display unit presents a video including the image data to an image viewer on a moving body to superimpose the video on an actual outside scene. The image data includes a first display object and a second display object. The first display object includes a lower part object. The lower part object has a lower part, an upper right part and an upper left part. A length of the lower part along a normal direction is longer than lengths of the upper right and upper left parts. The second display object is disposed in the image with reference to a display position of the first display object. The second display object includes information on the moving body.

Abstract: A target tracking apparatus and method according to an exemplary embodiment of the present invention may quickly and accurately perform target detection and tracking in a photographed image given as consecutive frames by acquiring at least one target candidate image most similar to a photographed image of a previous frame among prepared reference target images, determining one of the target candidate images as a target confirmation message based on the photographed image, and calculating a homography between the determined target confirmation image and the photographed image, and searching the photographed image of the previous image for feature points according to the calculated homography, and tracking an inter-frame change from the previous frame of the found feature points to a current frame.

Abstract: A wireless video camera system including a single or dual HDTV digital camera; a system for the wireless transmission of uncompressed single or multiple SMPTE 292M, HDSDI data streams over an RF band; and automatic self-pointing transmitting and receiving antennas.

Abstract: An image signal processing unit partitions a frame image into a plurality of partitioned blocks and calculates for each partitioned block luminance information, color information, contrast information, and a motion vector quantity. A grouping unit groups the partitioned blocks into an image area of the same object based on the luminance information and the color information of each partitioned block. A moving amount calculating unit calculates a moving amount of an object contained in a grouped image area based on the motion vector quantity of each partitioned block, a detection value of a motion detection sensor, and a focal length calculated by a focal length calculating unit. A tracking object selecting unit selects an object in the image area of the highest contrast value as a tracking target object out of objects each having a moving amount exceeding a threshold value.

Abstract: Methods and systems for video retargeting and view selection using motion saliency are described. Salient features in multiple videos may be extracted. Each video may be retargeted by modifying the video to preserve the salient features. A crop path may be estimated and applied to a video to retarget each video and generate a modified video preserving the salient features. An action score may be assigned to portions or frames of each modified video to represent motion content in the modified video. Selecting a view from one of the given modified videos may be formulated as an optimization subject to constraints. An objective function for the optimization may include maximizing the action score. This optimization may also be subject to constraints to take into consideration optimal transitioning from a view from a given video to another view from another given video, for example.

Abstract: An imaging apparatus is equipped with: imaging means, for obtaining images of a subject; imaging control means, for controlling the imaging means to sequentially obtain a plurality of images; reference image selecting means, for selecting a single reference image from among the plurality of images; moving object region specifying means, for specifying moving object regions within corresponding images, which are the plurality of images other than the selected reference image; positioning means, for positioning the plurality of corresponding images with respect to the reference image in the case that the plurality of images have been imaged by flow shooting, the positioning being performed such that the amount of positioning is greater at the specified moving object regions than at non moving object regions; and combining means, for combining the plurality of corresponding images, which have been positioned by the positioning means, with the reference image.

Abstract: A method for presentation interaction. The method includes, receiving by a computer system an indication of a manual selection of a region proximate to an audience member of an audience wherein the indication is received via an interaction with a displayed image of the audience. The method also includes utilizing a microphone array communicatively coupled with a beam-forming component of the computer system to focus audio pickup from the region proximate to the audience member in response to receiving the indication. The method also includes displaying an enhanced image of the region proximate to the audience member using the computer system in response to receiving the indication.

Abstract: A computerized method of video analysis that includes receiving several series of video frames generated by a number of image sensors. Each image sensor has its own field-of-view which can, but does not have to, overlap with another image sensor's field-of-view. The image sensors monitor a portion of a monitored environment. The computerized method also includes concurrently tracking, independent of calibration, multiple objects within the monitored environment as the objects move between fields-of-view, and multiple objects within one field-of-view. The tracking is based on the plurality of received series of video frames.

Abstract: There are provided an automatic vision sensor placement apparatus and method which analyze static spatial information in various aspects, calculate priorities of spaces using an agent that models the movement pattern of a user, suggest a method of effectively covering a given space, provide a camera placement method to appropriately install cameras with various levels of performance in a specified space, and calculate the optimal number of cameras to be installed based on installation cost.

Abstract: The present invention discloses a method for image pickup and an image pickup device using the same. The image pickup device includes a lens, an image-processing program, and a user interface. The lens is utilized to obtain a main image by shooting an object. The image-processing program divides the main image into a plurality of sub-image blocks, computes the resolution of every sub-image block, and compares each resolution with a threshold. The user interface displays the compared result of each sub-image block to indicate if the lens and the object are parallel.

Abstract: Coherent motion regions extend in time as well as space, enforcing consistency in detected objects over long time periods and making the algorithm robust to noisy or short point tracks. As a result of enforcing the constraint that selected coherent motion regions contain disjoint sets of tracks defined in a three-dimensional space including a time dimension. An algorithm operates directly on raw, unconditioned low-level feature point tracks, and minimizes a global measure of the coherent motion regions. At least one discrete moving object is identified in a time series of video images based on the trajectory similarity factors, which is a measure of a maximum distance between a pair of feature point tracks.

Abstract: A system for automatically capturing an event of interest in a venue is disclosed, comprising a plurality of cameras for capturing video images of the event; and at least one processor communicatively connected to said plurality of cameras and con figured to execute a plurality of modules, said modules comprising a rectification module for combining the video images to form a wide-angle view; at least one of a motion analysis module configured for tracking salient blobs that are not part of a background of the wide-angle view, an activity analysis module configured for extracting temporal and spatial patterns from the wide-angle view, and a shape and appearance module configured for selecting one or more objects in the wide-angle view based on descriptors that are scale and rotational invariant; and a region of interest selector for selecting a viewpoint from the wide-angle view based on output from at least one of the motion analysis module, the activity analysis module, and the shape and appearance module,

Abstract: Segments of interest within video footage are identified automatically. Such segments of interest include portions of the footage which were taken using a hand held camera and which show a static subject, portions which track the motion of a moving subject, and portions which show an abrupt event. Methods are presented for identifying such segments, based on motion and/or color analysis of the video footage or based on observations of discontinuities in the video footage following a period of stability.

Abstract: In order to appropriately detect abnormalities for the purpose of surveillance with it being possible to prevent an unnecessary increase in data amount of the monitoring images, a monitoring system includes an image capturing section that captures a moving image of a monitored area, a variation reduced image generating section that generates a variation reduced image by reducing a temporal variation in an image, based on a plurality of moving-image making-up images included in the moving image captured by the image capturing section, a condition storing section that stores thereon a condition which is required to be satisfied by a variation reduced image which is generated by using a plurality of moving-image making-up images included in a moving image which is judged to show an abnormality, a satisfaction judging section that judges whether the variation reduced image generated by the variation reduced image generating section satisfies the condition, an output moving image generating section that, when the

Abstract: The present invention provides a scene classification apparatus for classifying uncompressed or compressed video into various types of scenes at low cost and with high accuracy using characteristics of a video and audio characteristics accompanied by the video. When video are compressed data, their motion intensity, spatial distribution of motion and histogram of motion direction are detected by using values of motion vectors of predictive coding images existing in respective shots, and the respective shots of the video are classified into a dynamic scene, a static scene, a slow scene, a highlight scene, a zooming scene, a panning scene, a commercial scene and the like based on the motion intensity, the spatial distribution of motion, the histogram of motion direction and shot density.

Abstract: An image recognition device includes; an image sensor that captures an image via an image forming optical system and outputs image information repeatedly; a detector that detects differences between reference image information related to a reference image and a plurality of sets of partial information included in the image information; a recognition circuit that includes a microprocessor and recognizes a set of partial information, for which a smallest difference value among a plurality of differences detected in correspondence to the plurality of sets of partial information is calculated, as information matching the reference image information if the smallest value is smaller than a threshold value; and a controller that includes a microprocessor and sets the threshold value in correspondence to a color indicated in the reference image information.

Abstract: Method and system for utilizing multiple phenomenological techniques to resolve closely spaced objects during imaging includes detecting a plurality of closely spaced objects through the imaging of a target area by an array, and spreading electromagnetic radiation received from the target area across several pixels. During the imaging, different phenomenological techniques may be applied to capture discriminating features that may affect a centroid of the electromagnetic radiation received on the array. Comparing the locations of the centroids over multiple images may be used to resolve a number of objects imaged by the array. Examples of such phenomenological discriminating techniques may include imaging the target area in multiple polarities of light or in multiple spectral bands of light. Another embodiment includes time-lapse imaging of the target area, to compare time lapse centroids for multiple movement signal characteristics over pluralities of pixels on the array.

Abstract: An automatic tracking apparatus is provided, which is capable of solving a failure occurred in an automatic tracking operation in connection with a zooming operation, and capable of tracking an object in a stable manner, while a zooming-up operation, or a zooming-down operation is carried out in a high speed.

Abstract: With an x-ray imaging system with a moveable part, obstacles can stand in the way of the movement of the moveable part. In accordance with the invention, video cameras capture the occupation of the space by objects using volume elements. It is possible to determine at a target movement of the moveable part which volume elements are passed through during this. If one of these volume elements proves to be a volume element occupied by an object, the movement of the moveable part is prevented, otherwise it is enabled or actively implemented.

Abstract: Systems and methods are described for robust online face tracking. In one implementation, a system derives multiple resolutions of each video frame of a video sequence portraying movement of a visual object. The system tracks movement of the visual object in a low resolution as input for tracking the visual object in a higher resolution. The system can greatly reduce jitter while maintaining an ability to reliably track fast-moving visual objects.

Abstract: An image processing apparatus comprises a distance measurement section for measuring a distance from the section to a subject for each pixel on the basis of a plurality of images photographed at different visual point positions. A setting section sets a range of the distance in which an obstacle is present. An image formation section executes image processing of replacing a first image signal relating to an obstructed region included in the range of the distance with a second image signal different from the first image signal on the basis of an output from the distance measurement section.

Abstract: An interface (402) to a video imaging device (490) that generates captured frames of a video image (100) is described. The interface includes control registers (430) that store at least two sets of stream parameters (401) corresponding to at least two regions of interest (ROIs) and a function (410) that generates at least two corresponding ROI video streams (460) that are derived from the captured frames as essentially simultaneous output signals using the at least two sets of stream parameters. In some embodiments a new selection value (436) is determined from a current selection value and a derivative parameter stored as a portion of a set of stream parameters. In these embodiments, the generating of the at least two corresponding ROI video streams as essentially simultaneous output signals includes using the new selection value.

Abstract: Segments of interest within video footage are identified automatically. Such segments of interest include portions of the footage which were taken using a hand held camera and which show a static subject, portions which track the motion of a moving subject, and portions which show an abrupt event. Methods are presented for identifying such segments, based on motion and/or color analysis of the video footage or based on observations of discontinuities in the video footage following a period of stability.

Abstract: A system, method and computer readable medium are disclosed for tracking motion of an object image, by receiving an input image and correlating the input image with a reference image by computing differences between the input image and the reference image. A motion vector is generated for a subimage of the input image using a subimage metric surface, and a tracking assessment of object image motion is output based on the motion vector.