Abstract: An image tracking apparatus includes: an imaging device that generates image information by capturing an image formed through an image forming optical system; a setting unit that sets, based upon the image information, first reference image information that includes image information corresponding to a part of an image to be designated as a target in the image information and also sets second reference image information based upon information related to an image assuming a position close to an image corresponding to the first reference image information; and a recognition unit that recognizes the target based upon the first reference image information and the second reference image information.

Abstract: The present invention utilizes video compression techniques in providing multi display and user control of picture layout with a single non-mechanical camera. According to a preferred embodiment of the present invention, a subsection of interest within a general view captured by the camera is coded based on the prediction of the main picture. In one aspect of the embodiment, scaling of the predicted pixel values in the subsection to match with the corresponding raw pixel data of extended resolution is carried out before subtracting the prediction from the raw data to provide the residual in the coding process. In a second aspect, the frame rate and the number of quantization intervals are increased when coding the subsection relative to the coding of the general view.

Abstract: A subject shake detection device includes a shake detection unit that detects a shake amount of an imaging unit for photographing a subject, a subject shake detection unit that detects an image shake amount from a motion picture to be photographed by the imaging unit and acquires a subject shake amount on the basis of a difference between the image shake amount and the shake amount, and an informing unit that informs a subject shake on the basis of the subject shake amount.

Abstract: Digital cameras and methods that help a user accurately align sequential photographs to create large panoramas and composite photographs derived from a sequence of smaller photographs. This effectively creates a higher resolution, or larger, photograph from a zigzag series of photographs using a low resolution camera. An algorithm running on the camera guides a user through the image-taking procedure, allowing him or her to select if a panoramic or composite photograph is to be taken, and optionally the number of images (width and height) needed to create the final image. The algorithm displays indicia, such as marks or a shadow (transparent) image, that are overlaid and moved over the live image during the image-taking process to help align the subsequent image to be taken with the previously recorded image.

Abstract: An information processing apparatus and method is disclosed wherein a detailed image of a moving body can be picked up accurately. A tracking object pan tilt zoom module reads out moving body information stored in a moving body tracking rank management database at predetermined intervals of time, and pan tilt movement of a zoom camera is controlled based on angle-of-view information as appearance information corresponding to an angle of view of a moving body having the highest priority rank. At this time, an additional tracking object pan tilt module reads out the latest moving body information of the moving body tracking rank management database at intervals of time sufficiently shorter than the predetermined intervals of time at which the tracking object pan tilt zoom process is repeated, and the pan tilt movement of the zoom camera is further controlled repetitively.

Abstract: While an image of an object is taken and image data of the image is generated by an imaging apparatus, at least either a panning or tilting movement of the imaging apparatus is detected. Form the image data, a feature of one or more humans is detected. Moving speeds of the one or more humans in the image data are calculated. Imaging control procedures with at least either a focus or exposing adjustment are performed to the human moving at the calculated minimum speed when at least either the panning or tilting movement of the imaging apparatus is detected.

Abstract: An image processing method is provided for detecting the position of a specific subject from a movie and combining a display of detection result indicating the detected position with the movie. The image processing method includes a step of determining, depending on a display time of the detection result, whether the detection result should be continuously displayed, when the subject cannot be detected during the display of the detection result combined with the movie.

Abstract: A method of storing and organizing digital images includes the steps of: a) using a camera, creating a digital image consisting of visual data representing visual content of a scene; b) storing the visual data along with additional information which indicates a position of the camera and a spatial orientation of the camera at the moment when the digital image is created; c) moving the camera to another location and repeating steps a) and b); d) repeating step c) until the desired amount of information is obtained. The camera can be moved intermittently, or moved continuously, while repeatedly capturing the visual data relating to the scene. Once captured and stored, the digital images can be compared to analyze the content of the scene.

Abstract: An image processing method is provided for detecting the position of a specific subject from a movie and combining a display of detection result indicating the detected position with the movie. The image processing method includes a step of determining, depending on a display time of the detection result, whether the detection result should be continuously displayed, when the subject cannot be detected during the display of the detection result combined with the movie.

Abstract: A system for automatically acquiring a target with a narrow field-of-view gimbaled imaging sensor. The system includes a target-detection subsystem including one or more target-detection imaging sensor with a first field-of-view, a target-tracking subsystem and a processing system in communication with the target-detection subsystem and the target-tracking imaging subsystem. The target-tracking subsystem includes a target-tracking imaging sensor with a second field-of-view smaller than the first field-of-view, and a gimbal mechanism for controlling a viewing direction of the target-tracking imaging sensor.

Abstract: The present invention enables the high speed processing of a foreground component image and a background component image associated with images received on a network platform. A client computer outputs information specifying image data to a separation server. The separation server then obtains the specified image data from a storage server and outputs it to a motion detecting server to perform motion detection processing. Thereafter, the image data, a motion vector, and positional information are output to an area specifying server. The area specifying server generates area information corresponding to the image data and outputs the area information to a mixture ratio calculating server in addition to the image data, the motion vector, and the positional information.

Abstract: A system and method for control of an audio field based on the position of the user. In one embodiment, a system and a method for audio reproduction are provided. One or more audio signals are obtained that are representative of sounds occurring at a first location. The audio signals are communicated from the first location to a second location of a person. A position of the head of the person is determined in at least two dimensions at the second location by obtaining at least one image of the person. An audio field is reproduced at the second location from the audio signals, wherein sounds emitted by each means for reproducing are controlled based on the position of the head of the person. This may include controlling the volume of reproduction by each of a plurality of sound reproductions means based on the position of the head of the person. In another embodiment, delay associated with of reproduction may be controlled based on the position of the head of the person.

Abstract: A method is described comprising: applying phosphorescent paint to specified regions of a performer's face and/or body; strobing a light source on and off, the light source charging the phosphorescent paint when on; and strobing the shutters of a first plurality of cameras synchronously with the strobing of the light source to capture images of the phosphorescent paint, wherein the shutters are open when the light source is off and the shutters are closed when the light source is open.

Abstract: An image processing method is provided for detecting the position of a specific subject from a moving image and combining a display of detection result indicating the detected position with the moving image. The image processing method includes a step of determining, depending on a display time of the detection result, whether the detection result should be continuously displayed, when the subject cannot be detected during the display of the detection result combined with the moving image.

Abstract: An imaging system is provided which can efficiently capture an authentication image of a subject by an imaging device provided around a position toward which the subject is moving. The imaging system includes; a plurality of imaging devices, provided at different positions, respectively, for capturing moving images; a direction detection unit for detecting the moving direction of the subject based on the moving image in which the subject is contained; a selection unit for selecting one of the imaging devices, that is to capture the authentication image of the subject based on the moving direction thus detected and the positions of the imaging devices; and a storage unit for storing the authentication image captured by the selected imaging device.

Abstract: An image processing apparatus comprising: a block selector that selects one of blocks that contain an amount of features, larger than a predetermined amount of features, from among a plurality of blocks which compose a particular one of a plurality of frames of a moving image of a subject; a motion calculator that calculates a motion vector of each of blocks of a second particular one of the plurality of frames next to the first-mentioned particular frame and corresponding to a respective one of the selected blocks; a displacement calculator that calculates a displacement of the second particular frame based on the calculated motion vectors; and an image shake corrector that corrects an image shake in the moving image based on the calculated displacement.

Abstract: A method and system for detecting faces at different views within images that allocates the computational effort based on a prior probability associated with a view is provided. A face detection system determines whether an image contains a face using detectors that are adapted to detect faces at various views and a filter that filters out windows of the image that are provided to a detector based on a prior probability associated with the view of the detector. Each view has an associated prior probability that a face from a collection of real-life home photographs will be at that view. The face detection system allocates increasing computational effort to a detector as the prior probability of its view increases.

Abstract: A system and method are described for performing motion capture on a subject using fluorescent lamps. For example, a system according to one embodiment of the invention comprises: a synchronization signal generator to generate one or more synchronization signals; one or more fluorescent lamps configured to strobe on and off responsive to a first one of the one or more synchronization signals, the fluorescent lamps charging phosphorescent makeup, paint or dye applied to a subject for a motion capture session; and a plurality of cameras having shutters strobed synchronously with the strobing of the light source to capture images of the phosphorescent paint, wherein the shutters are open when the light source is off and the shutters are closed when the light source is on.

Abstract: An electronic image stabilizer in a digital camera compensates for camera motion-induced blurriness by segmenting exposure times into multiple shorter exposure times and summing the individual pixels from successive frames after applying an appropriate motion correction. Motion is detected by computing the correlation function between successive images, and compensation is applied by maximizing the correlation function. This avoids the need for mechanical stabilization devices in order to detect or correct the motion as is done in prior art. This method further enables the detection of moving objects in a still background, and correction of blurriness images due to such motion.

Abstract: A solid state image pickup device has a high-resolution pixel array consisting of a plurality of photo-receptive elements disposed at a high density. A low-resolution whole picture scanning unit outputs low-resolution whole picture data by reading out and scanning the wholeness with the resolution of the pixel array lowered. A high-resolution partial picture scanning unit outputs high-resolution partial picture data by partial readout and scanning with high-resolution of the pixel array kept. A switching unit provides a switching between the low-resolution whole picture scanning unit and the high-resolution partial picture scanning unit within a frame period to thereby output in sequence the low-resolution whole picture data and the high-resolution partial image data at a speed equal to or greater than the video rate.

Abstract: A system and method are described for performing motion capture on a subject. For example, a method according to one embodiment of the invention comprises: mixing phosphorescent makeup with a makeup base; applying the mixture of phosphorescent makeup and makeup base to surface regions of a motion capture subject; strobing a light source on and off, the light source charging phosphor within the phosphorescent makeup when on; and strobing the shutters of a first plurality of cameras synchronously with the strobing of the light source to capture images of the phosphorescent makeup, wherein the shutters are open when the light source is off and the shutters are closed when the light source is on.

Abstract: Quantities of motion between images of an electronic camera are calculated and used to adjust the exposure time and one or more other exposure parameters used to capture an image in order to improve the quality of the image. Motion blur caused by movement of the camera or by movement of an object within the scene being photographed is reduced by selecting appropriate exposure parameters. Further, when there is little or no motion detected, the exposure parameters may be selected to improve the depth of field and reduce the noise in the captured image.

Abstract: The present invention is intended to measure a three-dimensional position of a tracking object snapped by a camera. The invention is based upon a measuring device using an image provided with an image data input part for inputting an image of a tracking object snapped by a camera and a tracking part for calculating a position of the tracking object and the tracking part moves a frame for extracting image data based upon the image, extracts image data included in the frame from the image in each moved position, counts the number of pixels having a hue feature based upon the extracted image data, determines the position of the frame in which the counted number of pixels is maximum for every hue feature and calculates the position of the tracking object based upon the determined position of the frame.

Abstract: Disclosed is a monitor device for a moving body such as a vehicle, aircraft or vessel, moving at a certain speed. The monitor device displays an image of a front scene of the moving body with the image of the central area being enlarged in accordance with the running speed of the moving body such that condition of a far away portion can be recognized accurately. A zoom ratio calculating section determines a zoom ratio in accordance with running speed of the moving body. The area of image to be displayed is selected in accordance with the zoom ratio and the image of the selected area is displayed on a display screen in an enlarged form. A specially designed distortion lens may be used to take the picture of the front scene to form an image of the scene with its central area being optically enlarged.

Abstract: A method for providing user comments relating to a scene captured by an image capture device and a digital imaging device configured to implement the method are described. In one aspect, a scene to be captured is displayed to a user through a display device of the image capture device. The image capture device uses an eye-tracking system to track where the user is gazing as the user views the scene, and detects and collects a user input that comprises user comments. While the user views the scene, a processor in the image capture device associates the user input with a location in the scene corresponding to an area where the user is gazing.

Abstract: There is provided an image-taking method and apparatus capable of quickly taking an image in which a human face is in focus. When an instruction to take an image is input, multiple images are taken with different focus positions. A human face in each of the images is detected, an area enclosing a detected human face is set as a focus evaluation area, and a focus evaluation value is calculated. Once focus evaluation values for all the images taken have been calculated, the image with the highest focus evaluation value among the images is chosen and recorded. Thus, an image in which the human face is in focus can be readily taken without having to perform cumbersome operations such as an image choosing operation.

Abstract: A navigation system utilizing augmented reality is provided which utilizes captured images to generate orientation information, wherein the pitch, yaw and roll are periodically derived from an inexpensive sensor, and in-between the periodical update, the pitch, roll, and yaw information are derived by capturing and image of the observed scene, identifying reference image components (RIC's) in a images and comparing those RIC's with subsequently captured images, to derive orientation information.

Abstract: A method for controlling a masking block in a monitoring camera. The method adjusts the masking block to precisely hide an image of a subject with its position and size changed when a zoom magnification is changed under a state where the masking block is set. In addition, the method adjusts a masking block to precisely hide a changed image of a subject when the monitoring camera is rotated to change the position of the image of the subject. In addition, the method measures and corrects a distance between a center axis of a CCD and an optical axis of a lens if the two axes are not coincident with each other. In addition, the method corrects an offset occurring due to an incorrect coupling between the monitor camera and a pan/tilter. Furthermore, a method for setting a masking block when a remotely uncontrollable monitoring camera is used is disclosed.

Abstract: A precision motion platform carrying an imaging device under a large-field-coverage lens enables capture of high resolution imagery over the full field in an instantaneous telephoto mode and wide-angle coverage through temporal integration. The device permits automated tracking and scanning without movement of a camera body or lens. Coupled use of two or more devices enables automated range computation without the need for subsequent epipolar rectification. The imager motion enables sample integration for resolution enhancement. The control methods for imager positioning enable decreasing the blur caused by both the motion of the moving imager or the motion of an object's image that the imager is intended to capture.

Abstract: An object of the present invention is to make it possible to detect the mixture state of an image. An area specifying unit 103 specifies, in correspondence with image data, a mixed area in which foreground object components forming a foreground object and background object components forming a background object are mixed and a non-mixed area formed of a foreground area consisting of only the foreground object components and a background area consisting of only the background object components. A mixture-ratio calculator 104 estimates, based on the ratio of the width of the mixed area in a predetermined direction with respect to the moving direction of the foreground object, the width of the mixed area being specified by the area information, to the distance from the position of a designated pixel to the edge of the mixed area in the predetermined direction, the mixture ratio indicating the ratio of the foreground object components and the background object components of the designated pixel.

Abstract: A subject user is photographed in a photographing system in a theme park. At this time, photographs are taken a plurality of times at a predetermined time interval. Further, an instruction is given to photograph a specified number of times according to a number of persons included in an image which will be photographed. It is judged whether or not persons included in a plurality of image data obtained by photographing have their eyes open. A single set of image data which is judged to include the persons with open eyes is sent to an image storage server and stored in the image storage server.

Abstract: A line of sight stabilization system using two mirrors pivotally mounted to a fixed platform that can be used with existing imaging systems to provide pitch, roll, and yaw compensation while maintaining image orientation. By deflecting only the photons, the inventive system avoids the need to stabilize the entire imaging sensor and optics system. The only mass to move is that of the two imaging system mirrors. By monitoring attitude changes via an inertial measurement system, proceeding platform positions can be estimated for subsequent image acquisitions, and efficient mirror positioning can provide optimal image orientation and stabilization. This approach requires small motors with low torque, providing a less expensive, lightweight, and small image orientation and stabilization system.

Abstract: A digital imaging system that allows the user to select and mark objects with markers is disclosed. The digital imaging device tracks the position of the marked objects even when the marked objects are not in the field of view of the digital imaging system.

Abstract: An image processing apparatus comprises a detection unit adapted to detect a positional shift of a main object in each of the images, a coordinate converting unit adapted to convert coordinates of each of the images using a detection result of the detection unit, and a correcting unit adapted to correct image exposure by combining the images after coordinate conversion. In combination of the images, images that have fewer positional shifts are selected and combined among images that have been sensed in a number larger than the number of images with correct exposure.

Abstract: A method and apparatus are described for improving object trackability via parametric camera tuning. In one embodiment, a determination is made as to whether the camera settings loaded cause saturation of a video image and hue differences between objects and between the objects and a background of the video image. If the saturation and hue differences do not exceed the threshold, a search of camera settings is performed to increase saturation and hue differences between objects and between the objects and a background of the video image.

Abstract: Methods, devices and computer program products for identifying a target subject for auto-focusing a digital camera include selecting a target subject at a first position in a first image and identifying the target subject on a display. The target subject is identified at a second position in a second image based on the first image. A digital camera lens is automatically focused on the target subject at the second position.

Abstract: Auto-focus in a digital camera is improved by stabilizing successive images. Each auto-focus image is correlated to previous images so that scene movement or motion can be tracked. The area in the scene where focus figure-of-merit is computed is adjusted according to the amount of scene movement. Also, two separate focus frames may be compared to determine the direction and speed of the motion. This improves the accuracy of the focus figure-of-merit which results in fewer autofocus failures.

Abstract: In order to facilitate a setting of multiple parameters of a tracking function of a camera, in a setting window, an image display window is displayed in which a picked-up image sent from a camera server and an indicator indicating a change detection maximum area as a detection result of an image change detection process by the camera server are superimposingly on the picked-up image. In addition, in the setting window, a window is displayed in which a setting window is displayed which is used to make a setting of a tracking method by referring to an image displayed in the image display window.

Abstract: The present invention describes a method and system for identifying a picture freeze situation on a display by adding a repeated electronic signature in the signal chain fed to the display, and detecting if the electronic signature is present on the display. If the electronic signature is not present a warning unit will be activated.

Abstract: A variable acuity imager incorporates an array of detection elements for light energy, in the visible, infrared, ultraviolet, or light energy in another region of the electromagnetic spectrum with a means to change the spatial configuration of the array to include “superpixels” by combining energy detected by adjacent elements, thus permitting any number of high-resolution “foveal” regions to be placed within the confines of the focal plane array and moved around at the frame rate of the imaging device. Detectors to measure the pitch, yaw and roll angle rates of background imagery using velocity-sensing circuitry are employed for variation of the foveal regions to accommodate motion of the array.

Abstract: An imaging system disables pixel integration for images within frames that are identified as moving while enables pixel integration for images that are not moving. The system may implement a frame-averaging type of integration or recursive types of frame integration, or may refrain from performing frame integration. On a pixel-by-pixel basis, the system may compare a pixel from frame memory with a corresponding pixel of an input frame and may disable pixel integration for the pixel when a difference between the compared pixels exceeds a threshold. One of the integration processes may be performed on the pixels when the difference does not exceed the threshold. When frame integration is disabled or de-selected (e.g., for pixels having motion), the frame memory may be bypassed and a self-integration may be performed with corresponding pixels from a current frame effectively resulting in no integration.

Abstract: The invention provides an image processing apparatus that can reduce the memory capacity of a memory forming part of the image processing apparatus and can correct the optical axis misalignment of a video camera in a simple manner. The image processing apparatus 10, which comprises a video camera 11, a memory 13 for storing an image signal supplied from the video camera, and a CPU 14 for performing prescribed processing on the image signal read out of the memory, includes a selective writing means 12 for selecting only a designated portion of the image signal in accordance with a select command C from the CPU, and for writing only the selected portion as a selected image signal S? into the memory 13. The image processing apparatus further includes a switching means for selecting the pixel data to be stored in the memory by switching between high-density pixel data covering a designated range centralized in a horizontal direction of the image and relatively low-density pixel data covering a full image range.

Abstract: An aspect of the present invention provides a moving obstacle detecting device installed in or on a moving body for detecting moving obstacles in the vicinity of the moving body, the moving obstacle detecting device that includes an image capturing unit configured and arranged to capture an image of the surroundings of the moving body, an optical flow calculating unit configured to find an optical flow corresponding to characteristic points in the image captured with the camera, a focus of expansion calculating unit configured to calculate focus or foci of expansion of the motion vectors in the optical flow found by the optical flow calculating unit, a histogram creating unit configured to create a histogram of the distribution of the focus or foci of expansion calculated by the focus of expansion calculating unit, a peak test unit configured to detect at least one moving obstacle to test peaks in the histogram, the test determining whether or not the peaks correspond to the same object if two or more peaks e

Abstract: A system and method is provided for enhancement of an object in a video frame, where the method includes recognizing and locating an object within an image frame and performing an automatic enhancement process on the object. The automatic enhancement process may include performing image and/or object enhancement on the object to make the object easier for an observer to detect. Such object enhancement may include enhancement to part of the object, such as the perimeter of the object, or to the entire object, and may also include varying enhancement, such as causing enhancing features to blink, flash or otherwise change to catch a viewer's attention, making the object easier to detect.

Abstract: Three-dimensional position information is used to identify the gesture created by a body part of interest. At one or more instances of an interval, the posture of a body part is recognized, based on the shape of the body part and its position and orientation. The posture of the body part over each of the one or more instances in the interval are recognized as a combined gesture. The gesture is classified for determining an input into a related electronic device.

Abstract: A security camera system is provided. Several video cameras operate in conjunction with an image display monitor, a user control and camera selector means whereby a target of interest may be followed. Each two cameras providing adjacent areas of coverage are operable to provide an overlay image portion at transition regions of a displayed image. Upon movement of the target of interest to a specified transition region of a currently displayed image provided by one video camera, the camera selection means is operable to select a second camera whereby to maintain target display continuity by the monitor.

Abstract: A photography system includes a digital camera and a remote control. The remote control emits a light that the photographer can use to designate a subject to be photographed by pointing the remote control at the subject, casting a light spot on the subject. In a preferred embodiment, the light is generated by a laser pointer included in the remote control. The camera selects a region to photograph from its field of view, based on the location or motion of the light spot. The camera may optionally select a region that is centered on the light spot. The photographer may optionally specify the size of the region to be selected. The camera may optionally adjust the size of the selected region to assist in photographic composition. The camera may optionally be capable of making video recordings.

Abstract: An image pickup apparatus comprising a first lens unit which comprises at least a negative lens element and at least a positive lens element and has negative refractive power, a second lens unit which has positive refractive power, and an optical path bending reflecting optical element which has a variable reflecting surface disposed in an airspace between a most object side lens component of the first lens unit and a most object side lens component of the second lens unit. This image pickup apparatus changes a magnification by moving the second lens unit along an optical axis and corrects a deviation of an image location by varying a shape of the variable reflecting surface of the reflecting optical element.

Abstract: A method for controlling a camera using an image compression algorithm. A motion region and a motionless region are determined with respect to an input image based on a motion vector of a macro block which is for the generation of compressed data from the input image. A center value and a size of a moving object is estimated from the motion region. According to the center value and the size of the moving object, the camera is controlled to track and photograph the moving object. Accordingly, a central processing unit of the moving object tracking system is relieved of substantial processing load, and the processing speed of the system is improved.

Abstract: A photosensitive region includes a semiconductor substrate 40 made of a P-type semiconductor, and N-type semiconductor regions 41, 42 and 43 formed on the surface of the semiconductor substrate 40. Accordingly, the first photosensitive portion includes a portion of the semiconductor substrate 40 and the semiconductor regions 41, thus configuring a photodiode. The photosensitive region on one side contained in the second photosensitive region includes a portion of the semiconductor substrate 40 and the semiconductor regions 42, thus configuring a photodiode. The photosensitive region on the other side contained in the second photosensitive region includes a portion of the semiconductor substrate 40 and the semiconductor regions 43, thus configuring a photodiode. Each of the semiconductor regions 42 and 43 is in a shape of an approximate triangle, and is formed so that one side of the regions 42 is adjacent to one side of the region 43, and vice versa, in one pixel.