Abstract: A method and apparatus for performing gesture recognition. In one embodiment of the invention, the method includes the steps of receiving one or more raw frames from one or more cameras, each of the one or more raw frames representing a time sequence of images, determining one or more regions of the one or more received raw frames that comprise highly textured regions, segmenting the one or more determined highly textured regions in accordance textured features thereof to determine one or more segments thereof, determining one or more regions of the one or more received raw frames that comprise other than highly textured regions, and segmenting the one or more determined other than highly textured regions in accordance with color thereof to determine one or more segments thereof. One or more of the segments are then tracked through the one or more raw frames representing he time sequence of images.

Abstract: Apparatus for determining a spatial property in a 3D-space, wherein the apparatus comprises a physical pointer, a camera and a position and orientation measurement system, wherein a first object in the 3D-space comprises a pattern on it, wherein the physical pointer is configured to contact a surface area of a second object in the 3D-space, wherein the camera is configured to capture, at a position of the camera with respect to the first object, image data comprising an image of the pattern; wherein the position and orientation measurement system is configured to determine a heading, position, verticality, attitude, and/or inclination of the camera based on the image of the pattern, and determine, based on the determined heading, position, verticality, attitude, and/or inclination of the camera and a relative position of the physical pointer with respect to the camera, the spatial property of the surface area by the physical pointer.

Abstract: A method for generating a special effect program file package and a method for generating a special effect are provided. The method for generating a special effect program file package includes: importing a sub-material; obtaining a parameter value of a playback parameter of the sub-material and establishing a correspondence between a display position of the sub-material and at least one predetermined key point; and generating a special effect program file package according to the sub-material, the correspondence and the parameter value. The method for generating a special effect includes: importing a special effect program file package; obtaining a parameter value of a playback parameter of a sub-material in the special effect program file package; performing key point detection on a video image; and generating a special effect of the sub-material on the video image based on the detected key point and the parameter value of the playback parameter.

Abstract: A video may be captured by an image capture device in motion. A stabilization trajectory for the video may reflect stabilization rotational positions to compensate for at least some of the motion of the image capture device. The stabilization trajectory may have a stabilization trajectory length. The stabilization of the visual content may be assessed based on the stabilization trajectory length.

Abstract: Electronic tracking systems are disclosed for assisting users with locating objects in a sporting environment. One such system includes a ball tracking component that tracks a game ball while moving in the sporting environment, and a heads up display that is worn by the user. This heads up display has an electronic display screen with a transparent display area that dynamically displays images within the user's field of view. A processor, which communicates with the ball tracking component and heads up display, is programmed to detect movement of the game ball, and responsively determine launch characteristics and/or flight characteristics of the moving game ball. The heads up display displays the launch/flight characteristics contemporaneous with an object indication adjacent to or superimposed over the moving game ball as the game ball is visible through the transparent display area of the display screen within the user's field of view.

Abstract: A motion compensation method includes determining one or more weighting coefficients of a predicted value of a target pixel to be processed according to at least one of a first parameter or a second parameter, and determining the predicted value of the target pixel according to the weighting coefficient. The target pixel is in a boundary pixel block of a current image block. The first parameter is a size of the current image block or a distance between the target pixel and a center position of the current image block. The second parameter is a size of an adjacent image block of the current image block or a distance between the target pixel and a center position of the adjacent image block.

Abstract: There is provided an image processor, an image processing method, a program, and a remote communication system that make it possible to provide a more satisfactory user experience. A region segmentation section segments an image at another base into a plurality of regions, and an estimation section estimates a lighting environment in which the image at the other base has been captured, by performing an image analysis on the image as a whole at the other base and on each region in the image at the other base. Then, the color correction section performs color correction, in accordance with a light-source color at the self base, on the image at the other base that has a light-source color corresponding to the lighting environment. For example, the present technology is applicable to a remote communication system using an image received and transmitted between the other base and the self base.

Abstract: Systems, methods, and non-transitory computer-readable media can identify a first user depicted in image content captured by a second user. It is determined that the first user should be obscured in the image content based on privacy settings. The image content is modified to obscure the first user.

Abstract: Embodiments of the present disclosure provide a method and an apparatus for recognizing an object, a device, a vehicle and a medium. The method includes: selecting a target camera matched with a target object from at least two cameras according to position information of the target object in a map and photographing parameters of the at least two cameras, in which, the at least two cameras has at least two focal lengths; controlling the target camera to photograph an image of the target object; and obtaining the image photographed by the target camera, and performing recognition on the image to recognize the target object.

Abstract: A display device capable of expanding a reproducible color gamut range while suppressing a decrease in image brightness is provided. The display device includes a display portion in which first groups and second groups are disposed to line up regularly with each other. The first groups include red color filters, blue color filters and first green color filters, and the second groups include the red color filters, the blue color filters and second green color filters. The second group is equal to the first groups in number of color filters and different from the first groups in filter combination.

Abstract: Electronic tracking systems are disclosed for assisting users with locating objects in a sporting environment. One such system includes a ball tracking component that tracks a game ball while moving in the sporting environment, and a heads up display that is worn by the user. This heads up display has an electronic display screen with a transparent display area that dynamically displays images within the user's field of view. A processor, which communicates with the ball tracking component and heads up display, is programmed to detect movement of the game ball, and responsively determine launch characteristics and/or flight characteristics of the moving game ball. The heads up display displays the launch/flight characteristics contemporaneous with an object indication adjacent to or superimposed over the moving game ball as the game ball is visible through the transparent display area of the display screen within the user's field of view.

Abstract: An autonomous mobile robot includes a target acquisition unit which acquires a target by using an image obtained by an imaging unit whose field of view is able to be changed, a target movement prediction unit which predicts the destination of the target by using the image of the target, an obstacle movement prediction unit which predicts the destination of an obstacle by using an image of the obstacle, an occlusion determination unit which determines whether or not the target is occluded by the obstacle from result of the prediction by the target movement prediction unit and result of the prediction by the obstacle movement prediction unit, and a target tracking unit which changes the field of view of the imaging unit so that the area of the target coming into the field of view increases in the case where it is determined that at least a part of the target is occluded by the obstacle.

Abstract: Techniques and architecture are disclosed for mobile transport systems configured to determine vehicle positions within an area using light-based communication signals. The system includes a plurality of luminaires located in an area and configured to transmit luminaire position data recognizable by a sensor disposed on a vehicle. The sensor receives an image of a luminaire including a light-based communication signal encoded with luminaire position data. Luminaire position data can be combined with luminaire layout information to determine a known location of the luminaire. A vehicle position relative to the known luminaire location can be determined based on mathematical relationships. Vehicle orientation relative to the area can be determined based an asymmetric fiducial pattern or multiple known luminaire locations. The system can combine a vehicle position relative to a known luminaire location with vehicle orientation relative to the area to determine a vehicle position relative to the area.

Abstract: The present application is applicable in the field of videos. Provided are a method and system for panoramic video stabilization, and a portable terminal. The method comprises: acquiring in real time the timestamp of a current state, an accelerometer count value, and an angular velocity value of a portable terminal; estimating the rotation vector of the current state by utilizing an Extended Kalman Filtering combined with the accelerometer count value and the angular velocity value; calculating a current rotation matrix via the Rodrigues' rotation formula on the basis of the rotation vector of the current state; and rotating a panoramic image on the basis of the current rotation matrix and producing a stabilized video frame. The present invention allows the stabilization of a jittering video frame and alleviates VR motion sickness.

Abstract: An image processing apparatus, comprising: an obtainment unit configured to obtain an image captured by an image capturing apparatus; a recognition unit configured to recognize a person from the image obtained by the obtainment unit; a setting unit configured to set a time limit for the person to be recognized by the recognition unit; and a processing unit configured to execute processing for privacy protection on an image including the person for which the time limit set by the setting unit has been exceeded.

Abstract: A method capable of performing an automatic focus function upon a specific movable object in a real-time manner, the method being applicable to a photographic apparatus with the automatic focus function, includes: capturing real-time image within a field of view (FOV) of a lens; comparing images of a plurality of image areas of the real-time image with a feature image of the specific movable object to identify an image area corresponding to the feature image of the specific movable object; and, performing automatic focus on the identified image area.

Abstract: An image compression method, performed by a computer, includes: acquiring image data of an image captured by an imaging device mounted to a vehicle; setting a segmented region in a reference image corresponding to an image to be compressed and encoded; enlarging the reference image so that a magnification rate of a region including the periphery of the reference image is greater than a magnification rate of a region including a center point of the reference image in the segmented region, the center point being a contact point of an optical axis of the image incident to the imaging device and an imaging element in the imaging device; generating a predictive image in accordance with the enlarged reference image; and compressing and encoding image data of the image to be encoded in accordance with the generated predictive image.

Abstract: Embodiments of the present disclosure relate to autofocusing of images using motion vectors generated by an image signal processor of a device. An image being processed may include one or more motion detection windows associated with a motion vector as well as one or more autofocus windows. An autofocus window that follows a motion detection window by at least a threshold vertical distance may be selected, for example, to account for a period of time or latency for determining a motion vector of the motion detection window. The device may perform autofocusing by shifting location of the selected autofocus window.

Abstract: Electronic tracking systems are disclosed for assisting users with locating objects in a sporting environment. One such system includes a ball tracking component that tracks a game ball while moving in the sporting environment, and a heads up display that is worn by the user. This heads up display has an electronic display screen with a transparent display area that dynamically displays images within the user's field of view. A processor, which communicates with the ball tracking component and heads up display, is programmed to detect movement of the game ball, and responsively determine launch characteristics and/or flight characteristics of the moving game ball. The heads up display displays the launch/flight characteristics contemporaneous with an object indication adjacent to or superimposed over the moving game ball as the game ball is visible through the transparent display area of the display screen within the user's field of view.

Abstract: The embodiments herein provide a method and system for masking personally identifiable elements in a captured multimedia content and communicating through an integrated messaging system. The method comprises capturing multimedia content, automatically or manually identifying and selecting content or coordinates of the personally identifiable elements for modification manually, automatically or semi-automatically, modifying the identified elements through a disfiguring or masking process selected from a group consisting of blurring, pixelating, pixel manipulation, modulating, deleting, hiding, applying several layers to an image or frame, superimposing an image or character, audio processing, and altering multimedia information, and displaying the modified multimedia on the second computing device. The modification is done internally at sender end, or externally at a central server or at a receiver end device. The multimedia content is modified and stored for sharing with another user at a later time.

Abstract: A moving body detecting device in accordance with embodiments includes a motion information acquirer, approximate image generator, and moving body detector. The motion information acquirer generates motion information on an imaging device capable of performing imaging with a first exposure time and a second exposure time longer than the first exposure time. The approximate image generator generates an approximate image generated by approximating one of a first photographic image imaged with the first exposure time and a second photographic image imaged with the second exposure time to another photographic image, on the basis of the motion information. The moving body detecting device detects a moving body captured in the first and second photographic images, on the basis of the approximate image and the other photographic image.

Abstract: Methods and apparatus for allowing an individual to preserve his/her privacy and control the use of the individual's images and/or personal information by other, without disclosing the identity of the individual to others, are described. In various embodiments the individual seeking privacy provides his/her identifying information, images, and sharing preferences indicating desired level of privacy to a control device which is then stored in a customer record. The control device can be queried to determine if an image or other information corresponds to a user who has restricted use of his/her image or other information in a public manner. Upon receiving a query the control device determines using the stored customer record whether an individual has authorized use of his or her image. Based upon the determination a response is sent to the querying device indicating whether the use of the image and/or individual's information is authorized.

Abstract: In the image capturing apparatus, the controller controls an optical element, when a motion of the image capturing apparatus follows a motion of the object, by using first motion information obtained from a first detector to detect the motion of the image capturing apparatus and second motion information obtained from a second detector to detect the motion of the object. The calculator calculates prediction information on the motion of the object during an exposure time, by using the second information detected at multiple times before the exposure time. The controller uses the prediction information to control the optical element during the exposure time.

Abstract: Various embodiments of the present disclosure provide a method and apparatus for dynamically determining an auto focusing (AF) area according to a size information of a face in a digital image processing device. An embodiment of the disclosure provides a digital image processing device including a camera and a processor configured to detect a face area in a preview image obtained by the camera, obtain a size of the face area, determine a focus area based on the size of the face area, and set focus based on the focus area.

Abstract: In general, the subject matter described in this disclosure can be embodied in methods, systems, and program products for detecting motion in images. A computing system receives first and second images that were captured by a camera. The computing system generates, using the images, a mathematical transformation that indicates movement of the camera from the first image to the second image. The computing system generates, using the first image and the mathematical transformation, a modified version of the first image that presents the scene that was captured by the first image from a position of the camera when the second image was captured. The computing system determines a portion of the first image or second image at which a position of an object in the scene moved, by comparing the modified version of the first image to the second image.

Abstract: An imaging apparatus includes an image pickup device having a plurality of photoelectric converters that receive light fluxes from an object that have passed through different pupil areas. A distance information generator detects light from the object and generates distance information regarding a distance of the object. The distance information generator is different from the image pickup device. A determining unit determines whether or not the object exists in a refocusable range in a process to an image signal obtained by an image pickup of the image pickup device, after the image pickup, on the basis of the distance information and a pupil division construction of the plurality of photoelectric converters. A control unit controls the image pickup of the object by the image pickup device in accordance with a result of the determination by the determining unit.

Abstract: A method for use with a stream of images defining a video. The method includes the steps of periodically conducting a face finding operation on an image in the stream. In respect to the last image in the stream preceding the image in which one or more faces was found, a tracker based upon wavelet decomposition is used to find a face for each face found in the last image for which no counterpart was found in the image.

Abstract: Method for determining the pose of a camera with respect to an object of a real environment for use in authoring/augmented reality application that includes generating a first image by the camera capturing a real object of a real environment, generating first orientation data from at least one orientation sensor associated with the camera or from an algorithm which analyzes the first image for finding and determining features which are indicative of an orientation of the camera, allocating a distance of the camera to the real object, generating distance data indicative of the allocated distance, determining the pose of the camera with respect to a coordinate system related to the real object of the real environment using the distance data and the first orientation data. May be performed with reduced processing requirements and/or higher processing speed, in mobile device such as mobile phones having display, camera and orientation sensor.

Abstract: Tracking hand or body pose from image data is described, for example, to control a game system, natural user interface or for augmented reality. In various examples a prediction engine takes a single frame of image data and predicts a distribution over a pose of a hand or body depicted in the image data. In examples, a stochastic optimizer has a pool of candidate poses of the hand or body which it iteratively refines, and samples from the predicted distribution are used to replace some candidate poses in the pool. In some examples a best candidate pose from the pool is selected as the current tracked pose and the selection processes uses a 3D model of the hand or body.

Abstract: A moving image compression device has an obtaining unit, an image conversion unit, and a compression processing unit. The obtaining unit obtains a RAW moving image having plural frames associated in an order of imaging, the frames having pixels of three different color components which are disposed periodically according to a color array with two rows and two columns. The image conversion unit separates, in a target frame, a first pixel group corresponding to a first color component of odd rows and a second pixel group corresponding to the first color component of even rows, and alternately arrays, in a time base direction, a first image including the first pixel group and a second image including the second pixel group. The compression processing unit performs inter-frame prediction coding compression on the first image and the second image.

Abstract: An electronic tracking system is disclosed for assisting a user in determining distances to objects in a sporting environment. The system includes a user tracking system for determining the location of a user, a heads up display for displaying information to the user, and a processor operable to communicate with the user tracking system and heads up display. The heads up display is designed to be worn by the user, and to display images within the user's field of view. The processor is programmed to determine a distance between the user's determined location and an object, such as a ball, located within the sporting environment. This information is displayed via the heads up display as a numeric representation of the determined distance. If tracking a ball, the heads up display may display an object indication, such as an enhanced image or a comet tail, superimposed over or adjacent the ball.

Abstract: A method for user recognition, comprising receiving user information from an information unit of a user; detecting the user face in a captured user image; and recognizing the user identity in the captured image according to a predetermined gesture associated with the user information and performed by the user.

Abstract: A golf aid for displaying one or more golf-related statistics to a user includes a golf ball tracking system for tracking a flight of a golf ball, a heads up display, and a processor in communication with the golf ball tracking system and the heads up display. The heads up display is configured to be worn on the user's head and display an image within the user's field of view. The processor is configured to compute one or more shot statistics from the tracked flight of the golf ball and display the one or more computed shot statistics within the field of view of the user via the heads up display. The one or more shot statistics include at least one of an initial ball speed, a spin rate, a carry, and a remaining distance to the pin.

Abstract: The automatic generation (702) of one or more secondary video streams based on an input primary video stream (701) may use analytics performed on the video to provide information on targets, events, and/or areas of interest to permit the one or more secondary video streams (703) to concentrate on one or more targets, events, and/or areas of interest.

Abstract: An image processing apparatus comprising a storage unit configured to store image data; a readout unit configured to read out the image data stored in the storage unit; a detection unit configured to detect a target object from the image data read out by the readout unit; a conversion unit configured to convert a resolution of the image data read out by the readout unit; and a write unit configured to write the image data having the resolution converted by the conversion unit in the storage unit, wherein the readout unit outputs the readout image data in parallel to the detection unit and the conversion unit.

Abstract: A gesture recognition system is disclosed. The gesture recognition system comprises at least one lighting module, at least one angle detecting module, an image capturing module and a gesture information control module. The lighting module is used for emitting a light. The angle detecting module receives a reflected light of the light and accordingly outputs a light sensing signal. The image capturing module is used for capturing at least one 2-D reference image for at least one hand of the user. The distance between the angle detecting module and the image capturing module is a fixed length. The gesture information control module acquires a plurality of angle data according to the light sensing signal and the 2-D reference image to calculate at least one depth data for at least one hand according to the plurality of angle data and the fixed length, so as to recognize the gestures.

Abstract: An image capturing device includes an assistant image synthesizing unit that changes a degree of transparency of a first assistant image in a transparent background area set in a second assistance image, when generating a synthesized assistant image by synthesizing the first and second assistant images providing assistance information for capturing, and a display control unit that overlaps the synthesized assistant image with a captured image and displays the image on a display unit.

Abstract: An automatic tracking camera system includes: a rotating unit for panning and tilting an image pickup unit including a lens apparatus and an image pickup apparatus; a tracking object detector; a motion vector detector for detecting a motion vector of the object to be tracked; a capture position setting unit for setting a capture position of the object to be tracked in the picked up image; and a controller for controlling drive of the rotating unit. The controller controls the rotating unit in a capture mode to capture the object to be tracked at the capture position based on the motion vector detected by the motion vector detector after the tracking object detector has detected the object to be tracked in the picked up image, and a maintenance mode to continuously capture the object to be tracked at the capture position after the capture mode.

Abstract: Even when as an object targeted for registering feature data, an object for which registered feature data has reached an upper limit is selected, replacement of the registered feature data is prompted to register new feature data. An imaging apparatus includes a registration unit configured to register a plurality of feature data up to an upper limit number in association with the same object, a selection unit configured to select one of registered objects for which new feature data is to be registered, and a control unit configured to perform control to display a selection screen for allowing, when the object selected by the selection unit is the object for which the upper limit number of feature data has been registered, a user to select the feature data to be replaced with the new feature data among the upper limit number of feature data registered for the object.

Abstract: Various methods are provided for automatically adjusting a zoom feature in accordance with a camera movement to perform a dolly zoom effect. One example method may include causing reception of a first image frame from video data, wherein the first image frame comprises two or more interest points, causing reception of a second image frame from the video data, wherein the second image frame comprises the two or more interest points in a different location, and tracking a difference in location of the two or more interest points from the first image frame to the second image frame. The method may also include calculating a scaling factor and applying the scaling factor to the second image frame.

Abstract: A digital video camera system that provides a video summary using a method that includes: designating a reference image containing a particular person; capturing a video sequence of the scene using the image sensor, the video sequence including a time sequence of image frames; processing the captured video sequence using a video processing path to form a digital video file; during the capturing of the video sequence, analyzing the captured image frames using a person recognition algorithm to identify a subset of the image frames that contain the particular person; forming the video summary including fewer than all of the image frames in the captured video sequence, wherein the video summary includes at least part of the identified subset of image frames containing the particular person; storing the digital video file in the storage memory; and storing a representation of the video summary in the storage memory.

Abstract: An image processing apparatus acquires a plurality of input images which are serially photographed, detects a plurality of object regions from each input image, and associates object regions in a past input image with object regions in a current input image. If any object region that has not been appropriately associated exists in the object regions detected from the past input image, the apparatus calculates object region movement information for each size of the object region based on the object regions mutually associated between the past input image and the current input image, and estimates a position of the object region of the current input image that has not been associated based on the movement information for each size of the object region and a size of the object region that has not been associated.

Abstract: An image processing apparatus includes an image acquiring unit that acquires an image of a subject imaged by an image capturing lens; a face detecting unit that detects face information corresponding to a person's face from the image acquired by the image acquiring unit; an image angle-of-view calculating unit that calculates an angle of view of a portion including the face in the image based on the face information detected by the face detecting unit; and a correction necessity determining unit that determines whether distortion correction of the image is need to be performed, based on the angle of view calculated by the image angle-of-view calculating unit and distortion characteristics of the image capturing lens.

Abstract: A method of operating an image sensor chip, which includes a color sensor pixel and a dynamic vision sensor (DVS) pixel sensing a motion of an object, is provided. The method includes enabling one of the color sensor pixel and the DVS pixel according to a mode selection signal and processing a pixel signal output from the enabled pixel.

Abstract: Implementations generally relate to continually capturing photos. In some implementations, a method includes collecting photos that are captured continually, where the photos are captured continually using a device that is operable to track a gaze of a user. The method also includes enabling the user to select one or more of the photos subsequent to the photos being captured. The method also includes enabling the user to process the selected photos.

Abstract: A feed forward command aiding architecture with corresponding method, system, and computer product are provided. The feed forward command aiding architecture includes generating angle and rate commands from a received inertial data input. The angle command is feed into a proper order position loop producing an intermediate result. An angle feedback is differentiated producing a rate loop feedback. The intermediate result, rate command, and rate loop feedback are then feed into a proper order rate loop producing a torque command. The proper order rate loop is nested inside of the proper order position loop. The torque command being generated moves a beam steering element of an electro-optic sensor to deflect a line of sight of the electro-optic sensor by an angle approximating the received inertial angular input.

Abstract: An image pickup apparatus which changes focal point adjustment by a focal point adjusting unit in accordance with the panning state detected by a panning detecting unit and a focal point state detected by a focal point detecting unit.

Abstract: There is a need for an object recognition apparatus for identifying multiple objects separately or collectively and a method therefor. An object recognition apparatus is configured to include: an image output section acquiring multiple object images and outputting an image; a detection section detecting the multiple object images in the image; a first identification section identifying the detected multiple object images; and a second identification section identifying the detected multiple object images collectively.

Abstract: Method for determining the pose of a camera with respect to at least one object of a real environment for use in authoring/augmented reality application that includes generating a first image by the camera capturing a real object of a real environment, generating first orientation data from at least one orientation sensor associated with the camera or from an algorithm which analysis the first image for finding and determining features which are indicative of an orientation of the camera, allocating a distance of the camera to the real object, generating distance data indicative of the allocated distance, determining the pose of the camera with respect to a coordinate system related to the real object of the real environment using the distance data and the first orientation data. May be performed with reduced processing requirements and/or higher processing speed, in mobile device such as mobile phones having display, camera and orientation sensor.

Abstract: A method may include capturing, by a computing device and during a time interval, a plurality of images. The computing device may determine a sharpness of a first image from the plurality of images based on detection of a difference between sharpness of a first plurality of high-contrast areas within the first image and sharpness of a corresponding, second plurality of high-contrast areas within a second image from the plurality of images. The first image may be sent to a search service. Image recognition data based on the first image or indication of unavailability of the image recognition data may be received from the search service. The determining may further include detecting a movement from at least a portion of the first plurality of high-contrast areas within the first image to a corresponding portion of the second plurality of high-contrast areas within the second image.