Abstract: A semiconductor device for use in controlling a camera module performs position adjustment of a correction lens for use in optical camera shake correction, based on information representing a present position of the correction lens and position information of an output image of electronic camera shake correction with respect to a photographed image photographed by an imaging element. As a result, an operation margin of the correction lens is kept, while keeping a correction margin for the electronic camera shake correction.

Abstract: Visual content is captured by an image capture device during a capture duration. The image capture devices experiences motion during the capture duration. The intentionality of the motion of the image capture device is determined based on angular acceleration of the image capture device during the capture duration. A punchout of the visual content is determined based on the intentionality of the motion of the image capture device. The punchout of the visual content is used to generate stabilized visual content.

Abstract: The present disclosure provides a method and a device for compositing a plurality of images. The method includes obtaining a first exposure time t required for current photographing. The first exposure time t is divided into N segments where N is M power of 4, and M is a positive integer. A micro-electro-mechanical system (MEMS) controls an image sensor to move clockwise or anticlockwise according to a step length of a preset number of pixels. The image sensor is controlled to expose for a second exposure time t/N after each movement of the image sensor according to the preset number of pixels, to obtain N images. The N images are composited to obtain a composite picture.

Abstract: The present disclosure provides a method and a device for compositing a plurality of images. The method includes obtaining a first exposure time t required for current photographing. The first exposure time t is divided into N segments where N is M power of 4, and M is a positive integer. A micro-electro-mechanical system (MEMS) controls an image sensor to move clockwise or anticlockwise according to a step length of a preset number of pixels. The image sensor is controlled to expose for a second exposure time t/N after each movement of the image sensor according to the preset number of pixels, to obtain N images. The N images are composited to obtain a composite picture.

Abstract: Image processing method and device are disclosed. The image processing method is inclusive of a step of obtaining a target image; a step of performing motion estimation on the target image so as to attain motion paths; a step of determining, on the basis of the motion paths, whether there exists a fluctuation meeting a predetermined requirement in the target image; and a step of taking, if there exists a fluctuation meeting the predetermined requirement in the target image, the target image as a reference image. The reference image is utilized to carry out inter frame motion estimation with respect to the respective images acquired.

Abstract: An exemplary video encoding system accesses an image set that includes first and second consecutive color data images depicting a virtual reality scene from a particular vantage point, and first and second consecutive depth data images corresponding to the color data images. The system performs a first-pass video encoding of the image set by identifying motion vector data associated with a transformation from the first to the second color data image, and abstaining from analyzing a transformation from the first to the second depth data image. The system then performs a second-pass video encoding of the image set based on the identified motion vector data by encoding the first and second color data images into a color video stream to be rendered by a media player device, and the first and second depth data images into a depth video stream to be rendered by the media player device.

Abstract: There is provided an information processing apparatus including an action recognition unit that recognizes an action state of a user based on a measurement result obtained by a sensor carried by the user, an image processing unit that performs a process regarding an amount of information on an image photographed by a photographing unit based on an action state of the user recognized by the action recognition unit during photographing by the photographing unit carried by the user, and a transmission control unit that causes the image processed by the image processing unit to be transmitted to an image processing device used to perform image recognition.

Abstract: Provided is an imaging device that performs multiple AD conversions including a first AD conversion and a second AD conversion for one pixel signal. A first memory has a bit width of N+1 bits (N is a natural number) and holds the least significant bit to the N+1th bit of a digital value obtained by the first AD conversion, and second memory has a bit width of M bits (M is a natural number) greater than N+1 bits and holds the least significant bit to the Mth bit of a digital value obtained by the second AD conversion.

Abstract: By using various information such as GPS information, cartographic information, and atmospheric pressure acquired by a sensor, a CPU of an imaging device calculates a motion vector in a limited MV calculation area acquired by excluding from images an area where radial motion vectors occur which highly possibly give an adverse effect to motion vector calculation, in accordance with the gravity direction with respect to the imaging device, the orientation of the imaging device, and the slope angle of the road where the imaging device is moving forward. After calculating the motion vector, the CPU estimates a blur amount between frames from the calculated motion vector and, based on this blur amount, performs the alignment of a feature point between the frames by image deformation processing.

Abstract: An image-processing device is provided with: a pattern-matching portion that performs pattern matching between a first image and a second image acquired before the first image and that outputs a motion vector between the images and an evaluation value that indicates the accuracy of the motion vector; a recursive noise-reduction portion that outputs a noise reduction image, which is the first image to which noise reduction has been applied, and that performs noise reduction in which an image based on the first image and an image based on the noise reduction image formed in the past are mixed in accordance with a predetermined recursion amount; and a controlling portion that controls a recursion amount in the recursive noise-reduction portion on the basis of the motion vector and the evaluation value output by the pattern-matching portion and a gain that is applied to the first image to adjust a brightness thereof.

Abstract: A method for detecting jittering in videos generated by a shaken camera to remove the jittering on the videos using neural networks is provided for fault tolerance and fluctuation robustness in extreme situations. The method includes steps of: a computing device, generating each of t-th masks corresponding to each of objects in a t-th image; generating each of t-th object motion vectors of each of object pixels, included in the t-th image by applying at least one 2-nd neural network operation to each of the t-th masks, each of t-th cropped images, each of (t?1)-th masks, and each of (t?1)-th cropped images; and generating each of t-th jittering vectors corresponding to each of reference pixels among pixels in the t-th image by referring to each of the t-th object motion vectors. Thus, the method is used for video stabilization, object tracking with high precision, behavior estimation, motion decomposition, etc.

Abstract: The present disclosure involves a method for automating media audio volume based on the physical motion of a mobile computing device. In one embodiment, the method includes detecting motion of the mobile device based on input motion data from a motion detection mechanism, determining whether the detected motion of the mobile device exceeds a configured motion threshold, based on the determining, causing a logical state change to transition into a automated volume state, and after the logical state change to transition to the automated volume state, automatically configuring the audio volume of audio output provided by a mobile computing device based on configured volume and fade parameters.

Abstract: A vehicle control system mounted in a vehicle, including a plurality of sensor devices each configured to perform at least one of detection of behaviors of the vehicle and detection of an object around the vehicle with predetermined detection timing and a vehicle control apparatus configured to perform driving aid control of the vehicle based on detection information detected by the plurality of sensor devices. The plurality of sensor devices include a first sensor device and second sensor devices other than the first sensor device. The first sensor device is configured to, with transmission timing of first detection information detected by the first sensor device, group the first detection information and second detection information acquired from the respective second sensor devices with the predetermined detection timing of the first sensor device and transmit the first and second detection information grouped together to the vehicle control apparatus.

Abstract: The present disclosure relates to a method and system for taking photos. According to another embodiment of the present invention, there is provided a system. The system includes an electronic device having a camera. The electronic device is configured to determine an object to be taken by the camera. Then the electronic device is configured to determine at least one shooting parameter for the object based on at least one previous photo related to the object. The electronic device is further configured to cause a setting of the camera to be adjusted based on the at least one shooting parameter. According to a further embodiment of the present invention, there is provided a computer program product. The computer program produce is tangibly stored on a non-transient machine-readable medium and include machine-executable instructions.

Abstract: An image capture system is provided for a vehicle equipped with a display for displaying streamed video images of a scene proximate the vehicle. The image capture system includes a camera for capturing video images of the scene proximate the vehicle at a selected exposure time and streaming the video images, and an image processing unit for receiving the streamed video images, processing the streamed video images and supplying the streamed video images to the display. The image processing unit is configured to detect amplitude-modulated light sources in the streamed video images, and adjust the exposure time of the camera to match a multiple of a modulation frequency of the amplitude-modulated light sources decreasing a flicker intensity of the amplitude-modulated light sources in the streamed video images supplied to the display.

Abstract: In one aspect, the present invention provides an imaging system, which includes an optical system for collecting light from a field of view and directing it to an image plane. One or more image detecting elements are disposed on a movable platform coupled to the image plane. The image detecting elements detect the collected light and generate image data corresponding to the field of view. A processor in communication with the image detecting elements receives the image data. The processor is configured to effect movement of the platform to move the one or more image detecting elements within the image plane to gather the image data.

Abstract: An electronic device includes a camera module, a board, and a first member fixed to the board. A second member is movably connected to the first member, and formed in at least a portion of the first member. A control member is connected to the first member and the second member so as to control the second member in response to a movement of the electronic device.

Abstract: An energy-efficient industrial sensor is provided that optimizes power consumption based on characteristics of the requirements of the sensing application in which the sensor is used. Operating parameters of the sensor, such as sensing range, operating frequency, response time, noise immunity, or other such parameters, can be scaled to suit the sensing and response requirements and environmental conditions of the sensing application. This allows the sensor to consume less energy when used in sensing applications that do not require peak sensor performance. In some embodiments, the sensor can measure the environmental or machine operating conditions in its immediate vicinity and dynamically scale its operating parameters based on the measured information. By down-scaling the sensor's operating parameters from their maximum performance levels where appropriate, the overall energy footprint of a network of sensors can be reduced.

Abstract: Aspects and embodiments are generally directed to an imaging system and methods for correcting geometric distortion induced by rolling-shutter operation of framing sensors. In one example, a method includes the acts of developing a DtoN mapping from a distorted image space to a normalized image space for initial pixels of the rolling-shutter framing sensor, developing an NtoD mapping from the normalized image space to the distorted image space for repositioned pixels in the normalized image space based on the DtoN mapping, the repositioned pixels corresponding to the initial pixels of the rolling-shutter framing sensor, producing a normalized image based on the repositioned pixels and the NtoD mapping, and resampling the normalized image to produce a corrected image of the imagery collected by the rolling-shutter framing sensor.

Abstract: A method for estimating a blur kernel size, the method including: (1) pre-processing a blurred image, to obtain an image, so that a size of the image satisfies an image input size of a multi-class convolutional neural network (CNN); (2) inputting the image into a multi-class CNN with completed training, to obtain a blur-kernel-size probability distribution vector; and (3) comparing each element in the blur-kernel-size probability distribution vector, so that an estimated blur kernel size of the blurred image is the blur kernel size corresponding to a largest element. The invention also provides a system for estimating a blur kernel size. The system includes an image pre-processing module, a training-set synthesizing module, a multi-class CNN module, and a blur kernel size estimation module.

Abstract: A method and apparatus for managing video transport is disclosed. A system that incorporates teachings of the present disclosure may include, for example, a server having a controller to predict visibility to a viewer of packet loss impairment for communicated video content based at least in part on scene information for one or more packets of the video content. Other embodiments are disclosed.

Abstract: There is provided an information processing device, an information processing method, and a program that enable easy generation of a motion picture in which performers imaged at different locations have been composited in a balanced manner. Processing of performing an image analysis on a second motion picture to set, as an analysis result, a position of a second subject appearing in the second motion picture, and on the basis of the analysis result, adjusting, as a compositing condition, a composited position at which a first motion picture is composited into the second motion picture avoiding a first subject from overlapping the second subject is performed. Moreover, processing of setting, as an analysis result, a face size of a first person appearing in the first motion picture as the first subject and a face size of a second person appearing in the second motion picture as the second subject.

Abstract: The present disclosure provides a detection system, which includes an image sensor, a lens device, and a processor. The image sensor is configured to take a first picture of a foreground object and a background object. The lens device is attached to the image sensor and configured to allow the foreground object to form a clear image on the first picture and the background object to form a blurred image on the first picture. The processor is configured to determine the image of the foreground object by analyzing the sharpness of the images of the first pictures.

Abstract: The present invention provides a driving circuit of pixel unit and a driving method thereof, and a display device. The driving circuit of pixel unit is configured to drive sub-pixel units on a display panel, and comprises a driving power supply signal port connected to the sub-pixel units through power supply signal lines and at least one compensation unit. The driving power supply signal port is configured to transfer a driving voltage output from the driving power supply to each of the sub-pixel units through the power supply signal lines. The compensation unit is configured to perform real-time compensation on voltage drops on the power supply signal lines when the sub-pixel units display different gray levels.

Abstract: According to an aspect of the invention, an offset calculator calculates a first offset value from an angular velocity detection signal which is detected by an angular velocity sensor and determines a panning offset value as a second offset value. A camera shake correction controller controls driving of a shift lens group and performs camera shake correction on the basis of a signal obtained by subtracting the first offset value. A panning controller acquires angular velocity data of an object with respect to an imaging apparatus which is calculated on the basis of the signal obtained by subtracting the panning offset value.

Abstract: An image processing apparatus including a CPU which is operable to function as units comprising a processing unit which sets, as a first area, an area that is not a peripheral edge area in a captured image acquired by an imaging unit, sets an area including the peripheral edge area as a second area, and performs predetermined processing on one of the first area and the second area, and a specification unit which specifies whether the first area is subjected to the predetermined processing or the second area is subjected to the predetermined processing, based on orientation information of the imaging unit when the captured image is acquired.

Abstract: A digital video camera comprising a memory that temporarily stores a video image including any number of frames is provided. The digital video camera outputs a video image of a first frame to a first signal path and outputs a video image of a second frame that is a frame earlier than the first frame in the memory to a second signal path. The digital video camera calculates a first correction amount used for correcting an image shake relating to the video image of the second frame based on the video image of the first frame output to the first signal path. Subsequently, the digital video camera corrects the image shake relating to the video image of the second frame by cutting out a predetermined region from the video image of the second frame based on the first correction amount.

Abstract: Methods, systems, and computer readable media for performing image compression are disclosed. According to one exemplary method, the method includes identifying a canonical image set from a plurality of images uploaded to or existing on a cloud computing and/or a storage environment. The method also includes computing an image representation for each image in the canonical image set. The method further includes receiving a first image. The method also includes identifying, using the image representations for the canonical image set, one or more reference images that are visually similar to the first image. The method further includes compressing the first image using the one or more reference images.

Abstract: A pose estimation method and apparatus are provided. The method includes determining, as a rotation component, an output value of a motion sensor configured to sense a motion of the pose estimation apparatus, determining a change amount of a translation component based on the rotation component, and the translation component extracted from images photographed by a vision sensor included in the pose estimation apparatus, optimizing the translation component based on the change amount, and outputting the rotation component and the optimized translation components a pose estimation value of the pose estimation apparatus.

Abstract: An image stabilization apparatus includes: a first detection unit that detects object moving amounts at a plurality of positions on a screen; a determination unit that determines an object range on the screen based on a result of detection performed by the first detection unit; a holding unit that holds object position information regarding an object position within the object range in association with moving amount information at the object position based on the result of detection performed by the first detection unit and a result of detection performed by a second detection unit that detects a motion of the apparatus; and a control unit that controls an operation of an image stabilization unit that corrects object image blur at the object position held in the holding unit.

Abstract: The invention relates to a phase-detection autofocus system using a single two-dimensional (2D) image sensor as an autofocus sensor. This allows for a number of novel functionalities such as calibration by adaptive selection of pixels for the autofocus collection zone, dynamically optimization of the collection zone for various scene and lightning conditions, as well as the use of 2D phase signals in the cross-correlation. This freedom in selecting which pixels to use gives rise to an equivalent freedom for the focus points presented to the user, which can be created, moved and scaled according to the conditions and the scene.

Abstract: A method and program product includes capturing at least one image of an operations display of at least one peripheral device. The operations display at least presents information associated with a status encountered by the at least one peripheral device. The at least one image is communicated to at least one computing system. The at least one computing system is at least configured for processing the at least one image for extracting features of the at least one peripheral device, determining a model of the at least one peripheral from the extracted features, determining at least a status encountered by the peripheral device from the extracted features, and creating a resolution to the encountered status. The resolution to the encountered status is received from the at least one computing system and displayed.

Abstract: Techniques to improve a digital image capture device's ability to stabilize a video stream—while enforcing desired stabilization constraints on particular images in the video stream—are presented that utilize an overscan region and a look-ahead technique enabled by buffering a number of video input frames before generating a first stabilized video output frame. More particularly, techniques are disclosed for buffering an initial number of input frames so that a “current” frame can use motion data from both “past” and “future” frames to adjust the value of a stabilization strength parameter and/or the weighted contribution of particular frames from the buffer in the determination of stabilization motion values for the current frame. Such techniques keep the current frame within its overscan and ensure that the stabilization constraints are enforced, while maintaining desired smoothness in the video stream. In some embodiments, the stabilization constraint may comprise a maximum allowed frame displacement.

Abstract: The present disclosure relates to a method and apparatus for determining the misalignment between a device and a pedestrian, wherein the pedestrian can carry, hold, or use the device in different orientations in a constrained or unconstrained manner, and wherein the device includes an optical sensor or camera. The optical sensors have a corresponding frame for the optical sensors' axes. The misalignment between the device and the pedestrian means the misalignment between the frame of the optical sensor assembly or camera in the device and the frame of the pedestrian. The present method and apparatus can work whether in the presence or in the absence of absolute navigational information updates (such as, for example, Global Navigation Satellite System (GNSS) or WiFi positioning).

Abstract: A code reader includes an image acquisition system to acquire a plurality of images. A sensor detects motion of the code reader, and a processor is operatively coupled to the image acquisition system and the sensor. The processor performs a plurality of steps including associating a first detected motion data with one of the plurality of acquired images; associating a second detected motion data with a subsequent one of the plurality of acquired images; attempting to decode the one of the plurality of acquired images; determining if the second detected motion data is preferred over the first detected motion data; and attempting to decode the subsequent one of the plurality of acquired images when the second detected motion data is preferred over the first detected motion data.

Abstract: Photometric stabilization for time-compressed video is described. Initially, video content captured by a video capturing device is time-compressed by selecting a subset of frames from the video content according to a frame sampling technique. Photometric characteristics are then stabilized across the frames of the time-compressed video. This involves determining correspondences of pixels in adjacent frames of the time-compressed video. Photometric transformations are then determined that describe how photometric characteristics (e.g., one or both of luminance and chrominance) change between the adjacent frames, given movement of objects through the captured scene. Based on the determined photometric transformations, filters are computed for smoothing photometric characteristic changes across the time-compressed video. Photometrically stabilized time-compressed video is generated from the time-compressed video by using the filters to smooth the photometric characteristic changes.

Abstract: An image pickup apparatus includes: an image pickup device; a body portion; an attitude detection portion configured to detect an attitude of the body portion; an image stabilization portion configured to correct image blur; an image stabilization control portion configured to calculate an amount of correction for the image stabilization portion; and a control portion including an image processing portion configured to generate one piece of composite image data from a group of continuously picked-up images; wherein the image stabilization control portion sets a reference angle at a time of picking up image data picked up first in the group of continuously picked-up images, and drives the image stabilization portion so that the reference angle corresponds to inclination of each image at a time of picking up image data picked up for a second time and after.

Abstract: An electronic device including a motion sensor and motion correction circuitry. The motion sensor detects motion of the electronic device and outputs motion information based on the detected motion. The motion correction circuitry corrects raw domain image data, received from an image sensor that has a block-based analog-to-digital converter architecture, based on the motion information. The corrected image data is output in a same raw domain image data format as the uncorrected raw domain image data.

Abstract: Various aspects of a system and a method are provided for detection of objects in motion are disclosed herein. In accordance with an embodiment, the system includes an electronic device, which is configured to compute a first sensor offset for a current frame based on a first motion vector and a second motion vector. A validation of the first motion vector is determined based on the second motion vector and one or more criteria. An object in motion from the current frame is extracted based on the first sensor offset of the current frame and the determined validation of the first motion vector.

Abstract: A system for displaying an image on a display device of a motor vehicle includes a rear-view camera connected to a moveable component on the motor vehicle and a controller in communication with the rear-view camera. The controller has memory for storing control logic and a processor configured to execute the control logic. The control logic includes capturing a field of view image from the rear-view camera, determining a position of the rear-view camera, determining an image perspective relationship of the field of view image based on the position of the rear-view camera, modifying the field of view image based on the image perspective relationship to create a virtual perspective image, and displaying the virtual perspective image on the display device in the motor vehicle as the position of the rear-view camera changes between at least a first position and a second position.

Abstract: There is provided an image-capturing device including an image-capturing unit that captures a subject to output the captured image, a detection unit that physically detects a shake angle when the image-capturing unit has shaken, and a correction processing unit that calculates a correction amount based on an arrangement position of a pixel constituting the image outputted by the image-capturing unit and the shake angle detected by the detection unit, to correct the image according to the correction amount.

Abstract: The present disclosure relates to an image processing device, an image processing method, and a solid-state imaging device capable of detecting image information with high accuracy by using images with different shooting conditions. A difference detection unit detects difference information of a short exposure image of a current frame and a past frame shot in a short exposure time. The difference detection unit detects difference information of a long exposure image of a current frame and a past frame shot in a long exposure time. The combining unit combines the difference information of the short exposure image and the difference information of the long exposure image on the basis of the short exposure image or the long exposure image and generates a motion vector of the current frame on the basis of the combined difference information. The present disclosure may be applied to the image processing apparatus and the like, for example.

Abstract: A communication object can be determined based on wireless communication technologies. A method can include determining a communication object according to sensor data of a target device and image information of a visual object; and sending a connection request to a determined communication object. A communication object can be determined according to sensor data of a target device and image information of a visual object, which can accurately match a signal source and a physical device, thereby providing a more reliable basis for communications between mobile network terminal devices.

Abstract: An on-board device, that outputs a control signal to a cleaning control unit that controls accumulation removing units used to remove accumulations settled on a photographic lens in an on-board camera by adopting a plurality of methods, includes: an accumulation detection unit that detects an accumulation settled on the photographic lens from a photographic image output from the on-board camera when a vehicle speed input thereto is equal to or higher than a predetermined vehicle speed; a selection unit that selects an accumulation removing unit adopting a first method among the accumulation removing units adopting the plurality of methods; and a removal decision unit that makes a decision, based upon the photographic image, as to whether or not the accumulation has been removed from the photographic lens through a removal operation performed by the accumulation removing unit adopting the first method, which has been selected by the selection unit, wherein: if the removal decision unit decides that the accumul

Abstract: Methods and systems for rendering an electronic greeting card to a portable computing device, wherein the visually-perceived light effects of the electronic greeting card are updated in real time. The electronic greeting card is dynamically rendered to the portable computing device including these dynamic light effects. An accelerometer is used to generate an input signal capable of initiating an algorithm that generates the dynamic light effects.

Abstract: An image shake correction device provided in an image pickup apparatus drives an image shake correction lens on the basis of detection information about shaking and corrects the image shake. An angular velocity sensor detects an angular velocity of shaking, and a motion vector detection unit detects a motion vector from a plurality of images that has been captured. An adaptive digital filter and an adaptive algorithm unit perform a process that generates a compensation value for a shake correction remainder, and FF (feed forward) control is performed in accordance with the result of the process. In the FF control, a filter coefficient of the adaptive digital filter is adjusted on the basis of the motion vector and a detection signal for shaking. The control filter calculates a feedback control amount so as to track the position of the image shake correction lens to a target position.

Abstract: An image processing apparatus obtains a plurality of images obtained by shooting the same subject at different positions, at each of a plurality of timings. Then, a first phase difference between images obtained at the same time, and a second phase difference between images obtained by shooting at the same position but at different timings, are detected. The image processing apparatus then selects at least some of the obtained images as images to be used in synthesis in accordance with a set generation condition, synthesizes the images so as to eliminate at least one of the first and second phase differences, and outputs the resulting image.

Abstract: An apparatus, a method, and a recording medium for image stabilization are provided. The image stabilization method includes receiving an image that is captured by a camera, detecting a motion of the image, predicting a motion of the image, using a Kalman filter, comparing the detected motion with the predicted motion, and updating a parameter of the Kalman filter based on a result of the comparing.

Abstract: A tilt correction apparatus includes a manipulation unit configured to designate a level of an effect of first tilt correction of an imaging apparatus having an optical axis as a rotary axis and a level of an effect of second tilt correction of the imaging apparatus having an axis orthogonal to the optical axis as a rotary axis, an electronic correction unit configured to execute at least one of the first tilt correction and the second tilt correction by moving an image clipping range set within an imaging screen, and a calculation unit configured to vary a ratio of a first tilt-correctable range and a ratio of a second tilt-correctable range from the electronic correction unit according to the level of the effect of the first tilt correction and the level of the effect of the second tilt correction.

Abstract: According to an embodiment, an amplifier which amplifies a first signal to output a second signal includes the following elements. The comparator compares the first signal with a third signal to output a fourth signal. The delay circuit delays a fifth signal by a delay time to generate a sixth signal. The first capacitor is connected between a voltage source and a first node that provides the third signal. The second capacitor is connected between the first node and a second node that provides the second signal. The first switch is connected between the second node and a constant current source, and is controlled by the fourth signal and the fifth signal. The second switch is connected between the first node and the second node, and is controlled by the fifth signal and the sixth signal.