Motion Correction Patents (Class 348/208.4)
  • Patent number: 10778894
    Abstract: In an imaging apparatus, a first motion vector detector calculates a first motion vector on the basis of images with a low spatial resolution and a second motion vector detector calculates a second motion vector on the basis of images with a high spatial resolution. A first control amount having a great weight for information with a low frequency resolution with respect to frequency components of the first motion vector information and a second control amount having a great weight for information with a high frequency resolution with respect to frequency components of the second motion vector information are calculated. A third control amount is calculated through multiplication by a predetermined weight regardless of the frequency resolution with respect to frequency components of the first or second motion vector information. Drive control of an image blur correction lens is performed according to the first to third control amounts.
    Type: Grant
    Filed: August 10, 2018
    Date of Patent: September 15, 2020
    Assignee: Canon Kabushiki Kaisha
    Inventor: Kenji Takeuchi
  • Patent number: 10755390
    Abstract: An image deblurring method based on light streak information in an image is provided, wherein shape information of a blur kernel is obtained based on a light streak in a motion blur image and image restoration is constrained by combining the shape information, a natural image and the blur kernel to thereby obtain an accurate blur kernel and a high-quality restored image. The method specifically comprises: selecting an optimum image patch including an optimum light streak; extracting shape information of a blur kernel from the optimum image patch including the optimum light streak; performing blur kernel estimation to obtain the final blur kernel; performing non-blind deconvolution and restoring a sharp restored image as a final deblurred image. The present disclosure establishes a blurry image test set of captured images including light streaks and a method to obtain an accurate blur kernel and a high quality restore image.
    Type: Grant
    Filed: July 15, 2016
    Date of Patent: August 25, 2020
    Assignee: PEKING UNIVERSITY SHENZHEN GRADUATE SCHOOL
    Inventors: Ronggang Wang, Xinxin Zhang, Zhenyu Wang, Wen Gao
  • Patent number: 10748255
    Abstract: An image blur correction device acquires a blur detection signal, and separates it into a high frequency band signal component and a low frequency band signal component using an HPF and an LPF. A high frequency side prediction processing unit acquires an output of the HPF, and a low frequency side prediction processing unit acquires an output of the LPF via a down-sampler. A prediction processing unit updates a filter coefficient of a prediction filter using an adaptive algorithm, and performs linear prediction on the blur detection signal. An adder adds an output of the high frequency side prediction processing unit to an output of the low frequency side prediction processing unit via an up-sampler, and outputs a superimposed output signal. Image blur correction control is performed on the basis of a superimposed output signal.
    Type: Grant
    Filed: March 2, 2018
    Date of Patent: August 18, 2020
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Fumihiro Kajimura
  • Patent number: 10708512
    Abstract: The present disclosure relates to a method and a device for capturing an image and a computer readable storage medium. In the method, a current motion parameter of the terminal and a current ambient light parameter are acquired, a current exposure parameter of the terminal is set based on the current motion parameter of the terminal and the current ambient light parameter, and the image is captured based on the set current exposure parameter of the terminal. The exposure parameter includes a shutter value, an aperture value and a sensitivity.
    Type: Grant
    Filed: November 21, 2018
    Date of Patent: July 7, 2020
    Assignee: Beijing Xiaomi Mobile Software Co., Ltd.
    Inventors: Heng Sun, Zhehong Lin
  • Patent number: 10681370
    Abstract: Techniques are described to unify the motion vectors of sub-blocks of an affine block and the motion vector information that is stored and used as predictors for determining motion vectors for subsequent blocks. A video coder may determine that the motion vector for a sub-block is the same as the motion vector information that is used to determine motion vectors for subsequent blocks.
    Type: Grant
    Filed: December 28, 2017
    Date of Patent: June 9, 2020
    Assignee: QUALCOMM Incorporated
    Inventors: Yi-Wen Chen, Wei-Jung Chien, Jianle Chen, Marta Karczewicz
  • Patent number: 10681277
    Abstract: Techniques described herein can address these and other issues by synchronizing the positioning of an adjustable lens in a camera assembly with the capture of an image frame by the image sensor and optimizing the position of the adjustable lens to reduce the amount of blur caused by translation of the camera assembly along a direction along the optical axis over the course of a frame. More specifically, techniques provide for moving the lens to a plurality of optimized positions, relative to the image sensor, over the course of a frame, to reduce motion blur in an image due to translation of the camera assembly in a direction of along the optical axis during the frame. Some embodiments may provide for “tight” synchronization in cases where the plurality of optimized positions are based on a time-dependent function that takes into account when each row of the image sensor is being exposed over the course of the frame.
    Type: Grant
    Filed: March 7, 2019
    Date of Patent: June 9, 2020
    Assignee: QUALCOMM Incorporated
    Inventors: Victor Kulik, Mehul Soman
  • Patent number: 10677939
    Abstract: Improvement of the dynamic range of a radiation detector is described. In one embodiment, one or more non-destructive readout operations are performed during a radiation exposure event to acquire data used to improve the dynamic range of the detector. In one implementation, one or more non-destructive readouts of pixels are performed prior to saturation of the pixels during an X-ray exposure so as to obtain non-saturated measurements at the pixels. In an additional implementation, non-destructive readouts of pixels are performed between exposure events so as to obtain an estimate of electronic noise during a multi-exposure examination.
    Type: Grant
    Filed: October 29, 2015
    Date of Patent: June 9, 2020
    Assignee: GENERAL ELECTRIC COMPANY
    Inventors: Biju Jacob, Hao Lai, Remy Andre Klausz, John Eric Tkaczyk
  • Patent number: 10672144
    Abstract: A method, client terminal and server for displaying an image, and a method and a server for sending an image are disclosed. The image display method includes providing an input interface; receiving an input information from a user via the input interface, wherein the input information being used for determining an observation point; and displaying a projection image of at least one of an observation object or an observation area, wherein the projection image is an image formed by projecting the at least one of the observation object or the observation area onto a projection plane corresponding to the observation point. The present disclosure can display a viewing effect corresponding to an observation point.
    Type: Grant
    Filed: October 26, 2017
    Date of Patent: June 2, 2020
    Assignee: Zhonglian Shengshi Culture (Beijing) Co., Ltd.
    Inventor: Yuan Tian
  • Patent number: 10663299
    Abstract: The present invention provides a stabilizer control system and method, wherein the system comprises a detecting module, a controlling module, a driving module, a feedback module and a motor; the detecting module detects posture information of a stabilizer, and sends the posture information to the controlling module; the controlling module receives the posture information of the stabilizer and issues a command to the driving module according to a preset control strategy; an input end of the driving module is connected with an output end of the controlling module, the output end of the driving module is electrically connected with the motor; the driving module receives the command from the controlling module and adjusts a rotating speed of the motor according to the command; the feedback module detects the rotating speed of the motor and sends rotating speed data of the motor to the controlling module.
    Type: Grant
    Filed: July 18, 2018
    Date of Patent: May 26, 2020
    Assignee: Guilin Feiyu Technology Corporation Ltd.
    Inventor: Chengyun Wei
  • Patent number: 10656375
    Abstract: The present embodiments relates to a lens driving device comprising: a housing; a bobbin disposed in the housing; a coil disposed on the bobbin; a first magnet which is disposed on the housing and faces the coil; a second magnet disposed on the bobbin; and a sensor which is disposed on the housing and faces the second sensor, wherein the sensor comprises an upper surface, a lower surface disposed opposite the upper surface, an inner surface facing the second magnet, an outer surface disposed opposite the inner surface, and both lateral surfaces connecting the inner surface with the outer surface, the upper surface and the lower surface of the sensor are fixed to the housing, and one of the side surfaces of the sensor is opened.
    Type: Grant
    Filed: May 8, 2017
    Date of Patent: May 19, 2020
    Assignee: LG Innotek Co., Ltd.
    Inventors: Jung Cheol Kim, Jin Suk Han, Sang Ok Park, Tae Bong Park, Seung Taek Shin
  • Patent number: 10657629
    Abstract: A memory stores image data generated by sensors included in an imager and containing a component data piece for each of color components that has undergone A/D conversion by an A/D converter. A width detector detects, based on the image data having undergone image processing by an image processor, the width along the main scanning direction of a duplicate area in which pieces of image data generated by adjoining sensors overlap each other. A displacement detector detects, based on the width of the duplicate area along the main scanning direction, a displacement of a scan target object for each of optical systems included in the imager. A first blur corrector performs blur correction on the component data piece using a point spread function for each of the color components that is dependent on a displacement of the scan target object.
    Type: Grant
    Filed: April 2, 2018
    Date of Patent: May 19, 2020
    Assignee: Mitsubishi Electric Corporation
    Inventors: Shigeru Takushima, Hiroyuki Kawano, Yoshitaka Toyoda, Taku Matsuzawa
  • Patent number: 10643313
    Abstract: Systems and methods related to pre-processing images and estimating PSFs for image deblurring in a noise-robust manner. The pre-processing may include iteratively denoising a reference image, iteratively denoising a scene image containing at least one straight edge within the scene image while preserving the at least one straight edge. The pre-processing may include smoothing, subtracting and dividing to provide a pre-processed image. The PSF-estimation process may include generating, with the at least one processor, a first noise value from portions of an edge intensity profile, generating a second noise value from a difference between the edge intensity profile and an integral of the noise-regularized inversion of the integration operator operating on the edge intensity profile and determining a value of a local curvature regularization parameter resulting in the first noise value and the second noise value being within a tolerance range.
    Type: Grant
    Filed: January 19, 2018
    Date of Patent: May 5, 2020
    Assignee: BAE Systems Information and Electronic Systems Integration Inc.
    Inventors: Michael J. DeWeert, Ian B. Murray
  • Patent number: 10645282
    Abstract: An electronic apparatus for providing a panorama image and a controlling method thereof are provided. The method includes acquiring photograph setting values of first images photographed respectively through a plurality of cameras, resetting a photograph setting value to be applied to at least one of the plurality of cameras based on the acquired photograph setting values and generating a panorama image comprising second images photographed through the plurality of cameras using the reset photograph setting value.
    Type: Grant
    Filed: March 13, 2017
    Date of Patent: May 5, 2020
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Jin-hyoung An, Jae-il Jung, Min-chul Kim, Young-kuk Kim, Yong-jin Kim, Sung-rae Cho
  • Patent number: 10635929
    Abstract: The present invention belongs to the field of machine vision. A saliency-based method for extracting a road target from a night vision infrared image is disclosed. The method combines saliencies of the time domain and the frequency domain, global contrast and local contrast, and low level features and high level features, and energy radiation is also considered to be a saliency factor; thus, the object of processing is an infrared image and not the usual natural image. The extraction of a salient region is performed on the raw natural image on the basis of energy radiation, and the obtained extraction result if the salient region is more accurate and thorough, and the contour of a target in the salient region is clearer.
    Type: Grant
    Filed: June 8, 2017
    Date of Patent: April 28, 2020
    Assignee: JIANGSU UNIVERSITY
    Inventors: Yingfeng Cai, Lei Dai, Hai Wang, Xiaoqiang Sun, Long Chen, Haobin Jiang, Xiaobo Chen, Youguo He
  • Patent number: 10623644
    Abstract: A vibration sensor of an image pick-up apparatus detects shake of an image pick-up apparatus and acquires shake information. An imaging unit outputs an image signal of a subject to an imaging signal processing unit. A motion vector detection unit calculates a motion vector according to an image signal after imaging. A feature point tracking unit performs feature point tracking by calculating a coordinate value of a subject on a photographing screen using the motion vector. A feature coordinate map and position and attitude estimation unit estimates a position or attitude of the image pick-up apparatus on the basis of information obtained by a band limit filter performing band limitation on shake information from a vibration sensor and an output of the feature point tracking unit.
    Type: Grant
    Filed: August 1, 2018
    Date of Patent: April 14, 2020
    Assignee: Canon Kabushiki Kaisha
    Inventor: Kenji Takeuchi
  • Patent number: 10591731
    Abstract: A system and method for ocular stabilization of video images is disclosed. While capturing video images in a forward field of view with a forward-facing video camera of a wearable head-mountable device (HMD), binocular eye-gaze directions of left and right eyes of a user of the HMD may be obtained with an eye-tracking device of the HMD. Based on the obtained binocular eye-gaze directions of left and right eyes of the user of the HMD, convergent gaze directions of the user may be determined as a function of time during an interval concurrent with the capturing of the video images. The captured video images may then be stabilized by compensating for motion of the forward-facing video camera with an intersection of the convergent gaze directions of the user with an image plane of the forward-facing video camera.
    Type: Grant
    Filed: October 25, 2017
    Date of Patent: March 17, 2020
    Assignee: Google LLC
    Inventor: Erfan Davami
  • Patent number: 10594996
    Abstract: An image processing apparatus includes a separation unit, a Bayer image signal supply unit, and a signal processing unit. The separation unit separates and removes, in input image signals in which pixel signals each including an invisible light component are arranged in an array different from a Bayer array, the invisible light components from the pixel signals. The Bayer image signal supply unit arranges the pixel signals from which the invisible light components have been removed in the Bayer array and supplies the pixel signals as Bayer image signals. The signal processing unit subjects the Bayer image signals to predetermined signal processing.
    Type: Grant
    Filed: July 9, 2015
    Date of Patent: March 17, 2020
    Assignee: Sony Semiconductor Solutions Corporation
    Inventors: Yasushi Sato, Koji Kurata, Yuta Okano, Shin Yoshimura, Tamaki Eyama, Ryuhei Hata, Masatsugu Fukunaga, Masahiro Ito
  • Patent number: 10559064
    Abstract: An HMD includes an attitude calculating unit, an attitude correcting unit, an image generating unit, and a display control unit. The attitude calculating unit may calculate a first attitude of the HMD based on an angular rate detected by an angular rate sensor. The attitude correcting unit may correct the first attitude to calculate a second attitude, based on an acceleration detected by an accelerometer and a rotation amount per predetermined time of the HMD. The image generating unit may generate an image according to the second attitude. The display control unit may cause a display to display the image.
    Type: Grant
    Filed: July 13, 2018
    Date of Patent: February 11, 2020
    Assignee: NINTENDO CO., LTD.
    Inventors: Gilles Pouliquen, Janos Boudet, François-Xavier Pasquier, Shinji Takenaka, Kenji Iwata
  • Patent number: 10560999
    Abstract: A data generation method is for generating video data that covers a second luminance dynamic range wider than a first luminance dynamic range and has reproduction compatibility with a first device that does not support reproduction of video having the second luminance dynamic range and supports reproduction of video having the first luminance dynamic range, and includes: generating a video signal to be included in the video data using a second OETF; storing, into VUI in the video data, first transfer function information for identifying a first OETF to be referred to by the first device when the first device decodes the video data; and storing, into SEI in the video data, second transfer function information for identifying a second OETF to be referred to by a second device supporting reproduction of video having the second luminance dynamic range when the second device decodes the video data.
    Type: Grant
    Filed: August 30, 2019
    Date of Patent: February 11, 2020
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Virginie Drugeon, Takahiro Nishi, Tadamasa Toma
  • Patent number: 10545398
    Abstract: A projection device including at least one projection module, at least one reflecting element, and at least one adjusting structure is provided. The projection module has at least one optical axis. The projection module is adapted to provide a projection beam. The projection beam is transmitted along a light transmission path to a projection target to form a projection image. The reflecting element is disposed between the at least one projection module and the projection target and located on the optical axis and has a reflecting surface, wherein the reflecting surface is adapted to reflect the projection beam to the projection target. The adjusting structure is connected to the reflecting element. The adjusting structure is adapted to drive the reflecting element to rotate along a first axis such that the projection image moves horizontally.
    Type: Grant
    Filed: September 20, 2018
    Date of Patent: January 28, 2020
    Assignee: Coretronic Corporation
    Inventors: Chuan-Te Cheng, Yen-Lin Chen, Chih-Wei Shih, Chin-Sheng Chao
  • Patent number: 10547784
    Abstract: A camera having a gyro and accelerometer stabilizes a video recording by the following steps. First, gyro data and acceleration data are synchronized with a frame of video data. The gyro data and the acceleration data are fused together to get a space domain rotation matrix that corresponds to the frame. The frame is adjusted based on the space domain rotation matrix. Next, at least one feature of the adjusted frame is detected. A modified rotation matrix is determined by comparing the at least one detected feature of the adjusted frame with a corresponding feature in a neighboring frame of the video data. Finally, the adjusted frame is further adjusted based on the modified rotation matrix.
    Type: Grant
    Filed: June 19, 2018
    Date of Patent: January 28, 2020
    Assignee: SighTour Technologies, Inc.
    Inventors: Shi-Mu Sun, Huah Tu
  • Patent number: 10536641
    Abstract: A display system includes an imaging apparatus installed on a mobile body; a display apparatus installed at a position different from that of the imaging apparatus on the mobile body and displaying a post-processing image; a first sensor detecting vibration at or near the imaging apparatus; a second sensor detecting vibration at or near the display apparatus; a first image processor clipping out a preprocessing image from an image captured by the imaging apparatus, based on the first sensor detection result; and a second image processor clipping out the post-processing image from the preprocessing image based on the second sensor detection result. The first image processor moves a clip-out region of the preprocessing image in a direction to counteract vibration at or near the imaging apparatus, and the second image processor causes a clip-out region of the post-processing image to follow vibration at or near the display apparatus.
    Type: Grant
    Filed: November 21, 2017
    Date of Patent: January 14, 2020
    Assignee: Japan Display Inc.
    Inventors: Fumitaka Gotoh, Tsutomu Harada
  • Patent number: 10536714
    Abstract: The invention relates to a method for encoding, a method for decoding, an apparatus, computer program products, an encoder and a decoder for video information. The motion vector for a block in a video image is predicted from a set of motion vector prediction candidates determined based on previously-coded motion vectors. A motion vector prediction candidate is included in the set based on the location of the block associated with the first spatial motion vector prediction candidate and in comparison with motion vector prediction candidates already in the set.
    Type: Grant
    Filed: March 18, 2019
    Date of Patent: January 14, 2020
    Assignee: Nokia Technologies Oy
    Inventors: Mehmet Oguz Bici, Jani Lainema, Kemal Ugur
  • Patent number: 10498967
    Abstract: An image pickup apparatus capable of, when a photometry is performed using an output of an image sensor, performing the photometry without being affected by a diaphragm of an image pickup optical system is provided. A mode is switched between a display mode in which an image according to the image signal which is an output of the image sensor is displayed as a live image and a non-display mode in which the live image is not displayed. In the display mode, a lower limit value of an accumulation time during which an electric charge is accumulated in the image sensor at a time of photometry is controlled to a first lower limit value. In the non-display mode, the lower limit value of the accumulation time is controlled to a second lower limit value lower than the first lower limit value.
    Type: Grant
    Filed: June 15, 2018
    Date of Patent: December 3, 2019
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Takashi Kosaka
  • Patent number: 10491800
    Abstract: An imaging apparatus includes an imaging element, an imaging lens, an AF controller, an image synthesis unit, and a display. The imaging element captures multiple images of an object to obtain a plurality of image data. The imaging lens includes a focus lens and is used for generating an image of the object in the imaging element. The AF controller controls a focus state of the imaging lens. The image synthesis unit synthesizes a region with a large amount of blurriness in image data of a current frame and a region with a small amount of blurriness in image data of a preceding frame obtained before the image data of the current frame, among the plurality of image data obtained by the imaging element by the plurality of times of image capturing during the drive of the focus lens. The display displays an image synthesized by the image synthesis unit.
    Type: Grant
    Filed: June 21, 2017
    Date of Patent: November 26, 2019
    Assignee: Olympus Corporation
    Inventors: Koichi Shintani, Katsuhisa Kawaguchi, Masaomi Tomizawa
  • Patent number: 10474924
    Abstract: A non-limiting example information processing apparatus includes a processor, and an infrared LED and an imaging device are connected to the processor. The processor controls on/off of the infrared LED, and an image sensor images infrared images according to switching timings thereof. An image processing circuit estimates an influence (situation) of noise such as sunlight etc. based on respective infrared images at times when the infrared LED is turned on and off, and determines at least advisability of use of the imaging device (infrared sensor). A determination result about the advisability of use is applied to the processor from the image processing circuit, and when it cannot be used, a message to that effect is displayed on an LCD.
    Type: Grant
    Filed: April 25, 2017
    Date of Patent: November 12, 2019
    Assignee: NINTENDO CO., LTD.
    Inventors: Takeshi Nishikawa, Yoshiyasu Ogasawara, Yasuyuki Shimohata, Yuki Tanaka
  • Patent number: 10477108
    Abstract: Image pickup apparatus includes imaging control circuit, keystone correction circuit, and composite circuit. Imaging control circuit acquires plurality of first images corresponding to subject image formed on imaging plane by image pickup optical system by causing imaging element to execute exposure plurality of times in accordance with imaging instruction. Keystone correction circuit corrects keystone distortion occurring in each first image due to change of attitude of body, by keystone correction based on tilt angle corresponding to each first image, and the optical characteristic, thereby generating plurality second images. Composite circuit generates third image by compositing second images.
    Type: Grant
    Filed: June 2, 2017
    Date of Patent: November 12, 2019
    Assignee: OLYMPUS CORPORATION
    Inventors: Tomoyuki Sato, Hitoshi Tsuchiya, Takanori Fukuda
  • Patent number: 10451424
    Abstract: Provided is a position and azimuth detecting device including a photographing instructing unit that acquires an output signal of a sensor mounted on equipment and instructs a photographing apparatus mounted on the equipment to perform photographing based on the output signal, a mark reading unit that reads from a mark included in an image photographed based on the instruction from the photographing instructing unit position information and azimuth information included in the mark, a relative position and azimuth calculating unit that calculates a relative position and a relative azimuth of the equipment to the mark based on a geometric shape of the mark included in the image, and a position and azimuth calculating unit that calculates an absolute position and an absolute azimuth of the equipment based on the position information, the azimuth information, the relative position and the relative azimuth.
    Type: Grant
    Filed: June 6, 2017
    Date of Patent: October 22, 2019
    Assignee: ASAHI KASEI KABUSHIKI KAISHA
    Inventors: Masaya Yamashita, Shiro Kobayashi, Keisuke Shigeta
  • Patent number: 10440800
    Abstract: A data generation method is for generating video data that covers a second luminance dynamic range wider than a first luminance dynamic range and has reproduction compatibility with a first device that does not support reproduction of video having the second luminance dynamic range and supports reproduction of video having the first luminance dynamic range, and includes: generating a video signal to be included in the video data using a second OETF; storing, into VUI in the video data, first transfer function information for identifying a first OETF to be referred to by the first device when the first device decodes the video data; and storing, into SEI in the video data, second transfer function information for identifying a second OETF to be referred to by a second device supporting reproduction of video having the second luminance dynamic range when the second device decodes the video data.
    Type: Grant
    Filed: May 2, 2019
    Date of Patent: October 8, 2019
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Virginie Drugeon, Takahiro Nishi, Tadamasa Toma
  • Patent number: 10440270
    Abstract: Image pickup apparatus includes imaging control circuit, keystone correction circuit, and composite circuit. Imaging control circuit acquires plurality of first images corresponding to subject image formed on imaging plane by image pickup optical system by causing imaging element to execute exposure plurality of times in accordance with imaging instruction. Keystone correction circuit corrects keystone distortion occurring in each first image due to change of attitude of body, by keystone correction based on tilt angle corresponding to each first image, and the optical characteristic, thereby generating plurality second images. Composite circuit generates third image by compositing second images.
    Type: Grant
    Filed: June 2, 2017
    Date of Patent: October 8, 2019
    Assignee: OLYMPUS CORPORATION
    Inventors: Tomoyuki Sato, Hitoshi Tsuchiya, Takanori Fukuda
  • Patent number: 10440271
    Abstract: An image-capture system, which handles on-chip compensation of rolling shutter effect in an imaging sensor, generates motion vector information for a plurality of speed values of a vehicle at each location on a specified route and derives an image-kernel for the plurality of speed values at each location on the specified route. A successive location of the vehicle is predicted at a current location of the vehicle based on the generated motion vector information for a current speed value of the vehicle at the current location on the specified route. A first image, which exhibits a shift of a plurality of pixels, is captured by the imaging sensor at the predicted successive location on the specified route. A second image is generated from the captured first image based on a compensation of the shift of the plurality of pixels in the captured first image.
    Type: Grant
    Filed: March 1, 2018
    Date of Patent: October 8, 2019
    Assignee: SONY CORPORATION
    Inventors: Prabakaran Ramalingam, Awadh Bihari Mohan
  • Patent number: 10412272
    Abstract: A method, system, apparatus, and/or device for adjusting or removing frames in a set of frames. The method, system, apparatus, and/or device may include: associating a first frame of a set of frames with motion data that is captured approximately contemporaneously with the first frame; when a sampling rate of the motion data is greater than a frame rate of the set of frames, aggregating a first sample of the motion data captured at the first frame and a second sample of the motion data captured between the first frame and a second frame of the set of frames to obtain a movement value; when the movement value does not exceed a first threshold value, accepting the first frame from the set of frames; and when the movement value exceeds the first threshold value, rejecting the first frame from the set of frames.
    Type: Grant
    Filed: September 28, 2018
    Date of Patent: September 10, 2019
    Assignee: Atheer, Inc.
    Inventors: Ryan Fink, Gary Peck, Bryan Ransil
  • Patent number: 10412244
    Abstract: A function which can be executed by an application is determined from information obtained from data obtained within a standard rule, thereby implementing a function within the standard rule. More specifically, processing executed by a scanner is recorded in EXIF information, and the application determines a function to be executed, based on the EXIF information.
    Type: Grant
    Filed: June 13, 2018
    Date of Patent: September 10, 2019
    Assignee: Canon Kabushiki Kaisha
    Inventor: Koichi Kuno
  • Patent number: 10404917
    Abstract: A method of stabilizing a video in real time using a single pass including receiving consecutive video frames, where the consecutive video frames include a current video frame and previous video frames, storing the consecutive video frames in a buffer, estimating a global motion for the current video frame by describing a camera's relative motion between the current video frame and one of the previous video frames adjacent to the current video frame, estimating a long-term camera motion for the current video frame by determining a geometric mean of an accumulation of the estimate of the global motion for the current video frame and an estimate of global motion for each of the previous video frames, and displaying the current video frame on a display of an electronic device, the current video frame stabilized based on the estimate of the long-term camera motion.
    Type: Grant
    Filed: October 13, 2017
    Date of Patent: September 3, 2019
    Assignee: Futurewei Technologies, Inc.
    Inventors: Zhenyu Wu, Wei Jiang, John Wus, Hong Heather Yu
  • Patent number: 10404916
    Abstract: Producing stabilized video can include: (a) accessing a first video including a sequence of first frames, (b) accessing a second video including a sequence of second frames, and (c) building the stabilized video based on the accessed first and second videos. The stabilized video can include a sequence of stabilized frames. At least one stabilized frame can include pixels derived from at least one of the first frames and at least one of the second frames.
    Type: Grant
    Filed: August 30, 2017
    Date of Patent: September 3, 2019
    Assignee: QUALCOMM Incorporated
    Inventors: Pasi Johannes Parkkila, Cullum James Baldwin
  • Patent number: 10397480
    Abstract: An image stabilization apparatus includes: a first calculation unit configured to calculate an angular velocity of movement of an image capturing apparatus; a second calculation unit configured to calculate a moving amount of an object from a plurality of images; a third calculation unit configured to calculate an angular velocity of movement of the object; a determination unit configured to determine whether or not the object is walking; and a selection unit configured to select, based on a determination result of the determination unit, whether to perform control such that an image stabilization unit corrects image blur based on the angular velocities calculated by the first calculation unit and the third calculation unit, or such that the image stabilization unit corrects image blur based on the angular velocity calculated by the first calculation unit.
    Type: Grant
    Filed: May 30, 2017
    Date of Patent: August 27, 2019
    Assignee: Canon Kabushiki Kaisha
    Inventor: Masayuki Mukunashi
  • Patent number: 10389948
    Abstract: A method for displaying preview images is disclosed. In one aspect, the method includes: receiving first images captured by a first camera having a first field-of-view (FOV), receiving second images captured by a second camera having a second FOV that is different than the first FOV, and displaying preview images generated based on the first and second images. The method may further include determining a spatial transform based on depth information associated with individual pixels in the first and second images, and upon receiving instructions to zoom in or out beyond a camera switching threshold, modifying the second image using the spatial transform and displaying the first image and the modified second image consecutively.
    Type: Grant
    Filed: December 6, 2016
    Date of Patent: August 20, 2019
    Assignee: QUALCOMM Incorporated
    Inventors: James Wilson Nash, Adarsh Abhay Golikeri, Narayana Karthik Sadanandam Ravirala
  • Patent number: 10383194
    Abstract: A data generation method is for generating video data that covers a second luminance dynamic range wider than a first luminance dynamic range and has reproduction compatibility with a first device that does not support reproduction of video having the second luminance dynamic range and supports reproduction of video having the first luminance dynamic range, and includes: generating a video signal to be included in the video data using a second OETF; storing, into VUI in the video data, first transfer function information for identifying a first OETF to be referred to by the first device when the first device decodes the video data; and storing, into SEI in the video data, second transfer function information for identifying a second OETF to be referred to by a second device supporting reproduction of video having the second luminance dynamic range when the second device decodes the video data.
    Type: Grant
    Filed: May 2, 2019
    Date of Patent: August 13, 2019
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Virginie Drugeon, Takahiro Nishi, Tadamasa Toma
  • Patent number: 10382710
    Abstract: An image processing apparatus includes an image acquirer configured to acquire a first image that is generated by image capturing and includes information of light intensity distributions obtained with a plurality of different exposures provided with transmittance distributions that are different from one another, an information acquirer configured to acquire information on the transmittance distributions, and an image estimator configured to separate image signals corresponding to two or more exposures among the plurality of exposures from the first image in the same pixel based on an estimation using the information on the transmittance distributions, and to generate two or more second images using the separated image signals.
    Type: Grant
    Filed: July 27, 2016
    Date of Patent: August 13, 2019
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Norihito Hiasa
  • Patent number: 10372979
    Abstract: A method for performing image processing of a physical document image. The method may include receiving an image file including an image of a physical document and a control target. The method may include measuring control target attributes of the control target. Measuring the control target attributes of the control target may include numerically measuring a degree of focus of the image file based on the control target. The method may include performing a static crop of the image file based on the control target attributes by removing the control target from the image file to create a cropped image.
    Type: Grant
    Filed: May 24, 2017
    Date of Patent: August 6, 2019
    Assignee: ArcaSearch Corporation
    Inventors: James R. Walker, Calvin G. Sixta
  • Patent number: 10373339
    Abstract: A method for determining structure from motion in hyperspectral imaging includes acquiring hyperspectral data cubes containing intensity data, the intensity data being stored in dimensions of the hyperspectral data cube including a first spatial dimension, a second spatial dimension, and a spectrum dimension; establishing a set of baseline spectral features from a data cube for tracking between data cubes; establishing a set of standard features from a data cube for tacking between data cubes; matching, between data cubes, respective baseline features and standard features; and extracting imaging device motion information based on relative positions of matched baseline and standard features.
    Type: Grant
    Filed: December 14, 2016
    Date of Patent: August 6, 2019
    Assignee: The Government of the United States of America, as represented by the Secretary of the Navy
    Inventors: Corey A. Miller, Thomas J. Walls
  • Patent number: 10318113
    Abstract: One or more embodiments of a digital content system allow a user to conveniently search and/or navigate through a collection of digital content items. In particular, a user can interact with a client device to search for and identify one or more digital content items within a collection of digital content items. For example, the digital content system may provide a photo from a collection of photos via a graphical user interface. The digital content system can receive a user input identifying a selection of one or more visual features within the photo. Based on the selected visual feature(s), the digital content system may identify photos from the collection of photos that include the identified visual feature(s) and provide access to the identified photos via the graphical user interface.
    Type: Grant
    Filed: July 11, 2016
    Date of Patent: June 11, 2019
    Assignee: DROPBOX, INC.
    Inventors: Peter N. Belhumeur, David J. Kriegman, Thomas Berg
  • Patent number: 10247957
    Abstract: A lens drive apparatus includes a plurality of protrusions that protrude from an end of a magnet holder in a direction of an optical axis toward an inner wall surface of a cover and function as a fracture prevention supporting member. The plurality of protrusions are configured to support prevention of fracture in a plurality of suspension wires by contacting the inner wall surface of the cover when a magnet holder moves in the direction of the optical axis.
    Type: Grant
    Filed: July 16, 2018
    Date of Patent: April 2, 2019
    Assignee: MITSUMI ELECTRIC CO., LTD.
    Inventors: Keiichi Sato, Makoto Ariji, Masayoshi Sugawara, Akihiro Moriya
  • Patent number: 10237574
    Abstract: The invention relates to a method for encoding, a method for decoding, an apparatus, computer program products, an encoder and a decoder for video information. The motion vector for a block in a video image is predicted from a set of motion vector prediction candidates determined based on previously-coded motion vectors. A motion vector prediction candidate is included in the set based on the location of the block associated with the first spatial motion vector prediction candidate and in comparison with motion vector prediction candidates already in the set.
    Type: Grant
    Filed: August 21, 2017
    Date of Patent: March 19, 2019
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Mehmet Oguz Bici, Jani Lainema, Kemal Ugur
  • Patent number: 10225460
    Abstract: An electronic device includes a first operation member for changing a set value of an allocated function item, and a second operation member for changing a function item allocated to the first operation member, and registers a set of function items to be allocated to the first operation member. The set includes a standard function that is allocated to the first operation member before the second operation member is operated, and the electronic device controls switching among function items to be allocated to the first operation member based on whether the standard function is an invalid function and on the number of function items included in the registered set, the switching being performed in response to an operation performed on the second operation member, the invalid function disabling changing of the set value by the first operation member.
    Type: Grant
    Filed: August 24, 2017
    Date of Patent: March 5, 2019
    Assignee: Canon Kabushiki Kaisha
    Inventors: Koki Kitaya, Takashi Yoshimi
  • Patent number: 10217227
    Abstract: Image feature trackability ranking systems and methods are disclosed. A method of establishing a trackability ranking order from tracked image features within a training video sequence at a tracking analysis device includes establishing a tracking region within the training video sequence using a feature detection algorithm. Trajectories of tracked image features within the tracking region are compiled using a feature tracking algorithm. Saliency metrics are assigned to each one of the trajectories of tracked image features based on one or more feature property measurements within the tracking region, and a trackability ranking algorithm that is a function of the saliency metrics and a defined feature trajectory ranking associated with the training video sequence is determined, the trackability ranking algorithm being usable for ranking, based on trackability, tracked image features within another video sequence.
    Type: Grant
    Filed: May 8, 2018
    Date of Patent: February 26, 2019
    Assignee: Nant Holdings IP, LLC
    Inventor: Kamil Wnuk
  • Patent number: 10212348
    Abstract: An image stabilization apparatus used in an image capturing apparatus that includes a display unit and which causes the display unit to display a still image captured by the image capturing apparatus by following a moving main object comprises a control unit configured to control the display unit so as to extract an area for the main object from an image captured by the image capturing apparatus and to display the extracted area and a calculating unit configured to calculate a motion of the main object based on a blur detected by a first detector which detects the blur of the image capturing apparatus and a motion vector detected by a second detector which detects the motion vector from the image, wherein the control unit changes the area for the main object based on the motion of the main object before the still image is captured.
    Type: Grant
    Filed: April 27, 2017
    Date of Patent: February 19, 2019
    Assignee: Canon Kabushiki Kaisha
    Inventor: Hiroaki Kuchiki
  • Patent number: 10198004
    Abstract: A method and an apparatus for obtaining a range image, and a UAV are provided. The method includes: reading an image sequence of a predetermined scene, in which the Nth image and the (N+1)th image of the image sequence have an overlapping region; obtaining a pixel movement velocity of each pixel point in the overlapped region in a camera coordinate system of the UAV; obtaining an actual flying velocity of the UAV in a world coordinate system; obtaining a range image of each overlapped region according to the pixel movement velocity of each pixel point in the overlapped region in the camera coordinate system of the UAV, the actual flying velocity of the UAV in the word coordinate system, and parameters of the airborne camera, and obtaining a range image of the preset scene through integrating the range image of each overlapped region.
    Type: Grant
    Filed: September 23, 2016
    Date of Patent: February 5, 2019
    Assignee: GUANGZHOU XAIRCRAFT TECHNOLOGY CO., LTD.
    Inventor: Yousheng Chen
  • Patent number: 10194084
    Abstract: An image processing device including: one or more processors comprising hardware, wherein the one or more processors are configured to: calculate an estimated movement amount of a subject in each image of a plurality of images; perform, based on the estimated movement amounts, one of: select and output an image that is most recently captured among the plurality of images; and select a reference image from the plurality of images based on the estimated movement amounts of the subject in the plurality of images; in response to selecting the reference image, determine a gain of the reference image; and perform, based on the gain, one of: select and output the reference image; and a synthesis process including: select a synthesis target image from the plurality of images; and generate and output a synthesized image by synthesizing the synthesis target image and the reference image.
    Type: Grant
    Filed: August 25, 2017
    Date of Patent: January 29, 2019
    Assignee: OLYMPUS CORPORATION
    Inventor: Kenji Numata
  • Patent number: 10182222
    Abstract: An omnidirectional camera is disclosed that records spherical video associated with a particular focal direction while in motion. The omnidirectional camera may implement one or more sensors and location-determining components to facilitate the recorded spherical video being subsequently correlated to an orientation and location of the omnidirectional camera during recording in a time-wise fashion to provide several enhancements during playback. These enhancements include reorienting the spherical video to a new focal direction. Data derived from the one or more sensors and location-determining components may be further utilized to overlay graphical objects onto the spherical video during playback to provide additional feedback.
    Type: Grant
    Filed: May 12, 2017
    Date of Patent: January 15, 2019
    Assignee: Garmin Switzerland GmbH
    Inventors: Jerad P. Hesla, Brian Lipkowitz, David S. Wissenbach, Michael M. Russell