Motion Correction Patents (Class 348/208.4)
  • Patent number: 10635929
    Abstract: The present invention belongs to the field of machine vision. A saliency-based method for extracting a road target from a night vision infrared image is disclosed. The method combines saliencies of the time domain and the frequency domain, global contrast and local contrast, and low level features and high level features, and energy radiation is also considered to be a saliency factor; thus, the object of processing is an infrared image and not the usual natural image. The extraction of a salient region is performed on the raw natural image on the basis of energy radiation, and the obtained extraction result if the salient region is more accurate and thorough, and the contour of a target in the salient region is clearer.
    Type: Grant
    Filed: June 8, 2017
    Date of Patent: April 28, 2020
    Assignee: JIANGSU UNIVERSITY
    Inventors: Yingfeng Cai, Lei Dai, Hai Wang, Xiaoqiang Sun, Long Chen, Haobin Jiang, Xiaobo Chen, Youguo He
  • Patent number: 10623644
    Abstract: A vibration sensor of an image pick-up apparatus detects shake of an image pick-up apparatus and acquires shake information. An imaging unit outputs an image signal of a subject to an imaging signal processing unit. A motion vector detection unit calculates a motion vector according to an image signal after imaging. A feature point tracking unit performs feature point tracking by calculating a coordinate value of a subject on a photographing screen using the motion vector. A feature coordinate map and position and attitude estimation unit estimates a position or attitude of the image pick-up apparatus on the basis of information obtained by a band limit filter performing band limitation on shake information from a vibration sensor and an output of the feature point tracking unit.
    Type: Grant
    Filed: August 1, 2018
    Date of Patent: April 14, 2020
    Assignee: Canon Kabushiki Kaisha
    Inventor: Kenji Takeuchi
  • Patent number: 10594996
    Abstract: An image processing apparatus includes a separation unit, a Bayer image signal supply unit, and a signal processing unit. The separation unit separates and removes, in input image signals in which pixel signals each including an invisible light component are arranged in an array different from a Bayer array, the invisible light components from the pixel signals. The Bayer image signal supply unit arranges the pixel signals from which the invisible light components have been removed in the Bayer array and supplies the pixel signals as Bayer image signals. The signal processing unit subjects the Bayer image signals to predetermined signal processing.
    Type: Grant
    Filed: July 9, 2015
    Date of Patent: March 17, 2020
    Assignee: Sony Semiconductor Solutions Corporation
    Inventors: Yasushi Sato, Koji Kurata, Yuta Okano, Shin Yoshimura, Tamaki Eyama, Ryuhei Hata, Masatsugu Fukunaga, Masahiro Ito
  • Patent number: 10591731
    Abstract: A system and method for ocular stabilization of video images is disclosed. While capturing video images in a forward field of view with a forward-facing video camera of a wearable head-mountable device (HMD), binocular eye-gaze directions of left and right eyes of a user of the HMD may be obtained with an eye-tracking device of the HMD. Based on the obtained binocular eye-gaze directions of left and right eyes of the user of the HMD, convergent gaze directions of the user may be determined as a function of time during an interval concurrent with the capturing of the video images. The captured video images may then be stabilized by compensating for motion of the forward-facing video camera with an intersection of the convergent gaze directions of the user with an image plane of the forward-facing video camera.
    Type: Grant
    Filed: October 25, 2017
    Date of Patent: March 17, 2020
    Assignee: Google LLC
    Inventor: Erfan Davami
  • Patent number: 10560999
    Abstract: A data generation method is for generating video data that covers a second luminance dynamic range wider than a first luminance dynamic range and has reproduction compatibility with a first device that does not support reproduction of video having the second luminance dynamic range and supports reproduction of video having the first luminance dynamic range, and includes: generating a video signal to be included in the video data using a second OETF; storing, into VUI in the video data, first transfer function information for identifying a first OETF to be referred to by the first device when the first device decodes the video data; and storing, into SEI in the video data, second transfer function information for identifying a second OETF to be referred to by a second device supporting reproduction of video having the second luminance dynamic range when the second device decodes the video data.
    Type: Grant
    Filed: August 30, 2019
    Date of Patent: February 11, 2020
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Virginie Drugeon, Takahiro Nishi, Tadamasa Toma
  • Patent number: 10559064
    Abstract: An HMD includes an attitude calculating unit, an attitude correcting unit, an image generating unit, and a display control unit. The attitude calculating unit may calculate a first attitude of the HMD based on an angular rate detected by an angular rate sensor. The attitude correcting unit may correct the first attitude to calculate a second attitude, based on an acceleration detected by an accelerometer and a rotation amount per predetermined time of the HMD. The image generating unit may generate an image according to the second attitude. The display control unit may cause a display to display the image.
    Type: Grant
    Filed: July 13, 2018
    Date of Patent: February 11, 2020
    Assignee: NINTENDO CO., LTD.
    Inventors: Gilles Pouliquen, Janos Boudet, François-Xavier Pasquier, Shinji Takenaka, Kenji Iwata
  • Patent number: 10547784
    Abstract: A camera having a gyro and accelerometer stabilizes a video recording by the following steps. First, gyro data and acceleration data are synchronized with a frame of video data. The gyro data and the acceleration data are fused together to get a space domain rotation matrix that corresponds to the frame. The frame is adjusted based on the space domain rotation matrix. Next, at least one feature of the adjusted frame is detected. A modified rotation matrix is determined by comparing the at least one detected feature of the adjusted frame with a corresponding feature in a neighboring frame of the video data. Finally, the adjusted frame is further adjusted based on the modified rotation matrix.
    Type: Grant
    Filed: June 19, 2018
    Date of Patent: January 28, 2020
    Assignee: SighTour Technologies, Inc.
    Inventors: Shi-Mu Sun, Huah Tu
  • Patent number: 10545398
    Abstract: A projection device including at least one projection module, at least one reflecting element, and at least one adjusting structure is provided. The projection module has at least one optical axis. The projection module is adapted to provide a projection beam. The projection beam is transmitted along a light transmission path to a projection target to form a projection image. The reflecting element is disposed between the at least one projection module and the projection target and located on the optical axis and has a reflecting surface, wherein the reflecting surface is adapted to reflect the projection beam to the projection target. The adjusting structure is connected to the reflecting element. The adjusting structure is adapted to drive the reflecting element to rotate along a first axis such that the projection image moves horizontally.
    Type: Grant
    Filed: September 20, 2018
    Date of Patent: January 28, 2020
    Assignee: Coretronic Corporation
    Inventors: Chuan-Te Cheng, Yen-Lin Chen, Chih-Wei Shih, Chin-Sheng Chao
  • Patent number: 10536641
    Abstract: A display system includes an imaging apparatus installed on a mobile body; a display apparatus installed at a position different from that of the imaging apparatus on the mobile body and displaying a post-processing image; a first sensor detecting vibration at or near the imaging apparatus; a second sensor detecting vibration at or near the display apparatus; a first image processor clipping out a preprocessing image from an image captured by the imaging apparatus, based on the first sensor detection result; and a second image processor clipping out the post-processing image from the preprocessing image based on the second sensor detection result. The first image processor moves a clip-out region of the preprocessing image in a direction to counteract vibration at or near the imaging apparatus, and the second image processor causes a clip-out region of the post-processing image to follow vibration at or near the display apparatus.
    Type: Grant
    Filed: November 21, 2017
    Date of Patent: January 14, 2020
    Assignee: Japan Display Inc.
    Inventors: Fumitaka Gotoh, Tsutomu Harada
  • Patent number: 10536714
    Abstract: The invention relates to a method for encoding, a method for decoding, an apparatus, computer program products, an encoder and a decoder for video information. The motion vector for a block in a video image is predicted from a set of motion vector prediction candidates determined based on previously-coded motion vectors. A motion vector prediction candidate is included in the set based on the location of the block associated with the first spatial motion vector prediction candidate and in comparison with motion vector prediction candidates already in the set.
    Type: Grant
    Filed: March 18, 2019
    Date of Patent: January 14, 2020
    Assignee: Nokia Technologies Oy
    Inventors: Mehmet Oguz Bici, Jani Lainema, Kemal Ugur
  • Patent number: 10498967
    Abstract: An image pickup apparatus capable of, when a photometry is performed using an output of an image sensor, performing the photometry without being affected by a diaphragm of an image pickup optical system is provided. A mode is switched between a display mode in which an image according to the image signal which is an output of the image sensor is displayed as a live image and a non-display mode in which the live image is not displayed. In the display mode, a lower limit value of an accumulation time during which an electric charge is accumulated in the image sensor at a time of photometry is controlled to a first lower limit value. In the non-display mode, the lower limit value of the accumulation time is controlled to a second lower limit value lower than the first lower limit value.
    Type: Grant
    Filed: June 15, 2018
    Date of Patent: December 3, 2019
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Takashi Kosaka
  • Patent number: 10491800
    Abstract: An imaging apparatus includes an imaging element, an imaging lens, an AF controller, an image synthesis unit, and a display. The imaging element captures multiple images of an object to obtain a plurality of image data. The imaging lens includes a focus lens and is used for generating an image of the object in the imaging element. The AF controller controls a focus state of the imaging lens. The image synthesis unit synthesizes a region with a large amount of blurriness in image data of a current frame and a region with a small amount of blurriness in image data of a preceding frame obtained before the image data of the current frame, among the plurality of image data obtained by the imaging element by the plurality of times of image capturing during the drive of the focus lens. The display displays an image synthesized by the image synthesis unit.
    Type: Grant
    Filed: June 21, 2017
    Date of Patent: November 26, 2019
    Assignee: Olympus Corporation
    Inventors: Koichi Shintani, Katsuhisa Kawaguchi, Masaomi Tomizawa
  • Patent number: 10474924
    Abstract: A non-limiting example information processing apparatus includes a processor, and an infrared LED and an imaging device are connected to the processor. The processor controls on/off of the infrared LED, and an image sensor images infrared images according to switching timings thereof. An image processing circuit estimates an influence (situation) of noise such as sunlight etc. based on respective infrared images at times when the infrared LED is turned on and off, and determines at least advisability of use of the imaging device (infrared sensor). A determination result about the advisability of use is applied to the processor from the image processing circuit, and when it cannot be used, a message to that effect is displayed on an LCD.
    Type: Grant
    Filed: April 25, 2017
    Date of Patent: November 12, 2019
    Assignee: NINTENDO CO., LTD.
    Inventors: Takeshi Nishikawa, Yoshiyasu Ogasawara, Yasuyuki Shimohata, Yuki Tanaka
  • Patent number: 10477108
    Abstract: Image pickup apparatus includes imaging control circuit, keystone correction circuit, and composite circuit. Imaging control circuit acquires plurality of first images corresponding to subject image formed on imaging plane by image pickup optical system by causing imaging element to execute exposure plurality of times in accordance with imaging instruction. Keystone correction circuit corrects keystone distortion occurring in each first image due to change of attitude of body, by keystone correction based on tilt angle corresponding to each first image, and the optical characteristic, thereby generating plurality second images. Composite circuit generates third image by compositing second images.
    Type: Grant
    Filed: June 2, 2017
    Date of Patent: November 12, 2019
    Assignee: OLYMPUS CORPORATION
    Inventors: Tomoyuki Sato, Hitoshi Tsuchiya, Takanori Fukuda
  • Patent number: 10451424
    Abstract: Provided is a position and azimuth detecting device including a photographing instructing unit that acquires an output signal of a sensor mounted on equipment and instructs a photographing apparatus mounted on the equipment to perform photographing based on the output signal, a mark reading unit that reads from a mark included in an image photographed based on the instruction from the photographing instructing unit position information and azimuth information included in the mark, a relative position and azimuth calculating unit that calculates a relative position and a relative azimuth of the equipment to the mark based on a geometric shape of the mark included in the image, and a position and azimuth calculating unit that calculates an absolute position and an absolute azimuth of the equipment based on the position information, the azimuth information, the relative position and the relative azimuth.
    Type: Grant
    Filed: June 6, 2017
    Date of Patent: October 22, 2019
    Assignee: ASAHI KASEI KABUSHIKI KAISHA
    Inventors: Masaya Yamashita, Shiro Kobayashi, Keisuke Shigeta
  • Patent number: 10440270
    Abstract: Image pickup apparatus includes imaging control circuit, keystone correction circuit, and composite circuit. Imaging control circuit acquires plurality of first images corresponding to subject image formed on imaging plane by image pickup optical system by causing imaging element to execute exposure plurality of times in accordance with imaging instruction. Keystone correction circuit corrects keystone distortion occurring in each first image due to change of attitude of body, by keystone correction based on tilt angle corresponding to each first image, and the optical characteristic, thereby generating plurality second images. Composite circuit generates third image by compositing second images.
    Type: Grant
    Filed: June 2, 2017
    Date of Patent: October 8, 2019
    Assignee: OLYMPUS CORPORATION
    Inventors: Tomoyuki Sato, Hitoshi Tsuchiya, Takanori Fukuda
  • Patent number: 10440271
    Abstract: An image-capture system, which handles on-chip compensation of rolling shutter effect in an imaging sensor, generates motion vector information for a plurality of speed values of a vehicle at each location on a specified route and derives an image-kernel for the plurality of speed values at each location on the specified route. A successive location of the vehicle is predicted at a current location of the vehicle based on the generated motion vector information for a current speed value of the vehicle at the current location on the specified route. A first image, which exhibits a shift of a plurality of pixels, is captured by the imaging sensor at the predicted successive location on the specified route. A second image is generated from the captured first image based on a compensation of the shift of the plurality of pixels in the captured first image.
    Type: Grant
    Filed: March 1, 2018
    Date of Patent: October 8, 2019
    Assignee: SONY CORPORATION
    Inventors: Prabakaran Ramalingam, Awadh Bihari Mohan
  • Patent number: 10440800
    Abstract: A data generation method is for generating video data that covers a second luminance dynamic range wider than a first luminance dynamic range and has reproduction compatibility with a first device that does not support reproduction of video having the second luminance dynamic range and supports reproduction of video having the first luminance dynamic range, and includes: generating a video signal to be included in the video data using a second OETF; storing, into VUI in the video data, first transfer function information for identifying a first OETF to be referred to by the first device when the first device decodes the video data; and storing, into SEI in the video data, second transfer function information for identifying a second OETF to be referred to by a second device supporting reproduction of video having the second luminance dynamic range when the second device decodes the video data.
    Type: Grant
    Filed: May 2, 2019
    Date of Patent: October 8, 2019
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Virginie Drugeon, Takahiro Nishi, Tadamasa Toma
  • Patent number: 10412272
    Abstract: A method, system, apparatus, and/or device for adjusting or removing frames in a set of frames. The method, system, apparatus, and/or device may include: associating a first frame of a set of frames with motion data that is captured approximately contemporaneously with the first frame; when a sampling rate of the motion data is greater than a frame rate of the set of frames, aggregating a first sample of the motion data captured at the first frame and a second sample of the motion data captured between the first frame and a second frame of the set of frames to obtain a movement value; when the movement value does not exceed a first threshold value, accepting the first frame from the set of frames; and when the movement value exceeds the first threshold value, rejecting the first frame from the set of frames.
    Type: Grant
    Filed: September 28, 2018
    Date of Patent: September 10, 2019
    Assignee: Atheer, Inc.
    Inventors: Ryan Fink, Gary Peck, Bryan Ransil
  • Patent number: 10412244
    Abstract: A function which can be executed by an application is determined from information obtained from data obtained within a standard rule, thereby implementing a function within the standard rule. More specifically, processing executed by a scanner is recorded in EXIF information, and the application determines a function to be executed, based on the EXIF information.
    Type: Grant
    Filed: June 13, 2018
    Date of Patent: September 10, 2019
    Assignee: Canon Kabushiki Kaisha
    Inventor: Koichi Kuno
  • Patent number: 10404916
    Abstract: Producing stabilized video can include: (a) accessing a first video including a sequence of first frames, (b) accessing a second video including a sequence of second frames, and (c) building the stabilized video based on the accessed first and second videos. The stabilized video can include a sequence of stabilized frames. At least one stabilized frame can include pixels derived from at least one of the first frames and at least one of the second frames.
    Type: Grant
    Filed: August 30, 2017
    Date of Patent: September 3, 2019
    Assignee: QUALCOMM Incorporated
    Inventors: Pasi Johannes Parkkila, Cullum James Baldwin
  • Patent number: 10404917
    Abstract: A method of stabilizing a video in real time using a single pass including receiving consecutive video frames, where the consecutive video frames include a current video frame and previous video frames, storing the consecutive video frames in a buffer, estimating a global motion for the current video frame by describing a camera's relative motion between the current video frame and one of the previous video frames adjacent to the current video frame, estimating a long-term camera motion for the current video frame by determining a geometric mean of an accumulation of the estimate of the global motion for the current video frame and an estimate of global motion for each of the previous video frames, and displaying the current video frame on a display of an electronic device, the current video frame stabilized based on the estimate of the long-term camera motion.
    Type: Grant
    Filed: October 13, 2017
    Date of Patent: September 3, 2019
    Assignee: Futurewei Technologies, Inc.
    Inventors: Zhenyu Wu, Wei Jiang, John Wus, Hong Heather Yu
  • Patent number: 10397480
    Abstract: An image stabilization apparatus includes: a first calculation unit configured to calculate an angular velocity of movement of an image capturing apparatus; a second calculation unit configured to calculate a moving amount of an object from a plurality of images; a third calculation unit configured to calculate an angular velocity of movement of the object; a determination unit configured to determine whether or not the object is walking; and a selection unit configured to select, based on a determination result of the determination unit, whether to perform control such that an image stabilization unit corrects image blur based on the angular velocities calculated by the first calculation unit and the third calculation unit, or such that the image stabilization unit corrects image blur based on the angular velocity calculated by the first calculation unit.
    Type: Grant
    Filed: May 30, 2017
    Date of Patent: August 27, 2019
    Assignee: Canon Kabushiki Kaisha
    Inventor: Masayuki Mukunashi
  • Patent number: 10389948
    Abstract: A method for displaying preview images is disclosed. In one aspect, the method includes: receiving first images captured by a first camera having a first field-of-view (FOV), receiving second images captured by a second camera having a second FOV that is different than the first FOV, and displaying preview images generated based on the first and second images. The method may further include determining a spatial transform based on depth information associated with individual pixels in the first and second images, and upon receiving instructions to zoom in or out beyond a camera switching threshold, modifying the second image using the spatial transform and displaying the first image and the modified second image consecutively.
    Type: Grant
    Filed: December 6, 2016
    Date of Patent: August 20, 2019
    Assignee: QUALCOMM Incorporated
    Inventors: James Wilson Nash, Adarsh Abhay Golikeri, Narayana Karthik Sadanandam Ravirala
  • Patent number: 10382710
    Abstract: An image processing apparatus includes an image acquirer configured to acquire a first image that is generated by image capturing and includes information of light intensity distributions obtained with a plurality of different exposures provided with transmittance distributions that are different from one another, an information acquirer configured to acquire information on the transmittance distributions, and an image estimator configured to separate image signals corresponding to two or more exposures among the plurality of exposures from the first image in the same pixel based on an estimation using the information on the transmittance distributions, and to generate two or more second images using the separated image signals.
    Type: Grant
    Filed: July 27, 2016
    Date of Patent: August 13, 2019
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Norihito Hiasa
  • Patent number: 10383194
    Abstract: A data generation method is for generating video data that covers a second luminance dynamic range wider than a first luminance dynamic range and has reproduction compatibility with a first device that does not support reproduction of video having the second luminance dynamic range and supports reproduction of video having the first luminance dynamic range, and includes: generating a video signal to be included in the video data using a second OETF; storing, into VUI in the video data, first transfer function information for identifying a first OETF to be referred to by the first device when the first device decodes the video data; and storing, into SEI in the video data, second transfer function information for identifying a second OETF to be referred to by a second device supporting reproduction of video having the second luminance dynamic range when the second device decodes the video data.
    Type: Grant
    Filed: May 2, 2019
    Date of Patent: August 13, 2019
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Virginie Drugeon, Takahiro Nishi, Tadamasa Toma
  • Patent number: 10373339
    Abstract: A method for determining structure from motion in hyperspectral imaging includes acquiring hyperspectral data cubes containing intensity data, the intensity data being stored in dimensions of the hyperspectral data cube including a first spatial dimension, a second spatial dimension, and a spectrum dimension; establishing a set of baseline spectral features from a data cube for tracking between data cubes; establishing a set of standard features from a data cube for tacking between data cubes; matching, between data cubes, respective baseline features and standard features; and extracting imaging device motion information based on relative positions of matched baseline and standard features.
    Type: Grant
    Filed: December 14, 2016
    Date of Patent: August 6, 2019
    Assignee: The Government of the United States of America, as represented by the Secretary of the Navy
    Inventors: Corey A. Miller, Thomas J. Walls
  • Patent number: 10372979
    Abstract: A method for performing image processing of a physical document image. The method may include receiving an image file including an image of a physical document and a control target. The method may include measuring control target attributes of the control target. Measuring the control target attributes of the control target may include numerically measuring a degree of focus of the image file based on the control target. The method may include performing a static crop of the image file based on the control target attributes by removing the control target from the image file to create a cropped image.
    Type: Grant
    Filed: May 24, 2017
    Date of Patent: August 6, 2019
    Assignee: ArcaSearch Corporation
    Inventors: James R. Walker, Calvin G. Sixta
  • Patent number: 10318113
    Abstract: One or more embodiments of a digital content system allow a user to conveniently search and/or navigate through a collection of digital content items. In particular, a user can interact with a client device to search for and identify one or more digital content items within a collection of digital content items. For example, the digital content system may provide a photo from a collection of photos via a graphical user interface. The digital content system can receive a user input identifying a selection of one or more visual features within the photo. Based on the selected visual feature(s), the digital content system may identify photos from the collection of photos that include the identified visual feature(s) and provide access to the identified photos via the graphical user interface.
    Type: Grant
    Filed: July 11, 2016
    Date of Patent: June 11, 2019
    Assignee: DROPBOX, INC.
    Inventors: Peter N. Belhumeur, David J. Kriegman, Thomas Berg
  • Patent number: 10247957
    Abstract: A lens drive apparatus includes a plurality of protrusions that protrude from an end of a magnet holder in a direction of an optical axis toward an inner wall surface of a cover and function as a fracture prevention supporting member. The plurality of protrusions are configured to support prevention of fracture in a plurality of suspension wires by contacting the inner wall surface of the cover when a magnet holder moves in the direction of the optical axis.
    Type: Grant
    Filed: July 16, 2018
    Date of Patent: April 2, 2019
    Assignee: MITSUMI ELECTRIC CO., LTD.
    Inventors: Keiichi Sato, Makoto Ariji, Masayoshi Sugawara, Akihiro Moriya
  • Patent number: 10237574
    Abstract: The invention relates to a method for encoding, a method for decoding, an apparatus, computer program products, an encoder and a decoder for video information. The motion vector for a block in a video image is predicted from a set of motion vector prediction candidates determined based on previously-coded motion vectors. A motion vector prediction candidate is included in the set based on the location of the block associated with the first spatial motion vector prediction candidate and in comparison with motion vector prediction candidates already in the set.
    Type: Grant
    Filed: August 21, 2017
    Date of Patent: March 19, 2019
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Mehmet Oguz Bici, Jani Lainema, Kemal Ugur
  • Patent number: 10225460
    Abstract: An electronic device includes a first operation member for changing a set value of an allocated function item, and a second operation member for changing a function item allocated to the first operation member, and registers a set of function items to be allocated to the first operation member. The set includes a standard function that is allocated to the first operation member before the second operation member is operated, and the electronic device controls switching among function items to be allocated to the first operation member based on whether the standard function is an invalid function and on the number of function items included in the registered set, the switching being performed in response to an operation performed on the second operation member, the invalid function disabling changing of the set value by the first operation member.
    Type: Grant
    Filed: August 24, 2017
    Date of Patent: March 5, 2019
    Assignee: Canon Kabushiki Kaisha
    Inventors: Koki Kitaya, Takashi Yoshimi
  • Patent number: 10217227
    Abstract: Image feature trackability ranking systems and methods are disclosed. A method of establishing a trackability ranking order from tracked image features within a training video sequence at a tracking analysis device includes establishing a tracking region within the training video sequence using a feature detection algorithm. Trajectories of tracked image features within the tracking region are compiled using a feature tracking algorithm. Saliency metrics are assigned to each one of the trajectories of tracked image features based on one or more feature property measurements within the tracking region, and a trackability ranking algorithm that is a function of the saliency metrics and a defined feature trajectory ranking associated with the training video sequence is determined, the trackability ranking algorithm being usable for ranking, based on trackability, tracked image features within another video sequence.
    Type: Grant
    Filed: May 8, 2018
    Date of Patent: February 26, 2019
    Assignee: Nant Holdings IP, LLC
    Inventor: Kamil Wnuk
  • Patent number: 10212348
    Abstract: An image stabilization apparatus used in an image capturing apparatus that includes a display unit and which causes the display unit to display a still image captured by the image capturing apparatus by following a moving main object comprises a control unit configured to control the display unit so as to extract an area for the main object from an image captured by the image capturing apparatus and to display the extracted area and a calculating unit configured to calculate a motion of the main object based on a blur detected by a first detector which detects the blur of the image capturing apparatus and a motion vector detected by a second detector which detects the motion vector from the image, wherein the control unit changes the area for the main object based on the motion of the main object before the still image is captured.
    Type: Grant
    Filed: April 27, 2017
    Date of Patent: February 19, 2019
    Assignee: Canon Kabushiki Kaisha
    Inventor: Hiroaki Kuchiki
  • Patent number: 10198004
    Abstract: A method and an apparatus for obtaining a range image, and a UAV are provided. The method includes: reading an image sequence of a predetermined scene, in which the Nth image and the (N+1)th image of the image sequence have an overlapping region; obtaining a pixel movement velocity of each pixel point in the overlapped region in a camera coordinate system of the UAV; obtaining an actual flying velocity of the UAV in a world coordinate system; obtaining a range image of each overlapped region according to the pixel movement velocity of each pixel point in the overlapped region in the camera coordinate system of the UAV, the actual flying velocity of the UAV in the word coordinate system, and parameters of the airborne camera, and obtaining a range image of the preset scene through integrating the range image of each overlapped region.
    Type: Grant
    Filed: September 23, 2016
    Date of Patent: February 5, 2019
    Assignee: GUANGZHOU XAIRCRAFT TECHNOLOGY CO., LTD.
    Inventor: Yousheng Chen
  • Patent number: 10194084
    Abstract: An image processing device including: one or more processors comprising hardware, wherein the one or more processors are configured to: calculate an estimated movement amount of a subject in each image of a plurality of images; perform, based on the estimated movement amounts, one of: select and output an image that is most recently captured among the plurality of images; and select a reference image from the plurality of images based on the estimated movement amounts of the subject in the plurality of images; in response to selecting the reference image, determine a gain of the reference image; and perform, based on the gain, one of: select and output the reference image; and a synthesis process including: select a synthesis target image from the plurality of images; and generate and output a synthesized image by synthesizing the synthesis target image and the reference image.
    Type: Grant
    Filed: August 25, 2017
    Date of Patent: January 29, 2019
    Assignee: OLYMPUS CORPORATION
    Inventor: Kenji Numata
  • Patent number: 10182222
    Abstract: An omnidirectional camera is disclosed that records spherical video associated with a particular focal direction while in motion. The omnidirectional camera may implement one or more sensors and location-determining components to facilitate the recorded spherical video being subsequently correlated to an orientation and location of the omnidirectional camera during recording in a time-wise fashion to provide several enhancements during playback. These enhancements include reorienting the spherical video to a new focal direction. Data derived from the one or more sensors and location-determining components may be further utilized to overlay graphical objects onto the spherical video during playback to provide additional feedback.
    Type: Grant
    Filed: May 12, 2017
    Date of Patent: January 15, 2019
    Assignee: Garmin Switzerland GmbH
    Inventors: Jerad P. Hesla, Brian Lipkowitz, David S. Wissenbach, Michael M. Russell
  • Patent number: 10165187
    Abstract: A correction optical device comprises an OIS frame, and an OIS lock ring that restricts a movement of the OIS frame. The OIS lock ring rotates so that a position of a first protrusion reciprocates between a lock position and an unlock position. The first protrusion and the second protrusion are formed into such shapes that generate a component force acting on the first protrusion in a direction from the unlock position toward the lock position when a force causing the first protrusion and the second protrusion to push against each other is generated between the first protrusion and the second protrusion.
    Type: Grant
    Filed: March 8, 2017
    Date of Patent: December 25, 2018
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventor: Keita Kadowaki
  • Patent number: 10116866
    Abstract: In one embodiment, a method includes determining a first maximum exposure time for capturing one or more image frames of a video clip. The first maximum exposure time represents an exposure time below which the captured image frames are substantially free of motion-blur artifacts and above which the captured image frames exhibit motion-blur artifacts. The first maximum exposure time is based on a first amount of motion of a computing device and a first light level. The method also includes capturing the image frames with an exposure time that is less than or equal to the first maximum exposure time. While the capture is in progress, a second amount of motion and a second light level are determined. Based on the second amount of motion and the second light level, the method determines whether the first maximum exposure time should be adjusted to a second maximum exposure time.
    Type: Grant
    Filed: May 24, 2017
    Date of Patent: October 30, 2018
    Assignee: Facebook, Inc.
    Inventor: Alexandre Karpenko
  • Patent number: 10110825
    Abstract: The present disclosure relates to an imaging apparatus, an imaging method, and a program that enable exposure control on a captured image in a non-Bayer pattern by an exposure control method designed for captured images in Bayer patterns. When a Bayering process is performed on a captured image in an RGBW pixel array, a level correction unit corrects the signal level of the captured image so that an earlier level that is the signal level of each white pixel with the highest sensitivity in the captured image prior to the Bayering process becomes equal to a later level that is the signal level of each green pixel to be used in exposure control on an image in a Bayer pattern that is the RGB image after the Bayering process. The present disclosure can be applied to imaging apparatuses, for example.
    Type: Grant
    Filed: December 8, 2015
    Date of Patent: October 23, 2018
    Assignee: Sony Semiconductor Solutions Corporation
    Inventors: Koji Kurata, Yasushi Sato, Seiji Kayashima
  • Patent number: 10096151
    Abstract: Embodiments of the present disclosure are directed to methods and computer systems for converting datasets into three-dimensional (“3D”) mesh surface visualization, displaying the mesh surface on a computer display, comparing two three-dimensional mesh surface structures by blending two primary different primary colors to create a secondary color, and computing the distance between two three-dimensional mesh surface structures converted from two closely-matched datasets. For qualitative analysis, the system includes a three-dimensional structure comparison control engine that is configured to convert dataset with three-dimensional structure into three-dimensional surfaces with mesh surface visualization. The control engine is also configured to assign color and translucency value to the three-dimensional surface for the user to do qualitative comparison analysis. For quantitative analysis, the control engine is configured to compute the distance field between two closely-matched datasets.
    Type: Grant
    Filed: July 7, 2015
    Date of Patent: October 9, 2018
    Assignee: Varian Medical Systems International AG
    Inventors: Janos Zatonyi, Marcin Novotni, Patrik Kunz
  • Patent number: 10091524
    Abstract: The invention relates to a method for encoding, a method for decoding, an apparatus, computer program products, an encoder and a decoder for video information. The motion vector for a block in a video image is predicted from a set of motion vector prediction candidates determined based on previously-coded motion vectors. A motion vector prediction candidate is included in the set based on the location of the block associated with the first spatial motion vector prediction candidate and in comparison with motion vector prediction candidates already in the set.
    Type: Grant
    Filed: August 21, 2017
    Date of Patent: October 2, 2018
    Assignee: NOKIA TECHNOLOGY OY
    Inventors: Mehmet Oguz Bici, Jani Lainema, Kemal Ugur
  • Patent number: 10057499
    Abstract: An electronic device, computer program product and method provide automatic exposure control (AEC) convergence in a dual camera system. A main camera is triggered to perform AEC convergence procedure at a first frame rate. A display presents at least one of first images from the main camera. An auxiliary camera is triggered to perform AEC convergence procedure. A determination is made whether the AEC of the auxiliary camera has converged. In response convergence by the AEC, an exposure setting of the main camera is synchronized to the exposure setting of the auxiliary camera. The display presents a next image captured by the main camera operating with the synchronized exposure settings.
    Type: Grant
    Filed: February 21, 2017
    Date of Patent: August 21, 2018
    Assignee: Motorola Mobility LLC
    Inventors: Yin Hu Chen, Valeriy Marchevsky, Susan Yanqing Xu
  • Patent number: 10038850
    Abstract: Systems and methods for compensating angular misalignment in Optical Image Stabilization (OIS) systems are described. In some embodiments, a method may include measuring an angle representing a misalignment between an actuator and an electronic component within a camera; and compensating for the misalignment using a rotation matrix, wherein the rotation matrix is calculated based upon the angle. In other embodiments, a camera may include an image sensor coupled to a Printed Circuit Board (PCB); an OIS actuator coupled to the PCB and optically coupled to the image sensor, where the OIS actuator is physically misaligned with respect to the image sensor; and a controller coupled to the PCB, the controller configured to: measure an angle representing the misalignment; and compensate for the misalignment using a rotation matrix at the time of an image capture, where the rotation matrix is calculated based upon the angle.
    Type: Grant
    Filed: September 10, 2015
    Date of Patent: July 31, 2018
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Juha Jorma Sakari Karttunen, Jussi Petteri Tikkanen
  • Patent number: 10021308
    Abstract: There is provided a digital imaging apparatus including a motion sensor configured to output motion data corresponding to a movement of a camera module from at least one sensing axis, a single signal conversion processor configured to transmit or receive the motion data at a switching timing interval, and to compensate for a phase delay due to the switching timing interval of the motion data, and a single signal conversion controller configured to control the switching timing interval of the single signal conversion processor and phase delay compensation regarding the motion data of the at least one sensing axis according to the switching timing interval.
    Type: Grant
    Filed: March 31, 2016
    Date of Patent: July 10, 2018
    Assignee: Samsung Electro-Mechanics Co., Ltd.
    Inventor: Shin Jae Kang
  • Patent number: 10003748
    Abstract: A method for processing high-frequency movements in an optronic system including an image sensor functioning with a first acquisition frequency, each image obtained by the image sensor representing a scene, the method includes a step of obtaining signal values representing a movement of the scene from a high-frequency movement sensor functioning with a second acquisition frequency higher than the first acquisition frequency, a step of determining values representing a movement of an image in the course of acquisition by the image sensor from values of the signals representing the movement of the scene, and a step of transmitting the values representing the movement of the image in the course of acquisition by the image sensor to a movement compensation device so that the movement compensation device can compensate for the movement of the image in the course of acquisition by the image sensor.
    Type: Grant
    Filed: July 15, 2015
    Date of Patent: June 19, 2018
    Assignee: SAFRAN ELECTRONICS & DEFENSE SAS
    Inventor: Georges-Olivier Reymond
  • Patent number: 9984473
    Abstract: Image feature trackability ranking systems and methods are disclosed. A method of establishing a trackability ranking order from tracked image features within a training video sequence at a tracking analysis device includes establishing a tracking region within the training video sequence using a feature detection algorithm. Trajectories of tracked image features within the tracking region are compiled using a feature tracking algorithm. Saliency metrics are assigned to each one of the trajectories of tracked image features based on one or more feature property measurements within the tracking region, and a trackability ranking algorithm that is a function of the saliency metrics and a defined feature trajectory ranking associated with the training video sequence is determined, the trackability ranking algorithm being usable for ranking, based on trackability, tracked image features within another video sequence.
    Type: Grant
    Filed: July 9, 2015
    Date of Patent: May 29, 2018
    Assignee: Nant Holdings IP, LLC
    Inventor: Kamil Wnuk
  • Patent number: 9973683
    Abstract: There is provided a focus control apparatus including: a first adjustment unit configured to adjust a focus distance; a second adjustment unit configured to adjust an addition amount of the focus distance adjusted with the first adjustment unit; and a focus control unit configured to control a focus based on the focus distance adjusted with the first adjustment unit and the addition amount adjusted with the second adjustment unit. Also provided are a focus control method, a camera apparatus and a focus control method in the camera apparatus.
    Type: Grant
    Filed: February 28, 2017
    Date of Patent: May 15, 2018
    Assignee: SONY CORPORATION
    Inventor: Koji Kamiya
  • Patent number: 9930258
    Abstract: An image processing device is provided. The image processing device includes a determination unit configured to determine a scheme of capturing a pixel value of an imaging element at a time of imaging operation of moving image contents using a feature amount which is obtained from a plurality of regions in a frame which configures the moving image contents; and a correction unit configured to perform a correction of focal plane distortion with respect to the moving image contents based on the determined capturing scheme. An image processing system is also provided.
    Type: Grant
    Filed: June 9, 2016
    Date of Patent: March 27, 2018
    Assignee: Sony Semiconductor Solutions Corporation
    Inventor: Yukinao Kenjo
  • Patent number: 9916660
    Abstract: A vision system of a vehicle includes a camera configured to be disposed at a vehicle so as to have a field of view exterior of the vehicle. The camera may include a fisheye lens. An image processor is operable to process image data captured by the camera. The vision system provides enhanced camera calibration using a monoview noncoplanar three dimensional calibration pattern. The system may include a plurality of cameras configured to be disposed at the vehicle so as to have respective fields of view exterior of the vehicle.
    Type: Grant
    Filed: January 15, 2016
    Date of Patent: March 13, 2018
    Assignee: Magna Electronics Inc.
    Inventors: Jagmal Singh, Sebastian Pliefke, Holger Hess