Motion Correction Patents (Class 348/208.4)
  • Patent number: 11516414
    Abstract: Provided is an imaging device in which a subject moving within a visual field can be freely expressed with a simple configuration. This imaging device is an imaging device which acquires an image by dividing one imaging period into a plurality of periods for exposure to add for each pixel, and includes an imaging element which includes a photoelectric conversion unit configured to generate a signal charge, and a control unit configured to control an accumulation time of the signal charge generated in the photoelectric conversion unit. The control unit changes the accumulation time in each period obtained by dividing the one imaging period.
    Type: Grant
    Filed: July 10, 2020
    Date of Patent: November 29, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Kosuke Kiyamura
  • Patent number: 11445169
    Abstract: A measurement system for a vehicle including a first camera defining a field of view having a corresponding optical axis, and a motion detection sensor mechanically fixed to the first camera such that the motion detection sensor is configured to detect motion of the optical axis.
    Type: Grant
    Filed: July 31, 2020
    Date of Patent: September 13, 2022
    Assignee: Stoneridge Electronics, A.B.
    Inventors: Milan Gavrilovic, Frans Kievith, Bárbara Martín Leung, Annette Lef, Parinaz Kasebzadeh
  • Patent number: 11438522
    Abstract: Provided is an image pickup apparatus that can determine a step-out with a high approximation accuracy and then return a lens position to an initial position. The image pickup apparatus includes: an optical element that is movable with respect to a predetermined initial position; acceleration detection means that detects a shock applied to a body of the apparatus and outputs a vector of the shock; and control means that adds up an optical axis direction component of the optical element in the vector of the shock each time the shock is detected and, when a cumulative shock that is a result of adding up exceeds a predetermined threshold, determines that the optical element has stepped out and returns the optical element to the initial position.
    Type: Grant
    Filed: November 15, 2021
    Date of Patent: September 6, 2022
    Assignee: JVCKENWOOD CORPORATION
    Inventors: Hidehiro Kato, Takahiro Furukawa, Yuzuru Kanazawa
  • Patent number: 11425304
    Abstract: A method to reduce a motion blur and a rolling shutter effect, comprising, receiving a main image frame, a main timing and a main exposure from a main camera, receiving a secondary image frame, a secondary timing and a secondary exposure from a secondary camera, correcting the secondary image frame to the main image frame, determining a delta timing based on the main timing and the secondary timing, determining a delta exposure based on the main exposure and the secondary exposure, determining a discrete motion of offset sequences based on the secondary image frame, determining a row-wise motion blur kernel based on the main image frame and the discrete motion of offset sequences and determining a spatially varying kernel deconvolution based on the main image frame and the row-wise motion blur kernel.
    Type: Grant
    Filed: December 6, 2021
    Date of Patent: August 23, 2022
    Assignee: Black Sesame Technologies Inc.
    Inventors: Chao Wang, Zhaowei Xin, Donghui Wu
  • Patent number: 11423654
    Abstract: Embodiments of the present invention are directed towards determining visual inconsistencies in frames of a video to identify continuity errors in the video. A visual inconsistency can be based on an appearance or a disappearance of an object between frames of the video. Visual inconsistencies in the video can also be identified based on a semantic analysis of an object corresponding to a frame of the video. Identified continuity errors can be used to generate an error report.
    Type: Grant
    Filed: October 1, 2019
    Date of Patent: August 23, 2022
    Assignee: Adobe Inc.
    Inventors: Tatiana Kosiakova, Nils Meder
  • Patent number: 11412144
    Abstract: Various embodiments of the present technology may provide methods and apparatus for optical image stabilization. The methods and apparatus for optical image stabilization may be integrated within an electronic device. An exemplary system may include an actuator control circuit responsive to a sensor and a feedback signal from an actuator. The actuator control circuit may be configured to calibrate a gain applied to a drive signal based on a relative position between the actuator and the sensor and an output signal generated by the actuator control circuit.
    Type: Grant
    Filed: March 30, 2021
    Date of Patent: August 9, 2022
    Assignee: SEMICONDUCTOR COMPONENTS INDUSTRIES, LLC
    Inventor: Yoshihisa Tabuchi
  • Patent number: 11412143
    Abstract: In embodiments, an electronic device may include a processor and a camera module functionally connected to the processor. The camera module may include a lens assembly including at least one lens, and an image sensor for processing light acquired through the lens assembly. The processor may be configured to identify position information of the lens assembly, to move the camera module within a first range to correct a shake in an image acquired through the image sensor when the position information of the lens assembly corresponds to a first position, and to move the camera module within a second range to correct the shake in the image acquired through the image sensor when the position information of the lens assembly corresponds to a second position.
    Type: Grant
    Filed: November 30, 2020
    Date of Patent: August 9, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Kwangseok Byon, Dongsung Hur, Youngjae Hwang
  • Patent number: 11405555
    Abstract: There is provided an information processing apparatus. A detecting unit detects a first motion amount of an object from an image obtained through first shooting carried out repeatedly at predetermined intervals of time. A converting unit converts the first motion amount into a first motion blur amount that will arise in second shooting, on the basis of the predetermined intervals of time and a shutter speed used in the second shooting. A determining unit determines a first shutter speed adjustment step size on the basis of a difference between the first motion blur amount and a first target motion blur amount that is lower than the first motion blur amount. A changing unit changes the shutter speed of the second shooting at the first shutter speed adjustment step size in response to a first shutter speed changing unit being operated.
    Type: Grant
    Filed: December 27, 2019
    Date of Patent: August 2, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Yoshiaki Honda
  • Patent number: 11388340
    Abstract: The present disclosure relates to an image processing device and method, and an image processing system that can suppress an increase in load due to image stabilization. A readout area, which is an area from which an image is read out, in an imaging area formed by a plurality of pixels is set on the basis of motion prediction information for a predetermined frame after a frame to be processed, and a cutout area to cut out a partial image from a readout image read out from the set readout area of the frame to be processed is set. The present disclosure can be applied to, for example, an image processing device, an imaging device, or an image processing system, or the like.
    Type: Grant
    Filed: December 26, 2018
    Date of Patent: July 12, 2022
    Assignee: SONY SEMICONDUCTOR SOLUTIONS CORPORATION
    Inventor: Mamoru Yamazaki
  • Patent number: 11375180
    Abstract: A method and an apparatus for generating a pair of images consisting of a dominant image to be displayed to a dominant eye and a nondominant image to be displayed to a nondominant eye causes a user to perceive a three-dimensioned image. The apparatus is configured to perform the method initiated by receiving the dominant image in a dominant image buffer. A skewing engine performs a skewing transformation; a rotating engine performs a rotating transformation; and a translating engine performs a translating and scaling transformation thereby to produce the nondominant image for storage in the nondominant image buffer.
    Type: Grant
    Filed: December 10, 2020
    Date of Patent: June 28, 2022
    Inventor: Yousseff El Moumni
  • Patent number: 11375132
    Abstract: The imaging apparatus of the present invention determines the cumulative amount of motion amounts of the object between frames of multiple pieces of image data, which are captured by a second imaging device, and starts the exposure for the image data for a first frame by the first imaging device in accordance with a result of comparison between the cumulative amount and a first threshold value.
    Type: Grant
    Filed: April 16, 2020
    Date of Patent: June 28, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Hironori Kaida
  • Patent number: 11341623
    Abstract: Image analysis and processing may include a first sensor readout unit configured to receive first Bayer format image data, a second sensor readout unit configured to receive second Bayer format image data, a first Bayer-to-RGB unit configured to obtain first RGB format image data based on the first Bayer format image data, a second Bayer-to-RGB unit configured to obtain second RGB format image data based on the second Bayer format image data, a high dynamic range unit configured to obtain high dynamic range image data based on a combination of the first RGB format image data and the second RGB format image data, an RGB-to-YUV unit configured to obtain YUV format image data based on the high dynamic range image data, and a three-dimensional noise reduction unit configured to obtain noise reduced image data based on the YUV format image data.
    Type: Grant
    Filed: February 11, 2019
    Date of Patent: May 24, 2022
    Assignee: GoPro, Inc.
    Inventors: Guillaume Matthieu Guerin, Bruno Faure, Vincent Vacquerie, Bruno César Douady
  • Patent number: 11330198
    Abstract: An image processor according to the present embodiment includes an acquirer, an output unit, and a generator. The acquirer acquires a first pixel value obtained by making a pixel value in a first image captured in a first exposure time correspond to a predetermined sensitivity and a second pixel value obtained by making a pixel value in a second image captured in a second exposure time shorter than the first exposure time correspond to the predetermined sensitivity. The output unit outputs a pixel value serving as a predetermined value larger than the second pixel value when the first pixel value has been saturated and the second pixel value corresponding to the first pixel value is less than the first pixel value. The generator generates a high dynamic range image using at least the first image and the second image based on the pixel value output by the output unit.
    Type: Grant
    Filed: July 8, 2019
    Date of Patent: May 10, 2022
    Assignee: KABUSHIKI KAISHA TOSHIBA
    Inventor: Fumihiko Hyuga
  • Patent number: 11323689
    Abstract: An image processing device includes an imaging unit which captures an image of a subject, generates an image from a plurality of viewpoint images with different viewpoints, and displays the generated image on a display unit. A system control unit acquires a position designated using an operation unit by a user on a displayed image and detects a direction of a slide operation and an amount of movement from the designated position. An image processing unit acquires a plurality of pieces of viewpoint image data from the imaging unit and acquires distance information associated with a viewpoint image from a distance information acquisition unit. The image processing unit generates a viewpoint image if the viewpoint is moved in a direction opposite to the direction of the slide operation by the user on the basis of the plurality of viewpoint images.
    Type: Grant
    Filed: August 4, 2020
    Date of Patent: May 3, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Masahiko Okuzawa
  • Patent number: 11323623
    Abstract: An image stabilization apparatus includes a subject detection unit, a motion vector detection unit, a separation unit for separating a motion vector of a main subject and that of a background, a calculation unit for calculating a correction amount for correcting image blur, and a control unit for controlling, in a case where a second main subject is detected, so as to transition from a state in which the calculation unit calculates the correction amount based on a first motion vector of the first main subject, via a state in which the correction amount is calculated based on the third motion vector of the background, to a state in which the correction amount is calculated based on a second motion vector of the second main subject.
    Type: Grant
    Filed: December 22, 2020
    Date of Patent: May 3, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Kazuki Konishi
  • Patent number: 11315967
    Abstract: Provided is a camera module and a photosensitive component thereof and a manufacturing method thereof.
    Type: Grant
    Filed: September 19, 2018
    Date of Patent: April 26, 2022
    Assignee: NINGBO SUNNY OPOTECH CO., LTD.
    Inventors: Takehiko Tanaka, Bojie Zhao, Zhewen Mei, Nan Guo
  • Patent number: 11317026
    Abstract: Some embodiments provide enhanced resolution imaging systems. These systems comprise: a mounting configured to secure with a vehicle; an electro-optical image capture system configured to sequentially obtain a series of frames per second; and a first jitter compensation system comprising: an angular velocity sensor system to detect velocity of change of line of sight angular displacement of the image capture system; and an image capture control circuit is configured to: receive, in real-time, angular velocity data from the angular velocity sensor system; identify, during the frame, when an angular velocity is less than an angular velocity threshold; and activate, during the frame, exposure of the image capture system to illumination for at least one of: at least a minimum integration period of time during the frame, and while the angular velocity is less than the angular velocity threshold during the frame.
    Type: Grant
    Filed: August 19, 2020
    Date of Patent: April 26, 2022
    Assignee: General Atomics Aeronautical Systems, Inc.
    Inventors: Drew F. DeJarnette, Patrick R. Mickel, Matthew C. Cristina, Jason A. Paxton
  • Patent number: 11310426
    Abstract: The present technology relates to a control device, a controlling method, and an imaging apparatus that make it possible to reduce a weight of a movable body while simplifying a structure and to improve control accuracy. A moving body that moves in two or more directions, and a controller that controls movement of the moving body are provided. The controller sets a control value directed to controlling of the movement of the moving body on the basis of an initial position of the moving body and an instructed position of the moving body. A parameter directed to setting of the control value is set on the basis of the initial position and the instructed position. The present technology is applicable, for example, to a shake correction device that corrects a hand shake of an imaging apparatus or a technique that achieves super-resolution by shifting a sensor to capturing a plurality of images.
    Type: Grant
    Filed: July 18, 2018
    Date of Patent: April 19, 2022
    Assignee: SONY SEMICONDUCTOR SOLUTIONS CORPORATION
    Inventors: Kohki Watanabe, Akira Akiba, Hidetoshi Kabasawa, Mitsuo Hashimoto, Tomohiro Shirane
  • Patent number: 11284014
    Abstract: An image processing apparatus includes: an image acquisition unit to obtain a plurality of images that have been captured under different exposure conditions; an acceptance unit to receive designation of an area in a first image, the first image being one of the plurality of images; a brightness characteristics acquisition unit to obtain a brightness characteristic value of the designated area in the first image; and a combining unit to: determine a combining condition used for combining the first image and a second image according to the brightness characteristic value, the second image being any one of the plurality of images other than the first image, and combine the first image and the second image based on the combining condition to correct brightness of the designated area for display.
    Type: Grant
    Filed: October 24, 2018
    Date of Patent: March 22, 2022
    Assignee: RICOH COMPANY, LTD.
    Inventors: Keiichi Kawaguchi, Takahiro Asai, Kazuhiro Yoshida
  • Patent number: 11284001
    Abstract: A movable support device includes: a movable unit that includes an imager, a first flexible substrate including wirings connected to terminals other than a power supply terminal and a ground terminal among terminals of the imager, and a second flexible substrate including wirings connected to the power supply terminal and the ground terminal; and a support member that supports the movable unit to be movable in a longitudinal direction of a light receiving surface of the imager and a short direction of the light receiving surface, the first flexible substrate includes a first portion extending in one direction of the short direction and a folded portion folded at an end portion of the first portion in other direction of the short direction, and the second flexible substrate includes a second portion and a folded portion as defined herein.
    Type: Grant
    Filed: August 3, 2020
    Date of Patent: March 22, 2022
    Assignee: FUJIFILM Corporation
    Inventor: Kouhei Awazu
  • Patent number: 11218636
    Abstract: An electronic device includes an image sensor configured to receive light that is incident on the electronic device through a lens and generate image data, a gyroscope configured to generate rotation motion data of the electronic device, and an image stabilizer configured to generate translation motion data of the electronic device based on the image data received from the image sensor and to generate a stabilized image by compensating for a motion of the electronic device while capturing the image, such as vibration of a handheld device. The stabilized image is generated based on filtered translation motion data obtained by performing a first filtering operation on the translation motion data and filtered rotation motion data obtained by performing a second filtering operation on the rotation motion data received from the gyroscope.
    Type: Grant
    Filed: October 12, 2020
    Date of Patent: January 4, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Kai Guo, Seung-won Choi
  • Patent number: 11202400
    Abstract: A recognition device includes an imaging device that images a tip of the lead of a lead component multiple times at different shutter speeds, and multiple pieces of captured image data corresponding to the multiple times of imaging are generated. Then, it is determined whether the tip position of the lead is recognizable based on each of the multiple pieces of captured image data, and a shutter speed between the fastest shutter speed and the slowest shutter speed among the shutter speeds at the time of imaging according to the pieces of captured image data, which are determined to be recognizable, is determined as the optimum shutter speed. By determining the optimum shutter speed in this manner, the exposure light amount at the time of imaging can be stabilized regardless of the shape of the tip of the lead, and the tip position of the lead can be appropriately recognized.
    Type: Grant
    Filed: September 7, 2016
    Date of Patent: December 14, 2021
    Assignee: FUJI CORPORATION
    Inventor: Takuya Nagaishi
  • Patent number: 11178323
    Abstract: A photosensitive element driving mechanism includes a fixed assembly, a first movable assembly and a first driving assembly. The first movable assembly is movable relative to the fixed assembly, and the first movable assembly is configured to be connected to a photosensitive element. The photosensitive element corresponds to an optical element. The first driving assembly is configured to drive the first movable assembly to move relative to the fixed assembly. The first movable assembly includes a heat dissipation structure corresponding to the first driving assembly, the optical element or the photosensitive element.
    Type: Grant
    Filed: April 17, 2020
    Date of Patent: November 16, 2021
    Assignee: TDK TAIWAN CORP.
    Inventors: Chao-Chang Hu, Liang-Ting Ho
  • Patent number: 11172130
    Abstract: Visual content is captured by an image capture device during a capture duration. The image capture devices experiences change in position during the capture duration. The trajectory of the image capture device is smoothed based on a look ahead of the trajectory. A punchout of the visual content is determined based on the smoothed trajectory. The punchout of the visual content is used to generate stabilized visual content.
    Type: Grant
    Filed: September 30, 2019
    Date of Patent: November 9, 2021
    Assignee: GoPro, Inc.
    Inventors: César Douady, Thomas Derbanne, Maxim Karpushin
  • Patent number: 11153467
    Abstract: A method and apparatus for processing image data is provided. The method comprises storing accumulated image data, obtaining a new frame of image data, performing motion detection based at least on the new frame of image data, updating the accumulated frame of image data, and generating output image data. The motion detection identifies a pixel location in which motion is detected. For the pixel location identified by the motion detection, a pixel intensity value of the new frame of image data contributes more to a pixel intensity value representing the identified pixel location in the updated accumulated imaged data than to a pixel intensity value representing the identified pixel location in the output image data.
    Type: Grant
    Filed: March 4, 2020
    Date of Patent: October 19, 2021
    Assignee: Apical Limited
    Inventors: David Hanwell, Laurence Mark Arden
  • Patent number: 11153497
    Abstract: An image capturing device includes inclination detecting circuitry to detect an inclination from a reference position and output the inclination as angle data; feature point extracting circuitry to extract, based on both a reference position image and a current position image, respective feature points; amount of deviation calculating circuitry to calculate an inclination angle based on the angle data, and calculating an amount of deviation in pixels on the basis of the feature points; and correcting method determining circuitry to, when it is determined that the inclination angle is within a range in which the angle can be corrected, the range being equal to or greater than a lower limit and equal to or less than an upper limit, provide a correction instruction to make a correction to the inclination angle and then to make a fine adjustment to the inclination of the angle of view.
    Type: Grant
    Filed: July 17, 2018
    Date of Patent: October 19, 2021
    Assignee: MITSUBISHI ELECTRIC CORPORATION
    Inventor: Mitsuo Hashimoto
  • Patent number: 11138693
    Abstract: Techniques of adjusting the salience of an image include generating values of photographic development parameters for a foreground and background of an image to adjust the salience of the image in the foreground. These parameters are global in nature over the image rather than local. Moreover, the optimization of the salience over such sets of global parameters is provided through two sets of these parameters by an encoder: one set corresponding to the foreground, in which the salience is to be either increased or decreased, and the other set corresponding to the background. Once the set of development parameters corresponding to the foreground region and the set of development parameters corresponding to the background region have been determined, a decoder generates an adjusted image with an increased salience based on these sets of development parameters.
    Type: Grant
    Filed: January 24, 2020
    Date of Patent: October 5, 2021
    Assignee: ADOBE INC.
    Inventors: Youssef Alami Mejjati, Zoya Bylinskii, Elya Shechtman
  • Patent number: 11107192
    Abstract: A display control device for a vehicle is mounted on a host vehicle, and the display control device for a vehicle is configured to generate a non-rectangular image from a rectangular image of an area located rearward of the host vehicle, the rectangular image being captured by a capturing unit mounted on the host vehicle, and display the non-rectangular image in a rectangular display area of a display unit.
    Type: Grant
    Filed: March 16, 2018
    Date of Patent: August 31, 2021
    Assignee: TOYOTA JIDOSHA KABUSHIKI KAISHA
    Inventors: Goro Asai, Tomoaki Iida
  • Patent number: 11102382
    Abstract: A direction control device includes: a camera unit that acquires an image captured by photographing a subject by a camera targeted for adjustment of a photographing direction; an image-processing unit that calculates a position of a first setting image that represents the subject in the captured image; a posture detection unit that detects a difference between a position of a second setting image that represents the subject in a reference image registered in advance and the position of the first setting image; and a camera control unit that shifts the photographing direction of the camera based on the difference.
    Type: Grant
    Filed: April 10, 2019
    Date of Patent: August 24, 2021
    Assignee: NEC CORPORATION
    Inventors: Shoji Yachida, Toshihiko Hiroaki
  • Patent number: 11093112
    Abstract: One or more embodiments of a digital content system allow a user to conveniently search and/or navigate through a collection of digital content items. In particular, a user can interact with a client device to search for and identify one or more digital content items within a collection of digital content items. For example, the digital content system may provide a photo from a collection of photos via a graphical user interface. The digital content system can receive a user input identifying a selection of one or more visual features within the photo. Based on the selected visual feature(s), the digital content system may identify photos from the collection of photos that include the identified visual feature(s) and provide access to the identified photos via the graphical user interface.
    Type: Grant
    Filed: June 6, 2019
    Date of Patent: August 17, 2021
    Assignee: DROPBOX, INC.
    Inventors: Peter N. Belhumeur, David J. Kriegman, Thomas Berg
  • Patent number: 11089221
    Abstract: Provided are a lens driving device, a camera module and a camera-mounted device which can perform translational deviation correction in addition to angular deviation correction. The lens driving device is provided with: an image-capturing unit which captures a subject image formed by a lens unit; a driving unit for translational deviation correction which performs translational deviation correction by shaking the lens unit within a plane perpendicular to an optical axis, on the basis of a detection signal from a translational deviation detecting unit that detects a translational deviation; and a driving unit for angular deviation correction which performs angular deviation correction by integrally tilting the image-capturing unit and the driving unit for translational deviation correction, on the basis of a detection signal from an angular deviation detecting unit that detects an angular deviation.
    Type: Grant
    Filed: November 14, 2016
    Date of Patent: August 10, 2021
    Assignee: MITSUMI ELECTRIC CO., LTD.
    Inventors: Shun Sasaki, Toshiyuki Takahashi, Satoshi Ajiki
  • Patent number: 11070730
    Abstract: Provided is a video correction method comprising: extracting a common feature point from a number of video frames corresponding to a correction window size; extracting a trace of the feature point from the video frames; calculating an average value of the trace in the video frames; extracting a stabilized trace from a circular queue circular queue buffer using the trace and the average value; and applying a repositioning operation and a perspective warping operation to the video frames based on the stabilized trace to generate a stabilized video.
    Type: Grant
    Filed: April 17, 2019
    Date of Patent: July 20, 2021
    Assignee: LG ELECTRONICS INC.
    Inventors: Chanyong Park, Eunsung Lee, Hejin Cheong
  • Patent number: 11070743
    Abstract: In a night shot mode, a photo is captured and processed based on a plurality of frames. The plurality of frames are obtained based on a plurality of parameters including an exposure duration, a light sensitivity, and a number of frames. These parameters are determined based on factors, such as whether the electronic device is in a handheld state or not, and whether the current photographing scene is a dark scene or a light source scene.
    Type: Grant
    Filed: March 27, 2018
    Date of Patent: July 20, 2021
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Tao Sun, Congchao Zhu
  • Patent number: 11062464
    Abstract: An image processing apparatus that derives an optical flow which is a set of motion vectors of at least a part of pixels between a plurality of input images includes an acquisition unit and a deriving unit. The acquisition unit is configured to acquire a contrast value of one of the input images. The deriving unit is configured to derive the optical flow based on the contrast value acquired by the acquisition unit and an energy function. The energy function includes a data term specifying a correlation between the plurality of input images and a smoothing term specifying a degree of smoothing.
    Type: Grant
    Filed: May 15, 2019
    Date of Patent: July 13, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Masaaki Kobayashi
  • Patent number: 11050938
    Abstract: Apparatus and methods for the pre-processing of image data so as to enhance quality of subsequent encoding and rendering. In one embodiment, a capture device is disclosed that includes a processing apparatus and a non-transitory computer readable apparatus comprising a storage medium have one or more instructions stored thereon. The one or more instructions, when executed by the processing apparatus, are configured to: receive captured image data (such as that sourced from two or more separate image sensors) and pre-process the data to enable stabilization of the corresponding images prior to encoding. In some implementations, the pre-processing includes combination (e.g., stitching) of the captured image data associated with the two or more sensors to facilitate the stabilization. Advantageously, undesirable artifacts such as object “jitter” can be reduced or eliminated. Methods and non-transitory computer readable apparatus are also disclosed.
    Type: Grant
    Filed: July 3, 2019
    Date of Patent: June 29, 2021
    Assignee: GoPro, Inc.
    Inventor: David Newman
  • Patent number: 11042035
    Abstract: Aspects of the present invention relate to methods and systems for the see-through computer display systems with adjustable-zoom cameras positioned such that their respective capture fields-of-view at least partially overlap at a target distance.
    Type: Grant
    Filed: December 18, 2019
    Date of Patent: June 22, 2021
    Assignee: Mentor Acquisition One, LLC
    Inventors: Ralph F. Osterhout, Robert Michael Lohse
  • Patent number: 11030732
    Abstract: A picture data acquisition unit 52 of an information processing device 10 acquires data of frames of a moving picture from an imaging device 12. A picture data storage unit 54 stores data of at least a predetermined number of past frames. A picture adding unit 56 generates a sum picture obtained by adding pictures of the past frame and a current frame together on a pixel value by pixel value basis. An image analysis unit 58 extracts feature points and acquire position information from each of the sum pictures and the pictures of the current frame, and integrates the acquired pieces of position information. An information processing unit 60 performs information processing using the position information, and an output unit 62 outputs a result of the information processing to a display device 16.
    Type: Grant
    Filed: April 14, 2017
    Date of Patent: June 8, 2021
    Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
    Inventor: Yoshinori Ohashi
  • Patent number: 11025828
    Abstract: There is provided an imaging control apparatus including a control section that creates a first image by performing exposing to a pixel with first exposure by a first exposure time and creates a second image by performing exposing to a pixel with second exposure by a second exposure time in succession to the first image and a synthesizing section that synthesizes a synthesized image in which the first image and the second image have been synthesized and a selected image selected from either the first image or the second image. The control section decides the first exposure time and the second exposure time such that an image to be selected as the selected image in the synthesizing section is switched over on a basis of an exposure ratio being a ratio of an exposure time of the synthesized image and an exposure time of the selected image.
    Type: Grant
    Filed: February 20, 2017
    Date of Patent: June 1, 2021
    Assignee: SONY CORPORATION
    Inventors: Fumihito Yasuma, Ryo Hirono, Keita Sasaki
  • Patent number: 10986278
    Abstract: A lens apparatus includes an aperture stop, configured to form an image via the aperture stop and detachably mountable to a camera apparatus, a storage storing correction data for correcting image data obtained by image pickup by the camera apparatus, with respect to a light amount distribution in the image; and a communication device configured to transmit the correction data to an external apparatus. The correction data includes a coefficient of an n-th order polynomial (n is a non-negative integer) with respect to an image height, which corresponds to each of a plurality of states of the aperture stop. Minimum F-numbers at a wide angle end a telephoto end, focal lengths at the wide angle end and at the telephoto end, and F-numbers corresponding to the correction data are appropriately set.
    Type: Grant
    Filed: December 9, 2019
    Date of Patent: April 20, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Kazufumi Goto, Tomoya Yamada
  • Patent number: 10976476
    Abstract: An optical element driving mechanism is provided. The optical element driving mechanism includes a fixed portion, a movable portion, a plurality of first elastic elements, and a first driving assembly. The movable portion is movably connected to the fixed portion, and includes a holder to hold an optical element, wherein the optical element has an optical axis. The first elastic elements are elastically connected to the fixed portion and the movable portion. The first elastic elements extend in a first direction, and the first direction is perpendicular to the optical axis. The first driving assembly drives the movable portion to move relative to the fixed portion in a direction that is perpendicular to the first direction. The first driving assembly is electrically connected to the first elastic elements.
    Type: Grant
    Filed: January 25, 2019
    Date of Patent: April 13, 2021
    Assignee: TDK TAIWAN CORP.
    Inventors: Chen-Hsien Fan, Chao-Chang Hu
  • Patent number: 10965871
    Abstract: An electronic device is disclosed. Moreover, various embodiment found through the disclosure are possible. An electronic device may include a lens assembly including, one or more lenses, an image sensor, an image stabilizer, and a processor. The lens assembly may be arranged to from a first angle between an optical axis of at least some lenses of the one or more lenses, and a surface of the image sensor. The processor may be configured to change an angle of the lens assembly through the image stabilizer in response to shaking of the electronic device, obtain an image through the image sensor, in a state that the angle of the lens assembly is changed, correct, based at least on the first angle and a second angle corresponding to the changed angle of the lens assembly, at least a portion of the image, which is distorted, by the second angle, and display the corrected image through a display electrically connected with the electronic device.
    Type: Grant
    Filed: September 11, 2018
    Date of Patent: March 30, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Won Seok Song, Nak Hoon Kim, Jae Mu Yun, Bo Hee Lee, Hak Jae Jeon, Min Heu, Byung Ho Ahn
  • Patent number: 10958840
    Abstract: Visual content is captured by an image capture device during a capture duration. The image capture devices experiences change in position during the capture duration. The trajectory of the image capture device is smoothed based on a look ahead of the trajectory. A punchout of the visual content is determined based on the smoothed trajectory. The punchout of the visual content is used to generate stabilized visual content.
    Type: Grant
    Filed: December 13, 2019
    Date of Patent: March 23, 2021
    Assignee: GoPro, Inc.
    Inventors: Cesar Douady, Thomas Derbanne, Maxim Karpushin
  • Patent number: 10924665
    Abstract: An image processing apparatus comprises at least one processor or circuit configured to perform the operations of following units: an obtaining unit configured to obtaining an image signal containing intensity information and angle information of an incident light beam, an operating unit configured to obtain a viewpoint changing operation and a focus position changing operation, and a processing unit configured to generate, based on a plurality of viewpoint images obtained based on the image signal, a display image by changing a viewpoint in accordance with the viewpoint changing operation, and changing a focus position in accordance with the focus position changing operation.
    Type: Grant
    Filed: September 21, 2018
    Date of Patent: February 16, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Akihiko Kanda, Koichi Fukuda, Yuki Yoshimura
  • Patent number: 10877357
    Abstract: A signal processing apparatus according to an embodiment of the present disclosure includes a positioner and a synthesizer. The positioner generates, on the basis of two pieces of RAW data different in angle of view from each other, positioning data of the two pieces of RAW data. The synthesizer synthesizes the two pieces of RAW data with each other on the basis of the positioning data generated by the positioner.
    Type: Grant
    Filed: January 18, 2017
    Date of Patent: December 29, 2020
    Assignee: Sony Corporation
    Inventors: Hiroaki Yamajo, Masayuki Tachi
  • Patent number: 10863092
    Abstract: Imaging device has a configuration provided with: a primary correction amount calculator that calculates a primary correction amount for correcting image shake in a current frame image based on a physical shake amount of the imaging device; a secondary correction amount calculator that calculates a secondary correction amount for correcting a search shake amount between the current frame image and a previous frame image which is one frame image before the current frame image; a correction amount selector that selects at least one of the primary correction amount and the secondary correction amount based on at least one of an imaging condition and the primary correction amount; and an image converter that performs a geometrical conversion with respect to the current frame image based on at least one of the primary correction amount and the secondary correction amount which is selected by the correction amount selector.
    Type: Grant
    Filed: January 17, 2018
    Date of Patent: December 8, 2020
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Shogo Tanaka, Kenji Tabei
  • Patent number: 10859846
    Abstract: The disclosure reduces the size of an optical unit with a shake correction function provided with a filter switching function and reduces the power consumption. An optical unit with a shake correction function includes a fixed body; a movable body having an optical element; an oscillation support mechanism configured to oscillatably support the movable body with respect to the fixed body; and a shake correction drive mechanism configured to oscillate the movable body, such that the movable body includes a filter and a filter switching mechanism configured to switch the presence or absence of the filter, and the oscillation support mechanism is arranged at a position overlapping the shake correction drive mechanism when seen from a direction perpendicular to a direction of an optical axis of the optical element, and the filter and the filter switching mechanism are arranged at a subject side of the optical element.
    Type: Grant
    Filed: November 8, 2018
    Date of Patent: December 8, 2020
    Assignee: NIDEC SANKYO CORPORATION
    Inventors: Tsutomu Arai, Takeshi Sue, Shinji Minamisawa
  • Patent number: 10848757
    Abstract: The present invention relates to a method and apparatus for setting a reference picture index of a temporal merging candidate. An inter-picture prediction method using a temporal merging candidate can include the steps of: determining a reference picture index for a current block; and inducing a temporal merging candidate block of the current block and calculating a temporal merging candidate from the temporal merging candidate block, wherein the reference picture index of the temporal merging candidate can be calculated regardless of whether a block other than the current block is decoded. Accordingly, a video processing speed can be increased and video processing complexity can be reduced.
    Type: Grant
    Filed: March 5, 2019
    Date of Patent: November 24, 2020
    Assignees: Electronics and Telecommunications Research Institute, University-Industry Cooperation Group of Kyung Hee University
    Inventors: Hui Yong Kim, Gwang Hoon Park, Kyung Yong Kim, Sang Min Kim, Sung Chang Lim, Jin Ho Lee, Jin Soo Choi, Jin Woong Kim
  • Patent number: 10841494
    Abstract: Video image stabilization provides better performance on a generic platform for computing devices by evaluating available multimedia digital signal processing components, and selecting the available components to utilize according to a hierarchy structure for video stabilization performance for processing parts of the video stabilization. The video stabilization has improved motion vector estimation that employs refinement motion vector searching according to a pyramid block structure relationship starting from a downsampled resolution version of the video frames. The video stabilization also improves global motion transform estimation by performing a random sample consensus approach for processing the local motion vectors, and selection criteria for motion vector reliability. The video stabilization achieves the removal of hand shakiness smoothly by real-time one-pass or off-line two-pass temporal smoothing with error detection and correction.
    Type: Grant
    Filed: April 3, 2019
    Date of Patent: November 17, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Yongjun Wu, Nikola Borisov, Weidong Zhao, Shyam Sadhwani, Naveen Thumpudi
  • Patent number: 10832380
    Abstract: Systems and methods for correcting color of uncalibrated material is disclosed. Example embodiments include a system to correct color of uncalibrated material. The system may include a non-transitory computer-readable medium operatively coupled to processors. The non-transitory computer-readable medium may store instructions that, when executed cause the processors to perform a number of operations. One operation is to obtain a target image of a degraded target material with one or more objects. The degraded target material comprises degraded colors and light information corresponding to light sources in the degraded target material. Another operations is to obtain color reference data. Another operation is to identify an object in the target image that corresponds to the color reference data. Yet another operation is to correct the identified object in the target image. Another operation is to correct the target image.
    Type: Grant
    Filed: June 4, 2018
    Date of Patent: November 10, 2020
    Assignee: DISNEY ENTERPRISES, INC.
    Inventors: Steven Chapman, Mehul Patel, Joseph Popp, Ty Popko, Erika Doggett
  • Patent number: 10827124
    Abstract: An object of the present invention is to provide a shake correction device, an imaging apparatus, and a shake correction method capable of accurately correcting a parallel shake. According to a shake correction device according to an aspect of the present invention, since a rotation radius to be used in correction of a shake is determined based on a calculated rotation radius and whether or not a polarity corresponding to the calculated rotation radius is different from a polarity corresponding to a rotation radius stored in advance and an image blur is corrected based on a correction amount corresponding to the determined rotation radius, it is possible to accurately correct a parallel shake by taking influence on a polarity of correction due to the updating of the rotation radius into consideration. The “rotation radius stored in advance” may be a fixed value or may be updated during a period of the shake correction.
    Type: Grant
    Filed: March 21, 2019
    Date of Patent: November 3, 2020
    Assignee: FUJIFILM Corporation
    Inventor: Kazutaka Imanishi