Camera Image Stabilization Patents (Class 348/208.99)
  • Patent number: 11457149
    Abstract: A method and apparatus for capturing digital video includes displaying a preview of a field of view of the imaging device in a user interface of the imaging device. A sequence of images is captured. A main subject and a background in the sequence of images is determined, wherein the main subject is different than the background. A sequence of modified images for use in a final video is obtained, wherein each modified image is obtained by combining two or more images of the sequence of images such that the main subject in the modified image is blur free and the background is blurred. The sequence of modified images is combined to obtain the final video, which is stored in a memory of the imaging device, and displayed in the user interface.
    Type: Grant
    Filed: March 11, 2022
    Date of Patent: September 27, 2022
    Assignee: CLEAR IMAGING RESEARCH, LLC
    Inventor: Fatih M. Ozluturk
  • Patent number: 11454863
    Abstract: A camera module includes a support structure having an internal space, a movable body disposed in the internal space of the support structure, and a plurality of driving wires supporting the movable body in the internal space of the support structure and configured to move the movable body relative to the support structure, each of the driving wires being made of a shape-memory alloy and having one end connected to the support structure, and another end connected to the movable body. An angle between the movable body and each of the driving wire is maintained at 15.5° or less at all positions to which the movable body is movable by the driving wires.
    Type: Grant
    Filed: June 21, 2019
    Date of Patent: September 27, 2022
    Assignee: Samsung Electro-Mechanics Co., Ltd.
    Inventor: Jung Hoo Lee
  • Patent number: 11454221
    Abstract: Broadly speaking, the present techniques provide specific arrangements of shape memory alloy (SMA) actuator wires in SMA actuation apparatuses. In one arrangement, a single straight shape memory alloy actuator wire may be used, which may be inclined at an acute angle greater than 0 degrees with respect to a plane normal to the movement direction. In another arrangement, two straight lengths of shape memory alloy actuator wire may be used, where the SMA wires may be inclined at an acute angle greater than 0 degrees with respect to a plane normal to the movement direction.
    Type: Grant
    Filed: January 22, 2019
    Date of Patent: September 27, 2022
    Assignee: CAMBRIDGE MECHATRONICS LIMITED
    Inventors: Stephen Matthew Bunting, Andrew Benjamin Simpson Brown, Marc-Sebastian Scholz, James Howarth
  • Patent number: 11448892
    Abstract: A lens driving module includes a holder, a cover, a carrier, at least one first magnet, a first coil, at least two second magnets, at least one first sensor and at least one second sensor. The holder includes an opening hole. The cover is made of metal material and coupled to the holder. The carrier is movably disposed in the cover and for coupling to a lens. The first magnet is movably disposed in the cover. The first coil is wound around an outer side of the carrier. The second magnets are disposed on one end of the carrier. The first sensor is for detecting a magnetic field of the second magnets. The second sensor is for detecting a magnetic field of the first magnet.
    Type: Grant
    Filed: May 13, 2020
    Date of Patent: September 20, 2022
    Assignee: LARGAN PRECISION CO., LTD.
    Inventors: Chun-Yi Lu, Te-Sheng Tseng, Wen-Hung Hsu
  • Patent number: 11436707
    Abstract: An image stabilization control apparatus includes an extraction unit configured to extract signals in a plurality of frequency bands from a signal output from a first shake detection sensor detecting a translation component of shake, and extract signals in the plurality of frequency bands from a signal output from a second shake detection sensor detect detecting a rotation component of shake; a first calculation unit configured to calculate a rotational radius of shake for each of the plurality of frequency bands, using the signal from the first shake detection sensor and the signal from the second shake detection sensor; and a second calculation unit configured to calculate a parallel shake amount for each of the plurality of frequency bands, using the signal output from the second shake detection sensor and the rotational radius.
    Type: Grant
    Filed: March 3, 2020
    Date of Patent: September 6, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventor: Tomomi Uesugi
  • Patent number: 11418810
    Abstract: A method, computer program, and computer system is provided for coding video data. Video data including (1) a first frame comprising a first current view and a first reference view and (2) a second frame comprising a second current view and a second reference view is received. A co-located block in the first reference view is identified for a current block in the first current view. A predicted offset vector is calculated based on the motion vector between the co-located block and its reference block in the second reference view. The video data is encoded/decoded based on the predicted offset vector.
    Type: Grant
    Filed: September 21, 2020
    Date of Patent: August 16, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Jun Tian, Shan Liu, Xiaozhong Xu, Weiwei Feng
  • Patent number: 11402653
    Abstract: An image shake correction device includes: a movable member; an imager that is fixed to the movable member; a support member that supports the movable member to be movable; and two movement restrictors that restrict a movement range of the movable member, each of the two movement restrictors includes a recess portion or a through-hole and an insertion member as defined herein, a shape of the recess portion or the through-hole is as defined herein, and a second diagonal line overlaps an extension line of a first diagonal line and the center of the light receiving surface overlaps a line connecting the first diagonal line and the second diagonal line as defined herein.
    Type: Grant
    Filed: December 9, 2020
    Date of Patent: August 2, 2022
    Assignee: FUJIFILM Corporation
    Inventors: Kouhei Awazu, Hajime Fukushima
  • Patent number: 11397303
    Abstract: An optical element driving mechanism is provided and includes a fixed assembly, a movable assembly, a driving assembly, and a position-sensing assembly. The movable assembly corresponds to an optical element, and the movable assembly is movable relative to the fixed assembly. The driving assembly is configured to drive the movable assembly to move relative to the fixed assembly. The position-sensing assembly is configured to sense the movement of the movable assembly relative to the fixed assembly, and the position-sensing assembly includes a sensed unit and a sensing element. The sensing element corresponds to the sensed unit. The sensed unit has a plurality of reference magnetic elements arranged in a first direction, the sensed unit and the sensing element are arranged in an arrangement direction, and the first direction is not parallel to the arrangement direction.
    Type: Grant
    Filed: January 16, 2020
    Date of Patent: July 26, 2022
    Assignee: TDK TAIWAN CORP.
    Inventors: Yi-Cheng Hsiao, Chao-Chang Hu, Che-Wei Chang, Sin-Jhong Song
  • Patent number: 11398014
    Abstract: When swinging of a camera does not follow a motion of a subject in following-photographing, the position of the subject deviates among a plurality of images, and thus there is a problem that the subject that is moving is blurred. An image processing apparatus includes: a standard region designation unit configured to designate a partial region in an image as a standard region; a standard region motion blur setting unit configured to set a motion blur in the standard region designated by the standard region designation unit as a predetermined motion blur; and a motion blur adjustment unit configured to adjust a motion blur in the standard region so that the motion blur becomes the predetermined motion blur and adjust a motion blur on a screen of a region different from the standard region in accordance with the adjusting of the motion blur in the standard region.
    Type: Grant
    Filed: August 23, 2019
    Date of Patent: July 26, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Satoru Kobayashi
  • Patent number: 11388339
    Abstract: The present invention provides an anti-shake method for a panoramic video, which comprises: obtaining, in real time, an output video frame, a fisheye image corresponding thereto, a pixel timestamp in the video frame, and a corresponding camera gyroscope timestamp; synchronizing the pixel timestamp in the video frame with the corresponding camera gyroscope timestamp, and calculating a rotation matrix of the camera movement in the camera gyroscope timestamp; smoothing the camera movement and establishing a coordinate system of a smooth trajectory; correcting the fisheye image distortion; and rendering the fisheye image by means of forward rendering to generate a stable video. According to the present invention, the rolling shutter distortion of a panoramic video sequence can be corrected, the image distortion caused by the rolling shutter of a CMOS can be corrected, and the rolling shutter is eliminated, thereby achieving a better anti-shake effect of a video image.
    Type: Grant
    Filed: March 15, 2019
    Date of Patent: July 12, 2022
    Assignee: ARASHI VISION INC.
    Inventors: Cong Chen, Jingkang Liu, Wenjie Jiang, Yibin Guo
  • Patent number: 11381741
    Abstract: An untethered apparatus for performing inside-out device tracking based on visual-inertial simultaneous location and mapping (SLAM) includes a dynamic vision sensor (DVS) configured to output an asynchronous stream of sensor event data, an inertial measurement unit (IMU) sensor configured to collect IMU data associated with motion of the apparatus at a predetermined interval, a processor and a memory. The memory contains instructions, which when executed by the processor, cause the apparatus to accumulate DVS sensor output over a sliding time window, the sliding time window including the predetermined interval, apply a motion correction to the accumulated DVS sensor output, the motion correction based on the IMU data collected over the predetermined interval, generate an event-frame histogram of DVS sensor events based on the motion correction, and provide the event-frame histogram of the DVS sensor events and the IMU data to a visual inertial SLAM pipeline.
    Type: Grant
    Filed: November 19, 2020
    Date of Patent: July 5, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Michael Sapienza, Ankur Gupta, Abhijit Bendale, Fannie Fontanel
  • Patent number: 11379997
    Abstract: An operation method of an image sensor includes detecting a motion region based on a first image and a second image to obtain a detected motion region, the first image corresponding to a first exposure time and the second image corresponding to a second exposure time, the second exposure time being shorter than the first exposure time, determining a weight for the detected motion region, performing signal pre-processing on the first image to generate a pre-processed image, and outputting a third image based on the pre-processed image and the weight.
    Type: Grant
    Filed: August 13, 2020
    Date of Patent: July 5, 2022
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Hansol Lee, Shusaku Ishikawa, Jeongguk Lee
  • Patent number: 11375089
    Abstract: A camera system (1, 1?) which includes a housing (2); and an optoelectronic sensor unit (3), arranged in the housing (2), which has at least one detector device (4) and at least one optical unit (5), connected upstream of the at least one detector device (4). The optoelectronic sensor unit (3) is elastically mounted in relation to the housing (2). At least one elastic mounting device (6.1-6.7) is formed from multiple ring segments (6.10-6.70) arranged spaced apart from one another.
    Type: Grant
    Filed: March 11, 2019
    Date of Patent: June 28, 2022
    Assignee: HENSOLDT OPTRONICS GMBH
    Inventors: Simon Merz, Oliver Ziegler
  • Patent number: 11363191
    Abstract: An electronic device includes an acquisition unit capable of acquiring an image captured through optical system, wherein a subject image passing through the optical system has characteristic blurring based on a function of spherical aberration of the optical system or a function of an apodization filter of the optical system; and a control unit that performs control to display, together with the captured image, a guidance related to the characteristic blurring.
    Type: Grant
    Filed: February 11, 2021
    Date of Patent: June 14, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Tomohiro Ota, Ayumi Sato
  • Patent number: 11350904
    Abstract: A mammography apparatus (radiographic imaging apparatus) includes: a total irradiation time acquisition unit that acquires the total irradiation time of X-rays (radiation); a divided irradiation time calculation unit that calculates a divided irradiation time by dividing the total irradiation time; an imaging controller that obtains a plurality of time-division images by time-division imaging in which radiographic imaging is performed multiple times according to the divided irradiation time; a feature point recognition unit that recognizes feature points for each of the time-division images; a time-division image selection unit that selects some or all of the time-division images from the plurality of time-division images using the feature points; and a composite image generation unit that generates a composite image using the selected time-division images.
    Type: Grant
    Filed: February 13, 2020
    Date of Patent: June 7, 2022
    Assignee: FUJIFILM Corporation
    Inventors: Takahisa Arai, Takeyasu Kobayashi, Shunsuke Kodaira
  • Patent number: 11343430
    Abstract: The invention is drawn towards a method and apparatus for controlling a consumer based on motion detected in a data stream, comprising: receiving the data stream, extracting motion information from the image data, generating commands and parameters for the consumer according to the motion information and controlling the consumer according to the commands and parameters.
    Type: Grant
    Filed: October 12, 2020
    Date of Patent: May 24, 2022
    Assignee: Martineau & Associates
    Inventor: Pierre R. Martineau
  • Patent number: 11336828
    Abstract: A reflection module capable of image stabilization includes a reflecting element, a rotatable holder, a fixed base, a spherical supporting structure, an auxiliary supporting structure and an image stabilizing actuator. The reflecting element having a reflecting surface for folding optical path of incident light is disposed on the rotatable holder. The fixed base is connected to the rotatable holder via an elastic element. The spherical supporting structure is disposed between the rotatable holder and the fixed base. The auxiliary supporting structure disposed on at least one of the rotatable holder and the fixed base and corresponds to the spherical supporting structure. At least part of the image stabilizing actuator is disposed on the rotatable holder for driving the rotatable holder to rotate by taking the spherical supporting structure as rotation center. The spherical supporting structure is a ball having at least three contact points with the auxiliary supporting structure.
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: May 17, 2022
    Assignee: LARGAN DIGITAL CO., LTD.
    Inventors: Lin An Chang, Hao Jan Chen, Ming-Ta Chou, Chen-Yi Huang
  • Patent number: 11308624
    Abstract: An adhered substance detection apparatus determines whether a substance is adhered to an image-capturing apparatus. The adhered substance detection apparatus includes a controller configured to function as: an extractor that extracts candidate regions for being an adhered substance region in which the substance is adhered to the image-capturing apparatus, the candidate regions being extracted based on an edge that is detected from pixels in an image captured by the image-capturing apparatus; and a final determiner that finally determines whether the candidate regions are the adhered substance region, based on i) an area of the candidate region located in a first region of the captured image, the first region including a road surface region in the captured image and ii) an area of the candidate region located in a second region of the captured image, the second region including a region other than the road surface region in the captured image.
    Type: Grant
    Filed: September 14, 2020
    Date of Patent: April 19, 2022
    Assignee: DENSO TEN Limited
    Inventors: Takashi Kono, Nobunori Asayama, Nobuhisa Ikeda, Yasushi Tani, Daisuke Yamamoto, Daisuke Shiota, Teruhiko Kamibayashi
  • Patent number: 11294141
    Abstract: An optical element driving mechanism is provided. The optical element driving mechanism includes a movable part and a fixed part. The movable part holds an optical element with an optical axis and moves relative to the fixed part. The fixed part includes a bottom unit, which is integrally formed. The bottom unit includes a base member, a circuit member, and a driving coil assembly. The driving coil assembly is electrically connected to the circuit member. The circuit member and the driving coil assembly are located at the base member. The driving coil assembly includes a connection wire, a plurality of first driving coils, and a plurality of second driving coils. The first driving coils are connected via the connection wire. The second driving coils are located between the first driving coils and the circuit member. When viewed along a direction that is perpendicular to the optical axis, the second driving coils partially overlap the connection wire.
    Type: Grant
    Filed: July 12, 2019
    Date of Patent: April 5, 2022
    Assignee: TDK TAIWAN CORP.
    Inventors: Kuo-Chun Kao, Meng-Ting Lin, Wei-Han Hsia, Sin-Jhong Song
  • Patent number: 11297241
    Abstract: A frame rate is synchronized to a detected cadence in order to generate an output image sequence that is substantially stabilized. In an in-camera process, a camera receives motion data of the camera while the camera captures the sequence of image frames. A dominant frequency of motion is determined and the capture frame rate is dynamically adjusted to match the frequency of detected motion so that each image frame is captured when the camera is at approximately the same position along the axis of motion. Alternatively, in a post-processing process, frames of a captured image sequence are selectively sampled at a sampling rate corresponding to the dominant frequency of motion so that each sampled frame corresponds to an image capture that occurred when the camera is at approximately the same position along the axis of motion.
    Type: Grant
    Filed: April 27, 2020
    Date of Patent: April 5, 2022
    Assignee: GoPro, Inc.
    Inventors: Charles Weckel, Vishwanatha Bhat
  • Patent number: 11297240
    Abstract: An imaging device including an imaging unit that includes an imaging element converting a received subject image into an image signal and an imaging lens, and at least one of the imaging lens or the imaging element being movable in a direction orthogonal to a direction of an optical axis of an incidence ray; a shake detector that detects a shake of the imaging unit; and a processor configured to correct a shake of the subject image by moving at least one of the imaging lens or the imaging element relative to one another according to the detected shake, wherein the processor is further configured to determine whether or not a movable range of the relative movement, in which the shake of the subject image is corrected, is limited to an inside of a rectangle according to at least one of an imaging mode, an imaging timing, or a relative position of the imaging lens and the imaging element.
    Type: Grant
    Filed: September 10, 2020
    Date of Patent: April 5, 2022
    Assignee: FUJIFILM Corporation
    Inventor: Kazutaka Imanishi
  • Patent number: 11277562
    Abstract: Techniques and systems are provided for machine-learning based image stabilization. In some examples, a system obtains a sequence of frames captured by an image capture device during a period of time, and collects motion sensor measurements calculated by a motion sensor associated with the image capture device based on movement of the image capture device during the period of time. The system generates, using a deep learning network and the motion sensor measurements, parameters for counteracting motions in one or more frames in the sequence of frames, the motions resulting from the movement of the image capture device during the period of time. The system then adjusts the one or more frames in the sequence of frames according to the parameters to generate one or more adjusted frames having a reduction in at least some of the motions in the one or more frames.
    Type: Grant
    Filed: August 17, 2020
    Date of Patent: March 15, 2022
    Assignee: Qualcomm Incorporated
    Inventors: Young Hoon Kang, Hee Jun Park, Tauseef Kazi, Ron Gaizman, Eran Pinhasov, Meir Tzur
  • Patent number: 11277566
    Abstract: Aspects of the present disclosure relate to optical devices and related methods that facilitate independent control of movement of lenses and image sensors in camera systems. In one example, an image sensor is movable independently of and relative to a lens, and the lens is movable independently of the image sensor. In one example, an optical device includes a lens, and an image sensor disposed below the lens. The image sensor is movable relative to the lens. The optical device includes a plurality of magnets disposed about the lens, a plurality of vertical coil structures coiled in one or more vertical planes, and one or more horizontal coil structures coiled in one or more horizontal planes. The plurality of vertical coil structures are configured to, when powered, move the image sensor relative to the lens. The one or more horizontal coil structures are configured to, when powered, move the lens.
    Type: Grant
    Filed: June 29, 2020
    Date of Patent: March 15, 2022
    Assignee: WESTERN DIGITAL TECHNOLOGIES, INC.
    Inventors: Quang Le, Zhigang Bai, Xiaoyong Liu, Zhanjie Li, Kuok San Ho, Rajeev Nagabhirava
  • Patent number: 11265468
    Abstract: An image stabilization apparatus includes a first acquisition unit configured to acquire an output of a shake detection device, a motion vector detection unit configured to detect a motion vector, an estimation unit configured to calculate an estimate of an offset value of the shake detection device using an observed offset value and an a priori offset estimate, the observed offset value being obtained using a difference between the output of the shake detection device and the motion vector; and a calculation unit configured to calculate a correction amount for correcting image blur using the output of the shake detection device and the estimate of the offset value, wherein the estimation unit is configured to calculate the estimate of the offset value according to operation for driving a movable lens.
    Type: Grant
    Filed: March 17, 2021
    Date of Patent: March 1, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Ryuichiro Yasuda, Fumihiro Kajimura
  • Patent number: 11256066
    Abstract: An optical element driving mechanism is provided. The optical element driving mechanism includes a movable portion, a fixed portion, a magnetic sensed assembly, a first sensing element, and a magnetically permeable element. The movable portion is connected to an optical element which corresponds to incident light. The movable portion is movably connected to the fixed portion. The magnetic sensed assembly includes a first sensed portion having a first magnetic polar direction. The first sensing element is corresponding to the magnetic sensed assembly and is used to detect the rotation of the movable portion relative to the fixed portion, with a first rotational axis extending in a first direction that is different from an incident direction of the incident light and the first magnetic polar direction. The magnetically permeable element is corresponding to the first sensing magnet.
    Type: Grant
    Filed: February 21, 2020
    Date of Patent: February 22, 2022
    Assignee: TDK TAIWAN CORP.
    Inventors: Chao-Chang Hu, Shu-Shan Chen, Cheng-Kai Yu
  • Patent number: 11233980
    Abstract: Techniques for improving laser image quality are disclosed herein. An ultra-compact illumination module includes multiple illuminators, photodetectors, and color filters. The illuminators each emit a different spectrum of light. Because of the compact nature of the module and the positioning of the illuminators relative to one another, the different spectrums of light overlap one another prior to being detected by the photodetectors. Each of the photodetectors is associated with a corresponding one of the illuminators, and each of the color filters is associated with a corresponding one of the photodetectors. Each color filter is positioned in-between its corresponding illuminator and photodetector and passes a particular spectrum of light while filtering out other spectrums of light. Consequently, the photodetectors each receive spectrally filtered light having passed through at least one of the color filters. The power output of the illuminators can also be corrected based on output from the photodetectors.
    Type: Grant
    Filed: June 13, 2019
    Date of Patent: January 25, 2022
    Assignee: MICROSOFT TECHNOLOGLY LICENSING, LLC
    Inventors: Raymond Kirk Price, Yarn Chee Poon, Fei Chen
  • Patent number: 11228713
    Abstract: An adjustment device, a photographing assembly and a photographing device are provided in the present disclosure. The photographing device includes an underframe, a cover plate, and a photographing assembly installed between the underframe and the cover plate. The photographing assembly includes a photosensitive element and an adjustment device configured to adjust a position of the photosensitive element. The adjustment device includes plates and displacement adjusters. A support plate includes a frame body, an adjustment part in the frame body, and an elastic part for connecting the frame body with the adjustment part. A spacing is between the adjustment part and the frame body, and the adjustment part is able to move relative to the frame body. A displacement adjuster is abutted against the adjustment part and configured to overcome an elastic force of the elastic part to adjust a relative position between the adjustment part and the frame body.
    Type: Grant
    Filed: July 14, 2020
    Date of Patent: January 18, 2022
    Assignee: VICTOR HASSELBLAD AB
    Inventor: Karl Tomas Johansson
  • Patent number: 11228711
    Abstract: A shake correction control device includes an acquisition unit that acquires imaging information for selecting mechanical correction of mechanically performing shake correction of a subject image or electronic correction of electronically performing the shake correction of the subject image, and a shake correction control unit. The shake correction control unit performs a first control for performing a switching control from the mechanical correction to the electronic correction by synchronizing shake correction operations of the mechanical correction and the electronic correction and a second control, different from the first control, for performing a switching control from the electronic correction to the mechanical correction based on the imaging information acquired by the acquisition unit.
    Type: Grant
    Filed: May 25, 2021
    Date of Patent: January 18, 2022
    Assignee: FUJIFILM Corporation
    Inventors: Tomonori Masuda, Masahiko Sugimoto, Yi Pan, Takashi Hashimoto, Tetsuya Fujikawa, Yasunobu Kishine
  • Patent number: 11212446
    Abstract: A tracking device, comprising a first image stabilization actuator that moves the image stabilization lens, a second image stabilization actuator that moves an image sensor, and a processor that has a calculation section, a determination section and a tracking control section, wherein the determination section determines whether or not a subject image exists at a specified position within an effective imaging region of the image sensor, the calculation section calculates movement direction and movement velocity for moving the subject image with respect to the image sensor, and the tracking control section performs drive control for at least one of the first image stabilization actuator and the second image stabilization actuator based on the movement direction and movement velocity that have been calculated by the calculation section, to perform tracking such that the subject image is always positioned at a specified position within the effective imaging region of the image sensor.
    Type: Grant
    Filed: March 12, 2020
    Date of Patent: December 28, 2021
    Assignee: OLYMPUS CORPORATION
    Inventor: Hirotoshi Nomura
  • Patent number: 11195328
    Abstract: Methods, system and devices (10) for generating a three-dimensional (3D) model of a corresponding 3D environment are disclosed. An application is downloaded via a wireless telecommunication module to a mobile device having a sensor set including a depth sensor. A user moves the mobile device freehand to scan the 3D environment. The application controls the mobile device to log data from the sensor set into a raw data file which can be processed to generate a 3D model of the 3D environment.
    Type: Grant
    Filed: July 25, 2018
    Date of Patent: December 7, 2021
    Assignee: CROFTON GROUP LTD
    Inventor: Jason Sharp
  • Patent number: 11190686
    Abstract: A control apparatus includes a detecting unit configured to detect an object from an obtained image signal, an obtaining unit configured to obtain a variation amount of a focal length for reducing a size variation of the object detected by the detecting unit, and a correcting unit configured to obtain a blur correction amount for controlling an image stabilizer configured to correct a blur, based on the blur detected by a shake detector and the variation amount of the focal length obtained by the obtaining unit.
    Type: Grant
    Filed: March 12, 2020
    Date of Patent: November 30, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Hitoshi Miyazawa
  • Patent number: 11178330
    Abstract: An image stabilizing apparatus comprises: a shake detector that detects shake; an image stabilizer that corrects the shake by moving a position on the basis of the shake detected by the shake detector; a position detector that detects and outputs the position of the image stabilizer; a determinator that determines an extraction timing at which to extract the position of the image stabilizer on the basis of a timing at which an image sensor which shoots an image is exposed; and an extractor that extracts the position of the image stabilizer, from the output of the position detector, at the extraction timing determined by the determinator.
    Type: Grant
    Filed: October 2, 2019
    Date of Patent: November 16, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Hiroki Ota, Nobuhiko Tanaka, Hajime Inoue
  • Patent number: 11159737
    Abstract: A method includes detecting, based on sensor data from a sensor on a mobile device, an environmental brightness measurement, where the mobile device comprises a display screen configured to adjust display brightness based on environmental brightness. The method further includes determining, based on image data from a camera on the mobile device, an extent to which the detected environmental brightness measurement is caused by reflected light from the display screen. The method additionally includes setting a rate of exposure change for the camera based on the determined extent to which the detected environmental brightness measurement is caused by reflected light from the display screen.
    Type: Grant
    Filed: November 15, 2019
    Date of Patent: October 26, 2021
    Assignee: Google LLC
    Inventors: Jinglun Gao, Lin Lu, Gang Sun, Szepo Robert Hung, Ruben Manuel Velarde
  • Patent number: 11159725
    Abstract: An image processing apparatus includes: an alignment unit configured to perform alignment for a group of images including a plurality of short-time-exposure images that are captured with a first exposure time and a long-time-exposure image that is captured with a second exposure time that is longer than the first exposure time; and an output unit configured to output the long-time-exposure image in a case where the long-time-exposure image satisfies a predetermined condition and configured to output a composite image which is generated by compositing a plurality of images selected from among the plurality of short-time-exposure images, in a case where the long-time-exposure image does not satisfy the predetermined condition.
    Type: Grant
    Filed: May 5, 2020
    Date of Patent: October 26, 2021
    Assignees: MORPHO, INC., Sharp Corporation
    Inventors: Hirotaka Kawano, Shun Hirai, Masaki Satoh, Michihiro Kobayashi, Taiga Koseki
  • Patent number: 11159724
    Abstract: An imaging apparatus includes a motion detection unit that detects motions of panning, tilting, and camera-shake as motion information. A motion determination unit determines a motion occurring in the imaging apparatus as motion information. A highpass filter (HPF) removes a low-frequency component of a signal of the motion information and a lowpass filter (LPF) removes a high-frequency component of an output signal of the HPF. A swing-back detection unit detects a period in which a motion of swing-back occurs from an output signal of the LPF and a determination result of the motion determination unit A motion vector detection unit detects a motion vector between a plurality of input images. An image cutout unit performs a process of cutting out a partial image from an input image at a position at which the motion of swing-back is reduced during the period in which the motion of swing-back is determined to occur.
    Type: Grant
    Filed: October 14, 2019
    Date of Patent: October 26, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Mitsuhiro Saito
  • Patent number: 11153490
    Abstract: An image capturing device includes: an imaging lens; an image capturing device main body including an imaging element that captures an optical image transmitting through the imaging lens; a first correction unit that performs correction of an image shake by a correction lens; and a second correction unit that performs correction of the image shake by the image capturing device main body. The image capturing device performs a control of causing the first correction unit and the second correction unit to share and correct the image shake and calculates a correction amount of each of the first correction unit and the second correction unit according to at least one of a temperature of the imaging lens or a temperature of the image capturing device main body in a case where correction of the image shake is performed by the first correction unit and the second correction unit.
    Type: Grant
    Filed: December 24, 2020
    Date of Patent: October 19, 2021
    Assignee: FUJIFILM Corporation
    Inventors: Junya Kitagawa, Koichi Tanaka, Fuminori Irie
  • Patent number: 11151695
    Abstract: Some embodiments provide a method for processing a video that includes a sequence of images using a neural network. The method receives a set of video images as a set of inputs to successive executions of the neural network. The method executes the neural network for each successive video image of the set of video images to reduce an amount of noise in the video image by (i) identifying spatial features of the video image and (ii) storing a set of state data representing identified spatial features for use in identifying spatial features of subsequent video images in the set of video images. Identifying spatial features of a particular video image includes using the stored sets of spatial features of video images previous to the particular video image.
    Type: Grant
    Filed: September 26, 2019
    Date of Patent: October 19, 2021
    Assignee: PERCEIVE CORPORATION
    Inventors: Andrew C. Mihal, Steven L. Teig, Eric A. Sather
  • Patent number: 11153489
    Abstract: Visual content may be captured by an image capture device during a capture duration. The rotational positions of the image capture device may change during the capture duration. The rotational positions of the image capture device may be smoothed based on a look ahead of a rotation constraint. A punchout of the visual content may be determined based on the smoothed rotational positions. The punchout of the visual content may be used to generate stabilized visual content.
    Type: Grant
    Filed: August 7, 2020
    Date of Patent: October 19, 2021
    Assignee: GoPro, Inc.
    Inventor: Sophana Kok
  • Patent number: 11107436
    Abstract: A motion detection section 720 detects a motion exceeding a permissible limit in a wide-viewing-angle image displayed on a head-mounted display 100. A field-of-view restriction processing section 750 restricts a field of view for observing the wide-viewing-angle image in a case in which the motion exceeding the permissible limit has been detected in the wide-viewing-angle image. An image provision section 760 provides, for the head-mounted display 100, the wide-viewing-angle image in which the field of view has been restricted.
    Type: Grant
    Filed: February 21, 2017
    Date of Patent: August 31, 2021
    Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
    Inventor: Yasushi Okumura
  • Patent number: 11107205
    Abstract: A method includes obtaining multiple image frames of a scene using at least one camera of an electronic device. The method also includes using a convolutional neural network to generate blending maps associated with the image frames. The blending maps contain or are based on both a measure of motion in the image frames and a measure of how well exposed different portions of the image frames are. The method further includes generating a final image of the scene using at least some of the image frames and at least some of the blending maps. The final image of the scene may be generated by blending the at least some of the image frames using the at least some of the blending maps, and the final image of the scene may include image details that are lost in at least one of the image frames due to over-exposure or under-exposure.
    Type: Grant
    Filed: February 18, 2019
    Date of Patent: August 31, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Yuting Hu, Ruiwen Zhen, John W. Glotzbach, Ibrahim Pekkucuksen, Hamid R. Sheikh
  • Patent number: 11092817
    Abstract: Provided is the image pickup apparatus including an optical system forming an image of an object, an image pickup element receiving light from optical system, a driving unit driving at least one of an optical element included in optical system and image pickup element in a direction including a component of a direction perpendicular to an optical axis of optical system, and a determining unit performing first determination that driving unit is set to be in a non-driving state (NDS) or performing second determination that driving unit is set to be in a driving state (DS) based on information regarding object. When first determination is performed, determining unit outputs a signal for maintaining driving unit in NDS or switching driving unit from DS to NDS. When second determination is performed, determining unit outputs a signal for maintaining driving unit in DS or switching driving unit from NDS to DS.
    Type: Grant
    Filed: October 2, 2018
    Date of Patent: August 17, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Shinji Yamasaki
  • Patent number: 11067824
    Abstract: An optical image stabilization apparatus includes an image stabilization element, a base member, a shift member configured to hold the image stabilization element and movable in a direction including a component orthogonal to an optical axis relative to the base member, an elastic member configured to support the image stabilization element and the shift member, and a driver configured to move the shift member. The driver includes a first magnet part and a second magnet part provided on one of the base member and the shift member, a coil provided on the other of the base member and the shift member, a first magnetized portion provided on a side of the first magnet part with respect to a center axis of an opening in the coil, and a second magnetized portion provided on a side of the second magnet part with respect to the center axis.
    Type: Grant
    Filed: December 30, 2019
    Date of Patent: July 20, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Toshimune Nagano, Kazuhiro Noguchi
  • Patent number: 11054667
    Abstract: Provided is the image pickup apparatus including an optical system forming an image of an object, an image pickup element receiving light from optical system, a driving unit driving at least one of an optical element included in optical system and image pickup element in a direction including a component of a direction perpendicular to an optical axis of optical system, and a determining unit performing first determination that driving unit is set to be in a non-driving state (NDS) or performing second determination that driving unit is set to be in a driving state (DS) based on information regarding object. When first determination is performed, determining unit outputs a signal for maintaining driving unit in NDS or switching driving unit from DS to NDS. When second determination is performed, determining unit outputs a signal for maintaining driving unit in DS or switching driving unit from NDS to DS.
    Type: Grant
    Filed: October 2, 2018
    Date of Patent: July 6, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Shinji Yamasaki
  • Patent number: 11050930
    Abstract: An imaging apparatus includes: an imager including an imaging sensor configured to acquire an optical image; and a processor configured to: perform pixel displacement to displace a positional relationship between a subject and the imager in a unit of a pixel pitch or less; detect an amount and a direction of a shake; perform shake correction to correct the positional relationship between the subject and the imager based on a detection result; perform first imaging for a first predetermined number of times for each position of the pixel displacement to generate a first group of images; combine the images of the first group to generate a first high-resolution image; perform second imaging for a second predetermined number of times for each position of the pixel displacement to generate a second group of images; and combine the images of the second group to generate a second high-resolution image.
    Type: Grant
    Filed: November 27, 2019
    Date of Patent: June 29, 2021
    Assignee: Olympus Corporation
    Inventors: Takeshi Kawawa, Satoshi Miyazaki, Keiji Kunishige
  • Patent number: 11048147
    Abstract: Various embodiments include a camera with a voice coil motor (VCM) actuator assembly to provide autofocus (AF) and/or optical image stabilization (OIS) movement. The VCM actuator assembly is configured to move an image sensor of the camera in three dimensions (e.g. X, Y, and Z) to provide the AF and/or OIS movements. The VCM actuator assembly is asymmetrical and includes an at least partially open side that allows an optical assembly of the camera to pass through the open side of the VCM actuator. In some embodiments, the optical assembly is part of a folded optics arrangement of the camera that includes one or more prisms/and or lenses.
    Type: Grant
    Filed: September 16, 2019
    Date of Patent: June 29, 2021
    Assignee: Apple Inc.
    Inventor: Shashank Sharma
  • Patent number: 11044404
    Abstract: A first image is aligned with a second image. A first motion value is computed based at least in part on a sum of differences between corresponding pixels in the first image and the second image. A second motion value is computed further based at least in part on a third image. An impact score is generated based at least in part on a difference between values derived from the first motion value and the second motion value and an action is performed depending at least in part on whether the impact score indicates that damage has occurred among objects represented in the first image and the second image.
    Type: Grant
    Filed: November 28, 2018
    Date of Patent: June 22, 2021
    Assignee: Vulcan Inc.
    Inventors: Michael Persiantsev, Cecil Lee Quartey, Samuel Allan McKennoch, Paul Benjamin Albee
  • Patent number: 11025822
    Abstract: The power consumption is reduced in an imaging apparatus that detects the presence or absence of an event. In a pixel array unit, a plurality of transfer transistors that transfer charges from mutually different photoelectric conversion devices to a floating diffusion layer is provided. A scan circuit simultaneously controls the plurality of transfer transistors in a pixel addition mode in which pixel addition is performed, to transfer the charges and sequentially controls the plurality of transfer transistors in a normal mode in which pixel addition is not performed, to transfer the charges. An event detection unit detects the presence or absence of a predetermined event on the basis of an addition signal which is an analog signal generated in the normal mode, and generates a detection result. A mode control unit sets one of the pixel addition mode and the normal mode on the basis of the detection result.
    Type: Grant
    Filed: May 16, 2017
    Date of Patent: June 1, 2021
    Assignee: SONY CORPORATION
    Inventor: Takahiro Iinuma
  • Patent number: 11012664
    Abstract: A video messaging system facilitates a video messaging session between a client device and a remote device. A remote device provides information (e.g., a link) to a client device for connecting to a video messaging session. The client device uses the provided information to connect to the video messaging session between the client device and the remote device. The video messaging session generally includes two-way communication, with at least video information being transmitted by the client device to the remote device, and instructions describing video operations being transmitted by the remote device to the client device. The video operations may include annotating the video, rewinding the video, pausing the video, and various other modifications to the video. The video messaging system may mirror operations performed on one device (e.g., the remote device) on the other device (e.g., the client device) in the video messaging session.
    Type: Grant
    Filed: June 11, 2020
    Date of Patent: May 18, 2021
    Assignee: Viewabo, Inc.
    Inventor: George Shih-Hao Cheng
  • Patent number: 11012631
    Abstract: The present invention has an object to enable an improvement in accuracy of face detection and obtain an optimum image in which focus and exposure are adjusted in conformity with a detected face. An image capture processing device (50) of one mode of the present invention includes: a face detection section (40) configured to perform face detection so as to detect a face from an image of a subject, the image being captured by an auxiliary image capture section 20 which captures the image of the subject; and a control section (30) configured to control, on the basis of a result of the face detection, a main image capture section (10) to capture an image of the subject.
    Type: Grant
    Filed: May 26, 2017
    Date of Patent: May 18, 2021
    Assignee: SHARP KABUSHIKI KAISHA
    Inventors: Hidenori Fujisawa, Shigefumi Urata, Junki Asai
  • Patent number: 11002939
    Abstract: The present invention relates to an apparatus and a method for controlling auto focus of a camera module including a voice coil motor actuator. The camera module includes a sensing unit configured to sense a movement of the lens unit and a controller configured to control the movement of the lens unit based on a sensing signal sensed by the sensing unit. If an initial operation command is received, the controller moves the lens unit to an end point of a maximum movement range. If the lens unit is positioned at the end point of the maximum movement range, the controller compares the sensing signal sensed by the sensing unit with a predetermined reference signal to calculate a compensation value for an error. If a focus operation command is received, the controller can move the lens unit to a focus position based on the calculated compensation value and compensate for the focus position of the lens unit.
    Type: Grant
    Filed: June 30, 2016
    Date of Patent: May 11, 2021
    Assignee: LG ELECTRONICS INC.
    Inventors: Youngman Kwon, Hyungjoo Kang, Sungdu Kwon, Jayong Lee, Haejin Park, Samnyol Hong