Electrical (memory Shifting, Electronic Zoom, Etc.) Patents (Class 348/208.6)
  • Patent number: 10848676
    Abstract: An object of the present disclosure is to continue optical image stabilization even in the case where a correcting lens is positioned near a mechanical end. An optical image stabilization module used to control a camera module adjusts the position of a correcting lens and the like used for optical image stabilization while executing the optical image stabilization during an exposure period. An image distortion accompanying the position adjustment of the correcting lens can be corrected by, for example, an electronic image stabilization module.
    Type: Grant
    Filed: October 29, 2018
    Date of Patent: November 24, 2020
    Assignee: RENESAS ELECTRONICS CORPORATION
    Inventors: Ryuichi Murashima, Hirohide Okuno, Hiroshi Murakami, Hiromi Nishi
  • Patent number: 10771700
    Abstract: There is provided an image blur correction apparatus. A detection unit detects shake occurring in an image capturing apparatus. Based on the shake, a determination unit determines a first correction amount and a second correction amount that are for correcting image blur. A transmission unit transmits a second correction amount to a second image blur correction apparatus via a communication device, the second image blur correction apparatus controlling a second correction member based on the second correction amount. An acquisition unit acquires a correction error of the second correction member caused by a communication delay of the second correction amount in the communication device. Based on the first correction amount and the correction error, a control unit controls a first correction member configured to correct image blur of the image capturing apparatus so as to reduce the correction error.
    Type: Grant
    Filed: January 7, 2019
    Date of Patent: September 8, 2020
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Takeshi Watanabe, Masafumi Kimura
  • Patent number: 10755418
    Abstract: A background blurred method includes steps as follows: obtaining a color image, an IR light frame image and an IR dark frame image, and calculating a differential image between the IR light frame image and the IR dark frame image to generate a binary image; obtaining a foreground image of the binary image; calculating an IR brightness mean value of the foreground image of the differential image; and filtering the color image to generate a background blurred image according to the IR brightness mean value.
    Type: Grant
    Filed: April 1, 2019
    Date of Patent: August 25, 2020
    Assignee: REALTEK SEMICONDUCTOR CORP.
    Inventors: Zhong-Yi Qiu, Wen-Tsung Huang, Kai Liu
  • Patent number: 10748305
    Abstract: An image capturing apparatus comprises: an image capturing unit configured to capture a plurality of RAW image data sets while shifting a position of an image sensor relative to an optical axis; a difference generation unit configured to generate difference data; an encoding unit configured to encode the difference data; and a recording unit configured to record the encoded difference data, wherein, when generating difference data regarding a first RAW image data set and a second RAW image data set included in the plurality of RAW image data sets, the difference generation unit shifts the first RAW image data set, and obtains a difference between pieces of pixel data having the same color component, respectively included in the first RAW image data set and the second RAW image data set, to generate the difference data.
    Type: Grant
    Filed: April 12, 2018
    Date of Patent: August 18, 2020
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Masashi Kawakami
  • Patent number: 10732377
    Abstract: Providing a multi-aperture imaging device having a single-line array of optical channels arranged next to one another with and adjuster for channel-specifically changing a relative position between an image sensor region of a respective optical channel, the optics of the respective optical channel and a beam-deflecting device of the respective channel or for channel-specifically changing an optical characteristic of the optics of the respective optical channel or an optical characteristic of the beam-deflecting device relating to deflecting the optical path of the respective optical channel, and a storage having default values stored therein and/or a controller for converting sensor data to default values for channel-specifically controlling the adjusting device is used to reduce requirements to, for example, manufacturing tolerances of the multi-aperture imaging device and/or requirements to the multi-aperture imaging device as regards position and shape invariance relative to temperature variations such tha
    Type: Grant
    Filed: February 17, 2018
    Date of Patent: August 4, 2020
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Frank Wippermann, Andreas Brueckner, Andreas Braeuer, Alexander Oberdoerster
  • Patent number: 10699441
    Abstract: The calibration apparatus includes: an image acquisition unit configured to acquire images captured by a plurality of cameras; a vibration detection unit configured to detect vibration of the camera from the images for each of the cameras; an extraction unit configured to extract images captured by the camera whose vibration is within an allowable value and whose position and orientation are regarded as being the same as an image group for each of the cameras; a selection unit configured to select the image groups whose number is larger than or equal to a predetermined number of cameras as a combination; and an estimation unit configured to estimate a position and orientation parameter for each of the cameras by using the selected combination of the image groups.
    Type: Grant
    Filed: April 11, 2019
    Date of Patent: June 30, 2020
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Kaori Taya
  • Patent number: 10681711
    Abstract: Methods and apparatuses are provided method for operating a terminal. A motion pattern of at least one of the terminal or a peer terminal communicating with the terminal is determined in a time interval. A channel quality of a channel between the terminal and the peer terminal is determined in time intervals after the time interval based on the motion pattern in the time interval. At least one first time interval among the time intervals in which the channel quality is greater than or equal to a threshold value and at least one second time interval among the time intervals in which the channel quality is less than the threshold value are determined. Data in the at least one first time interval is transmitted to the peer terminal.
    Type: Grant
    Filed: April 29, 2019
    Date of Patent: June 9, 2020
    Assignee: Samsung Electronics Co., Ltd
    Inventors: Dong-Hyun Kim, Seong-Wook Song, Jong-Han Lim
  • Patent number: 10674087
    Abstract: The present disclosure provides an image stabilization method. The method includes acquiring a frame of an image to be stabilized and a related exposure time; acquiring first attitude data before the exposure time and second attitude data after the exposure time, wherein the number of the first attitude data is one or more, and the number of the second attitude data is one or more; acquiring a target attitude corresponding to the exposure time based on the first attitude data and the second attitude data; and obtaining a stabilized target image by stabilizing the image to be stabilized according to the target attitude.
    Type: Grant
    Filed: August 13, 2019
    Date of Patent: June 2, 2020
    Assignee: SZ DJI Technology Co., Ltd.
    Inventors: Bing Li, Wen Zou, Jun Ma, Guangyuan Lin
  • Patent number: 10616500
    Abstract: An image pickup apparatus that uses an area of an image pickup device, which has better characteristics, as an imaging area. The image pickup apparatus includes an image pickup optical system having a fish-eye lens. An image pickup device is movable relative to the image pickup optical system, and converts an object image formed through the image pickup optical system to electric signals. A characteristic detection section acquires characteristics of the image pickup device, and an imaging position detection section acquires an imaging position of the object image on the image pickup device. A target position to which the image pickup device is to be moved is determined based on the acquired characteristics of the image pickup device, and the acquired imaging position.
    Type: Grant
    Filed: April 24, 2018
    Date of Patent: April 7, 2020
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Takamichi Nakata
  • Patent number: 10606152
    Abstract: Multi-aperture imaging device includes at least one image sensor, an array of juxtaposed optical channels, wherein each optical channel has optics for projecting at least one partial area of an object area on an image sensor area of the image sensor, and a beam deflector for deflecting an optical path of the optical channels in beam-deflecting areas of the beam deflector. The beam deflector is formed as an array of facets arranged along a line-extension direction of the array of optical channels. One facet is allocated to each optical channel. Each facet has a beam-deflecting area. A stray light suppressing structure is arranged between a first beam-deflecting area of a first facet and a second beam-deflecting area of a juxtaposed second facet, which is configured to reduce transition of stray light between the first beam-deflecting area and the second beam-deflecting area.
    Type: Grant
    Filed: September 14, 2018
    Date of Patent: March 31, 2020
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Frank Wippermann, Andreas Brueckner, Andreas Braeuer
  • Patent number: 10582211
    Abstract: A neural network learning algorithm obtains a fingerprint of a video sequence. Using the fingerprint, selection of an appropriate video stabilization algorithm, and its parameter settings, is performed. The video thus stabilized is made more appealing for viewing and easier for subsequent video compression. The neural network may be trained during a training phase to select a correct fingerprint of each video sequence based on the effectiveness of resulting video stabilization and/or compression.
    Type: Grant
    Filed: December 30, 2016
    Date of Patent: March 3, 2020
    Assignee: Facebook, Inc.
    Inventors: Melanie Sclar, Amit Puntambekar, Michael Hamilton Coward, Wurzel David Parsons-Keir
  • Patent number: 10559084
    Abstract: A reflection determining apparatus is configured to determine reflection for a camera, wherein the camera is configured to photograph an external environment of a vehicle through a glass from an inside of the vehicle and the camera includes a reflection preventer configured to prevent reflection on the glass. The reflection determining apparatus is provided with: a calculator configured to calculate an optical flow of an area in which the reflection is not prevented in a photographed image of the camera; and a determinator configured to determine that there is the reflection in the photographed image of the camera if a duration in which a particular area is detected is greater than or equal to a predetermined time, wherein the particular area is defined by points with a value of the optical flow that is smaller than a predetermined threshold value.
    Type: Grant
    Filed: August 30, 2018
    Date of Patent: February 11, 2020
    Assignee: TOYOTA JIDOSHA KABUSHIKI KAISHA
    Inventor: Masakazu Nishijima
  • Patent number: 10546369
    Abstract: A method for determining exposure levels of an image-sensor pixel array includes (a) storing a first plurality of pixel values representing a first captured image, captured with the image sensor in an applied exposure configuration, each distinct region of the pixel array having a respective first exposure level, (b) determining pixel-value global statistics, (c) estimating, from the global statistics, a global pixel value of the first captured image, (d) determining, for each distinct region, a respective local statistics of the first pixel values, (e) assigning, to each distinct region, a respective scale factor based on the local statistics of the distinct region, (f) determining a refined exposure configuration including, for each distinct region, a second exposure level proportional to a product of its respective first exposure level and its respective scale factor, and (g) capturing second pixel values with the image sensor configured in the refined exposure configuration.
    Type: Grant
    Filed: January 9, 2018
    Date of Patent: January 28, 2020
    Assignee: OmniVision Technologies, Inc.
    Inventors: Fanbo Deng, Chengming Liu, Sarvesh Swami
  • Patent number: 10491821
    Abstract: An electronic apparatus includes a camera module including an optical image stabilizer (OIS) module and an image sensor, and at least one processor. The at least one processor is configured to control the camera module to calculate an error based on an operation of the OIS module responsive to movement of the electronic apparatus during at least part of time of the first exposure, to interrupt the first exposure and obtain a first image corresponding to the first exposure, based on the fact that the calculated error exceeds a critical value, to obtain a second image corresponding to the second exposure, and to generate a third image, in which at least part of the movement is corrected, by using the first image and the second image.
    Type: Grant
    Filed: February 6, 2018
    Date of Patent: November 26, 2019
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Han Sung Kim, Jae Mu Yun, Jeong Won Lee, Jae Joon Moon, Jae Hyoung Park
  • Patent number: 10475204
    Abstract: The present invention relates to the fast multi-object detection and tracking system. According to the system of the present invention, only a few frames are to be detected and the other frames are split into different size of steady motion segments in a binary way, and then the system of the present invention can predicted accurately. The system can help to achieve high tracking speed with multi-persons in high-definition videos and gain high accuracy as well.
    Type: Grant
    Filed: August 29, 2017
    Date of Patent: November 12, 2019
    Assignee: Canon Kabushiki Kaisha
    Inventors: Shiting Wang, Qi Hu, Dongchao Wen
  • Patent number: 10447923
    Abstract: An imaging apparatus captures a first image with a first exposure time, captures a second image with a second exposure time shorter than the first exposure time, and determines either the first image and the second image as an image to be used for the calculation of a motion vector depending on a result of the detection of flicker based on the first image and the second image. Then, the imaging apparatus calculates a motion vector based on the determined image.
    Type: Grant
    Filed: December 13, 2017
    Date of Patent: October 15, 2019
    Assignee: Canon Kabushiki Kaisha
    Inventor: Takuya Shintani
  • Patent number: 10360479
    Abstract: A method and an electronic device are disclosed. The method includes obtaining an image, obtaining information of the image, obtaining content information of content included in the image, obtaining related information which relates to the image based on at least one of the information of the image and the content information, and classifying the image into at least one category based on a plurality of defined information/data elements and a relation among the information/data elements and metadata of the image.
    Type: Grant
    Filed: February 27, 2019
    Date of Patent: July 23, 2019
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Woo-Chan Kim, Jun-Seok Heo
  • Patent number: 10334153
    Abstract: An image preview method, apparatus, and terminal are disclosed to provide a technical solution in which a background blurring effect with respect to a current scene can be previewed in real time. A terminal device synchronously obtains preview images of a current scene from different angles in a dual-camera photographing preview mode by using a dual-camera module, calculates, in the preview images based on a phase difference generated by a distance and an angle of the dual-camera module, a depth of field of each pixel unit included in a preview image, obtains a foreground depth of field of a preset target area in the preview image, and determines, in the same preview image, an area including all pixel units having a depth of field beyond a range as a background area.
    Type: Grant
    Filed: March 30, 2018
    Date of Patent: June 25, 2019
    Assignee: Hisense Mobile Communications Technology Co., Ltd.
    Inventor: Bing Li
  • Patent number: 10302807
    Abstract: The present specification discloses systems and methods for identifying and reporting contents of a tanker, container or vehicle. Programmatic tools are provided to assist an operator in analyzing contents of a tanker, container or vehicle. Manifest data is automatically imported into the system for each shipment, thereby helping security personnel to quickly determine container contents. In case of a mismatch between container contents shown by manifest data and the contents as ascertained from the scanning system, the container or vehicle may be withheld for further inspection.
    Type: Grant
    Filed: February 13, 2017
    Date of Patent: May 28, 2019
    Assignee: Rapiscan Systems, Inc.
    Inventors: Songyang Yu, Rupa Chittineni, Mark J. McCarthy
  • Patent number: 10290281
    Abstract: Provided is a display device including an imaging unit that captures a moving image in a predetermined range in an image display direction, a moving body detection unit that detects whether or not a moving body is present in a predetermined range in the image display direction, an image analysis unit that analyzes the moving image captured by the imaging unit to detect whether or not a face is present, and a power control unit that controls power consumption with different patterns according to a plurality of modes that are set by combining whether or not the face detected by the image analysis unit is present and whether or not the moving body detected by the detection unit is present.
    Type: Grant
    Filed: July 25, 2016
    Date of Patent: May 14, 2019
    Assignee: Saturn Licensing LLC
    Inventors: Junji Ooi, Yusuke Sakai, Shingo Tsurumi, Tomohiko Gotoh, Yuichi Iida, Shinichi Hayashi, Junichi Tsukamoto, Asako Tadenuma
  • Patent number: 10275584
    Abstract: A method and a system for unlocking a mobile terminal on the basis of a high-quality eyeprint image may include collecting an original image of a current user by utilizing a front-facing camera when the mobile terminal needs to be unlocked; carrying out a 1080p image cropping on the original image by means of a register configured for the front-facing camera to obtain an eye image located in a special area of the original image; carrying out an eyeprint analysis and processing on the eye image to acquire eyeprint information of the current user; making a comparison between the eyeprint information and prestored eyeprint information to judge whether the comparison result shows that they are identical or not; and unlocking the mobile terminal if it is judged that they are identical.
    Type: Grant
    Filed: December 8, 2015
    Date of Patent: April 30, 2019
    Assignee: JRD COMMUNICATION INC.
    Inventor: Xiangdong Tang
  • Patent number: 10225486
    Abstract: A camera includes: a shooting section that outputs images of an object; a moving image shooting control section that controls the shooting section to repeat shooting under predetermined shooting conditions at a predetermined frame rate; a moving image generation section that generates moving images based on images shot under the predetermined shooting conditions, respectively; an image extraction section that extracts a first image and a second image based on a predetermined condition from each of the moving images; a display section; and a display control section that performs control to simultaneously multi-display the first image and the second image of each moving image on the display section.
    Type: Grant
    Filed: February 1, 2016
    Date of Patent: March 5, 2019
    Assignee: Olympus Corporation
    Inventors: Osamu Nonaka, Masaomi Tomizawa
  • Patent number: 10205870
    Abstract: An image capturing apparatus reads out a signal from pixels of an image sensor, sets a region in which a plurality of signals having different viewpoints are read out from each pixel of the image sensor, acquires first depth information for detecting an object using a signal read out from a first signal readout region, acquires evaluation information for detecting a focus state of an object using a read signal, and controls a signal readout amount of the first signal readout region based on the focus state determined based on the evaluation information.
    Type: Grant
    Filed: April 13, 2017
    Date of Patent: February 12, 2019
    Assignee: Canon Kabushiki Kaisha
    Inventors: Kazunori Takayama, Toshihiro Mochizuki
  • Patent number: 10171737
    Abstract: An imaging device includes: a shake detection unit that holds a gyro sensor inside the shake detection unit; a first sheet metal and a second sheet metal that sandwich the shake detection unit in two facing directions; a first cushion member that abuts on the first sheet metal and faces the shake detection unit via the first sheet metal; and a second cushion member that abuts on the second sheet metal and faces the shake detection unit via the second sheet metal.
    Type: Grant
    Filed: April 25, 2017
    Date of Patent: January 1, 2019
    Assignee: Panasonic Intellectual Property Management Co., Ltd.
    Inventors: Fumitaka Kikuchi, Koji Yasuda
  • Patent number: 10122924
    Abstract: Miniature camera modules that achieve autofocus (AF) and optical image stabilization (OIS) using piston-tube electrostatic actuators are disclosed. Various embodiments of the camera modules that work on two main mechanisms are disclosed. The two mechanisms are the whole barrel motion leading to AF and OIS and the single lens motion leading to AF. The MEMS actuator is integrated within a housing which is, in turn, coupled with an image sensor module. Autofocus is achieved by a translational motion of the piston-tube electrostatic actuator to translate the whole barrel back and forth. OIS is achieved by tilting the whole barrel using the tilting action of the piston-tube actuator.
    Type: Grant
    Filed: January 23, 2017
    Date of Patent: November 6, 2018
    Inventors: Faez Ba-Tis, Ridha Ben-Mrad
  • Patent number: 10122922
    Abstract: An image pickup apparatus includes: an angular velocity sensor configured to detect image blur in translation and rotation directions; an image stabilization microcomputer; an image pickup device drive actuator configured to cause the image pickup device to move to perform optical correction of image blur in the translation direction and, when necessary, image blur in the rotation direction; a system controller configured to perform electronic correction of cutting out a part of image; and a walking detecting portion configured to detect which of a walking state and a non-walking state of the image pickup apparatus, wherein in a case of the walking state, an amount of correction of the image blur in the rotation direction is caused to be smaller by the optical correction, and is caused to be larger by the electronic correction, compared with the non-walking state.
    Type: Grant
    Filed: January 18, 2017
    Date of Patent: November 6, 2018
    Assignee: OLYMPUS CORPORATION
    Inventor: Kento Koyano
  • Patent number: 10101593
    Abstract: An optical apparatus comprises a shake detection unit, a first optical correction unit, a second optical correction unit, a zoom detection unit, a correction amount calculation unit configured to calculate correction amounts to be corrected by the first optical correction unit and the second optical correction unit, and a control unit configured to change a calculation method of the correction amounts according to whether or not zoom lens performs zoom operation, wherein the control unit controls to calculate the correction amounts by calculation of separating a frequency of the shake when the zoom operation is stopped, and to calculate the correction amounts by proportional calculation based on movable ranges of the first optical correction unit and the second optical correction unit when the zoom operation is performed.
    Type: Grant
    Filed: April 21, 2015
    Date of Patent: October 16, 2018
    Assignee: Canon Kabushiki Kaisha
    Inventor: Masahiro Shibata
  • Patent number: 10055009
    Abstract: The refresh rate of a display of a portable display device is dependent on the degree of device motion detected by one or more motion sensors included in the portable display device, according to an embodiment of the invention. In an embodiment, when no device motion is detected by the one or more sensors, the display of the portable display device is refreshed at an initial refresh rate. When the one or more motion sensors detects a degree of device motion above a motion threshold, the refresh rate of the display is decreased to a motion-based refresh rate, according to an embodiment. In an embodiment, the degree of motion of moving content on the display is also taken into account when determining the display refresh rate.
    Type: Grant
    Filed: May 30, 2014
    Date of Patent: August 21, 2018
    Assignee: Apple Inc.
    Inventors: Timothy R. Oriol, Norman N. Wang, Domenico P. Porcino, Jacques P. Gasselin de Richebourg
  • Patent number: 10043458
    Abstract: A display apparatus and a control method which displays an image based on an image signal transmitted from the outside are provided. The display apparatus includes a display which generates light in a plurality of colors and displays an image; a signal receiver which receives an image signal; a signal processor which processes the received image signal in order to display an image based on the image signal; and a controller which analyzes the image signal received by the signal receiver and obtains color reproduction feature information of the image signal, and changes each color distribution of light generated by the display to display an image in a color which corresponds to the color reproduction feature information obtained, based on the image signal.
    Type: Grant
    Filed: May 23, 2016
    Date of Patent: August 7, 2018
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Sang-un Yun, Gae-youn Kim, Sang-hoon Lee, Jun-ho Jung, Tae-young Huh
  • Patent number: 9992398
    Abstract: Optical sighting is performed using plural optical sighting apparatuses that each comprise: a camera unit and a viewing system for viewing images. Geometric calibration of the camera units with respect to the imaged scene is performed by detecting features within captured images, generating descriptors from respective patches of the image at the features; detecting corresponding descriptors from different images, and deriving the geometric calibration from the positions in the respective images of the corresponding descriptors. A target location in a designator image captured at an earlier image-capture time is designated and a corresponding location relative to the current image captured at the current time is identified from the geometric calibration. A viewing system indicates where the corresponding location lies relative to the current image.
    Type: Grant
    Filed: October 24, 2014
    Date of Patent: June 5, 2018
    Assignee: OXFORD METRICS PLC
    Inventors: Eric Sommerlade, Emmet Spier, Julian Morris
  • Patent number: 9983569
    Abstract: The invention is directed to a system and method for representing how a photograph was captured in relation to the field capture, and mapping this onto a shape in a 3D dimensional print. More specifically, a group of images, or single image captured through a lens with field of view distortion, is captured and stored together as a group. The images may be stitched together to form a single image. Once stitched together, a three-dimensional file is created and stored to the system. A server then provides the three-dimensional file to a three-dimensional printer for printing. Once printed, the three-dimensional object is packaged and mailed to the sender.
    Type: Grant
    Filed: August 22, 2016
    Date of Patent: May 29, 2018
    Assignee: Scandy, LLC
    Inventors: Charles Pierre Carriere, IV, Kaben Gabriel Nanlohy, Harold Cole Wiley
  • Patent number: 9986150
    Abstract: A system and method that calculates a yaw error in an image and provides a user interface to a user for correcting the yaw error. The method includes receiving an image, performing line detection in the image, computing a line parameterization for lines in the image, computing a yaw angle for the image and providing the yaw data calculated in the image.
    Type: Grant
    Filed: January 29, 2016
    Date of Patent: May 29, 2018
    Assignee: Ricoh Co., Ltd.
    Inventors: Daniel G Van Olst, Kathrin Berkner, Ramya Narasimha
  • Patent number: 9967463
    Abstract: A motion estimation and correction system and methods are shown comprising: an image acquisition device configured to acquire an image via scanning an image frame over a period of time, an inertial measurement unit configured to measure at least one of a position, an orientation, and a movement of the image acquisition device during the period of time and output an indication of the movement as detected; and a state estimation module, operatively coupled to the inertial measurement unit and the image acquisition device, configured to estimate a state related to at least one of position and orientation of the image acquisition device based on the at least one of the position, the orientation, and the movement. In one example, systems and methods include using an inertial measurement unit along with an image acquisition device. In one example, the image acquisition device includes a rolling-shutter camera.
    Type: Grant
    Filed: July 24, 2014
    Date of Patent: May 8, 2018
    Assignee: The Regents of The University of California
    Inventors: Anastasios Mourikis, Mingyang Li
  • Patent number: 9959674
    Abstract: Techniques for displaying navigation information on a mobile device are provided that include a method that includes obtaining an indication of a position and an indication of a direction associated with the mobile device, using the indication of the position, the indication of the direction, information regarding identities of POIs within a geographic region of interest, and information regarding areas associated with the POIs to determine at least one relevant POI, of the POIs, that is associated with the position and direction, and displaying at least one visual indication associated with each of the at least one relevant POI on the mobile device. The appearance of the at least one visual indication is dependent on at least one of a distance from the mobile device of the relevant POI associated with the visual indication or presence of a known physical barrier between the mobile device and that relevant POI.
    Type: Grant
    Filed: February 26, 2013
    Date of Patent: May 1, 2018
    Assignee: QUALCOMM Incorporated
    Inventors: Jiajian Chen, Hui Chao
  • Patent number: 9955092
    Abstract: Disclosed is an image sensor in which a redundant member is appropriately provided, and an image capture apparatus using this image sensor. The image sensor has a memory that performs A/D conversion on a read pixel signal and holds this signal. The memory includes a first memory unit for holding a first pixel signal in pixel signals, and a second memory unit for holding a second pixel signal. Larger redundant storage capacity is provided in the first memory than in the second memory.
    Type: Grant
    Filed: October 6, 2016
    Date of Patent: April 24, 2018
    Assignee: Canon Kabushiki Kaisha
    Inventors: Makiko Saito, Nobuhiro Takeda
  • Patent number: 9898803
    Abstract: An image processing apparatus including: an image obtaining unit that obtains low-resolution (LR) images acquired in time series; a position alignment unit that aligns the LR images on the basis of a movement between the LR images to generate a high-resolution (HR) image; a correlation calculating unit that calculates correlation information between areas of the LR images, the areas corresponding to partial area in the HR image; a compositing-ratio calculating unit that calculates, for each partial area, a ratio between the HR image and an image to be composited which is generated from the LR or HR images and has a lower resolution than the HR image, such that the proportion of the HR image becomes smaller as the correlation of the area decreases; and an image compositing unit that composites the HR image and the image to be composited according to the ratio.
    Type: Grant
    Filed: October 4, 2016
    Date of Patent: February 20, 2018
    Assignee: OLYMPUS CORPORATION
    Inventor: Kosuke Kajimura
  • Patent number: 9875424
    Abstract: A method for determining correspondences between a first and a second image, comprising the steps providing a first image and a second image of the real environment, defining a warping function between the first and second image, determining the parameters of the warping function between the first image and the second image by means of an image registration method, determining a third image by applying the warping function with the determined parameters to the first image, determining a matching result by matching the third image and the second image, and determining correspondences between the first and the second image using the matching result and the warping function with the determined parameters. The method may be used in a keyframe based method for determining the pose of a camera based on the determined correspondences.
    Type: Grant
    Filed: January 11, 2016
    Date of Patent: January 23, 2018
    Assignee: Apple Inc.
    Inventors: Selim Benhimane, Daniel Ulbricht
  • Patent number: 9819870
    Abstract: A photographing method is provided. The photographing method includes photographing, by an electronic device, a plurality of images through a photographing module functionally connected to the electronic device, providing a photographing guide associated with a validity of at least one photographed image during the photographing of the plurality of images, and generating a single image using the at least one photographed image.
    Type: Grant
    Filed: August 27, 2015
    Date of Patent: November 14, 2017
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Jae-Sik Sohn, Ki-Huk Lee, Sang-Hyeon Yoo
  • Patent number: 9811946
    Abstract: A hybrid-resolution panoramic VR generator places High-Resolution (HR) patches from a ring of HR cameras onto a 360-degree Low-Resolution (LR) image from a LR camera pointing upward from the ring into a panoramic mirror that captures the combined field of view of all the multiple HR cameras, but at a lower resolution. Ghosting artifacts caused by parallax errors between adjacent HR cameras are eliminated because object placement is determined by the 360-degree LR image. Each HR image is homographicly projected into 3 projections by grouping objects of different depths to obtain homographic matrixes. The 360-degree LR image is upscaled to HR and a query patch is searched in search windows in the three projections for up to two adjacent HR images. Best-matching patches are weighted by similarity with the query patch and blended to generate a reconstructed patch placed at the query patch location in a reconstructed HR panorama image.
    Type: Grant
    Filed: May 30, 2016
    Date of Patent: November 7, 2017
    Assignee: Hong Kong Applied Science and Technology Research Institute Company, Limited
    Inventors: Kwok Wai Hung, Luhong Liang, Xuejiao Liu
  • Patent number: 9781333
    Abstract: A phase difference AF processing unit of a digital camera including an imaging element that captures an image of an object through a lens device including an APD filter and includes a pair of phase difference detection pixels calculates a parameter related to a ratio of a phase difference between detection signals detected by each of the phase difference detection pixels to an amount of defocus based on the incident angle range of light on the pair of phase difference detection pixels through the lens device, the transmittance of a region of the APD filter through which light in the incident angle range passes, and a light reception sensitivity distribution indicating the light reception sensitivity of each of the phase difference detection pixels for each incident angle of light and calculates the amount of defocus using the parameter and the phase difference.
    Type: Grant
    Filed: March 10, 2017
    Date of Patent: October 3, 2017
    Assignee: FUJIFILM Corporation
    Inventor: Takashi Aoki
  • Patent number: 9781346
    Abstract: The image capturing control apparatus to control an image capturing apparatus that performs still image capturing of a moving object with drive of a movable element movable in a direction other than an optical axis direction of an image capturing optical system. The control apparatus includes a vector acquisition unit to acquire multiple motion vectors respectively detected in multiple object areas of a captured moving image produced by the image capturing apparatus, and a control unit to control the still image capturing with a drive control of the movable element. The control unit causes the image capturing apparatus, when the multiple motion vectors have mutually different magnitudes, to perform the still image capturing multiple times with the drive controls of the movable element while changing a drive amount of the movable element on the basis of the respective multiple motion vectors.
    Type: Grant
    Filed: June 7, 2016
    Date of Patent: October 3, 2017
    Assignee: Canon Kabushiki Kaisha
    Inventor: Tomonari Abe
  • Patent number: 9774803
    Abstract: At least one example embodiment discloses a method of generating an image using a global shutter image sensor. The method includes accumulating a first plurality of charges during a first exposure time from a first plurality of pixels, accumulating a second plurality of charges during a plurality of second exposure times from a second plurality of pixels, the plurality of second exposure times occurring during the first exposure time and being shorter than the first exposure time and generating the image based on the first plurality of charges and the second plurality of charges.
    Type: Grant
    Filed: February 18, 2016
    Date of Patent: September 26, 2017
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Mickey Bahar, Uzi Hizi
  • Patent number: 9761010
    Abstract: A tracking apparatus includes a grouping setting unit, a tracking feature detection unit, a tracking unit. The grouping setting unit groups a plurality of focus detection areas with an in-focus state. The tracking feature detection unit detects a feature amount of the tracking target in areas of the groups grouped. The tracking unit tracks the tracking target in accordance with a first or second tracking position depending on the number of the set groups.
    Type: Grant
    Filed: March 11, 2016
    Date of Patent: September 12, 2017
    Assignee: OLYMPUS CORPORATION
    Inventor: Hisashi Yoneyama
  • Patent number: 9749538
    Abstract: An imaging apparatus includes an image stabilizing unit, a position signal processing unit, and a position signal processing control unit. The image stabilizing unit includes a movable portion, a motor, and a position detector. The position signal processing unit converts an analog signal output from the position detector into position information. The position signal processing control unit applies first settings or second settings to the position signal processing unit. The position signal processing control unit applies the second settings based on an output obtained when the position signal processing unit is applied with the first settings.
    Type: Grant
    Filed: May 23, 2016
    Date of Patent: August 29, 2017
    Assignee: OLYMPUS CORPORATION
    Inventor: Takashi Ishikawa
  • Patent number: 9747664
    Abstract: An image processing apparatus includes: an image processor which: receives a captured-image from an image acquisition part acquiring the captured-image from a camera that captures an image of a vicinity of a vehicle; project data of the captured-image onto a virtual projection plane provided in the vicinity of the vehicle; and correct deformation of the captured-image caused by projection of the captured-image onto the virtual projection plane. In a case of presence of a command indicative of enlarging a portion of the captured-image, the image processor corrects the deformation of the captured-image by using a greater correction amount than that used in a case of absence of the input of the command indicative of enlarging the portion of the captured-image. Accordingly, in a case where a portion of an image of a vicinity of a vehicle is enlarged, deterioration of image quality can be suppressed as much as possible.
    Type: Grant
    Filed: August 4, 2015
    Date of Patent: August 29, 2017
    Assignee: FUJITSU TEN LIMITED
    Inventors: Naoshi Kakita, Atsushi Mino, Takayuki Ozasa
  • Patent number: 9699381
    Abstract: A digital photographing system may include a lens unit detecting an image of a subject, and a first processor performing an image compensation data generation process and an optical compensation process in parallel. The optical compensation process may be a process of selectively controlling a movement of the lens unit based on motion data corresponding to a motion of a camera module. The image compensation data generation process may be a process of generating image compensation data corresponding to the image.
    Type: Grant
    Filed: February 16, 2015
    Date of Patent: July 4, 2017
    Assignee: Samsung Electro-Mechanics Co., Ltd.
    Inventors: Sang Do Cho, Peter Jean Woo Lim
  • Patent number: 9635261
    Abstract: An easy-to-use online video stabilization system and methods for its use are described. Videos are stabilized after capture, and therefore the stabilization works on all forms of video footage including both legacy video and freshly captured video. In one implementation, the video stabilization system is fully automatic, requiring no input or parameter settings by the user other than the video itself. The video stabilization system uses a cascaded motion model to choose the correction that is applied to different frames of a video. In various implementations, the video stabilization system is capable of detecting and correcting high frequency jitter artifacts, low frequency shake artifacts, rolling shutter artifacts, significant foreground motion, poor lighting, scene cuts, and both long and short videos.
    Type: Grant
    Filed: May 9, 2016
    Date of Patent: April 25, 2017
    Assignee: Google Inc.
    Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
  • Patent number: 9609355
    Abstract: An image processing apparatus that is capable of improving image stabilization performance by improving motion vector search performance by restricting a search range even for an image with a large motion due to a camera shake of an image pickup apparatus at a tele-end side of a zoom lens or a shoot while walking at a wide-end side. A motion vector search unit searches for a motion vector of a reference image later input from an image pickup device with respect to a standard image input previously. A control unit sets at least one of a search range and a search position of a motion vector searched by the motion vector search unit based on position-posture change information about the image pickup apparatus detected by a detection unit and image stabilization control information obtained from an image stabilizing unit.
    Type: Grant
    Filed: August 20, 2015
    Date of Patent: March 28, 2017
    Assignee: Canon Kabushiki Kaisha
    Inventor: Hidetoshi Tsubaki
  • Patent number: 9565362
    Abstract: An imaging apparatus includes an image capturing unit including an image sensor capable of photoelectrically converting a subject image and configured to generate moving image data based on an output signal of the image sensor, a storage unit configured to store foreign substance information including information relating to at least a position and a size of a foreign substance adhered to an optical element disposed on a front side of the image sensor, a detection unit configured to detect a shake amount of the image sensor, a control unit configured to control an image clipping position on an entire screen of the image sensor according to the shake amount of the image sensor detected by the detection unit, and a recording unit configured to record the foreign substance information and information indicating the image clipping position in association with the moving image data.
    Type: Grant
    Filed: October 18, 2012
    Date of Patent: February 7, 2017
    Assignee: Canon Kabushiki Kaisha
    Inventor: Keisuke Kudo
  • Patent number: 9560277
    Abstract: An image processing apparatus performs distortion aberration correction appropriate for each of the cases where the image processing apparatus clips image data by performing electronic image stabilization and does not clip the image data by performing the electronic image stabilization. The image processing apparatus includes a correction unit configured to perform the distortion aberration correction on image data in which distortion aberration has, and a stabilization unit configured to perform clipping from the image data based on a movement of an imaging unit when the image data has been generated. The correction unit reduces an amount of the distortion aberration correction in a case where the stabilization unit does not clip the image data, as compared to a case where the stabilization unit clips the image data.
    Type: Grant
    Filed: April 9, 2014
    Date of Patent: January 31, 2017
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Hidetoshi Nishigori