Focus Measuring Or Adjusting (e.g., Deblurring) Patents (Class 382/255)
  • Patent number: 11184541
    Abstract: An imaging device is provided that can correct more accurately an image shake. The imaging device includes an imaging element taking an object image to generate image data, a gyro sensor unit including a gyro sensor, an image-shake correction unit holding the imaging element, moving the imaging element based on an output of the gyro sensor, and correcting a shake of an object image taken by the imaging element, and a mount base holding the gyro sensor unit and the image-shake correction unit.
    Type: Grant
    Filed: February 13, 2019
    Date of Patent: November 23, 2021
    Assignee: Panasonic Intellectual Property Management Co., Ltd.
    Inventors: Shunsuke Itaya, Rikiya Ejima
  • Patent number: 11145034
    Abstract: A method of deblurring an observed image acquired by an image sensor in order to determine an observable image corresponding to the deblurred observed image. The observable image and the observed image each are formed by a set of pixels defined by at least one numerical value. The method involves expressing the observable image as a solution minimizing a Tikhonov functional defined by the observed image, applying a spreading function at the point of the image sensor and applying a wavelet transform operator. The Tikhonov functional is expressed as a sum of at least two terms. The method further involves determining the observable image by implementing an iterative projection algorithm released on a closed convex, at each iteration of which, the successive application of a projection operator associated with each of the terms of the Tikhonov functional.
    Type: Grant
    Filed: November 19, 2019
    Date of Patent: October 12, 2021
    Assignee: IDEMIA IDENTITY & SECURITY FRANCE
    Inventor: Aldo Maalouf
  • Patent number: 11126896
    Abstract: A method of sampling and decoding of a signal of interest x comprising, at a training stage: acquiring a set of training signals {xi}i=1M, providing a sampling operator P? and a decoder g?g(.), training operator P? on signals {xi}i=1M to obtain a learned sampling operator P{circumflex over (?)}; and, at a sampling stage: applying P{circumflex over (?)} in a transform domain ? to signal x, resulting in observation signal y; applying the decoder g?g(.) to y, to produce an estimate {circumflex over (x)} of signal x to decode and/or, decide about, the signal. Decoder g?g(.) is trained jointly with P? on signals {xi}i=1M, to obtain a learned decoder g{circumflex over (?)}g, by jointly determining, during a cost minimization step, sampling parameters ? and decoding parameters ?g according to a cost function, and wherein the step of applying the decoder g?g(.) uses decoding parameters ?g, such that estimate {circumflex over (x)} is produced by the learned decoder g{circumflex over (?)}g.
    Type: Grant
    Filed: August 21, 2019
    Date of Patent: September 21, 2021
    Assignee: Université de Genève
    Inventors: Sviatoslav Voloshynovskiy, Olga Taran, Taras Holotyak, Martino Ferrari, Karen Eguiazarian
  • Patent number: 11106708
    Abstract: System and method of partitioning a plurality of data objects that are each represented by a respective high dimensional feature vector is described, including performing a hashing function on each high dimensional feature vector to generate a respective lower dimensional binary compact feature vector for the data object that is represented by the high dimensional feature vector; performing a further hashing function on each compact feature vector to assign a sub-index ID to the compact feature vector; and partitioning the compact feature vectors into respective partition groups that correspond to the sub-index IDs assigned to the compact feature vectors.
    Type: Grant
    Filed: July 24, 2018
    Date of Patent: August 31, 2021
    Assignee: HUAWEI TECHNOLOGIES CANADA CO., LTD.
    Inventors: Yangdi Lu, Wenbo He, Amirhosein Nabatchian
  • Patent number: 11080301
    Abstract: Storage allocation based on secure data comparisons is disclosed. One example is a system including a plurality of intermediaries, a data allocator and a plurality of storage containers. Each intermediary receives a request from the data allocator to identify a target storage container of the plurality of storage containers, for secure allocation of a data term. Each intermediary compares, for each storage container, the truncated data term with a collection of truncated candidate terms to select a representative term of the candidate terms, identifies the selected representative term to the storage container, receives a similarity profile from each storage container, where the similarity profile is representative of similarities between the truncated data term and terms in the storage container, and selects a candidate target storage container based on similarity profiles received from each storage container.
    Type: Grant
    Filed: September 28, 2016
    Date of Patent: August 3, 2021
    Assignee: Hewlett Packard Enterprise Development LP
    Inventors: Mehran Kafai, Manav Das
  • Patent number: 11080819
    Abstract: An image processing system receives an input depth image with a surface that is not developable and generates an output depth image with a piecewise developable surface that approximates the input depth image. Height values for the output depth image are determined using an optimization problem that balances data fidelity and developability. Data fidelity is based on minimizing differences in height values of pixels in the output depth image and height values of pixels in the input depth image. Developability is based on rank minimization of Hessians computed for pixels in the output depth image. In some configurations, the optimization problem is formulated as a semi-definite programming problem and solved using a tailor-made alternating direction method of multipliers algorithm.
    Type: Grant
    Filed: July 8, 2020
    Date of Patent: August 3, 2021
    Assignee: ADOBE INC.
    Inventors: Noam Aigerman, Alec Jacobson, Silvia Gonzalez Sellan
  • Patent number: 11064182
    Abstract: An imaging apparatus includes a large imaging section, a plurality of small imaging sections, and an image processing section. The plurality of small imaging sections are smaller in optical size than the large imaging section. The large imaging section captures an image of a subject outside the imaging apparatus. The plurality of small imaging sections are provided at positions around the large imaging section to capture images of the subject. The image processing section generates data to be output on the basis of the image captured by the large imaging section and the images captured by the plurality of small imaging sections.
    Type: Grant
    Filed: September 7, 2018
    Date of Patent: July 13, 2021
    Assignee: Sony Interactive Entertainment Inc.
    Inventor: Masashi Nakata
  • Patent number: 11039022
    Abstract: A device and algorithm for allowing a customer to choose a photo book cover template that is compatible with a photo having faces. The photo is compared with a set of templates arranged in a first order to determine how compatible the photo is to each of the templates, and a score indicative of compatibility is assigned. A re-sorted set of compatible templates combined with the photo is presented to the customer for consideration.
    Type: Grant
    Filed: June 23, 2020
    Date of Patent: June 15, 2021
    Assignee: PlanetArt LLC
    Inventors: Adam Black, Erik Malkemus, Roger Bloxberg, Zhang Ming Jun, Fan Xiang, Wang Ping
  • Patent number: 11039146
    Abstract: A method is presented for detecting visual artifacts such as macroblocking artifacts appearing in a rendering of a video stream. A decoded video stream that includes a plurality of frames is received. Edges appearing in the plurality of frames are detected and data characterizing the edges is directed to a neural network. The neural network determines a likelihood that a macroblocking artifact occurs in the video stream using the neural network. The neural network is trained using training data that includes (i) one or more video sequences having known macroblocking artifacts whose size and duration are known and (ii) user ratings indicating a likelihood that users visually perceived macroblocking in each of the one or more video sequences when each of the one or more video sequences are rendered.
    Type: Grant
    Filed: March 1, 2018
    Date of Patent: June 15, 2021
    Assignee: ARRIS Enterprises LLC
    Inventors: Gautam Babbar, Wayne D Woodruff
  • Patent number: 10991081
    Abstract: This application discloses a technology for flattening a photographed page of a book and straightening texts therein. The technology uses one or more mathematical models to represent a curved shape of the photographed page with certain parameters. The technology also uses one or more photographic image processing techniques to dewarp the photographed page using the parameters of the curved shape. The technology uses one or more additional parameters that represent certain features of the photographed page to dewarp the photographed page.
    Type: Grant
    Filed: December 31, 2020
    Date of Patent: April 27, 2021
    Assignee: VoyagerX, Inc.
    Inventors: Moogung Kim, Kunwoo Park, Eunsung Han, Sedong Nam
  • Patent number: 10984507
    Abstract: An image processing system may include a processor and an associated memory configured to store training data that includes training geospatial images. The processor may be configured to blur each of the training geospatial images. The processor may also be configured to iteratively operate a training model to identify a given feature from each of the blurred training geospatial images so that the blurring is reduced with each iteration.
    Type: Grant
    Filed: July 17, 2019
    Date of Patent: April 20, 2021
    Assignee: HARRIS GEOSPATIAL SOLUTIONS, INC.
    Inventors: Michael P. Deskevich, Robert A. Simon, Christopher R. Lees
  • Patent number: 10984045
    Abstract: An approach is provided in which a system transforms a set of embedding approximation values corresponding to a set of knowledge graph nodes into a set of binary valued embedding vectors. The system evaluates the set of binary valued embedding vectors against a query and a selects one of the binary valued embedding vectors based on the evaluation. The system then identifies one of the knowledge graph nodes that corresponds to the selected binary valued embedding vector and in turn, provides a result to the query based on the identified knowledge graph node.
    Type: Grant
    Filed: May 24, 2017
    Date of Patent: April 20, 2021
    Assignee: International Business Machines Corporation
    Inventors: Sumit Bhatia, Vinith Misra
  • Patent number: 10977310
    Abstract: An approach is provided in which a system transforms a set of embedding approximation values corresponding to a set of knowledge graph nodes into a set of binary valued embedding vectors. The system evaluates the set of binary valued embedding vectors against a query and a selects one of the binary valued embedding vectors based on the evaluation. The system then identifies one of the knowledge graph nodes that corresponds to the selected binary valued embedding vector and in turn, provides a result to the query based on the identified knowledge graph node.
    Type: Grant
    Filed: October 25, 2017
    Date of Patent: April 13, 2021
    Assignee: International Business Machines Corporation
    Inventors: Sumit Bhatia, Vinith Misra
  • Patent number: 10958894
    Abstract: An embodiment of the disclosure discloses an electronic device including at least one camera module to capture an image based on a specified angle of view, a display to display the image, a processor electrically connected with the camera module and the display. The processor detects a plurality of objects in the image, and performs setting of image data associated with at least one object of the plurality of objects such that a region, which corresponds to the at least one object, in a screen region of the display has a specified light transmittance value. Moreover, various embodiment found through the disclosure are possible.
    Type: Grant
    Filed: November 17, 2017
    Date of Patent: March 23, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Song Yi Lee, Young Mi Shin, Jin Soo Ha, Jang Woon Kim, Hyun Keun Son, Joo Hyung Lee
  • Patent number: 10896549
    Abstract: A system configured to provide a three-dimensional representation of a physical environment. The three-dimensional representation including annotation data associated with particular objects and/or viewpoints of the three-dimensional representation. In some cases, the viewpoints may be rendered using image data associated with a photograph captured from a corresponding viewpoint within the physical environment.
    Type: Grant
    Filed: November 19, 2018
    Date of Patent: January 19, 2021
    Assignee: Occipital, Inc.
    Inventors: Jeffrey Powers, Vikas Reddy, Alex Schiff
  • Patent number: 10891720
    Abstract: A method to denoise low dose CT images without introducing blurriness is shown using cross directional bilateral filtering. Techniques are provided that (1) enhance low-radiation dosage images, beyond just reducing noise, and (2) may be combined with other approaches, such as adaptive exposure techniques and iterative reconstruction, for radiation dose reduction.
    Type: Grant
    Filed: April 3, 2019
    Date of Patent: January 12, 2021
    Assignee: AlgoMedica, Inc.
    Inventor: Ichikawa Katsuhiro
  • Patent number: 10878070
    Abstract: A method for controlling a terminal is provided. The terminal includes a capturing apparatus and at least one processor. An image is acquired by the capturing apparatus. A motion parameter of the terminal is obtained. Image processing on the acquired image is controlled to be performed based on the motion parameter being equal to or less than a preset parameter threshold, and skipped based on the motion parameter being greater than the preset parameter threshold.
    Type: Grant
    Filed: June 25, 2018
    Date of Patent: December 29, 2020
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Lina Yuan, Luyi Lin, Yifeng Li, Liang Wang
  • Patent number: 10868953
    Abstract: An image processing device is provided that includes: an acquisition unit that acquires a plurality of viewpoint images which are captured at a plurality of different viewpoints by an imaging unit; a detection unit that detects viewpoint-relevant information between the plurality of viewpoint images; a determination unit that determines a second imaging condition in which image change between before and after predetermined image processing is greater than that in a first imaging condition in which the plurality of viewpoint images are captured on the basis of the first imaging condition and the viewpoint-relevant information; and an output unit that outputs the second imaging condition determined by the determination unit.
    Type: Grant
    Filed: October 3, 2018
    Date of Patent: December 15, 2020
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Akihiko Kanda, Yoshihito Tamaki, Hideyuki Hamano
  • Patent number: 10861166
    Abstract: A method for restoring images in a sequence of images, including, when it is applied to a first image in the image sequence: estimating an item of information representing a global motion of a background of the first image with respect to a second image; compensating for said global motion of the background in the second image in order to obtain an adjusted version of the second image, referred to as the adjusted second image; obtaining a contour of an object of the first image by applying a segmentation method using the adjusted second image; using the contour of the object thus obtained in order to estimate an item of information representing a global motion of the object; and applying to the first image an image restoration method using the information representing the estimated global motion of the background and the estimated global motion of the object.
    Type: Grant
    Filed: October 24, 2018
    Date of Patent: December 8, 2020
    Assignee: SAFRAN ELECTRONICS & DEFENSE
    Inventors: Anum Riaz, Arnaud Woiselle, Joël Budin
  • Patent number: 10857036
    Abstract: The disclosure features systems and methods for providing information to a user about the user's environment. The systems feature a detection apparatus configured to obtain image information about the environment, where the image information corresponds to information at multiple distances relative to a position of the user within the environment, and an electronic processor configured to obtain focal plane distance information defining a set of one or more distance values relative to the position of the user within the environment, construct one or more confocal images of the environment from the image information and the set of one or more distance values, wherein each of the one or more confocal images corresponds to a different distance value and includes a set of pixels, and transform the one or more confocal images to form one or more representative images having fewer pixels and a lower dynamic range.
    Type: Grant
    Filed: November 8, 2018
    Date of Patent: December 8, 2020
    Assignee: The Schepens Eye Research Institute, Inc.
    Inventors: Eliezer Peli, Jae-Hyun Jung
  • Patent number: 10855903
    Abstract: In an image processing apparatus of the present invention, multiple subjects are selected in an image signal, and subject distances for focusing on each of the selected subjects are specified. A subject distance range defined by the specified subject distances is then set. Then, based on the image signal, the image processing apparatus generates a reconstructed image that is focused on each of the subjects that are to be focused on in the set subject distance range.
    Type: Grant
    Filed: March 7, 2017
    Date of Patent: December 1, 2020
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Satoshi Yamada
  • Patent number: 10810707
    Abstract: Techniques of generating depth-of-field blur effects on digital images by digital effect generation system of a computing device are described. The digital effect generation system is configured to generate depth-of-field blur effects on objects based on focal depth value that defines a depth plane in the digital image and a aperture value that defines an intensity of blur effect applied to the digital image. The digital effect generation system is also configured to improve the accuracy with which depth-of-field blur effects are generated by performing up-sampling operations and implementing a unique focal loss algorithm that minimizes the focal loss within digital images effectively.
    Type: Grant
    Filed: November 29, 2018
    Date of Patent: October 20, 2020
    Assignee: Adobe Inc.
    Inventors: Jianming Zhang, Zhe Lin, Xiaohui Shen, Oliver Wang, Lijun Wang
  • Patent number: 10796417
    Abstract: A system and method for improving a video characteristic of a video stream is described. According to various implementations of the invention, a changed region between a later-in-time image frame and an earlier-in-time image frame and an unchanged region between such two image frames are determined. A new improvement to the video characteristic is determined and applied to the changed region of the later-in-time image frame. A prior improvement to the video characteristic that was determined for the earlier-in-time image frame is applied to the unchanged region of the later-in-time image frame.
    Type: Grant
    Filed: April 9, 2018
    Date of Patent: October 6, 2020
    Assignee: StereoVision Imaging, Inc.
    Inventors: Randall J. St. Romain, II, Ambrose J. Slone, Péter L. Venetianer
  • Patent number: 10769799
    Abstract: A computing system can receive an image including foreground pixels. The foreground pixels can be determined based on determining eccentricity ?k based on a sequence of images acquired by a stationary sensor. The vehicle can determine moving objects in the image based on the foreground pixels. The vehicle can be operated based on the moving objects in the image.
    Type: Grant
    Filed: August 24, 2018
    Date of Patent: September 8, 2020
    Assignee: Ford Global Technologies, LLC
    Inventors: Bruno Sielly Jales Costa, Enrique Corona, Gintaras Vincent Puskorius, Dimitar Petrov Filev
  • Patent number: 10757318
    Abstract: A method for determining a local contrast value for a digital image captured by an image sensor in a camera comprising: applying an edge detection algorithm to image data of the digital image, thereby obtaining a data set pertaining to edges in the digital image; calculating, based on said data set, an edge occurrence value for the digital image; estimating, based on image data of the digital image and a noise model of the image sensor, an estimated image sensor noise for the digital image; and computing the local contrast value as a relationship between the edge occurrence value of the digital image and the expected edge occurrence value for the digital image. A method for adjusting a focus setting of a camera using the local contrast value for images captured by the camera.
    Type: Grant
    Filed: December 14, 2018
    Date of Patent: August 25, 2020
    Assignee: Axis AB
    Inventors: Dennis Nilsson, Björn Benderius, Johan Jeppsson, Johan Nyström
  • Patent number: 10752158
    Abstract: A pulsed laser may illuminate a scene that is obscured by dense, dynamic and heterogeneous fog. Light may reflect back to a time-resolved camera. Each pixel of the camera may detect a single photon during each frame. The imaging system may accurately determine reflectance and depth of the fog-obscured target, without any calibration or prior knowledge of the scene depth. The imaging system may perform a probabilistic algorithm that exploits the fact that times of arrival of photons reflected from fog have a Gamma distribution that is different than the Gaussian distribution of times of arrival of photons reflected from the target. The probabilistic algorithm may take into account times of arrival of all types of measured photons, including scattered and un-scattered photons.
    Type: Grant
    Filed: February 7, 2019
    Date of Patent: August 25, 2020
    Assignee: Massachusetts Institute of Technology
    Inventors: Guy Satat, Matthew Tancik, Ramesh Raskar
  • Patent number: 10719916
    Abstract: An electronic device may include noise statistics circuitry to receive input image data corresponding to an image displayable on an electronic display. The input image data may include one or more channels of pixel data. The noise statistics circuitry may also determine a subset of pixel data of a channel of pixel data that qualifies for statistics gathering according to qualification criteria. Additionally, the noise statistics circuitry may determine noise statistics based on the subset of pixel data, and identify image features within the subset of pixel data based on the noise statistics. The image features may include frequency signatures, differentiated from noise, that correspond to features of content of the image. The electronic device may also include enhancement circuitry to enhance the input image data based on the noise statistics and the identified image features. Such enhancement circuitry may substantially preserve the image features within the input image data.
    Type: Grant
    Filed: August 2, 2018
    Date of Patent: July 21, 2020
    Assignee: Apple Inc.
    Inventors: Haiyan He, Jim C. Chou
  • Patent number: 10694050
    Abstract: A device and algorithm for allowing a customer to choose a photo book cover template that is compatible with a photo having faces. The photo is compared with a set of templates arranged in a first order to determine how compatible the photo is to each of the templates, and a score indicative of compatibility is assigned. A re-sorted set of compatible templates combined with the photo is presented to the customer for consideration.
    Type: Grant
    Filed: December 12, 2019
    Date of Patent: June 23, 2020
    Assignee: PLANET ART, LLC
    Inventors: Adam Black, Erik Malkemus, Roger Bloxberg, Zhang Ming Jun, Fan Xiang, Wang Ping
  • Patent number: 10694093
    Abstract: There is provided an image processing apparatus. A focal position determining unit determines, for each of a plurality of captured image data, a focal position in a depth direction at a target position. The focal position determining unit determines a position at which a subject at the target position is in focus as the focal position if a first focus mode has been selected by a selecting unit, and determines the focal position for each of the plurality of captured image data such that the focal positions track a position at which a subject at the target position is in focus at a speed that is less than or equal to a threshold value, in an order of generation of the plurality of captured image data, if a second focus mode has been selected by the selecting unit.
    Type: Grant
    Filed: July 20, 2018
    Date of Patent: June 23, 2020
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Tatsushi Katayama
  • Patent number: 10681275
    Abstract: A digital photographing method and apparatus include determining a motion vector of an object in a preview image, determining whether the motion vector meets a predetermined condition and, when it does, generating an image capturing signal to photograph a scene desired by a user.
    Type: Grant
    Filed: October 14, 2015
    Date of Patent: June 9, 2020
    Assignee: Samsung Electronics Co., Ltd.
    Inventor: Seung-yun Lee
  • Patent number: 10681286
    Abstract: An image processing apparatus includes: a memory configured to acquire a plurality of visual point images; a visual point change processing unit configured to perform image processing on image data based on the plurality of visual point images to generate a combination image; an area designation unit configured to designate an area subjected to the image processing using the visual point change processing unit; and an adjustment unit configured to set an adjustable range of the image processing for each area designated by the area designation unit.
    Type: Grant
    Filed: January 24, 2018
    Date of Patent: June 9, 2020
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Akihiko Kanda, Koichi Fukuda, Yuki Yoshimura
  • Patent number: 10677949
    Abstract: An anisotropic filtering method for deblurring complex seismic images from seismic data acquired from anisotropic earth formation. The algorithm is tested using synthetic data. Results demonstrate its effectiveness.
    Type: Grant
    Filed: January 5, 2018
    Date of Patent: June 9, 2020
    Assignee: China Petroleum & Chemical Corporation
    Inventor: Jianhua Yu
  • Patent number: 10650269
    Abstract: Systems and methods for detecting image anomalies include extracting one or more detected images from a submission file received from at least one computing device and generating an image identification (ID) for each of the one or more images. One or more image quality indices are determined for the submission file based on at least one of predetermined image features, an image type of the one or more images, and submission file attributes, and one or more image anomalies associated with the one or more images of the submission file are detected based on at least one of the image ID and the one or more image quality indices.
    Type: Grant
    Filed: May 13, 2019
    Date of Patent: May 12, 2020
    Assignee: FEDERAL HOME LOAN MORTGAGE CORPORATION
    Inventors: Wenhua Liu, Ming Xiong
  • Patent number: 10652955
    Abstract: Embodiments described herein provide for a distributed antenna system (DAS) including a host unit and a plurality of active antenna units (AAUs). The host unit is configured to send management information to the one or more RAN nodes. The one or more RAN nodes are configured to manage the RF signals based on the management information.
    Type: Grant
    Filed: May 21, 2018
    Date of Patent: May 12, 2020
    Assignee: CommScope Technologies LLC
    Inventors: Lance K. Uyehara, Boris Golubovic
  • Patent number: 10643310
    Abstract: An image processing apparatus capable of acquiring images with high visibility is provided. A system control circuit of an image processing apparatus acquires the turning speed of the image capturing device capable of being turned, determines a first intensity as the intensity of noise reduction processing when the turning speed is higher than a speed in a predetermined speed range, and determines a second intensity lower than the first intensity as the intensity of the noise reduction processing when the turning speed is within the predetermined speed range. An image processing circuit of the image processing apparatus performs the noise reduction processing on an image of a target frame, which is one of a plurality of images of frames captured by the image capturing device, at the determined intensity, based on the image of the target frame and an image of a frame preceding the target frame.
    Type: Grant
    Filed: February 23, 2018
    Date of Patent: May 5, 2020
    Assignee: Canon Kabushiki Kaisha
    Inventor: Shingo Hirayama
  • Patent number: 10616481
    Abstract: An image combining device, comprising a memory that stores a plurality of images for different focus positions, and focus positions when the plurality of images were acquired, a plurality of image processing circuits that combine the plurality of images for different focus positions to generate a combined image, and a processor that sets assignment for distributing the plurality of images for different focus positions to the plurality of image processing circuits, wherein the processor makes images for at least one focus position, among the plurality of images for different focus positions, a plural distribution image and distributes this plural distribution image to the plurality of image processing circuits, and sets assignment so that images other than the plural distribution image are distributed to any one of the plurality of image processing circuits.
    Type: Grant
    Filed: December 5, 2018
    Date of Patent: April 7, 2020
    Assignee: Olympus Corporation
    Inventor: Takuya Matsunaga
  • Patent number: 10616467
    Abstract: An imaging device including a pixel matrix and a processor is provided. The pixel matrix includes a plurality of phase detection pixels and a plurality of regular pixels. The processor performs autofocusing according to pixel data of the phase detection pixels, and determines an operating resolution of the regular pixels according to autofocused pixel data of the phase detection pixels, wherein the phase detection pixels are always-on pixels and the regular pixels are selectively turned on after the autofocusing is accomplished.
    Type: Grant
    Filed: October 30, 2018
    Date of Patent: April 7, 2020
    Assignee: PIXART IMAGING INC.
    Inventors: Guo-Zhen Wang, Ren-Hau Gu, En-Feng Hsu
  • Patent number: 10582120
    Abstract: Systems, methods, and media for providing interactive refocusing are provided, the systems comprising: a lens; an image sensor; and a processor that: causes the image sensor to capture a plurality of images over a predetermined period of time, wherein each of the plurality of images represents a scene at a different point in time; changes a depth of field between at least a pair of the plurality of images; concatenates the plurality of images to create a duration focal volume in the order in which the images were captured; computes a space-time in-focus image that represents in-focus portions from each of the plurality of images based on the duration focal volume; and computes a space-time index map that identifies an in-focus image for each location of the scene from among the plurality of images based on the duration focal volume and the space-time in-focus image.
    Type: Grant
    Filed: December 14, 2018
    Date of Patent: March 3, 2020
    Assignee: The Trustees of Columbia University in the City of New York
    Inventors: Shree K. Nayar, Daniel Miau, Changyin Zhou
  • Patent number: 10554904
    Abstract: An imaging apparatus and method enables an automated extended depth of field capability that automates and simplifies the process of creating extended depth of field images. An embodiment automates the acquisition of an image “stack” or sequence and stores metadata at the time of image acquisition that facilitates production of a composite image having an extended depth of field from at least a portion of the images in the acquired sequence. An embodiment allows a user to specify, either at the time of image capture or at the time the composite image is created, a range of distances that the user wishes to have in focus within the composite image. An embodiment provides an on-board capability to produce a composite, extended depth of field image from the image stack. One embodiment allows the user to import the image stack into an image-processing software application that produces the composite image.
    Type: Grant
    Filed: November 29, 2018
    Date of Patent: February 4, 2020
    Assignee: Applied Minds, LLC
    Inventor: Bran Ferren
  • Patent number: 10540735
    Abstract: An information processing device acquiring to the present invention includes: a CPU; and a memory storing a program, wherein the CPU, by the program, configures: a variation-amount calculating unit that, for an input image, calculates a variation amount between a value of a predetermined pixel of the input image and values of peripheral pixels of the predetermined pixel; an attribute reliability unit that, based on an attribute that is a property of pixels within a specified area in the input image and the variation amount, calculates attribute reliability of the pixel; a regularization strength estimating unit that, based on image quality information about image quality for the attribute and the attribute reliability, estimates a regularization strength of the pixel; and an image reconstructing unit generates a reconstructed image that is an image acquired by reconstructing the input image by using the regularization strength.
    Type: Grant
    Filed: December 10, 2015
    Date of Patent: January 21, 2020
    Assignee: NEC CORPORATION
    Inventor: Takashi Shibata
  • Patent number: 10511726
    Abstract: A device and algorithm for allowing a customer to choose a photo book cover template that is compatible with a photo having faces. The photo is compared with a set of templates arranged in a first order to determine how compatible the photo is to each of the templates, and a score indicative of compatibility is assigned. A re-sorted set of compatible templates combined with the photo is presented to the customer for consideration.
    Type: Grant
    Filed: February 6, 2019
    Date of Patent: December 17, 2019
    Assignee: PLANETART, LLC
    Inventors: Adam Black, Erik Malkemus, Roger Bloxberg, Zhang Ming Jun, Fan Xiang, Wang Ping, Zhang Xui Hao
  • Patent number: 10510156
    Abstract: Methods and apparatus for estimating a depth of unfocused plenoptic data are suggested. The method includes: determining a level of homogeneity of micro-lens images of unfocused plenoptic data; determining pixels of the micro-lens images of the unfocused plenoptic unfocused plenoptic data which either have disparities equal to zero or belong to homogeneous areas as a function of the calculated level of homogeneity of the micro-lens images of the unfocused plenoptic data; and estimating the depth of the unfocused plenoptic data by a disparity estimation without considering the determined pixels. With the disclosure, by pre-processing the raw data, it can prevent any disparity estimation method to spend time on estimating disparities for: (i) pixels that are in focus, (ii) pixels that belong to homogenous areas of the scene.
    Type: Grant
    Filed: November 24, 2015
    Date of Patent: December 17, 2019
    Assignee: InterDigital CE Patent Holdings
    Inventors: Mozhdeh Seifi, Neus Sabater, Valter Drazic
  • Patent number: 10489662
    Abstract: A vehicle includes a camera and processor(s) configured to: record images via the camera; combine the recorded images; identify edges in the combined image by comparing each pixel of the combined image to a threshold; update dimensions of the vehicle based on the identified edges; execute an automatic parking routine based on the updated dimensions.
    Type: Grant
    Filed: July 27, 2016
    Date of Patent: November 26, 2019
    Assignee: Ford Global Technologies, LLC
    Inventors: Erick Michael Lavoie, Zheng Hu
  • Patent number: 10489691
    Abstract: The disclosure extends to methods, systems, and apparatuses for automated fixation generation and more particularly relates to generation of synthetic saliency maps. A method for generating saliency information includes receiving a first image and an indication of one or more sub-regions within the first image corresponding to one or more objects of interest. The method includes generating and storing a label image by creating an intermediate image having one or more random points. The random points have a first color in regions corresponding to the sub-regions and a remainder of the intermediate image having a second color. Generating and storing the label image further includes applying a Gaussian blur to the intermediate image.
    Type: Grant
    Filed: January 15, 2016
    Date of Patent: November 26, 2019
    Assignee: FORD GLOBAL TECHNOLOGIES, LLC
    Inventors: Madeline Jane Schrier, Vidya Nariyambut Murali
  • Patent number: 10489891
    Abstract: According to one implementation, a video processing system includes a computing platform having a hardware processor and a system memory storing a sample-based video sharpening software code. The sample-based video sharpening software code receives a video sequence, and classifies frames of the video sequence as sharp or unsharp. For each pixel of an unsharp frame, the sample-based video sharpening software code determines a mapping of the pixel to another pixel in some or all of the sharp frames, determines a reverse mapping of each of the other pixels to the pixel, identifies a first confidence value corresponding to each of the other pixels based on the mapping, identifies a second confidence value corresponding to each of the other pixels based on the mapping and the reverse mapping, and sharpens the pixel based on a weighted combination of the other pixels determined using the first and second confidence values.
    Type: Grant
    Filed: June 22, 2017
    Date of Patent: November 26, 2019
    Assignee: Disney Enterprises, Inc.
    Inventors: Christopher Schroers, Henning Zimmer, Alexander Sorkine Hornung
  • Patent number: 10477187
    Abstract: A method of generating, by means of a processing device, a depth map and/or a fully focused image of a scene, from a series of images of the scene taken under a same viewing angle but with a different focusing, the method including the steps of: a) for each position of a pixel in the series of images, searching for an extremum of the pixel value in the series of images; and b1) assigning to said pixel position a depth value which is a function of the rank, in the series of images, of the image where the extremum has been identified at step a) to construct a depth map of the scene, and/or b2) assigning to said pixel position the value of the extremum identified at step a) to construct a fully focused image of the scene.
    Type: Grant
    Filed: October 1, 2017
    Date of Patent: November 12, 2019
    Assignee: Commissariat à l'Energie Atomique et aux Energies Alternatives
    Inventors: Simon Emberger, William Guicquero
  • Patent number: 10467762
    Abstract: A method is provided. The method includes activating an anti-shake mode for an electronic display. The method includes, in response to activating the anti-shake mode, identifying movement of a user relative to the electronic display at least based on processing of a plurality of captured images of at least part of the user, and transforming an image displayed on the electronic display based on the identified movement of the user. A computing device is also provided.
    Type: Grant
    Filed: December 7, 2017
    Date of Patent: November 5, 2019
    Assignee: Apical Limited
    Inventor: Viacheslav Chesnokov
  • Patent number: 10467753
    Abstract: Methods and apparatus for displaying information from a three dimensional imaging data cube, having particular application in ophthalmology, are disclosed. The method of the present invention slices 3D imaging data along curved surfaces that match anatomical layers, and comprising four steps: a locating step in which anatomical layers are located; a selecting step in which a slicing surface is selected based on the locations of the anatomical layers; an extracting step, wherein the user extracts data values that fall on the slicing surface selected; and a displaying step in which the data values extracted are displayed as a three dimensional image. The apparatus of the subject invention comprises hardware and software that employ the method of the subject invention to display improved anatomical 3D images.
    Type: Grant
    Filed: April 6, 2016
    Date of Patent: November 5, 2019
    Assignee: OCEANIT LABORATORIES, INC.
    Inventor: Edward Alan Pier
  • Patent number: 10423156
    Abstract: A system, device, and method for controlling a remotely-controlled device are disclosed. The remotely-controlled device control system could include one or more remotely-controlled devices; a controller comprised of a data collection module, at least one active module, at least one module description file (MDF), a robot description file (RDF) for each remotely-controlled device, and a processing unit (PU); at least one data source, and a marketplace. The PU may be configured to receive at least one active module; receive, for each received active module, input data of its associated MDF provided by the data collection module; generate, for each received active module, output data as a function of to the input data received by the processing unit, and provide the output data to a destination system.
    Type: Grant
    Filed: November 9, 2017
    Date of Patent: September 24, 2019
    Assignee: Aatonomy, Inc.
    Inventors: Ronald Wilson Pulling, Yang Hu
  • Patent number: 10410327
    Abstract: This disclosure relates to techniques for synthesizing out of focus effects in digital images. Digital single-lens reflex (DSLR) cameras and other cameras having wide aperture lenses typically capture images with a shallow depth of field (SDOF). SDOF photography is often used in portrait photography, since it emphasizes the subject, while deemphasizing the background via blurring. Simulating this kind of blurring using a large depth of field (LDOF) camera may require a large amount of computational resources, i.e., in order to simulate the physical effects of using a wide aperture lens while constructing a synthetic SDOF image. However, cameras having smaller lens apertures, such as mobile phones, may not have the processing power to simulate the spreading of all background light sources in a reasonable amount of time. Thus, described herein are techniques to synthesize out-of-focus background blurring effects in a computationally-efficient manner for images captured by LDOF cameras.
    Type: Grant
    Filed: May 25, 2018
    Date of Patent: September 10, 2019
    Assignee: Apple Inc.
    Inventors: Richard D. Seely, Michael W. Tao, Alexander Lindskog, Geoffrey T. Anneheim