Image Enhancement Or Restoration Patents (Class 382/254)
  • Patent number: 11126807
    Abstract: A space efficient automated processing system for processing objects is disclosed. The processing system includes an input conveyance system for moving objects from an input area in at least an input conveyance vector that includes an input conveyance horizontal direction component and an input conveyance vertical direction component, a perception system for receiving objects from the input conveyance system and for providing perception data regarding an object, a primary transport system for receiving the object from the perception system and for providing transport of the object along at least a primary transport vector including an primary transport horizontal component and a primary transport vertical component that is generally opposite the input conveyance horizontal direction component, and at least two secondary transport systems, each of which receives the object from the primary transport system and moves the object in either of reciprocal directions.
    Type: Grant
    Filed: May 5, 2020
    Date of Patent: September 21, 2021
    Assignee: Berkshire Grey, Inc.
    Inventors: Thomas Wagner, Kevin Ahearn, John Richard Amend, Jr., Benjamin Cohen, Michael Dawson-Haggerty, William Hartman Fort, Christopher Geyer, Victoria Hinchey, Jennifer Eileen King, Thomas Koletschka, Michael Cap Koval, Kyle Maroney, Matthew T. Mason, William Chu-Hyon McMahan, Gene Temple Price, Joseph Romano, Daniel Smith, Siddhartha Srinivasa, Prasanna Velagapudi, Thomas Allen
  • Patent number: 11112609
    Abstract: An eyewear device that adjusts aspects of a displayed object as a function of a user's eyeglass prescription. A detector identifies object edges for displayed far objects. A correction chart stores brightness corrections as a function of eyeglass prescriptions. The object edges are brightened as a function of the brightness corrections to sharpen objects displayed for a user with nearsightedness and/or farsightedness.
    Type: Grant
    Filed: April 16, 2020
    Date of Patent: September 7, 2021
    Assignee: Snap Inc.
    Inventor: Stephen Pomes
  • Patent number: 11113540
    Abstract: A vehicle monitoring system includes at least one camera, and a server that is communicably connected to a client terminal. The camera performs capturing a vehicle while switching a first capturing condition including an image parameter for capturing a number of the vehicle entering an angle of view of the camera and a second capturing condition including an image parameter for capturing an occupant's face of the vehicle, and transmits a first captured video under the first capturing condition and a second captured video under the second capturing condition to the server. The server arranges reproduction screens for the first captured video and the second captured video that are reproduceable in the client terminal and displays the reproduction screens on the client terminal based on the first captured video and the second captured video.
    Type: Grant
    Filed: May 15, 2020
    Date of Patent: September 7, 2021
    Assignee: PANASONIC I-PRO SENSING SOLUTIONS CO., LTD.
    Inventors: Toshimasa Funaki, Michinori Kishimoto, Hiroaki Jodan, Toshiyuki Sano, Masahiro Yamashita, Yuma Kobayashi, Yuji Arima, Hideaki Takahashi
  • Patent number: 11113801
    Abstract: Devices, methods, and computer-readable media describing an adaptive approach to reference image selection are disclosed herein, e.g., to generate fused images with reduced motion distortion. More particularly, an incoming image stream may be obtained from an image capture device, which image stream may comprise a variety of different image captures, e.g., including “image frame pairs” (IFPs) that are captured consecutively, wherein the images in a given IFP are captured with differing exposure settings. When a capture request is received at the image capture device, the image capture device may select two or more images from the incoming image stream for fusion, e.g., including at least one IFP. In some embodiments, one of the images from the at least one IFP will be designated as the reference image for a fusion operation, e.g., based on a robust motion detection analysis process performed on the images of the at least one IFP.
    Type: Grant
    Filed: September 6, 2019
    Date of Patent: September 7, 2021
    Assignee: Apple Inc.
    Inventor: Wu Cheng
  • Patent number: 11094134
    Abstract: Exemplary systems and methods are directed to generating synthetic data for computer vision. A processing device generates a synthetic three-dimensional (3D) image of an object. A background image is selected, and a composite image is generated by combining the 3D image of the object and the background image. The processing device simulates: reflection or emission of at least one type of radiant energy from the surface of the object and/or the background according to a set of parameters associated with at least one of the object and the background image; and a reflectance or emittance measurement of the at least one type of radiant energy from the surface of the object by a sensor device configured for detecting the at least one type of radiant energy. The processing device generates a plurality of two-dimensional (2D) simulated images of different perspectives of the object based on simulation data.
    Type: Grant
    Filed: August 13, 2020
    Date of Patent: August 17, 2021
    Assignee: BOOZ ALLEN HAMILTON INC.
    Inventors: Brandon Fallin, Dave Babbitt, Rory Thomas Burke, Paul McLone Carson, Cornelius Griggs, Kevin Green, Andrew Kalukin, Andre Tai Nguyen, David Sanborn, Douglas James Sanborn, Jacob Stevens-Haas, Alexander Tejada, James J. Ter Beest, Michael Tong
  • Patent number: 11081029
    Abstract: The invention discloses a method for evaluating a brightness measurement accuracy of a Demura equipment by generating a noise-added image by adding a random number to an original grayscale image and obtaining a measurement value corresponding to the added random number via the noise-added image displayed by the Demura equipment. The brightness measurement accuracy of the Demura equipment is evaluated based on a correlation between the measured value and the originally added random number to measure a brightness extraction performance of the Demura equipment. The method provided by the invention provides a quantitative and measurable determining method that may better reflect the actual performance of the Demura equipment.
    Type: Grant
    Filed: July 9, 2018
    Date of Patent: August 3, 2021
    Assignee: WUHAN JINGCE ELECTRONIC GROUP CO., LTD.
    Inventors: Xiaofan Feng, Zengqiang Zheng, Zhao Liu, Erwei Ma, Hongjun Wu, Ronghua Liu, Yafei Shen
  • Patent number: 11070755
    Abstract: An imaging device includes a pixel unit where pixels including photoelectric converters are arranged, and a signal processing unit that processes signals from the pixel unit. The pixel unit includes a first region including pixels each driven in a first mode to read a signal based on charge generated by the photoelectric converters and a second region including the pixels each driven in a second mode to read more signals than in the first mode including a signal based on charges generated by a part of the photoelectric converters and a signal based on charges generated by the photoelectric converters. The signal processing unit calculates a first correction value based on an average of a first data group from the first region and a second correction value based on an average of a second data group from the second region by using the first correction value as an initial value.
    Type: Grant
    Filed: March 18, 2020
    Date of Patent: July 20, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Keisuke Takahashi
  • Patent number: 11062666
    Abstract: A semiconductor device with a small circuit area that consumes low power is provided. The semiconductor device includes a shift register, a sample-and-hold circuit, a first buffer circuit, and a second buffer circuit. The sample-and-hold circuit includes a first input terminal, a second input terminal, and an output terminal. An output terminal of the first buffer circuit is electrically connected to the first input terminal. The shift register is electrically connected to the second input terminal. An input terminal of the second buffer circuit is electrically connected to the output terminal of the sample-and-hold circuit. In the semiconductor device, the potential of an input analog signal is retained in the sample-and-hold circuit and the analog signal is output from an output terminal of the second buffer circuit.
    Type: Grant
    Filed: February 20, 2020
    Date of Patent: July 13, 2021
    Assignee: Semiconductor Energy Laboratory Co., Ltd.
    Inventors: Yoshiyuki Kurokawa, Takayuki Ikeda, Tatsunori Inoue
  • Patent number: 11055887
    Abstract: Facial skin mask generated by a digital content creation system is described. The digital content creation system includes digital effects on skin in facial regions of digital content with efficiency and accuracy. Upon identifying a facial region within digital content, the system generates a first regional skin mask, a second regional skin mask, and combines both of the first and second regional skin masks to generate a facial skin mask indicative of skin of the identified facial regions depicted in digital content. The digital content creation system then modifies digital content by applying user selected digital effects to the skin of the facial region using the generated facial skin mask.
    Type: Grant
    Filed: November 29, 2018
    Date of Patent: July 6, 2021
    Assignee: Adobe Inc.
    Inventors: Yumin Jia, Xin Lu, Jen-Chan Chien
  • Patent number: 11049217
    Abstract: An example of the present disclosure provides methods, apparatuses and devices for magnifying a feature map, and a computer readable storage medium. The method includes: receiving a source feature map to be magnified; obtaining N reassembly kernels corresponding to each source position in the source feature map by performing convolution on the source feature map, wherein N refers to a square of a magnification factor of the source feature map; obtaining, for each of the reassembly kernels, a normalized reassembly kernel by performing normalization; obtaining, for each source position in the source feature map, N reassembly features corresponding to the source position by reassembling features of a reassembly region determined according to the source position with N normalized reassembly kernels corresponding to the source position; and generating a target feature map according to the N reassembly features corresponding to each source position in the source feature map.
    Type: Grant
    Filed: December 15, 2020
    Date of Patent: June 29, 2021
    Assignee: Beijing Sensetime Technology Development Co., Ltd.
    Inventors: Jiaqi Wang, Kai Chen, Rui Xu, Ziwei Liu, Chen Change Loy, Dahua Lin
  • Patent number: 11044453
    Abstract: Provided is a data processing apparatus for calculating confidence coefficient data to indicate a confidence of pixel values of a second image data. The apparatus acquires similarity between a pixel value of a first pixel of the first image data corresponding to a target pixel of the confidence coefficient data, and each pixel value of a plurality of second pixels around the first pixel. The apparatus acquires the confidence coefficient by determining an estimated pixel value in the third pixel of the second image data corresponding to the first pixel, based on the similarity of each of the plurality of second pixels, each pixel value of the plurality of fourth pixels around the third pixel and the pixel value of the third pixel and by comparing the pixel value of the third image and the estimated pixel value in the third pixel.
    Type: Grant
    Filed: December 11, 2019
    Date of Patent: June 22, 2021
    Assignee: Canon Kabushiki Kaisha
    Inventor: Shin Tanaka
  • Patent number: 11042777
    Abstract: The present disclosure provides a classification method and a classification device of an indoor scene. The classification method includes steps: receiving an input scene picture to be classified; obtaining a current local observation area from the scene picture to be classified according to a observation area positioning model; processing image information of the current local observation area to obtain a feature vector; obtaining a classification prediction result according to the feature vector; determining Whether the classification prediction result satisfies a predetermined scene picture classification condition; if not, obtaining a next local observation area from the scene picture to be classified and setting the next local observation area to be the current local observation area, then skipping to the step of processing the image information of the current local observation area; if yes, obtaining a classification label of the scene picture to be classified.
    Type: Grant
    Filed: March 27, 2017
    Date of Patent: June 22, 2021
    Assignee: SHENZHEN INSTITUTES OF ADVANCED TECHNOLOGY
    Inventors: Junyu Zhang, Hui Huang
  • Patent number: 11044438
    Abstract: A projection display apparatus includes a processing circuit and an image projection display device. The processing circuit is configured to perform a dynamic motion compensation based on two successive first frame and second frame in a first video signal, in order to generate a complement frame between the first frame and the second frame. The processing circuit is further configured to combine the first frame and the complement frame into a third frame, and to decompose the third frame to generate a plurality of fourth frames and to output the fourth frames as a second video signal. A resolution of the first video signal is higher than a resolution of the second video signal. The image projection display device is configured to project and display the second video signal, in which the imaging device has an original resolution equal to the resolution of the second video signal.
    Type: Grant
    Filed: June 27, 2019
    Date of Patent: June 22, 2021
    Assignee: DELTA ELECTRONICS, INC.
    Inventor: Fu-Jen Chiang
  • Patent number: 11030205
    Abstract: Non-limiting examples of the present disclosure describe processing by a contextual image analysis service that generates and surfaces contextually relevant data objects based on entities identified from image content. In one example, image content is analyzed and entity annotations are generated for the image content. The entity annotations may be converted to queries. Raw search results may be identified based on the converted queries. The raw search results may be filtered based on one or more specific content types. A contextual representation is generated based on the filtered raw search results, where the contextual representation comprises the image content and one or more contextually relevant data objects for at least one entity associated with the image content. The exemplary contextual representation of the image content and the one or more contextually relevant data objects may be surfaced through a user interface of an application/service.
    Type: Grant
    Filed: January 11, 2018
    Date of Patent: June 8, 2021
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Yuancao Cui, Soohoon Cho, Vincent Kin-Wah Leung
  • Patent number: 11032453
    Abstract: An image capturing apparatus includes a light receiving sensor including two-dimensionally arranged pixels and configured to photoelectrically convert a pair of object images and to output a first image signal and a second image signal, each of the first image signal and the second image signal corresponding to a respective object image of the pair of object images; a calculation unit configured to calculate a first phase difference between the first image signal and the second image signal in the first direction and a second phase difference in a second direction; a focus detection unit configured to calculate a first focus detection result based on the first phase difference; and a determination unit configured to determine presence or absence of heat haze based on the second phase difference.
    Type: Grant
    Filed: June 18, 2020
    Date of Patent: June 8, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Takashi Ichimiya
  • Patent number: 11024033
    Abstract: Provided is an image processing method including determining an edge region based on contrast of values of pixels included in an image; identifying an outline region in the edge region according to distribution characteristics of values of pixels included in the edge region; and, as the outline region is identified, performing blurring processing for reducing contrast of values of pixels included in at least a portion of the outline region.
    Type: Grant
    Filed: December 28, 2018
    Date of Patent: June 1, 2021
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventor: Shintaro Okada
  • Patent number: 11025830
    Abstract: According to some embodiments, a camera captures a plurality of images of substantially the same scene at different exposure levels for each video frame to be captured. These images are then deghosted, merged or fused, and processed using a spatially, and optionally also temporally, varying tonemapping operator, and the resulting image after some further finishing is written into a video stream. In some embodiments, this processing is performed in real time on a graphics processing unit present in the device containing the camera. Other applications are shown and discussed.
    Type: Grant
    Filed: February 10, 2018
    Date of Patent: June 1, 2021
    Inventor: Oliver Markus Haynold
  • Patent number: 11017503
    Abstract: Techniques for atmospheric and solar correction of aerial images are described. An apparatus may comprise an atmospheric and solar component arranged for execution by a logic device and operative to correct solar and atmosphere artifacts from an aerial image. The atmospheric and solar component may comprise an image information component operative to generate an image record for each aerial image of a group of aerial images, the image record comprising statistical information and image context information for each aerial image, a filter generation component operative to generate an atmospheric filter and a solar filter from the statistical information and the image context information stored in the image records, and an image correction component operative to correct atmospheric and solar artifacts from the aerial image using the respective atmospheric filter and solar filter. Other embodiments are described and claimed.
    Type: Grant
    Filed: February 20, 2017
    Date of Patent: May 25, 2021
    Assignee: Microsoft Technology Licensing , LLC
    Inventors: Ido Omer, Yuxiang Liu, Wolfgang Schickler, Robert Ledner, Leon Rosenshein, David Simons
  • Patent number: 11011102
    Abstract: A display apparatus according to the present invention includes: a display unit configured to display an image based on input image data on a screen; and a control unit configured to execute control to reduce an upper limit value of a display brightness range of a second area, which is different from a first area, of the screen of the display unit below an upper limit value of a display brightness range of the first area of the screen of the display unit, so that a power consumption of the display unit does not exceed a predetermined power consumption.
    Type: Grant
    Filed: September 11, 2018
    Date of Patent: May 18, 2021
    Assignee: Canon Kabushiki Kaisha
    Inventors: Mitsuru Tada, Takeshi Ikeda, Yasuo Suzuki
  • Patent number: 11003408
    Abstract: An image generating apparatus includes: a rendering unit that carries out rendering of objects of a virtual space and generates a computer graphics image; a drawing processing unit that executes subsequent drawing processing for the computer graphics image; and an interrupt unit that interrupts the rendering at a timing of a graphics processor interrupt and causes execution of the subsequent drawing processing based on a result of the rendering to the timing of the graphics processor interrupt. The drawing processing unit includes a reprojection unit that executes reprojection processing of converting the computer graphics image in conformity to a new position of a point of view or a new direction of a line of sight as the subsequent drawing processing. The interrupt unit causes execution of the reprojection processing of the computer graphics image, based on the result of the rendering to the timing of the graphics processor interrupt.
    Type: Grant
    Filed: October 2, 2019
    Date of Patent: May 11, 2021
    Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
    Inventor: Yoshinori Ohashi
  • Patent number: 11006098
    Abstract: Provided is a configuration to make a virtual viewpoint image be a more natural stereoscopic image. The virtual viewpoint image is transmitted/received between information processing apparatuses that execute bidirectional communication. A processor calculates a virtual viewpoint position corresponding to a position of a virtual camera that captures a virtual viewpoint image on the basis of viewing position information of a viewing user of the virtual viewpoint image, and generates the virtual viewpoint image corresponding to a captured image from the virtual viewpoint position. The virtual viewpoint image is generated based on the captured image of a real camera that captures an object user, and the virtual viewpoint image is generated by setting a capture direction of a virtual camera to a point C, wherein the point C is in a position different from the object user.
    Type: Grant
    Filed: April 7, 2017
    Date of Patent: May 11, 2021
    Assignee: SONY CORPORATION
    Inventors: Masato Akao, Kazuhiko Nishibori
  • Patent number: 10997696
    Abstract: An image processing method, an apparatus and a device are provided. The method includes: a first image is captured according to a preset first exposure time and a second image is captured according to a second exposure time by using dual cameras; a first foreground area and a first background area of the first image are determined, and a second foreground area of the second image is determined; image fusion is performed on the second foreground area and the first foreground area to generate a third foreground area; and blurring processing is performed on the first background area, and the third foreground area and the first background area subjected to the blurring processing are composed to generate a target image.
    Type: Grant
    Filed: October 29, 2018
    Date of Patent: May 4, 2021
    Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
    Inventor: Gong Zhang
  • Patent number: 10992936
    Abstract: Techniques are provided to encode and decode image data comprising a tone mapped (TM) image with HDR reconstruction data in the form of luminance ratios and color residual values. In an example embodiment, luminance ratio values and residual values in color channels of a color space are generated on an individual pixel basis based on a high dynamic range (HDR) image and a derivative tone-mapped (TM) image that comprises one or more color alterations that would not be recoverable from the TM image with a luminance ratio image. The TM image with HDR reconstruction data derived from the luminance ratio values and the color-channel residual values may be outputted in an image file to a downstream device, for example, for decoding, rendering, and/or storing. The image file may be decoded to generate a restored HDR image free of the color alterations.
    Type: Grant
    Filed: November 11, 2019
    Date of Patent: April 27, 2021
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Wenhui Jia, Ajit Ninan, Arkady Ten, Gregory John Ward
  • Patent number: 10972698
    Abstract: Inducing a particular behavior/process among a set of pre-determined behaviors/processes by implicitly signaling the selection of the particular behavior/process though a particular combination of specific values of said set of information data driven the process. Typically, enables re-using parameters already carried with a signal to signal how those parameters are used by a specific process.
    Type: Grant
    Filed: October 20, 2016
    Date of Patent: April 6, 2021
    Assignee: INTERDIGITAL VC HOLDINGS, INC.
    Inventors: Pierre Andrivon, Philippe Bordes, Edouard Francois
  • Patent number: 10950036
    Abstract: Disclosed is a method and apparatus for three-dimensional (3D) rendering, the apparatus including a processor configured to extract shading information, visibility information and shape information from a region of an input image, determine a light source based on the shading information, the visibility information, and the shape information of the region, and generate a 3D rendering image by rendering the input image based on the determined light source.
    Type: Grant
    Filed: October 16, 2018
    Date of Patent: March 16, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: In Woo Ha, Na Hyup Kang, Sung Hoon Hong
  • Patent number: 10949953
    Abstract: Embodiments relate to directional bilateral filtering of a raw image. For each pixel in the image, a block of pixels surrounding that pixel is used for filtering. When the block of pixels in a Bayer pattern have directionality, directional filter coefficients are used instead of default filter coefficients. To obtain a directional tap, a directional filter coefficient is attenuated by an attenuation factor that differs based at least on the location of the pixels in the pixel block. The directional taps are blended with non-directional taps derived from the default filter coefficients using a weight representing confidence on the directionality. The filtered pixel values are then obtained by multiplying pixel values with corresponding taps.
    Type: Grant
    Filed: March 13, 2019
    Date of Patent: March 16, 2021
    Assignee: APPLE INC.
    Inventors: Sheng Lin, David R. Pope
  • Patent number: 10943373
    Abstract: The present disclosure relates to an image processing apparatus and an image processing method that make it possible to generate a texture image of high picture quality at a predetermined viewpoint using an omnidirectional image. A drawing section generates a display image of a given viewpoint using a first layer image including a texture image and a depth image of an omnidirectional image and a second layer image including a texture image and a depth image in an occlusion region at a viewpoint of the first layer image. The present disclosure can be applied to, for example, a home server that generates a display image of a predetermined viewpoint from an omnidirectional image or the like.
    Type: Grant
    Filed: July 14, 2017
    Date of Patent: March 9, 2021
    Assignee: SONY CORPORATION
    Inventor: Nobuaki Izumi
  • Patent number: 10944688
    Abstract: An apparatus in one embodiment comprises at least one processing device having a processor coupled to a memory. The one or more processing devices are operative to configure a plurality of distributed processing nodes to communicate over a network, to abstract content locally accessible in respective data zones of respective ones of the distributed processing nodes into respective catalogs of a distributed catalog service in accordance with a layered extensible data model, and to provide in the distributed processing nodes a plurality of microservices for performing processing operations on at least one of the layered extensible data model and the catalogs. The layered extensible data model comprises a plurality of layers including a core data model layer and at least one extensions layer. The microservices may comprise at least one microservice to alter the layered extensible data model and at least one microservice to query one or more of the catalogs.
    Type: Grant
    Filed: July 24, 2019
    Date of Patent: March 9, 2021
    Assignee: EMC IP Holding Company LLC
    Inventor: Patricia Gomes Soares Florissi
  • Patent number: 10943361
    Abstract: The described positional awareness techniques employing visual-inertial sensory data gathering and analysis hardware with reference to specific example implementations implement improvements in the use of sensors, techniques and hardware design that can enable specific embodiments to provide positional awareness to machines with improved speed and accuracy.
    Type: Grant
    Filed: October 17, 2019
    Date of Patent: March 9, 2021
    Assignee: Trifo, Inc.
    Inventors: Grace Tsai, Zhe Zhang, Shaoshan Liu
  • Patent number: 10934689
    Abstract: A shovel includes a traveling undercarriage, an upper rotating structure swingably mounted on the traveling undercarriage, an attachment attached to the upper rotating structure and including a boom, an arm, and a bucket, a guidance device configured to guide an operation of the attachment, and a display device configured to display information related to work by the attachment. The guidance device is configured to display multiple distance indicating parts with respect to the width direction of the bucket on the display device. The distance indicating parts schematically indicate relative distances to a target surface.
    Type: Grant
    Filed: September 27, 2018
    Date of Patent: March 2, 2021
    Assignee: SUMITOMO(S.H.I.) CONSTRUCTION MACHINERY CO., LTD.
    Inventor: Takeya Izumikawa
  • Patent number: 10937200
    Abstract: In implementations of object-based color adjustment, an image editing system adjusts hue and saturation of a digital image so that objects in the digital image do not appear unnatural. The image editing system quantizes a CIELAB color space into classes that represent pairs of a and b channel values. The image editing system determines probabilities that pixels of a digital image belong to each of the classes, and based on the probabilities, determines a range of hue and a range of saturation for each pixel. An object detector segments objects in the digital image to determine ranges of hue and saturation for each segmented object. The image editing system selectively adjusts the hue and saturation for objects of the digital image based on whether the hue and saturation range for the object include a value of hue and saturation, respectively, selected in a user interface.
    Type: Grant
    Filed: March 19, 2019
    Date of Patent: March 2, 2021
    Assignee: Adobe Inc.
    Inventors: Nishant Kumar, Neeraj Chaudhary
  • Patent number: 10931875
    Abstract: One aspect of the present disclosure is an image processing device performing image stabilization of frame images shot by an imaging device. This device is provided with an acquiring unit, an image generating unit and a cropping unit. The acquiring unit acquires the plurality of frame images. The image generating unit stitches, among the plurality of frame images acquired by the acquiring unit, a first frame image and a second frame image, the second frame image being one frame image among several frames before and after the first frame image, to generate a composite image larger than a size of the first frame image and the second frame image. The cropping unit sets a cropping region to the composite image and outputs an image in the cropping region as an output frame image.
    Type: Grant
    Filed: January 13, 2017
    Date of Patent: February 23, 2021
    Assignee: Morpho, Inc.
    Inventor: Masaki Satoh
  • Patent number: 10930016
    Abstract: An image synthesizing method includes capturing a first image using a reference small aperture size; capturing a second image using a reference large aperture size; obtaining one or more reference color weights according to a corresponding pixel of the first image and adjacent pixels of the corresponding pixel of the first image and a corresponding pixel of the second image; obtaining an associated distance by looking up an association table according to the one or more reference color weights; obtaining one or more associated color weights by looking up the association table according to the associated distance and an expected aperture; and obtaining a color value of a corresponding pixel of a synthesized image, by applying weighting to the corresponding pixel of the first image and the adjacent pixels of the corresponding pixel of the first image with the one or more associated color weights.
    Type: Grant
    Filed: April 2, 2019
    Date of Patent: February 23, 2021
    Assignee: Wistron Corporation
    Inventor: Yao-Tsung Chang
  • Patent number: 10922792
    Abstract: An image adjustment method includes: sequentially processing a plurality of pixels in at least one frame, wherein a pixel under processing is a current pixel, the current pixel and multiple adjacent pixels form a current block, and each current block is performed with following operations: reading a grayscale value of each pixel in the current block; determining a region grayscale value and a region variance of the current block according to the grayscale values of the pixels; generating a variance adjustment parameter via a variance adjustment function, wherein the region grayscale value is a variable of the variance adjustment function; generating an adjusted region variance according to the variance adjustment parameter and the region variance; and comparing the adjusted region variance with a variance threshold to determine whether to perform a noise suppression operation on the current pixel.
    Type: Grant
    Filed: January 1, 2020
    Date of Patent: February 16, 2021
    Assignee: Realtek Semiconductor Corp.
    Inventors: Zhong-Yi Qiu, Wen-Tsung Huang, Kai Liu
  • Patent number: 10911785
    Abstract: A method for processing a video stream prior to encoding, the video stream potentially comprising a film grain, the method comprising: measuring a film grain intensity in the video stream; obtaining at least one encoding rate information item associated with the video stream, in order to determine a pair of respective values for the grain intensity and encoding rate; comparing the pair values with predetermined respective threshold values in order to categorize the video stream with respect to pairs of predetermined values of grain intensity and rate; and selecting a film grain management strategy among at least four combinations based on the categorization of the video stream.
    Type: Grant
    Filed: November 20, 2018
    Date of Patent: February 2, 2021
    Assignee: ATEME
    Inventor: Elie Gabriel Mora
  • Patent number: 10902619
    Abstract: Disclosed herein are systems and methods for determining quality metrics of images based on an edge gradient profile and characterizing regions of interest in an image or images. According to an aspect, a method includes using an imaging device to acquire one or more images including at least a portion of an organ of a subject. The method also includes computing an edge profile across an organ interface of a subject. The method also includes computing an edge gradient profile from the edge profile of a subject. The method also includes computing a image quality metric related to the spatial resolution of the image or images from the edge gradient profile. The method also includes defining multiple regions of interest within the portion of the organ. Further, the method includes characterizing the regions of interest based on predetermined criteria. The method also includes presenting the characterization of the edge gradient profile and characterization of the regions of interest to a user.
    Type: Grant
    Filed: October 26, 2017
    Date of Patent: January 26, 2021
    Assignee: Duke University
    Inventors: Jeremiah W. Sanders, Ehsan Samei
  • Patent number: 10891719
    Abstract: Methods, systems and programs for denoising a signal using discrete wavelet transformation are provided. For example, a method for denoising a signal may include determining a number of resolution levels to denoise, determining variable threshold(s) for each resolution level, applying the determined variable threshold(s) to denoise at least a detail component of each of the determined resolution levels. Each variable threshold includes a separately determined lower threshold and upper threshold. The method for denoising a signal may further include transforming, using an inverse discrete wavelet transformation, at least the denoised detail component for each of the determined resolution levels into a denoised signal.
    Type: Grant
    Filed: May 11, 2017
    Date of Patent: January 12, 2021
    Assignee: CORNELL UNIVERSITY
    Inventors: Madhur Srivastava, Jack H. Freed, C. Lindsay Anderson
  • Patent number: 10885608
    Abstract: In implementations of super-resolution with reference images, a super-resolution image is generated based on reference images. Reference images are not constrained to have same or similar content as a low-resolution image being super-resolved. Texture features indicating high-frequency content are extracted into texture feature maps, and patches of texture feature maps of reference images are determined based on texture feature similarity. A content feature map indicating low-frequency content of an image is adaptively fused with a swapped texture feature map including patches of reference images with a neural network based on similarity of texture features. A user interfaces allows a user to select regions of multiple reference images to use for super-resolution. Hence, a super-resolution image can be generated with rich texture details incorporated from multiple reference images, even in the absence of reference images having similar content to an image being upscaled.
    Type: Grant
    Filed: June 6, 2018
    Date of Patent: January 5, 2021
    Assignee: Adobe Inc.
    Inventors: Zhifei Zhang, Zhe Lin, Zhaowen Wang
  • Patent number: 10885326
    Abstract: A method for recognizing characters in an image of a document having at least one alphanumeric field. The method has the steps of: segmenting the image to identify objects therein; defining a bounding box around each object; making multiple successive selections based on different descriptors and dividing the bounding boxes into a plurality of cells for each of which a texture descriptor is determined as a gradient oriented histogram; performing character recognition on the finally selected bounding boxes. A device for implementing the method.
    Type: Grant
    Filed: May 17, 2019
    Date of Patent: January 5, 2021
    Assignee: IDEMIA IDENTITY & SECURITY FRANCE
    Inventors: Sègbédji Goubalan, Thierry Viguier
  • Patent number: 10854328
    Abstract: A universal service for objects (e.g., DICOM objects) and method for processing the same are described. In one embodiment, the method comprises: receiving, at a web service engine, a web services request from a remote web client for one or more Digital Imaging and Communications in Medicine (DICOM) objects; generating a DICOM Message Service Element (DIMSE) request from the web services request, wherein generating the DIMSE service request includes parsing a modified base URL that includes information for a DIMSE service request, the modified URL being compliant with a standard that specifies a web-based service for accessing and presenting DICOM objects; sending the DIMSE service request to a server; receiving a response to the DIMSE service request from the server; reformatting the response to be compliant with the standard that specifies a web-based service for accessing and presenting DICOM objects; and returning the reformatted response to the remote web client.
    Type: Grant
    Filed: March 29, 2019
    Date of Patent: December 1, 2020
    Assignee: FUJIFILM MEDICAL SYSTEMS U.S.A., INC.
    Inventors: Gary Kibble, Peter Jakes
  • Patent number: 10846839
    Abstract: Provided is an image processing apparatus for correcting an influence of atmospheric turbulence by using pieces of image data captured temporally successively. It includes: an obtaining unit that obtains pieces of partial image data corresponding to images of a processing target area in the pieces of image data; a transform unit that transforms the obtained pieces of partial image data into Fourier spectra; an estimation unit that estimates a phase containing a high-frequency component by using phases of low-frequency components in the Fourier spectra; a correction unit that, on the basis of the result of the estimation and reference data determined on the basis of the obtained pieces of partial image data, corrects the result of the estimation on at least one of the pieces of partial image data; and a generation unit that generates output image data corresponding to the pieces of image data on the basis of the corrected result.
    Type: Grant
    Filed: March 12, 2019
    Date of Patent: November 24, 2020
    Assignee: Canon Kabushiki Kaisha
    Inventor: Yoichi Takikawa
  • Patent number: 10839502
    Abstract: Devices and methods for evaluating at least one photograph during a photography session are described. In some instances, a camera may be used to capture images during a photography session and a computing device may be used to identify a portrait order specification for the photography session including a set of required photographs, each having associated required criteria. The computing device may evaluate the images and determine whether the images can be associated with any of the required photographs based on features included in the images being associated with the required criteria of the required photographs. The images associated with required photographs may be displayed, and a determination of whether the images qualify as a required photograph may be made using a graphical user interface, or may be made automatically.
    Type: Grant
    Filed: April 17, 2019
    Date of Patent: November 17, 2020
    Assignee: Shutterfly, LLC
    Inventors: Leo Cyrus, Keith Benson
  • Patent number: 10825149
    Abstract: A framework for defective pixel correction using adversarial networks. In accordance with one aspect, the framework receives first and second training image datasets. The framework performs adversarial training of a corrector and a classifier with the first and second training image datasets respectively. The corrector may be trained to correct a first input image and the classifier may be trained to recognize whether a second input image is real or generated by the corrector. The framework applies the trained corrector to a current image to correct any defective pixels and generate a corrected image. The corrected image may then be presented.
    Type: Grant
    Filed: August 23, 2018
    Date of Patent: November 3, 2020
    Assignee: Siemens Healthcare GmbH
    Inventors: Sebastian Schafer, Kevin Royalty, Olivier Pauly
  • Patent number: 10809879
    Abstract: Systems and methods for displaying a simplified version of a modification of a media content item on a mobile device are provided. The mobile device can receive, via a user interface presented on the mobile device, a request for a desired modification of an original media content item. The mobile device can perform a simplified version of the desired modification of the original media content item. The mobile device can present a preview of the modified media content item in the user interface. The mobile device can transmit, to another computing device, the original media content item with the request for the desired modification.
    Type: Grant
    Filed: March 6, 2017
    Date of Patent: October 20, 2020
    Assignee: GOOGLE LLC
    Inventors: Reed G A Morse, Christopher Peter Rhodes, John Gregg, Damien Kelly, Rushabh Ashok Doshi, Jason Toff, Molly Castle Nix, Joshua Abraham Tabak
  • Patent number: 10810717
    Abstract: A first image and a second image having a smaller pixel size than the first image are acquired. Based on a pixel size of the first image, a size of a calculation area to be set on the second image is calculated. A plurality of calculation areas including a corresponding position on the second image corresponding to a position of interest on the first image, and having the calculated area size are set on the second image. In each of the plurality of calculation areas, a representative value based on density values of pixels included in the calculation area is calculated, and based on a density value of a pixel at the position of interest and a plurality of representative values, a difference value between the first and second images at the position of interest is determined.
    Type: Grant
    Filed: May 29, 2018
    Date of Patent: October 20, 2020
    Assignee: Canon Kabushiki Kaisha
    Inventor: Toru Tanaka
  • Patent number: 10802770
    Abstract: A method and apparatus for generating print data are described herein. An apparatus comprising an image processor (110) is configured to select a region of an image spanning an intersection between at least two adjacent sub-images that partition the image. The spanning region is divided based on a non-linear path that is determined on the basis of a user input, resulting in at least two modified adjacent sub-images. Print data operable to cause a printing device (150) to print the respective modified adjacent sub-images are generated on the basis of the dividing.
    Type: Grant
    Filed: February 14, 2017
    Date of Patent: October 13, 2020
    Assignee: HP Indigo B.V.
    Inventors: Zelidor Fineberg, Eli Velner, Noam Shaham, Oren Haik
  • Patent number: 10805559
    Abstract: Multiple cameras are arranged in an array at a pitch, roll, and yaw that allow the cameras to have adjacent fields of view such that each camera is pointed inward relative to the array. The read window of an image sensor of each camera in a multi-camera array can be adjusted to minimize the overlap between adjacent fields of view, to maximize the correlation within the overlapping portions of the fields of view, and to correct for manufacturing and assembly tolerances. Images from cameras in a multi-camera array with adjacent fields of view can be manipulated using low-power warping and cropping techniques, and can be taped together to form a final image.
    Type: Grant
    Filed: December 20, 2018
    Date of Patent: October 13, 2020
    Assignee: GoPro, Inc.
    Inventors: Timothy Macmillan, Scott Patrick Campbell
  • Patent number: 10786196
    Abstract: A display apparatus includes a display which displays a screen including a plurality of photo contents containing a user face and a processor configured to control the display to distinguishably display the plurality of photo contents based on a photographing time of the plurality of photo contents with reference to a time at which a preset event related with skin has occurred.
    Type: Grant
    Filed: July 20, 2016
    Date of Patent: September 29, 2020
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Joo-young Son, Jae-jin Kim, Ji-yun Kim, Dae-young Hyun, Sun-ah Kim, Ga-hyun Joo, Tae-hwa Hong, Hong-il Kim
  • Patent number: 10791343
    Abstract: An encoder and/or a computer implemented encoding method includes a texture module configured to determine texture data associated with texture of an image, a noise module configured to determine noise data based on the texture data, a synthesis module configured to generate spatial spectral characteristics of the noise, and combine at least one of the noise data, the texture data, and the spatial spectral characteristics of the noise based on at least one border between adjacent textures, and an encoding module configured to compress the image using an image compression codec.
    Type: Grant
    Filed: March 13, 2018
    Date of Patent: September 29, 2020
    Assignee: Google LLC
    Inventors: Jyrki Antero Alakuijala, Jan Wassenberg
  • Patent number: 10783373
    Abstract: Embodiments of the present disclosure disclose a method and apparatus for augmenting reality. A specific embodiment of the method includes: acquiring outline data of a plurality of building blocks satisfying a preset selection condition, the outline data being used to describe an outline of a building block in three-dimensional space; generating reference information based on projected line segments of the plurality of building blocks; determining, based on the reference information, a target building block in the plurality of building blocks and a superimposed region in an image acquired by the terminal, labeling information of the target building block being superimposed on the superimposed region; and superimposing the labeling information of the target building block on the determined superimposed region, to obtain an augmented reality image.
    Type: Grant
    Filed: July 8, 2019
    Date of Patent: September 22, 2020
    Assignee: Baidu Online Network Technology (Beijing) Co., Ltd.
    Inventor: Zhilei Jiang