Combined Image Signal Generator And General Image Signal Processing Patents (Class 348/222.1)
  • Patent number: 11308916
    Abstract: A luminance determining method of determining a luminance of each pixel in a display device that includes a self emitting element includes dividing one image into a plurality of blocks that do no overlap each other; and correcting, in each of the plurality of blocks, a luminance of each pixel by reducing the luminance in the plurality of blocks through a correction method determined for each of the plurality of blocks.
    Type: Grant
    Filed: December 16, 2020
    Date of Patent: April 19, 2022
    Assignee: SOCIONEXT INC.
    Inventor: Katsuya Otoi
  • Patent number: 11301509
    Abstract: To search for a similar image more accurately, an image search system acquires a plurality of representative vectors, which are generated based on a plurality of feature vectors each indicating a feature of an image and included in a feature vector space, calculates a scalar value indicating a degree of similarity between each of the plurality of feature vectors and one of the representative vectors corresponding to the feature vector, calculates, for each of images, a feature value indicating a feature that depends on the representative vector based on the scalar value, and creates a search index associated with the calculated feature value.
    Type: Grant
    Filed: January 20, 2017
    Date of Patent: April 12, 2022
    Assignee: RAKUTEN GROUP, INC.
    Inventor: Ali Cevahir
  • Patent number: 11303888
    Abstract: A picture encoding/decoding method and a related apparatus are provided. The picture decoding method includes obtaining a current picture; selecting, from a knowledge base, K reference pictures of the current picture, where at least one picture in the knowledge base does not belong to a random access segment in which the current picture is located and wherein K is an integer greater than or equal to 1; and decoding the current picture according to the K reference pictures.
    Type: Grant
    Filed: February 3, 2021
    Date of Patent: April 12, 2022
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Lu Yu, Xuguang Zuo, Yin Zhao, Haitao Yang
  • Patent number: 11303876
    Abstract: A data capture device includes: an imaging module including an image sensor and a lens; a temperature sensor associated with the imaging module; a memory storing, for a plurality of temperatures, respective imaging module response parameters corresponding to the temperatures; an imaging controller connected to the image sensor and the temperature sensor; the imaging controller including a frame generator configured to: receive (i) image data from the image sensor and (ii) a temperature measurement from the temperature sensor; generate a raw image frame containing the temperature measurement and the image data; and provide the raw image frame to a calibrator for generation of a calibrated image frame based on the raw image frame and one of the imaging module response parameters corresponding to the temperature matching the temperature measurement.
    Type: Grant
    Filed: July 12, 2019
    Date of Patent: April 12, 2022
    Assignee: Symbol Technologies, LLC
    Inventors: Aleksandar Rajak, Parimal R. Patel
  • Patent number: 11303802
    Abstract: The present invention makes it possible to suppress, to the greatest extent possible, a situation where, in an image capturing apparatus that captures images automatically, the apparatus misses capturing a video that a user wishes to capture. An image capturing apparatus comprises an image capturing unit for capturing an object image and outputting image data, a control unit for controlling whether or not to carry out an image capturing operation of recording the image data output by the image capturing unit, and an obtaining unit for obtaining information pertaining to a frequency of the image capturing operation, wherein the control unit changes a threshold for determining whether or not to carry out the image capturing operation in accordance with the information pertaining to the frequency and total image capturing time.
    Type: Grant
    Filed: June 15, 2020
    Date of Patent: April 12, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Masahiro Takayama
  • Patent number: 11297276
    Abstract: A method and system for acquiring data from a pixelated image sensor for detecting charged particles. The method includes reading a pixel voltage of one or more of the multiple pixels multiple times without resetting the image sensor and digitizing the pixel into a first number of bits. The camera outputs a digitized compressed pixel voltage in a second, less, number of bits. The maximum range of the digitized compressed pixel voltage is less than a maximum range of the pixel voltage.
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: April 5, 2022
    Assignee: FEI Company
    Inventors: Henricus Gerardus Roeven, Rob Braan, Bart Jozef Janssen, Jeroen Keizer
  • Patent number: 11294448
    Abstract: Mobile devices, such as smartphones, are severely battery-limited. The capabilities of mobile device processors have increased at exponential rates, but battery technologies have improved at much slower rates. As a consequence, it is ever more important that mobile devices be operated in battery-preserving manners. An aspect of the present technology concerns methods and arrangements enabling on-going recognition-processing of imagery and audio by different detectors, without the high battery drain that has characterized the prior art. A variety of other features and arrangements are also detailed.
    Type: Grant
    Filed: November 21, 2019
    Date of Patent: April 5, 2022
    Assignee: Digimarc Corporation
    Inventor: Emma C. Sinclair
  • Patent number: 11295420
    Abstract: A method for correcting an image includes: orthographically correcting an image; removing a curtain artifact by applying a first filter to the orthographically corrected image; correcting brightness of the image, from which the curtain artifact is removed, by applying a second filter to the image, from which the curtain artifact is removed. The first filter includes a first function and a second function for a first domain and a second domain, which are orthogonal to each other in a frequency region, and the first filter is differentiable and continuous in the first domain and the second domain.
    Type: Grant
    Filed: October 29, 2020
    Date of Patent: April 5, 2022
    Assignees: SAMSUNG ELECTRONICS CO., LTD., RESEARCH & BUSINESS FOUNDATION SUNGKYUNKWAN UNIVERSITY
    Inventors: Sihyung Lee, Dongjae Kim, Jae Wook Nam, Wooram Hong
  • Patent number: 11294056
    Abstract: A spatial light modulator (SLM) has an array of pixels configured to modulate light in patterns responsive to first control signals. The modulated light forms at least one patterned light beam in a field of view. An illumination source is optically coupled to the SLM. The illumination source is configured to illuminate the array of pixels, responsive to second control signals. Circuitry is coupled to the SLM and to the illumination source. The circuitry is configured to provide the first control signals to the SLM and the second control signals to the illumination source. At least one detector is configured to detect a reflection of the patterned light beam in the field of view.
    Type: Grant
    Filed: January 6, 2020
    Date of Patent: April 5, 2022
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Terry Alan Bartlett, Stephen Aldridge Shaw, Patrick Ian Oden
  • Patent number: 11290665
    Abstract: There is provided a solid-state imaging device and an electronic apparatus that performs focus detection and image generation on objects of various shapes. A solid-state imaging device includes a pixel array in which multiple pixels are arrayed. The multiple pixels each receive light in a predetermined wavelength band. The pixel array includes at least one or more first pixels and at least one or more second pixels. The at least one or more first pixels each include a pair of sub-pixels provided beneath one microlens. The pair of sub-pixels is aligned in a first direction. The at least one or more second pixels each include a pair of sub-pixels provided beneath one microlens. The pair of sub-pixels is aligned in a second direction. The second direction is perpendicular to the first direction.
    Type: Grant
    Filed: September 21, 2018
    Date of Patent: March 29, 2022
    Assignee: SONY SEMICONDUCTOR SOLUTIONS CORPORATION
    Inventor: Kenji Azami
  • Patent number: 11285873
    Abstract: A method for generating surround view images derived from image data captured by cameras of a vehicular surround view vision system includes equipping a vehicle with a plurality of cameras disposed at the vehicle. Image data is captured by the cameras and provided to a control of the vehicle. The provided captured image data is processed to generate a first three-dimensional representation in accordance with a first curved surface model as if seen by a virtual observer from a first virtual viewing point exterior of the vehicle having a first viewing direction. The first representation is output to a display screen of the vehicle for display to the driver of the vehicle. Responsive to actuation of a user input, the processing is adjusted to generate a second three-dimensional representation in accordance with a second curved surface model, and the second representation is output to the display screen.
    Type: Grant
    Filed: October 5, 2020
    Date of Patent: March 29, 2022
    Assignee: MAGNA ELECTRONICS INC.
    Inventors: Joern Ihlenburg, Goerg Pflug, Achim Gieseke
  • Patent number: 11290669
    Abstract: An image reading apparatus includes a light emitter configured to irradiate an original with light, a reading device including a line sensor and an amplifier, a detector configured to detect a temperature of the reading device, a sampling portion configured to sample a value of the analog signal output from the amplifier, a converter configured to convert the value sampled by the sampling portion into a digital value. The sampling portion is configured to sample the analog signal corresponding to a first light-receiving element included in the plurality of light-receiving elements at a first timing in a case where the temperature detected by the detector is a first temperature, and to sample the analog signal corresponding to the first light-receiving element at a second timing, which is later than the first timing.
    Type: Grant
    Filed: March 31, 2020
    Date of Patent: March 29, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventor: Daisuke Akagi
  • Patent number: 11290715
    Abstract: The present invention relates to a video encoding/decoding method and apparatus. The video decoding method according to the present invention may comprise decoding filter information on a coding unit; classifying samples in the coding unit into classes on a per block classification unit basis; and filtering the coding unit having the samples classified into the classes on a per block classification unit basis by using the filter information.
    Type: Grant
    Filed: November 29, 2018
    Date of Patent: March 29, 2022
    Assignee: Electronics and Telecommunications Research Institute
    Inventors: Sung Chang Lim, Jung Won Kang, Ha Hyun Lee, Dong San Jun, Hyun Suk Ko, Jin Ho Lee, Hui Yong Kim
  • Patent number: 11284017
    Abstract: In order to improve linearity characteristics in synthesis processing for expanding a dynamic range, an image pickup apparatus comprising an AD conversion unit for performing AD conversion of input signals by comparing a first ramp signal or a second ramp signal; a first synthesis unit for synthesizing a first signal AD converted using the first ramp signal and a second signal AD converted using the second ramp signal; a first correction unit for correcting a level difference between the first signal and the second signal when the first signal and the second signal are synthesized; an amplifier for amplifying pixel signals by different gains; a second synthesis unit for synthesizing the signals amplified by the different gains; and a second correction unit for correcting a level difference between the signals amplified by the different gains when the signals amplified by the different gains are synthesized.
    Type: Grant
    Filed: March 19, 2021
    Date of Patent: March 22, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Yusuke Yamashita, Yasuhiro Itoh
  • Patent number: 11284024
    Abstract: The present technology relates to a solid-state imaging device, a driving method, and an electronic device that are able to enhance a gray scale of a combined pixel value obtained from a pixel including a plurality of photoelectric conversion units having different light receiving sensitivities. In a pixel array unit, a pixel including a plurality of photoelectric conversion units having different light receiving sensitivities is disposed. An analog to digital (AD) conversion unit that compares an electric signal corresponding to a charge of the photoelectric conversion unit having a low light receiving sensitivity among the plurality of photoelectric conversion units included in the pixel of the pixel array unit with a nonlinear reference signal that changes nonlinearly to perform AD conversion on the electric signal. The present technology is able to be applied to, for example, a complementary metal-oxide semiconductor (CMOS) image sensor.
    Type: Grant
    Filed: November 10, 2017
    Date of Patent: March 22, 2022
    Assignee: Sony Semiconductor Solutions Corporation
    Inventors: Naoki Kawazu, Atsushi Suzuki, Takumi Oka
  • Patent number: 11284061
    Abstract: Systems and methods for capturing a two dimensional (2D) image of a portion of a three dimensional (3D) scene may include a computer rendering a 3D scene on a display from a user's point of view (POV). A camera mode may be activated in response to user input and a POV of a camera may be determined. The POV of the camera may be specified by position and orientation of a user input device coupled to the computer, and may be independent of the user's POV. A 2D frame of the 3D scene based on the POV of the camera may be determined and the 2D image based on the 2D frame may be captured in response to user input. The 2D image may be stored locally or on a server of a network.
    Type: Grant
    Filed: April 25, 2019
    Date of Patent: March 22, 2022
    Assignee: ZSPACE, INC.
    Inventors: Jonathan J. Hosenpud, Arthur L. Berman, Jerome C. Tu, Kevin D. Morishige, David A. Chavez
  • Patent number: 11282391
    Abstract: A method for image processing at different illumination conditions, the method may include acquiring an image of an environment of a vehicle; selecting a set of pixels located within a region of interest that is located at an upper part of the image; calculating an illumination condition indicator based on values of the set of pixels; selecting a selected machine learning process, out of a machine learning processes, based on the illumination condition indicator; wherein different machine learning processes are trained to different illumination conditions; and processing the image by the selected machine learning process to provide processing results.
    Type: Grant
    Filed: February 25, 2020
    Date of Patent: March 22, 2022
    Assignee: CARTICA AI LTD.
    Inventors: Igal Raichelgauz, Karina Odinaev
  • Patent number: 11284157
    Abstract: Systems and methods are described for facilitating adjustment of multiple variables via a content guidance application. The method comprises generating, for display via a graphical user interface of a touchscreen, a first axis defining a first scale for a first adjustment characteristic. The method further comprises assigning to the first adjustment characteristic a plurality of first variables stored in memory. The method further comprises detecting, via the touchscreen, a touch input having a component along the first axis for adjusting the first adjustment characteristic. The method further comprises, in response to detecting the touch input, adjusting, in the memory, each of the plurality of first variables assigned to the first adjustment characteristic based on the touch input and the first scale.
    Type: Grant
    Filed: June 11, 2020
    Date of Patent: March 22, 2022
    Assignee: ROVI GUIDES, INC.
    Inventors: Riya Jomon, Susanto Sen
  • Patent number: 11277552
    Abstract: An image sensor includes a first and a second polarizing pixels in each of which transmission axis direction is different. Each of the first and second polarizing pixels has a same wavelength characteristic in transmittance, and has a sensitivity to a first and a second wavelength bandwidths. In each of the first and second polarizing pixels, a ratio of the transmittance in the transmission axis direction in the first and second wavelength bandwidths to a maximum value of the transmittance in the transmission axis direction in all wavelength bandwidths is 0.5 or more. In one of the first and second wavelength bandwidths, a ratio of the transmittance in a direction orthogonal to the transmission axis direction to the transmittance in the transmission axis direction is 0.5 or less, and in the other, the ratio is 0.5 or more.
    Type: Grant
    Filed: July 9, 2020
    Date of Patent: March 15, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Keita Nakamura
  • Patent number: 11275967
    Abstract: A computational method is disclosed for producing a sequence of high-resolution (HR) images from an input sequence of low-resolution (LR) images. The method uses a structured subspace framework to learn pairs of LR dictionaries from the input LR sequence ‘and’ employ learned pairs of LR dictionaries into estimating HR images. The structured subspace framework itself is based on a pair of specially structured HR basis matrices, wherein a HR basis spans any HR image whose so-called polyphase components (PPCs) are spanned by the corresponding LR dictionary.
    Type: Grant
    Filed: January 31, 2020
    Date of Patent: March 15, 2022
    Assignee: CICADA IMAGING INC.
    Inventor: Faisal M. al-Salem
  • Patent number: 11277619
    Abstract: Rate control techniques are provided for encoding an input video sequence into a compressed coded bitstream with multiple coding passes. The final coding pass may comprise final splices with non-overlapping frames that do not extend into neighboring final splices. A final splice in the final coding pass may correspond to at least one non-final splice in a non-final coding pass. A non-final splice may have overlapping frames that extend into neighboring final splices in the final coding pass. The overlapping frames in the non-final splice may be used to derive complexity information about the neighboring final splices. The complexity information about the neighboring final splices, as derived from the overlapping frames, may be used to allocate or improve rate control related budgets in encoding the final splice into the compressed coded bitstream in the final coding pass.
    Type: Grant
    Filed: June 18, 2020
    Date of Patent: March 15, 2022
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Athanasios Leontaris, Alexandros Tourapis
  • Patent number: 11275498
    Abstract: There is provided an information processing system, an information processing method, and a program capable of changing a process to be executed in response to a recognition result of an inclination of a hand with respect to an object. The information processing system includes: an acquisition unit configured to acquire a recognition result of an inclination of a hand with respect to an object when it is recognized that the hand is touching the object; and a change unit configured to change a value of a parameter related to a process to be executed on the basis of the recognition result.
    Type: Grant
    Filed: July 19, 2017
    Date of Patent: March 15, 2022
    Assignee: SONY CORPORATION
    Inventors: Kae Nagano, Tetsuo Ikeda
  • Patent number: 11272153
    Abstract: An information processing apparatus for determining a position of a virtual viewpoint for a virtual viewpoint image generated based on a plurality of images captured by a plurality of imaging apparatuses includes a first acquisition unit configured to acquire position information indicating a position existing within a predetermined range from a field to be captured by the plurality of imaging apparatuses, and a determination unit configured to determine, as the position of the virtual viewpoint for the virtual viewpoint image, a position different from the position indicated by the position information, based on the position information acquired by the first acquisition unit.
    Type: Grant
    Filed: December 19, 2018
    Date of Patent: March 8, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventors: Yasushi Shikata, Norihisa Suzuki, Kazuna Maruyama, Tomoaki Arai
  • Patent number: 11272119
    Abstract: High dynamic range imaging includes first image data captured using a first image sensor and a first exposure time, using a rolling shutter such that different lines within the first image data are captured at different times. Two or more instances of second image data are captured using second image sensors and second exposure times that are shorter than the first exposure time. The second image data are captured using a rolling shutter, and overlap at least in part with the first image data. A line of the first image data has a corresponding line in each instance of second image data, and the corresponding instances of second image data are captured at different second capture times. For a line in the first image data, the corresponding line from the instance of second image data is selected to be merged with the line in the first image data.
    Type: Grant
    Filed: November 2, 2020
    Date of Patent: March 8, 2022
    Assignee: AXIS AB
    Inventors: Song Yuan, Martin Santesson
  • Patent number: 11263734
    Abstract: An electronic device, a method and a storage medium are disclosed. The electronic device includes a processor and a memory operatively coupled to the processor. The processor is configured to receive a user input from an external electronic device. The processor is also configured to synthesize a first region that is a first partial region of a first raw image and a second partial region of a second raw image based on the user input to generate a composite raw image. The processor is further configured to modify at least one of a first attribute of the first raw image and a second attribute of the second raw image to generate a third attribute. Additionally, the processor is configured to calibrate the composite raw image using the third attribute to generate a composite image.
    Type: Grant
    Filed: March 19, 2020
    Date of Patent: March 1, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Changsu Han, Sungoh Kim, Youngjo Kim, Hyunhee Park, Jungeun Lee, Sungjun Lim, Hyungju Chun, Jongbum Choi, Jonghun Won, Arang Lee
  • Patent number: 11265490
    Abstract: Devices, methods, and non-transitory program storage devices for spatiotemporal image noise reduction are disclosed, comprising: maintaining an accumulated image in memory; and obtaining a first plurality of multispectral images (e.g., RGB-IR images). For each image in the first plurality of multispectral images, the method may: calculate a multispectral guide image for the current image; calculate blending weights for the current image; apply the calculated blending weights to each channel of the current image to generate a denoised current image; and update the accumulated image based on pixel differences between the denoised current image and the accumulated image. In some embodiments, additional images (e.g., the accumulated image and/or other images captured prior to or after a given current image) may also be included in the denoising operations for a given current image. Finally, the method may generate a denoised output image for each input image, based on the updated accumulated image.
    Type: Grant
    Filed: June 15, 2020
    Date of Patent: March 1, 2022
    Assignee: Apple Inc.
    Inventors: Ilya Romanenko, Alex Hayes
  • Patent number: 11265531
    Abstract: Aspects are generally directed toward creating a three-dimensional virtual model by a user identifying a three-dimensional object. Next, the system captures a plurality of two-dimensional images of the object in succession, the plurality of images being captured from different orientations, and recording the plurality of images on a storage medium. Then the system determines the relative change in position of the plurality of images by comparing two subsequent images, wherein the relative change is determined by a difference in color intensity values between the pixels of one image and another image, generates a plurality of arrays from the difference determined and generates a computer image from the plurality of arrays, wherein the computer image represents the three-dimensional object.
    Type: Grant
    Filed: November 30, 2020
    Date of Patent: March 1, 2022
    Assignee: HashD, Inc.
    Inventor: Marc Saunders
  • Patent number: 11256901
    Abstract: An image processing method performed at a computing device includes: identifying, using face recognition, one or more faces, each face corresponding to a respective person captured in a first image; for each identified face: extracting a set of profile parameters of a corresponding person in the first image; and selecting, from a plurality of image tiles, a first image tile that matches the face of the corresponding person in the first image in accordance with a predefined correspondence between the set of profile parameters of the corresponding person and a set of pre-stored description parameters of the first image tile; generating a second image by covering the faces of respective persons in the first image with their corresponding first image tiles; and sharing the first image and the second image in a predefined order via a group chat session.
    Type: Grant
    Filed: October 14, 2019
    Date of Patent: February 22, 2022
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventors: Zhenwei Zhang, Xinlei Zhang
  • Patent number: 11258957
    Abstract: An auto exposure method for an image sensor includes (a) evaluating variance, for each of a plurality of histograms of the pixel values from a respective plurality of individual exposures of the image sensor at respective exposure 5 time settings, of contribution from individual bins of the histogram to total entropy of the histogram, to determine an optimal exposure time for the image sensor corresponding to a minimum value of the variance, and (b) outputting the optimal exposure time to the image sensor.
    Type: Grant
    Filed: September 5, 2019
    Date of Patent: February 22, 2022
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Jon S. McElvain, Walter C. Gish, Jonathan Robert Miller, Gregory John Ward, Robin Atkins
  • Patent number: 11256906
    Abstract: Disclosed is a face verification method and apparatus. The method including analyzing a current frame of a verification image, determining a current frame state score of the verification image indicating whether the current frame is in a state predetermined as being appropriate for verification, determining whether the current frame state score satisfies a predetermined validity condition, and selectively, based on a result of the determining of whether the current frame state score satisfies the predetermined validity condition, extracting a feature from the current frame and performing verification by comparing a determined similarity between the extracted feature and a registered feature to a set verification threshold.
    Type: Grant
    Filed: December 4, 2020
    Date of Patent: February 22, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Changyong Son, Wonsuk Chang, Deoksang Kim, Dae-Kyu Shin, Byungin Yoo, Seungju Han, Jaejoon Han, Jinwoo Son, Chang Kyu Choi
  • Patent number: 11256741
    Abstract: An automatic video tagging system which learns from videos, their web context and comments shared on social networks is described. Massive multimedia collections are analyzed by Internet crawling and a knowledge base is maintained that updates in real time with no need of human supervision. As a result, each video is indexed with a rich set of labels and linked with other related contents. Practical applications of video recognition require a label scheme that is appealing to the end-user (i.e. obtained from social curation) and a training dataset that can be updated in real-time to be able to recognize new actions, scenes and people. To create this dataset that evolves in real-time and uses labels that are relevant to the users, a weakly-supervised deep learning approach is utilized combining both a machine-learning pre-processing stage together with a set of keywords obtained from the internet.
    Type: Grant
    Filed: October 30, 2017
    Date of Patent: February 22, 2022
    Assignee: Vertex Capital LLC
    Inventors: Elisenda Bou Balust, Juan Carlos Riveiro Insua, Delia Fernandez Cañellas, Joan Espadaler Rodes, Asier Aduriz Berasategi, David Varas Gonzalez
  • Patent number: 11258960
    Abstract: An imaging device further includes a correction gain calculating unit configured to calculate a first correction gain of a first partial image captured by the first imaging element and calculate a second correction gain of a second partial image captured by the second imaging element based on the first exposure amount and the second exposure amount; a photographing processing unit configured to make an imaging element having a smaller one of the first exposure amount and the second exposure amount image with an exposure amount of the imaging element and makes an imaging element having a larger one of the first exposure amount and the second exposure amount image with the third exposure amount; and an image correction unit configured to correct the first partial image with the first correction gain and correct the second partial image with the second correction gain calculated by the correction gain calculating unit.
    Type: Grant
    Filed: February 26, 2020
    Date of Patent: February 22, 2022
    Assignee: RICOH COMPANY, LTD.
    Inventor: Yasuhiro Kazama
  • Patent number: 11258956
    Abstract: An image capturing apparatus including: an imaging sensor and a processor configured to set a first exposure time and a second exposure time obtained by dividing the first exposure time by an integer m where m is an integer equal to or larger than 2; control the imaging sensor to capture frames successively by repeatedly performing exposure including at least exposure for one frame having the first exposure time and exposure for m frames having the second exposure time as one set; acquire image data of each frame from the imaging sensor; generate image data of an average frame that is an average of pieces of image data of the m frames having the second exposure time in the one set; and generate a composite frame for recording or displaying a motion picture of an extended dynamic range according to image data of the one frame having the first exposure time and the image data of the average frame.
    Type: Grant
    Filed: August 31, 2020
    Date of Patent: February 22, 2022
    Assignee: FUJIFILM Corporation
    Inventor: Shinya Fujiwara
  • Patent number: 11258972
    Abstract: An image sensor includes a pixel array including a plurality of pixels arranged in a matrix, the plurality of pixels configured to generate separate, respective pixel signals, a row driver configured to selectively read pixel signals generated by pixels of a plurality of rows of the pixel array, a binning circuitry configured to selectively sum or pass through the read pixel signals to generate binned pixel signals, a column array including a plurality of analog-to-digital converters (ADCs) configured to perform an analog-to-digital conversion on the binned pixel signals, and a mode selecting circuitry configured to control the row driver and the binning circuitry to change an operation mode of the image sensor based on a mode signal received at the image sensor to change an operation mode of the image sensor.
    Type: Grant
    Filed: March 6, 2020
    Date of Patent: February 22, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventor: Kyounghwan Moon
  • Patent number: 11252369
    Abstract: A readout circuit includes a ramp generator for generating a plurality of first short ramps having a first level in a reset conversion phase and a plurality of second short ramps having a second level greater than the first level and a full-scale ramp having a third level greater than the second level in a signal conversion phase, a comparator for comparing a first analog signal with each one of the first short ramps to obtain a plurality of first comparison results in the reset conversion phase, and comparing a second analog signal with each one of the second short ramps and the full-scale ramp in the signal conversion phase to generate a plurality of second comparison results and a third comparison result, and a controller configured to determine an output signal value of the second analog signal according to the plurality of second comparison results and the third result.
    Type: Grant
    Filed: April 2, 2020
    Date of Patent: February 15, 2022
    Assignee: SHENZHEN GOODIX TECHNOLOGY CO., LTD.
    Inventor: Matthew Powell
  • Patent number: 11252355
    Abstract: The present technology relates to an image pickup device and an electronic device that enables a reduction in influence exerted by a dark current. The image pickup device and the electronic device include a sample and hold unit configured to perform sampling and holding of a pixel signal, an analog digital (AD) conversion unit configured to perform AD conversion of the pixel signal that includes a digit after a decimal point, a digital gain processing unit configured to apply a predetermined gain to a digital signal from the AD conversion unit, and a gain setting unit configured to set an analog gain of a column unit including the sample and hold unit and the AD conversion unit. The gain setting unit sets the analog gain in accordance with a measured dark current amount. The present technology can be applied, for example, to a CMOS image sensor.
    Type: Grant
    Filed: February 20, 2019
    Date of Patent: February 15, 2022
    Assignee: SONY SEMICONDUCTOR SOLUTIONS CORPORATION
    Inventors: Chihiro Okada, Hung Luong
  • Patent number: 11250265
    Abstract: An image processing method includes: determining a current orientation of a target object; judging whether the current orientation satisfies a set condition; if satisfied, controlling a display screen of the device to display a prompt message to prompt the object to adjust the current orientation to not satisfy the condition; if not satisfied, adjusting a display parameter of a viewing frame to indicate that photographing is allowed; loading the target virtual image to a region where the viewing frame is located, in response to a photographing button being triggered, to acquire a target image after a portion of the object in the viewing frame has been replaced by a target virtual image. A photographer can therefore be guided by the current orientation to photograph correctly, thereby improving photographing quality and experience.
    Type: Grant
    Filed: November 29, 2019
    Date of Patent: February 15, 2022
    Assignee: BEIJING XIAOMI MOBILE SOFTWARE CO., LTD.
    Inventors: Xirui Du, Junzeng Du
  • Patent number: 11243639
    Abstract: A touch detection method is performed by a controller of a touch sensor of a capacitive type including sensor electrodes. The touch detection method includes acquiring detection values at crossing positions of the sensor electrodes, acquiring capacitance values for the crossing positions, calculating difference values for the crossing positions, each of the detection values being obtained by subtracting the moving average for one of the crossing positions from one of the difference values for the one of the crossing positions, acquiring a maximum value among the detection values at the crossing positions, determining a first threshold value by subtracting a subtraction value, which is a fixed value or a value that decreases as the maximum value increases, from the maximum value, and deriving a position of the indicator based on the detection values at the crossing positions with reference to the first threshold value.
    Type: Grant
    Filed: March 29, 2021
    Date of Patent: February 8, 2022
    Assignee: Wacom Co., Ltd.
    Inventors: Yoshio Nomura, Kazuhiro Miyoshi, Sadao Yamamoto
  • Patent number: 11245843
    Abstract: Information on posture data that can be used for processing on a frame basis can be acquired for moving image data to be captured. For the purpose, in an imaging apparatus including an imaging unit that captures an image by an optical system to generate image data, a posture data generation unit that generates posture data of a casing including the imaging unit at a timing corresponding to the image data, a notification unit that performs notification for correlating the image data with the posture data on the basis of a trigger, and a detector that detects the notification by the notification unit are provided.
    Type: Grant
    Filed: March 5, 2018
    Date of Patent: February 8, 2022
    Assignee: SONY CORPORATION
    Inventors: Ryuichi Tadano, Hiroshi Yamamoto, Sho Nakagawa, Takayoshi Ozone
  • Patent number: 11245852
    Abstract: An apparatus obtains a captured image, obtains exposure setting relating to the captured image, obtains for luminance of a scene, sets a mode for generating the display image; and generates the display image by performing luminance conversion of the captured image depending on the set mode. The apparatus performs, in a case where a first mode is set, the luminance conversion of the captured image using a first conversion characteristic indicating that output luminance after conversion is determined for the luminance of the scene, and does not change depending on the exposure setting. And the apparatus performs, in a case where a second mode is set, the luminance conversion of the captured image using a second conversion characteristic indicating that the output luminance changes depending on the exposure setting.
    Type: Grant
    Filed: March 4, 2021
    Date of Patent: February 8, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Tomoyuki Shiozaki
  • Patent number: 11233084
    Abstract: An image sensor includes one or more first unit pixels. Each of the one or more first unit pixels may include a first photoelectric conversion region including first photoelectric conversion elements arranged in the form of a matrix, and a first floating diffusion region at a center of the first photoelectric conversion elements; a first transistor region including a first active region in which a first reset gate, a first select gate and a first drive gate are disposed; a first signal interconnect electrically connecting the first floating diffusion region to the first drive gate; and a first shielding interconnect separated from the first signal interconnect and extending parallel to the first signal interconnect.
    Type: Grant
    Filed: October 24, 2019
    Date of Patent: January 25, 2022
    Assignee: SK hynix Inc.
    Inventors: Jong-Hwan Shin, Hye-Won Mun, Hoon-Sang Oh
  • Patent number: 11231887
    Abstract: An image forming apparatus includes a CPU, and receives print information transmitted from an information processing device via a network. The image forming apparatus generates an output image according to the print information, and if a non-matching character which a user recognizes with difficulty is included in the output image, generates a corrected image in which all or a part of the non-matching character is corrected.
    Type: Grant
    Filed: June 2, 2020
    Date of Patent: January 25, 2022
    Assignee: SHARP KABUSHIKI KAISHA
    Inventor: Yuhsuke Nagai
  • Patent number: 11227429
    Abstract: In an image processing apparatus, three-dimensional shape data indicating a shape of an object is generated based on at least one of a plurality of images captured from different directions by a plurality image capturing devices. Color information indicating a color of each element of the three-dimensional shape data is generated based on the generated three-dimensional shape data and the plurality of images. The three-dimensional shape data and the color information are associated with each other and written to a storage unit as material data for generating a virtual viewpoint image corresponding to virtual viewpoint information indicating a virtual viewpoint.
    Type: Grant
    Filed: May 24, 2019
    Date of Patent: January 18, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Hironao Ito
  • Patent number: 11227146
    Abstract: The subject matter described in this disclosure can be embodied in methods and systems for stabilizing video. A computing system determines a stabilized location of a facial feature in a frame of video accounting for its location in a previous frame. The computing system determines a physical camera pose in virtual space and maps the frame into virtual space. The computing system determines an optimized virtual camera pose using an optimization process that determines (1) a difference between the stabilized location of the facial feature and a location of the facial feature when viewed from a potential virtual camera pose, (2) a difference between the potential virtual camera pose and a previous virtual camera pose, and (3) a difference between the potential virtual camera pose and the physical camera pose. The computing system generates the stabilized view of the frame using the optimized virtual camera pose.
    Type: Grant
    Filed: August 10, 2020
    Date of Patent: January 18, 2022
    Assignee: Google LLC
    Inventors: Chia-Kai Liang, Fuhao Shi
  • Patent number: 11228744
    Abstract: A method for controlling a projection system including a projector and a portable apparatus including a camera includes causing the projector to project light representing a pattern image, acquiring image data from the camera that captures the light, determining a path in the pattern image based on a change in the image data according to displacement of the camera, and generating a filter that changes a portion of an image projected by the projector in the range defined by the path.
    Type: Grant
    Filed: December 22, 2020
    Date of Patent: January 18, 2022
    Assignee: SEIKO EPSON CORPORATION
    Inventor: Kentaro Kadota
  • Patent number: 11228710
    Abstract: An aerial vehicle is configured to process an image captured by an imaging device, and to identify a portion of the image that is likely to appear in images subsequently captured by the imaging device based on the motion of the aerial vehicle. A control unit aboard the aerial vehicle generates instructions for controlling such motion and provides the instructions to the imaging device. Based on such instructions, the imaging device processes the image to identify a portion of the image that will appear within a field of view of the imaging device following the motion, and selects a shutter speed, an aperture, a level of gain, or another attribute of the imaging device based on the portion of the image, in order to optimize the quality of an image subsequently captured by the imaging device.
    Type: Grant
    Filed: June 24, 2020
    Date of Patent: January 18, 2022
    Assignee: Amazon Technologies, Inc.
    Inventors: Scott Battocchi, Joshua Watson
  • Patent number: 11222466
    Abstract: Techniques are disclosed for changing the identities of faces in video frames and images. In embodiments, three-dimensional (3D) geometry of a face is used to inform the facial identity change produced by an image-to-image translation model, such as a comb network model. In some embodiments, the model can take a two-dimensional (2D) texture map and/or a 3D displacement map associated with one facial identity as inputs and output another 2D texture map and/or 3D displacement map associated with a different facial identity. The other 2D texture map and/or 3D displacement map can then be used to render an image that includes the different facial identity.
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: January 11, 2022
    Assignees: Disney Enterprises, Inc., ETH Zürich (Eidgenössische Technische Hochschule Zürich)
    Inventors: Jacek Krzysztof Naruniec, Derek Edward Bradley, Thomas Etterlin, Paulo Fabiano Urnau Gotardo, Leonhard Markus Helminger, Christopher Richard Schroers, Romann Matthew Weber
  • Patent number: 11216682
    Abstract: The technology relates to detecting possible imaging sensor occlusion. In one example, a system including an imaging sensor and one or more processors may be configured to capture first image data using the imaging sensor. The one or more processors may encode the first image data into an uncompressed image file and generate a compressed image file based on the uncompressed image file. The file size of the compressed image file may be determined and based on the file size of the compressed image file, the system may determine that the imaging sensor is possibly occluded.
    Type: Grant
    Filed: November 16, 2020
    Date of Patent: January 4, 2022
    Assignee: Waymo LLC
    Inventor: Ruffin Evans
  • Patent number: 11216075
    Abstract: A method, an apparatus and a device are provided for triggering a shooting mode, and a storage medium, and belongs to the field of man-machine interaction. The method includes: acquiring a shooting preview image; recognizing gesture information in the shooting preview image; and triggering a shooting mode corresponding to a number characterized by the gesture information when the gesture information is gesture information characterizing the number.
    Type: Grant
    Filed: April 30, 2020
    Date of Patent: January 4, 2022
    Assignee: Beijing Xiaomi Mobile Software Co., Ltd.
    Inventors: Qian Wang, Yuhang Liang
  • Patent number: RE48945
    Abstract: A multi-aperture imaging system comprising a first camera with a first sensor that captures a first image and a second camera with a second sensor that captures a second image, the two cameras having either identical or different FOVs. The first sensor may have a standard color filter array (CFA) covering one sensor section and a non-standard color CFA covering another. The second sensor may have either Clear or standard CFA covered sections. Either image may be chosen to be a primary or an auxiliary image, based on a zoom factor. An output image with a point of view determined by the primary image is obtained by registering the auxiliary image to the primary image.
    Type: Grant
    Filed: April 15, 2019
    Date of Patent: February 22, 2022
    Assignee: Corephotonics Ltd.
    Inventors: Gal Shabtay, Noy Cohen, Oded Gigushinski, Ephraim Goldenberg