Camera And Video Special Effects (e.g., Subtitling, Fading, Or Merging) Patents (Class 348/239)
  • Patent number: 10817379
    Abstract: An information processing apparatus which is provided with firmware, comprises: obtaining means for obtaining a data set of firmware; update means for performing firmware update using the data set of the firmware obtained by the obtaining means; and applying means for applying customized data indicating a setting value for a function of the firmware to the firmware provided in the information processing apparatus, wherein in a case where customized data is included in the data set of the firmware obtained by the obtaining means, the applying means applies the customized data.
    Type: Grant
    Filed: September 28, 2016
    Date of Patent: October 27, 2020
    Assignee: Canon Kabushiki Kaisha
    Inventor: Hideo Asahara
  • Patent number: 10819915
    Abstract: The disclosure provides for a novel system for generating a high dynamic range video of a colloid under investigation. This helps record images of various sizes of nanoparticles that scatter light with very different efficiencies (effective cross-sections), typically orders of magnitude different.
    Type: Grant
    Filed: April 9, 2020
    Date of Patent: October 27, 2020
    Assignee: HORIBA INSTRUMENTS INCORPORATED
    Inventor: Jan J. Tatarkiewicz
  • Patent number: 10812736
    Abstract: A method of applying an image effect based on recognized objects involves capturing an imaging area comprising at least one object as an image stream through operation of an image sensor. The method recognizes the at least one object in the image stream through operation of an object detection engine. The method communicates at least one correlated image effect control to an image processing engine, in response to the at least one object comprising an optical label. The method communicates at least one matched image effect control to the image processing engine, in response to receiving at least a labeled image stream at an image effect matching algorithm from the object detection engine. The method generates a transformed image stream displayable through a display device by applying at least one image effect control to the image stream through operation of the image processing engine.
    Type: Grant
    Filed: December 24, 2018
    Date of Patent: October 20, 2020
    Assignee: Polarr, Inc.
    Inventors: Borui Wang, Zhen Hua Yan
  • Patent number: 10810712
    Abstract: In an apparatus for monitoring surroundings of a vehicle based on a plurality of images captured by a plurality of imagers through a windshield of the vehicle, an image acquirer is configured to acquire the plurality of images captured by the plurality of imagers, and a distortion corrector is configured to correct the plurality of images based on an optical distortion distribution of the windshield.
    Type: Grant
    Filed: September 28, 2018
    Date of Patent: October 20, 2020
    Assignees: DENSO CORPORATION, TOYOTA JIDOSHA KABUSHIKI KAISHA, RICOH COMPANY, LTD.
    Inventors: Toshihiko Terada, Masaki Kuwahara, Hiroaki Ito, Naohide Uchida, Jun Kishiwada
  • Patent number: 10805531
    Abstract: An image processing system, an image generation apparatus, and an image generation method are provided. The image processing system includes a switching unit configured to switch an operating mode of the image processing system between at least a first mode and a second mode, a detection unit configured to detect a joining position among a plurality of input images to generate a detection result, and a joining unit configured to join the plurality of input images to generate an output image. When the mode is switched to the first mode, the joining unit joins the plurality of input images based on the detection result of the detection unit to generate the output image. When the mode is switched to the second mode, the joining unit joins the plurality of input images to generate the output image, without causing the detection unit to generate the detection result.
    Type: Grant
    Filed: September 10, 2018
    Date of Patent: October 13, 2020
    Assignee: RICOH COMPANY, LTD.
    Inventor: Tetsuya Satoh
  • Patent number: 10785406
    Abstract: A method of assisting photography includes: receiving input related to an object of interest to be photographed; obtaining a collection of information sets associated with the object of interest, each of the information sets including a respective location at which to take a respective photograph of the object of interest; selecting a particular information set of the collection of information sets, the location in the particular information set being a particular location at which to take a particular photograph of the object of interest; and providing user directional guidance through a user interface of a mobile device to direct a user of the mobile device to the particular location.
    Type: Grant
    Filed: February 1, 2019
    Date of Patent: September 22, 2020
    Assignee: QUALCOMM Incorporated
    Inventors: Venkata Mahesh Lanka, Santhosh Kumar Behara, Akash Kumar, Mohammed Ghouse Pasha, Ankita
  • Patent number: 10776970
    Abstract: Embodiments of the present application provide a method and an apparatus for processing a video image. The method includes: obtaining a video image to be processed and a business object to be displayed, wherein the video image comprises a background area and a foreground area comprising a target object non-overlapping with the background area; determining the background area of the video image; performing an action detection on the target object in the foreground area to obtain action detection data; determining a display position of the business object in the video image according to the action detection data; and drawing, according to the display position, the business object in the background area of the video image by means of computer graphics.
    Type: Grant
    Filed: December 10, 2019
    Date of Patent: September 15, 2020
    Assignee: Beijing Sensetime Technology Development Co., Ltd.
    Inventors: Qing Luan, Jianping Shi
  • Patent number: 10771676
    Abstract: A focus control device includes a region setting section 2010 that sets a plurality of regions, each including a plurality of pixels, to an image acquired by an imaging section 200, an AF evaluation value calculation section 2020 that calculates an AF evaluation value of each of the plurality of regions, an invalid region setting section (invalid block setting section 2050) that sets an invalid region (low contrast determination invalid block) in the plurality of regions, a low contrast state determination section 2075 that determines whether or not the target subject is in a low contrast state based on the AF evaluation value of a region, in the plurality of regions, other than the invalid region, and a focus control section 2000 that controls an in-focus object plane position based on the AF evaluation value. The focus control section 2000 is configured to implement the focus control varying depending on a determination result obtained by the low contrast state determination section 2075.
    Type: Grant
    Filed: July 9, 2018
    Date of Patent: September 8, 2020
    Assignee: OLYMPUS CORPORATION
    Inventor: Koichiro Yoshino
  • Patent number: 10764508
    Abstract: An apparatus provides a unit capable of improving gradation characteristics of a plurality of images (crop images) even in a case where a plurality of users individually performs cropping (cutting out) on a distributed image, calculates a target gradation range based on histograms of the regions cropped by the plurality of users, and executes gradation conversion based on an overlapping ratio of the plurality of target gradation ranges.
    Type: Grant
    Filed: July 25, 2018
    Date of Patent: September 1, 2020
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Hirotaka Omori
  • Patent number: 10762387
    Abstract: Embodiments of the present disclosure disclose a method and an apparatus for processing an image. A specific embodiment of the method includes: acquiring a target image including a polygon image; inputting the target image into a pre-trained convolutional neural network to obtain a characteristic vector of the target image, the convolutional neural network being used to represent a correspondence relationship between an image and a characteristic vector, and the characteristic vector being a vector including a category feature, a position feature, and a keypoint feature of the polygon image; and recognizing an image area of the polygon image based on the category feature, the position feature, and the keypoint feature. This embodiment improves the accuracy of polygon image recognition.
    Type: Grant
    Filed: September 18, 2018
    Date of Patent: September 1, 2020
    Assignee: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
    Inventors: Yang Hu, Shilei Wen, Xiao Liu, Xubin Li, Errui Ding
  • Patent number: 10764495
    Abstract: An image processing apparatus includes processing circuitry. The processing circuitry is configured to detect a positional shift amount of each of a plurality of images; select a composite target image from the plurality of images based on the detected positional shift amount; and obtain a composite image based on the positional shift amount and the selected composite target image.
    Type: Grant
    Filed: December 12, 2018
    Date of Patent: September 1, 2020
    Assignee: Ricoh Company, Ltd.
    Inventors: Hiroyasu Uehara, Masakazu Terauchi, Masashi Miyata, Hiroshi Kano, Akira Nakano, Takeyoshi Nishimura
  • Patent number: 10755743
    Abstract: The present technology is a video recording system and method of recording a video while applying special effects in real time prior to and/or while recording. The system includes a processing unit in communication with a camera and a memory unit. The processor receives a raw video data at a native speed rate from the camera or remote video stream, and an input from an interface. The system determines if the native speed rate of the raw video data is to be changed, and if so then modifies at least one frame in the raw video data to create a modified video data at a modified speed rate that is different to the native speed rate. The system then generates an output video recording data and writes it to memory. This allows for the continuous recording of video from the camera or video feed at different speed rates without altering camera operations or settings.
    Type: Grant
    Filed: June 28, 2019
    Date of Patent: August 25, 2020
    Inventors: Henry M. Pena, Thomas F. Bryant, III
  • Patent number: 10735721
    Abstract: An encoder includes circuitry and memory. Using the memory, the circuitry: generates a prediction image to be used to encode a current block to be processed; derives a luminance correction parameter by referring to an image region which is included in an image including the current block and is outside the current block; and corrects the prediction image to be used to encode the current block, using the luminance correction parameter. The luminance correction parameter is used in common between a plurality of blocks included in the image.
    Type: Grant
    Filed: April 17, 2019
    Date of Patent: August 4, 2020
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Kiyofumi Abe, Takahiro Nishi, Tadamasa Toma, Ryuichi Kanoh
  • Patent number: 10725540
    Abstract: Augmented reality speed reading is provided by detecting a reader's changing gaze direction; detecting movements of the reader's eye; and between movements of the reader's eye, displaying text at the reader's gaze direction. An exemplary apparatus includes an eye illuminator that delivers light to a reader's eye; an eyeward camera that generates digital images of the reader's eye including reflected light from the eye illuminator; a display; and a processor that is connected in communication with the eyeward camera and the display. The processor implements an eye tracking module that receives the digital images from the eyeward camera and detects the reader's gaze direction, and the processor implements a text display module that controls the display to present text at the reader's gaze direction.
    Type: Grant
    Filed: June 29, 2018
    Date of Patent: July 28, 2020
    Assignee: International Business Machines Corporation
    Inventors: Aldis Sipolins, Jenna Reinen, Ravi Tejwani, Marco Cavallo, Hui Wu
  • Patent number: 10721405
    Abstract: A digital graduated filter is implemented in an imaging device by combining multiple images of the subject wherein the combining may include combining different numbers of images for highlights and for shadows of the subject. The imaging device may present a user with a set of pre-defined graduated filter configurations to choose from. A user may also specify the direction of graduation and strength of graduation in a viewfinder. In an alternative implementation, combining may include scaling of pixels being added instead of varying the number of images being combined. In an alternative implementation, the combining of multiple images may include combining a different number of images for highlights of the subject than for shadows of subject.
    Type: Grant
    Filed: July 1, 2019
    Date of Patent: July 21, 2020
    Assignee: CLEAR IMAGING RESEARCH, LLC
    Inventor: Fatih M. Ozluturk
  • Patent number: 10708557
    Abstract: In one embodiment, a method includes accessing first image data generated by a first image sensor having a first filter array that has a first filter pattern. The first filter pattern includes a first filter type corresponding to a spectrum of interest and a second filter type. The method also includes accessing second image data generated by a second image sensor having a second filter array that has a second filter pattern different from the first filter pattern. The second filter pattern includes a number of second filter types, the number of second filter types and the number of first filter types have at least one filter type in common. The method also includes determining a correspondence between one or more first pixels of the first image data and one or more second pixels of the second image data.
    Type: Grant
    Filed: December 14, 2018
    Date of Patent: July 7, 2020
    Assignee: Lyft Inc.
    Inventors: Forrest Samuel Briggs, Romain Clément, Yi Zhou
  • Patent number: 10705408
    Abstract: An electronic device to autofocus on an object-of-interest within a field-of-view of the electronic device, includes an image sensor and a circuitry. The image sensor captures a sequence of image frames that includes a current frame and detect at least one prominent region in the current frame. The detected at least one prominent region has an optical flow similar to a direction of motion of the electronic device. The circuitry selects a region-of-interest from the detected at least one prominent region and estimates an autofocus point in the detected at least one prominent region. The circuitry controls focus of the image sensor at the estimated autofocus point in the current frame. The focus of the image sensor is controlled such that the estimated autofocus point exhibits a minimum deviation from an initialized position for the estimated autofocus point within the detected at least one prominent region.
    Type: Grant
    Filed: October 17, 2018
    Date of Patent: July 7, 2020
    Assignee: SONY CORPORATION
    Inventor: Junji Shimada
  • Patent number: 10701262
    Abstract: A server includes a photo filter module with instructions executed by a processor to identify when a client device captures a photograph. Photograph filters are selected based upon attributes of the photograph. The photograph filters are supplied to the client device.
    Type: Grant
    Filed: May 22, 2019
    Date of Patent: June 30, 2020
    Assignee: Snap Inc.
    Inventor: Timothy Sehn
  • Patent number: 10691418
    Abstract: Disclosed herein are system, method, and computer program product embodiments for providing an integration application design tool supporting integration-scenario modeling on mobile devices. The integration application design tool determines a focus node in an integration scenario. To conserve system resources, the integration application design tool loads data associated with that focus node. The integration application design tool displays only a visible area of predecessor nodes and successor nodes based on a neighborhood value. The integration application design tool receives interaction primitives from a user to navigate the integration scenario, examine properties of the nodes, and perform appropriate operations related to the design and modification of the integration scenario.
    Type: Grant
    Filed: January 22, 2019
    Date of Patent: June 23, 2020
    Assignee: SAP SE
    Inventors: Daniel Ritter, Egor Hinz
  • Patent number: 10672167
    Abstract: In some implementations, a computing device can generate a synthetic group selfie. For example, a synthetic group selfie can be an arrangement or composition of individual selfies obtained from a plurality of computing devices into a single group image (e.g., synthetic group selfie). The individual selfie images can be still images, stored video images, or live streaming images. Thus, the synthetic group selfie can be a composition of still images, stored video images, or live streaming video images. The computing device can automatically arrange the individual selfies into the synthetic group selfie. The synthetic group selfie can be stored as a multi-resource object that preserves the individual selfie images so that the user who created the synthetic group selfie or a recipient of the synthetic group selfie can modify the arrangement of the individual selfies within the synthetic group selfie.
    Type: Grant
    Filed: July 11, 2018
    Date of Patent: June 2, 2020
    Assignee: Apple Inc.
    Inventor: Jean-Francois M Albouze
  • Patent number: 10657684
    Abstract: A system and method for displaying in a two-dimensional array the structured interaction of two variables moving in tandem to achieve a target outcome: e.g., a chemical reaction balancing heat and pressure to produce a desired compound, or an aircraft changing speed over angles of attack. Underlying system operating variables are represented in the display as proxy values of X and Y, scaled so the range and interval of X- and Y-axes are the same. The resulting display is a “matched array” of all possible X,Y intersections, including a unique and clearly-delineated “alignment vector” of those cells in which proxy values of X equal proxy values of Y, the jointly-optimal values of the underlying system operating variables. Wherever X and Y intersect, indicators depict the operating variable values, their proximity to optimal on the alignment vector, and the direction and extent of adjustments needed to achieve optimal system performance.
    Type: Grant
    Filed: February 10, 2020
    Date of Patent: May 19, 2020
    Assignee: EffectiveTalent Office LLC
    Inventor: Craig M. Watson
  • Patent number: 10645274
    Abstract: A server apparatus performs communication with a distributor terminal that is used by a distributor of live content, and a viewer terminal that is used by a viewer of the live content. The server apparatus includes a photographing condition acquisition unit, a photographing instruction signal transmission unit, and a photographed image acquisition unit. The photographing condition acquisition unit acquires a photographing condition set by the distributor from the distributor terminal. The photographing instruction signal transmission unit transmits a photographing instruction signal, which allows a photographing operation to be executed in a case where the viewer satisfies the photographing condition, to the viewer terminal. The photographed image acquisition unit acquires a photographed image obtained by the photographing operation from the viewer terminal.
    Type: Grant
    Filed: September 25, 2018
    Date of Patent: May 5, 2020
    Assignee: DWANGO Co., Ltd.
    Inventors: Nobuo Kawakami, Hiroaki Saito, Takashi Kojima
  • Patent number: 10645273
    Abstract: An image capture apparatus includes an image capture instruction obtaining unit configured to obtain an image capture instruction that specifies a target portion of a subject, an image capture instruction display unit configured to display the image capture instruction in a chart indicating the subject displayed on a display screen, and a reception unit configured to receive an image capture command in a state in which the image capture instruction is displayed on the display screen.
    Type: Grant
    Filed: June 5, 2018
    Date of Patent: May 5, 2020
    Assignee: Canon Kabushiki Kaisha
    Inventor: Ken-ichi Abe
  • Patent number: 10642953
    Abstract: Systems and methods for multi-modality data processing are provided. Some embodiments are particularly directed to labeling and indexing multi-modality medical data. In one embodiment, a method for labeling medical data received by a multi-modality medical processing system includes receiving, by the medical processing system, medical data to be labeled. A reference set of labels corresponding to the medical data is presented at a display device. A selection of a first label from the reference set of labels is received from an interface device. A target set of labels corresponding to the medical data is presented at the display device, the target set of labels based on the first label. A selection of a second label from the target set of labels is received from the interface device. The medical data is then labeled based on the first and second labels.
    Type: Grant
    Filed: December 19, 2013
    Date of Patent: May 5, 2020
    Assignee: PHILIPS IMAGE GUIDED THERAPY CORPORATION
    Inventors: Aaron Cheline, Asher Cohen
  • Patent number: 10635931
    Abstract: The present technology relates to an information processing device, an information processing method, and a program that are designed to enable easy generation of a path for successively displaying characteristic images. The information processing device includes a setting unit that sets a path for connecting characteristic portions in at least one image by referring to metadata including at least information about feature points detected from the image. The setting unit sets the path by determining a regression curve, using the feature points. In a case where the feature points include a feature point at a distance equal to or longer than a predetermined threshold value from the regression curve, the setting unit redetermines the regression curve after removing a feature point detected from an image including a feature point having a low score among the feature points. The present technology can be applied to information processing devices that process still images and moving images.
    Type: Grant
    Filed: October 2, 2015
    Date of Patent: April 28, 2020
    Assignee: Sony Corporation
    Inventors: Kazuhiro Shimauchi, Seijiro Inaba, Nobuho Ikeda, Hiroshi Ikeda, Shuichi Asajima, Yuki Ono
  • Patent number: 10623664
    Abstract: An image processing system includes: a receiving unit configured to receive an input of a plurality of image frames constituting a video from an imaging apparatus; a detection unit configured to detect a feature point included in an image frame to be processed in the plurality of image frames; and an output unit configured to output an output image obtained by superimposing an image frame to be processed of an area detected as a feature point on a background image generated from at least some of a plurality of image frames.
    Type: Grant
    Filed: March 7, 2019
    Date of Patent: April 14, 2020
    Assignee: NEC CORPORATION
    Inventor: Ryo Kawai
  • Patent number: 10613335
    Abstract: Provided is a light guide plate for an image display device which uses lead-free glass, has excellent color reproducibility and a light weight, and may obtain a wide viewing angle. A light guide plate for an image display device, which guides image light inputted from an image display element and outputs the image light toward a user's pupil, is configured to be made of lead-free glass having a refractive index of 1.8 or more with respect to a wavelength of the image light, and to have internal transmittance of 0.6 or more with respect to a wavelength of 400 nm when a plate thickness is 10 mm.
    Type: Grant
    Filed: July 11, 2019
    Date of Patent: April 7, 2020
    Assignee: HOYA CANDEO OPTRONICS CORPORATION
    Inventor: Yasuo Kogure
  • Patent number: 10600161
    Abstract: An image correction device includes a line segment detection module, a shape specification module and an image correction module. The line segment detection module detects from a captured image obtained by photographing a document a plurality of line segments that correspond to the notation on the surface of the document. The shape specification module specifies shape approximation lines that approximate the surface shape of the document from the plurality of line segments. The image correction module utilizes the shape approximation lines specified by the shape specification module to correct the captured image.
    Type: Grant
    Filed: March 26, 2018
    Date of Patent: March 24, 2020
    Assignee: YAMAHA CORPORATION
    Inventor: Kazuhiko Yamamoto
  • Patent number: 10594932
    Abstract: A camera module includes a lens module comprising a lens; an image sensor disposed below the lens module and configured to generate an image of a subject from light passing through the lens; and a logic controller configured to perform a resolution correction calculation on the image generated using aberration information estimated by comparing the image generated with a pre-constructed clear image of the subject with each other.
    Type: Grant
    Filed: September 22, 2017
    Date of Patent: March 17, 2020
    Assignee: Samsung Electro-Mechanics Co., Ltd.
    Inventor: Hyun Kim
  • Patent number: 10575921
    Abstract: A camera system for providing images with simultaneous high resolution and large depth of field is provided. The system includes: a camera device having a field of view, the camera device configured to automatically acquire: a first image of the field of view at a first numerical aperture; and a second image of the field of view at a second numerical aperture smaller than the first numerical aperture; an image processing unit configured to combine the first image with the second image into a single image by: extracting a higher-resolution in-focus portion of the first image; and replacing a corresponding lower-resolution portion of the second image with the higher-resolution in-focus portion of the first image; and, a display device in communication with the image processing unit, the display device configured to render the single image.
    Type: Grant
    Filed: December 1, 2016
    Date of Patent: March 3, 2020
    Assignee: SYNAPTIVE MEDICAL (BARBADOS) INC.
    Inventors: Kresimir Franjic, Kai Hynna, Yanhui Bai, Michael Frank Gunter Wood, Michael Peter Bulk, Tammy Kee-Wai Lee
  • Patent number: 10582119
    Abstract: A device and method for composite selfie image composition for remote users, includes a first image-capture device that communicates a first notification message to a second image-capture device associated with a second user. The first notification message includes a request to capture a second self-portrait image of the second user, a user-identifier of a first user associated with the first image-capture device and first face coordinates of the first user. The second self-portrait image and second face coordinates of the second user is received from the second image-capture device. By face normalization on a portion of the second self-portrait image, a second face size of the second user is adjusted in accordance with a first face size in a first self-portrait image of the first user. A first output image, for example, a composite selfie, is generated based on at least the face normalization.
    Type: Grant
    Filed: July 26, 2017
    Date of Patent: March 3, 2020
    Assignee: SONY CORPORATION
    Inventor: Vedant B Hegde
  • Patent number: 10574884
    Abstract: An image pickup apparatus, image processing apparatus and corresponding program and method are disclosed. In one example, a second captured image acquired from another apparatus is aligned with a first captured image. Image stabilization is carried out in response to a positional relation between the captured images. For example, when overlapping between the captured images is equal to or smaller than an image stabilization limitation threshold value, the image stabilization is stopped or a correction range is limited for at least one of the captured images. When the amount of overlapping is larger than the image stabilization limitation threshold value, the image stabilization for both of the captured images is carried out without limitation. The captured images are aligned with each other by using the captured image with limited image stabilization, or both captured images where stabilization is carried out without limitation, thereby producing a panoramic image.
    Type: Grant
    Filed: July 14, 2016
    Date of Patent: February 25, 2020
    Assignee: Sony Corporation
    Inventors: Kazuhiro Shimauchi, Daisuke Tahara, Nobuho Ikeda, Atsushi Kimura
  • Patent number: 10572722
    Abstract: A display apparatus and a display device are provided. The display apparatus includes: a first image acquisition device, configured to acquire a target image of a target region in the case that a human body is in the target region; an image processing device, configured to identify a body physical feature of the human body according to a human body image in the target image; an image generating device, configured to generate, according to the body physical feature, a virtual human body image corresponding to the human body and conforming to a target age; and a display device, configured to display the virtual human body image. A region displaying the virtual human body image is a virtual human body display region.
    Type: Grant
    Filed: July 20, 2017
    Date of Patent: February 25, 2020
    Assignee: BOE TECHNOLOGY GROUP CO., LTD.
    Inventors: Zifeng Wang, Lei Cao, Yan Ren, She Lin, Nannan Hu, Hailan Jin
  • Patent number: 10567662
    Abstract: The digital camera includes a finder section, an imaging optical system, a focus ring, an eye sensor, an imaging element, a main control section, a digital signal processing section, and a finder display control section. The imaging element outputs first and second imaging signals obtained by receiving the first and second rays formed by performing pupil division on the subject image. The main control section calculates an amount of defocus so as to generate a defocus image, on the basis of first and second imaging signals obtained by receiving first and second rays. The eye sensor detects an eye position P of a photographer who is in contact with the finder section. The finder display control section changes a position, at which the defocus image is displayed, in accordance with the direction of shift of the eye position P.
    Type: Grant
    Filed: March 29, 2018
    Date of Patent: February 18, 2020
    Assignee: FUJIFILM Corporation
    Inventors: Kosuke Takahashi, Atsushi Misawa
  • Patent number: 10567644
    Abstract: An image capturing device includes a first lens module, a second lens module and an operation module. The first lens module and the second lens module capture a first image and a second image respectively. The operator transforms a first section of a first left block of the first image and a second section of a second right block of the second image to a first color space image and a second color space image, obtains a shifting value of a minimum color space distance according to the first color space image and the second color space image, adjusts the width of the first left block and the second right block according to the shifting value of the minimum color space distance, and produces a third image in accordance with the adjusted first image, the adjusted second image and a blending operation.
    Type: Grant
    Filed: June 29, 2018
    Date of Patent: February 18, 2020
    Assignee: ABILITY ENTERPRISE CO., LTD.
    Inventors: Shiu-Yung Lin, Chung-Chou Wang
  • Patent number: 10542224
    Abstract: There is provided an imaging device including: an image processing unit; a face recognition processing unit; a storage unit; and a composition processing unit for generating composite data by a composition process so that persons photographed in each of a plurality of image data are included in one image data. The face recognition processing unit recognizes a first person by performing a face recognition process on first image data. When second image data obtained by photographing a second person at the different photographing timing of the first image data, with the same background as the first image data, is recorded in the storage unit, the composition processing unit generates composite data in which the first person and the second person are superimposed on the same background.
    Type: Grant
    Filed: June 26, 2015
    Date of Patent: January 21, 2020
    Assignee: MAXELL, LTD.
    Inventors: Masayuki Hirabayashi, Yasunobu Hashimoto, Hiroshi Shimizu
  • Patent number: 10535193
    Abstract: There is provided with an image processing apparatus. A first image sensor outputs a first image. The first image sensor has a relatively small amount of image deterioration caused by a motion of an object. A second image sensor outputs a second image. The second image sensor has a relatively large amount of image deterioration caused by the motion of the object. An estimation unit analyzes the first image and generates position and orientation information of the image processing apparatus. A rendering unit renders a CG object on the second image such that the CG object is superimposed at a position determined based on the position and orientation information.
    Type: Grant
    Filed: September 6, 2016
    Date of Patent: January 14, 2020
    Assignee: Canon Kabushiki Kaisha
    Inventor: Masaaki Kobayashi
  • Patent number: 10531002
    Abstract: The present disclosure relates to an image processing device and an image processing method capable of generating a high-quality composite image. Exposure time and exposure timing of a basic imaging unit which images a basic image and a plurality of auxiliary imaging units which may image under an imaging condition independent from that of the basic imaging unit are controlled according to a motion amount. The present disclosure is applicable to an image processing device.
    Type: Grant
    Filed: September 16, 2016
    Date of Patent: January 7, 2020
    Assignee: SONY SEMICONDUCTOR SOLUTIONS CORPORATION
    Inventors: Hiroaki Takahashi, Yasunobu Hitomi, Kentaro Okamura, Masayuki Tachi
  • Patent number: 10529381
    Abstract: A method, system and computer program product for interactively identifying same individuals or objects present in video recordings is disclosed. When a thumbnail in a set of thumbnails is selected, new information is obtained. The new information may be that an individual or object is present in the portion of the video recording associated with the thumbnail. A search can be carried out for the individual or object based on the new information. The search generates new match likelihoods for each of displayed thumbnails within a user interface page. The displayed thumbnails are re-ordered based on the new match likelihoods.
    Type: Grant
    Filed: October 15, 2018
    Date of Patent: January 7, 2020
    Assignee: Avigilon Corporation
    Inventors: Moussa Doumbouya, Mahesh Saptharishi, Eric Sjue, Hannah Valbonesi
  • Patent number: 10523866
    Abstract: The present disclosure provides a mobile terminal image synthesis method, a mobile terminal image synthesis apparatus and a mobile terminal. The mobile terminal image synthesis method includes: acquiring a first fisheye image collected by a front fisheye camera group and a second fisheye image collected by a rear fisheye camera group; obtaining a first correction image by using a first internal parameter of the front fisheye camera group to correct the first fisheye image, and obtaining a second correction image by using a second internal parameter of the rear fisheye camera group to correct the second fisheye image; and obtaining a synthetic image by splicing and combining the first correction image and the second correction image according to splicing parameters.
    Type: Grant
    Filed: April 12, 2018
    Date of Patent: December 31, 2019
    Assignee: BOE TECHNOLOGY GROUP CO., LTD.
    Inventor: Xingxing Zhao
  • Patent number: 10515393
    Abstract: There are provided systems and methods for image data detection for micro-expression analysis and targeted data services. A user may utilize a communication device, where during use of the communication device, one or more images of the user are captured by the communication device. The image(s) may be analyzed to identify at least one micro-expression of the user during use of the communication device, for example, at a time of performing online purchasing or messaging with other merchants or users. The micro-expression may then be used to determine a user state for the user at the time of use of the communication device, where an action or process may be executed with the communication device in response to the user state. In various embodiments, a service provider may be utilized to determine the user's state based on the micro-expression and execute an action based on the user's state.
    Type: Grant
    Filed: June 30, 2016
    Date of Patent: December 24, 2019
    Assignee: PAYPAL, INC.
    Inventors: Michael Charles Todasco, Akshay Sanjeevaiah Krishnaiah, Megan Marie O'Neill, Srivathsan Narasimhan, Komalta Rajani
  • Patent number: 10507157
    Abstract: An environment assembly and interface for constructing trajectory (1) in the environment, the trajectory construction interface (1) including a mapping (2a) of the environment, the environment including at least one object, wherein the trajectory construction interface (1) includes: a memory (2) in which is stored the mapping (2a); a system for real-time calculation (6); a system for determining position of a user (3); a system for determining real azimuth of the user (4); a system for indication by haptic stimulation of the position of the at least one object (7), said system for indication of the position of the at least one object (7) being controlled by the system for real-time calculation (6); and a system for indication by haptic stimulation of the actual azimuth of the at least one object (8), said system for indication of the actual azimuth being controlled by the means of real-time calculation (6).
    Type: Grant
    Filed: October 1, 2015
    Date of Patent: December 17, 2019
    Inventor: Yannick Vaillant
  • Patent number: 10504264
    Abstract: Disclosed are methods and systems for merging of one or more objects from various images into a single image. An example method of combining images comprises obtaining a reference image and obtaining at least one further image. The reference image and the further image have a substantially common background. The further image also includes at least one object such as an individual. The method also includes analyzing the reference image to determine positions of the object for having the object correctly placed in a combined image. Next, the images can be seamlessly merged into a combined image by placing the object from the further image into the reference image according the determined positions. Thereafter, digital filters and beautification techniques can be applied to the combined image.
    Type: Grant
    Filed: November 6, 2018
    Date of Patent: December 10, 2019
    Inventor: Eric Koenig
  • Patent number: 10484613
    Abstract: An image capturing control apparatus, comprises: at least one processor or circuit configured to perform the operations of following units: a display control unit configured to perform control to display a video that an image capturing unit is capturing on a display unit; a boundary setting unit configured to set a boundary in relation to the video that is displayed on the display unit; a detection unit configured to detect a change of a capturing range in the image capturing unit; and a notification unit configured to, in a state in which the capturing range displayed does not include the outer side of the boundary, and in a case where the boundary is close to the capturing range from the inner side of the boundary, perform a notification by a display.
    Type: Grant
    Filed: January 30, 2018
    Date of Patent: November 19, 2019
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Kazuhiro Watanabe, Soushi Takita, Wataru Kaku
  • Patent number: 10482359
    Abstract: The present disclosure provides image capture devices and associated methods of operation that enable the interactive editing of imagery, including, for example, removal and/or addition of non-stationary objects from and/or to captured imagery. According to one example aspect of the present disclosure, an image capture device can capture a plurality of frames of imagery that depict a scene and, while capturing the plurality of frames of imagery, provide a composite image within a viewfinder of the image capture device, where non-stationary objects included in the scene are removed from the composite image. According to another example aspect of the present disclosure, the image capture device can allow a user to edit a final composite image directly within the viewfinder. Thus, the present disclosure provides systems and methods that enable enhanced capture and interactive editing of imagery.
    Type: Grant
    Filed: January 18, 2018
    Date of Patent: November 19, 2019
    Assignee: Google LLC
    Inventors: Alejandro Kauffmann, Ashley Ma, William Lindmeier, Andrew Dahley, Mark Ferdinand Bowers
  • Patent number: 10462433
    Abstract: An image sensor includes a substrate, a first set of sensor pixels formed on the substrate, and a second set of sensor pixels formed on the substrate. The sensor pixels of the first set are arranged in rows and columns and are configured to detect light within a first range of wavelengths (e.g., white light). The sensor pixels of the second set are arranged in rows and columns and are each configured to detect light within one of a set of ranges of wavelengths (e.g., red, green, and blue). Each range of wavelengths of the set of ranges of wavelengths is a subrange of said first range of wavelengths, and each pixel of the second set of pixels is smaller than each pixel of the first set of pixels.
    Type: Grant
    Filed: May 1, 2018
    Date of Patent: October 29, 2019
    Assignee: OmniVision Technologies, Inc.
    Inventors: Gang Chen, Duli Mao, Dyson Hsin-Chih Tai
  • Patent number: 10447935
    Abstract: In an image generating apparatus according to an embodiment of the present invention, the reference image selecting unit selects an image as a reference image. The image extracting unit extracts at least one related image related to the reference image. The image generating unit generates a new composite image by using the reference image and the at least one related image according to a layout including a definition of at least one kind of information selected from a group including a background image, the number of images to be used, a size of each image to be used, and positional relation among images to be used. The basic control unit issues an instruction to make the reference image selecting unit select an image being displayed as the reference image and make the image generating unit generate the new composite image based on the reference image.
    Type: Grant
    Filed: February 15, 2018
    Date of Patent: October 15, 2019
    Assignee: CASIO COMPUTER CO., LTD.
    Inventor: Hiroyuki Hoshino
  • Patent number: 10440265
    Abstract: An image processing method and apparatus, a control method are provided. A part of the color-block image within the fixed region is converted into a first image using a first interpolation algorithm. The first image includes first simulation pixels arranged in an array. A part of the color-block image beyond the fixed region is converted into a second image using a second interpolation algorithm. The second image includes second simulation pixels arranged in an array, and a complexity of the second interpolation algorithm is less than that of the first interpolation algorithm. The first image and the second image are merged into a simulation image corresponding to the color-block image. With the image processing method, by processing different parts of the image respectively with the first interpolation algorithm and the second, the time for processing the image is reduced while the image quality is improved, thus improving the user satisfaction.
    Type: Grant
    Filed: October 9, 2017
    Date of Patent: October 8, 2019
    Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
    Inventor: Yi Wei
  • Patent number: 10438373
    Abstract: The invention is related to a method and system for determining a pose of a first camera, comprising providing or receiving a spatial relationship (Rvc 1) between a visual content displayed on a display device and the first camera, receiving image information associated with an image (B1) of at least part of the displayed visual content captured by a second camera, and determining a pose of the first camera according to the image information associated with the image (B1) and the spatial relationship (Rvc1).
    Type: Grant
    Filed: November 8, 2017
    Date of Patent: October 8, 2019
    Assignee: Apple Inc.
    Inventors: Lejing Wang, Peter Meier
  • Patent number: 10432877
    Abstract: An image processing system includes: a receiving unit configured to receive an input of a plurality of image frames constituting a video from an imaging apparatus; a detection unit configured to detect a feature point included in an image frame to be processed in the plurality of image frames; and an output unit configured to output an output image obtained by superimposing an image frame to be processed of an area detected as a feature point on a background image generated from at least some of a plurality of image frames.
    Type: Grant
    Filed: June 17, 2015
    Date of Patent: October 1, 2019
    Assignee: NEC CORPORATION
    Inventor: Ryo Kawai