Patents Assigned to Morpho, Inc.
  • Publication number: 20210158136
    Abstract: A calculation scheme decision system includes a pre-calculation unit performing, in an execution environment in which calculation is performed, calculation for each of respective layers of the network structure using at least one of calculation schemes prepared in advance for the respective layers, a cost acquisition unit acquiring a calculation cost of at least one calculation scheme for each layer based on a result of the calculation by the pre-calculation unit, a decision unit selecting one calculation scheme for each layer based on the calculation cost from among at least one of the calculation schemes prepared in advance for the respective layers to associate the layer with the selected one calculation scheme, and a calculation unit performing the calculation for each of the respective layers of the network structure on input data in the execution environment using the calculation scheme associated with each layer.
    Type: Application
    Filed: January 23, 2019
    Publication date: May 27, 2021
    Applicant: Morpho, Inc.
    Inventors: Masaki HIRAGA, Yasuhiro KURODA, Hitoshi MATSUO, Hideaki NISHINO, Kouta KURIHARA
  • Patent number: 10931875
    Abstract: One aspect of the present disclosure is an image processing device performing image stabilization of frame images shot by an imaging device. This device is provided with an acquiring unit, an image generating unit and a cropping unit. The acquiring unit acquires the plurality of frame images. The image generating unit stitches, among the plurality of frame images acquired by the acquiring unit, a first frame image and a second frame image, the second frame image being one frame image among several frames before and after the first frame image, to generate a composite image larger than a size of the first frame image and the second frame image. The cropping unit sets a cropping region to the composite image and outputs an image in the cropping region as an output frame image.
    Type: Grant
    Filed: January 13, 2017
    Date of Patent: February 23, 2021
    Assignee: Morpho, Inc.
    Inventor: Masaki Satoh
  • Patent number: 10853954
    Abstract: The image processing apparatus includes: an input unit configured to receive input of a plurality of images; an alignment unit configured to select each of the plurality of images one by one as a base image, and aligns the base image and each of comparison images; a selection unit configured to select the comparison image to be combined with the base image from among the comparison images aligned with the base image for each of the base images, calculate a common region in which images included in the combination can be commonly drawn, and select the combination in which the ratio of the common region to the base image satisfies a predetermined condition; a determination unit configured to determine the combination that maximizes the number of comparison images from the selected combination; and an output unit configured to output an image group corresponding to the determined combination.
    Type: Grant
    Filed: May 14, 2020
    Date of Patent: December 1, 2020
    Assignee: MORPHO, INC.
    Inventor: Taiga Koseki
  • Publication number: 20200364886
    Abstract: The image processing apparatus includes: an input unit configured to receive input of a plurality of images; an alignment unit configured to select each of the plurality of images one by one as a base image, and aligns the base image and each of comparison images; a selection unit configured to select the comparison image to be combined with the base image from among the comparison images aligned with the base image for each of the base images, calculate a common region in which images included in the combination can be commonly drawn, and select the combination in which the ratio of the common region to the base image satisfies a predetermined condition; a determination unit configured to determine the combination that maximizes the number of comparison images from the selected combination; and an output unit configured to output an image group corresponding to the determined combination.
    Type: Application
    Filed: May 14, 2020
    Publication date: November 19, 2020
    Applicant: MORPHO,INC.
    Inventor: Taiga KOSEKI
  • Publication number: 20200358955
    Abstract: An image processing apparatus includes: an alignment unit configured to perform alignment for a group of images including a plurality of short-time-exposure images that are captured with a first exposure time and a long-time-exposure image that is captured with a second exposure time that is longer than the first exposure time; and an output unit configured to output the long-time-exposure image in a case where the long-time-exposure image satisfies a predetermined condition and configured to output a composite image which is generated by compositing a plurality of images selected from among the plurality of short-time-exposure images, in a case where the long-time-exposure image does not satisfy the predetermined condition.
    Type: Application
    Filed: May 5, 2020
    Publication date: November 12, 2020
    Applicants: MORPHO, INC., Sharp Corporation
    Inventors: Hirotaka Kawano, Shun HIRAI, Masaki Satoh, Michihiro KOBAYASHI, Taiga Koseki
  • Patent number: 10713828
    Abstract: An image processing device for stitching a plurality of input images together so as to generate a panoramic composite image is provided. An imaging control section sets a guide for photographing a photographing subject from different imaging directions as a guide information for obtaining a plurality of input images suitable for the image composition. A guide display setting section displays a photographing guide image based on the guide information. A user rotates a camera while checking the guide image and captures the plurality of input images from different imaging directions. An image compositing section stitches the plurality of input images together so as to generate a composite image.
    Type: Grant
    Filed: February 2, 2017
    Date of Patent: July 14, 2020
    Assignee: MORPHO, INC.
    Inventors: Masaki Hiraga, Shun Hirai, Takeshi Miura, Ryo Ono
  • Publication number: 20200202494
    Abstract: An image processing apparatus for obtaining an output image by performing a filter processing of an input image, includes a setting unit configured to set a plurality of local regions in the input image, a deriving unit configured to derive a plurality of coefficients corresponding to each of the plurality of local regions based on statistics indicating variations in pixel values in the plurality of local regions, and a filter processing unit configured to obtain an output pixel value by performing a liner transformation of the input image based on the plurality of the coefficients, wherein the plurality of local regions include a region that is partitioned diagonally to a raster scan direction; wherein the filter processing unit performs the liner transformation of the input image based on a coefficient adaptively selected from the plurality of coefficients.
    Type: Application
    Filed: December 18, 2019
    Publication date: June 25, 2020
    Applicant: MORPHO, INC.
    Inventor: HIROSHI KOYAMA
  • Publication number: 20200162657
    Abstract: The image generation apparatus includes: an acquisition unit configured to acquire a base image, a reference image, the respective exposure values associated with the base image and the reference image, and a pseudo-exposure value different from the respective exposure values associated with the base image and the reference image; an estimation unit configured to estimate a conversion parameter; and a generation unit configured to generate a pseudo-image regarded as an image photographed with the pseudo-exposure value by converting the luminance value of the base image for each of the pixels based on the respective exposure values associated with the base image and the reference image, the pseudo-exposure value, and the conversion parameter.
    Type: Application
    Filed: November 19, 2019
    Publication date: May 21, 2020
    Applicant: Morpho, Inc.
    Inventor: Michihiro KOBAYASHI
  • Publication number: 20200074238
    Abstract: An image identification apparatus includes an acquisition unit configured to acquire an input image, a classification unit configured to calculate a classification score of the input image based on a neural network having a weight coefficient in each layer determined to calculate the classification score indicating a degree of similarity between a training image and an image to be processed, an anomaly determination unit configured to calculate an anomaly score of the input image based on a function approximator constructed by machine learning based on the training image of correct answer, and an identification unit configured to classify the input image into a good image having a high degree of similarity to the training image of the correct answer or a bad image having low degree of similarity to the training image of correct answer based on the classification score and the anomaly score.
    Type: Application
    Filed: August 26, 2019
    Publication date: March 5, 2020
    Applicant: Morpho, Inc.
    Inventors: Takuma Umeno, Takafumi Yuasa
  • Patent number: 10452945
    Abstract: The present disclosure can obtain a high-quality composite image by determining a suitable boundary when input images are sequentially stitched together to generate the composite image. An image generating apparatus 1 generates a composite image by stitching sequentially input images together. A difference value calculating section 15 calculates difference values by using the pixel values of a reference image and the pixel values of a target image that partly overlap the reference image. The difference values represent the relative relationship between the reference image and the target image. A boundary determining section 16 determines a boundary for stitching the reference image and the target image together by using the difference values calculated by the difference value calculating section 15. Then, an image compositing section 18 generates the composite image by stitching the reference image and the target image together based on the boundary determined by the boundary determining section 16.
    Type: Grant
    Filed: July 31, 2017
    Date of Patent: October 22, 2019
    Assignee: Morpho, Inc.
    Inventors: Masaki Hiraga, Shun Hirai, Shogo Sawai, Ryo Ono
  • Patent number: 10440277
    Abstract: It is an object of the present disclosure to enable displaying information on unused area of an input image while displaying an enlarged image of the input image An image processing device includes a specified area setting part configured to set a specified area in an input image, an additional information setting part configured to set additional information on at least a part of non-specified area which is an area in the input image other than the specified area, and a display control part configured to display the specified area and the additional information on the display as an output image. The user can view the image of the specified area and the additional information at the same time. Therefore, the device can utilize the information of the input image more effectively.
    Type: Grant
    Filed: December 8, 2017
    Date of Patent: October 8, 2019
    Assignee: MORPHO, INC.
    Inventors: Shun Hirai, Jaesung Lee, Zhengyu Chen, Masaki Satoh, Ryo Ono
  • Patent number: 10319097
    Abstract: An image processing device is provided. The image processing device includes: a tracking area setting section that sets a tracking area in a frame image of an original motion picture; a color information obtaining section that obtains color information of the tracking area set by the tracking area setting section; a tracking position estimating section that estimates a tracking position with reference to the tracking area with respect to each frame image of the original motion picture by using the color information obtained by the color information obtaining section; an output frame setting section that sets an output frame enclosing the tracking area set by the tracking area setting section and that updates the output frame based on the estimated tracking position; and a lock-on motion picture generating section that generates a motion picture that is based on the output frame.
    Type: Grant
    Filed: October 24, 2016
    Date of Patent: June 11, 2019
    Assignee: Morpho, Inc.
    Inventors: Yasuhiro Kuroda, Akito Hyakutake, Naruo Takizawa, Ryo Ono
  • Patent number: 10200649
    Abstract: An image processing device comprising: a recording unit configured to record a previous frame image input before a target frame image that is to be a processing target or an output frame image from the previous frame image; an alignment unit configured to align the target frame image with the previous frame image or with the output frame image from the previous frame image; a correction unit configured to perform a temporal correction process to correct a pixel value of the target frame image by use of a pixel value of the previous frame image or a pixel value of the output frame image from the previous frame image that has been aligned by the alignment unit, with reference to the recording unit; and a generation unit configured to generate an output frame image from the target frame image by use of the target frame image corrected by the correction unit.
    Type: Grant
    Filed: February 5, 2015
    Date of Patent: February 5, 2019
    Assignee: Morpho, Inc.
    Inventors: Masaki Satoh, Shun Hirai
  • Publication number: 20190028645
    Abstract: One aspect of the present disclosure is an image processing device performing image stabilization of frame images shot by an imaging device. This device is provided with an acquiring unit, an image generating unit and a cropping unit. The acquiring unit acquires the plurality of frame images. The image generating unit stitches, among the plurality of frame images acquired by the acquiring unit, a first frame image and a second frame image, the second frame image being one frame image among several frames before and after the first frame image, to generate a composite image larger than a size of the first frame image and the second frame image. The cropping unit sets a cropping region to the composite image and outputs an image in the cropping region as an output frame image.
    Type: Application
    Filed: January 13, 2017
    Publication date: January 24, 2019
    Applicant: Morpho, Inc.
    Inventor: Masaki SATOH
  • Patent number: 10168817
    Abstract: (Problem) To facilitate setting of an image display style and selection of images in an image display apparatus with a touch screen. (Solution to Problem) Thumbnails included in an area designated by a pinch gesture are all specified. If it is not true that “the thumbnails included in the designated area are all displayed in the selected style” (S2004, No), the thumbnails included in the designated area are all displayed in the selected style (S2005), and the status is set to selected state (S2006). If it is true that “the thumbnails included in the designated area are all displayed in the selected style” (S2004, Yes), the thumbnails included in the designated area are all displayed in unselected style (S2007), and the status is set to unselected state (S2008). If the gesture is continuously changed to a pinch-out gesture or a pinch-in gesture (S2010, No), the selected area or the unselected area are expanded or reduced depending on the status (S2014, S2015).
    Type: Grant
    Filed: January 24, 2014
    Date of Patent: January 1, 2019
    Assignee: MORPHO, INC.
    Inventors: Masaki Hiraga, Tomoyuki Nakano
  • Patent number: 10136054
    Abstract: An image processing device includes an input unit, a selection unit, a matching unit, an estimation unit and a merging unit. The input unit sequentially inputs images. The selection unit selects a reference image from among the input images. The matching unit calculates a correspondence relationship between a feature point of the reference image and a feature point of a target image. The estimation unit estimates an equation that causes a coordinate system of the reference image to correspond to a coordinate system of the target image using positional information of a pair of the feature points whose correspondence relationship has been calculated by the matching unit by regarding a motion between the reference image and the target image as only a rotational motion of the imaging element. The merging unit merges the input image and the target image to generate the composite image based on the equation.
    Type: Grant
    Filed: October 24, 2012
    Date of Patent: November 20, 2018
    Assignee: Morpho, Inc.
    Inventors: Shogo Sawai, Masaki Hiraga, Takeshi Miura
  • Patent number: 10127639
    Abstract: An object of the present invention is to provide an image processing device and the like that can generate a composite image in a desired focusing condition. In a smartphone 1, an edge detecting section 107 detects an edge as a feature from a plurality of input images taken with different focusing distances, and detects the intensity of the edge as a feature value. A depth estimating section 111 then estimates the depth of a target pixel, which is information representing which of the plurality of input images is in focus at the target pixel, by using the edge intensity detected by the edge detecting section 107. A depth map generating section 113 then generates a depth map based on the estimation results by the depth estimating section 111.
    Type: Grant
    Filed: October 23, 2016
    Date of Patent: November 13, 2018
    Assignee: MORPHO, INC.
    Inventors: Takeshi Miura, Shogo Sawai, Yasuhiro Kuroda, Hiroshi Koyama, Kazuhiro Hiramoto, Kosuke Ishiguro, Ryo Ono
  • Publication number: 20180307946
    Abstract: A training system comprises a training device, and a training data creation device. The training device trains a neural network. The training data creation device acquires any one of a positive evaluation indicating that content of the input data coincides with the label, a negative evaluation indicating that content of the input data does not coincide with the label, and an ignorable evaluation indicating exclusion from a training target label, for each label regarding the input data to create training data. In training the neural network for training, the training system adjusts the weight coefficient for the intermediate layer and makes the recognition score of the label with the ignorable evaluation not affect the adjustment of the weight coefficient for the intermediate layer.
    Type: Application
    Filed: October 14, 2016
    Publication date: October 25, 2018
    Applicant: MORPHO, INC.
    Inventors: Yasuhiro KURODA, Masaki HIRAGA, Kenji OKUMA, Michihiro KOBAYASHI, Hiroshi KOYAMA
  • Patent number: 10089770
    Abstract: The present disclosure is to generate a high-quality image by correcting a predetermined correction target image based on a plurality of input images. In an image processing device 3, an image correcting section 160 detects a user tap gesture on a touch panel 250. When the position of the tap gesture is within foreground candidate areas detected by a foreground candidate area detecting section 140, the image correcting section 160 corrects a base image set by a base image setting section 120 in the areas corresponding to the foreground candidate areas.
    Type: Grant
    Filed: April 10, 2017
    Date of Patent: October 2, 2018
    Assignee: MORPHO, INC.
    Inventor: Michihiro Kobayashi
  • Patent number: 10074165
    Abstract: An image composition device composites a no-flash image including a subject captured under ambient light and a flash image including the subject captured by emitting flash light to generate a composite image including the subject. The image composition device includes an input unit that enables the no-flash image and the flash image to be input, a correction unit that corrects the no-flash image and the flash image input from the input unit, and a composition unit that composites the no-flash image and the flash image output from the correction unit to generate a composite image. The correction unit corrects a color temperature of the no-flash image.
    Type: Grant
    Filed: September 9, 2015
    Date of Patent: September 11, 2018
    Assignee: MORPHO, INC.
    Inventors: Michihiro Kobayashi, Kouta Kurihara, Ryo Ono