Patents by Inventor Shuji Senda

Shuji Senda has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 9875532
    Abstract: The present invention provides an information processing device in which a degradation process of an input image is accurately estimated and a dictionary necessary for generating a desired restored image from the input image can be obtained. The information processing device is provided with: an image acquisition means that acquires a plurality of study images and an input image; and an estimation means that, on the basis of similarity between an arbitrary region of the input image and each of a plurality of degradation images in a case where regions of the study images corresponding to the arbitrary region are degraded on the basis of each of the plurality of degradation processes, outputs an estimated degradation process corresponding to the degradation process corresponding to the region of the input image.
    Type: Grant
    Filed: July 18, 2014
    Date of Patent: January 23, 2018
    Assignee: NEC Corporation
    Inventors: Takashi Shibata, Akihiko Iketani, Shuji Senda
  • Patent number: 9779488
    Abstract: An information processing device according to the present invention includes: a proper identifier output unit which outputs proper identifiers for identifying learning images; a feature vector calculation unit which calculates feature vectors of at least a part of patches included in registered patches that are registered in a dictionary for compositing a restored image; and a search similarity calculation unit which calculates a similarity calculation method that classifies the proper identifiers to be given to the registered patches based on the feature vectors.
    Type: Grant
    Filed: March 25, 2014
    Date of Patent: October 3, 2017
    Assignee: NEC CORPORATION
    Inventors: Takashi Shibata, Akihiko Iketani, Shuji Senda
  • Patent number: 9747675
    Abstract: Provided is an information processing system configured to: receive a plurality of images; select a standard image; search, in extracting partial images for complementing a too bright region/too dark region in the standard image from a reference images, using correction images obtained by subjecting each of the images to multivalued processing for each division of luminance components, for regions having matching shapes of respective regions included in the correction image of the standard image and the correction images of the other images; and complement image portions corresponding to the too bright region and/or too dark region in the correction image of the standard image using image portions, which are matching regions and correspond to appropriately bright regions, to thereby generate a synthetic image.
    Type: Grant
    Filed: October 17, 2014
    Date of Patent: August 29, 2017
    Assignees: NEC Corporation, Tokyo Institute of Technology
    Inventors: Takashi Shibata, Shuji Senda, Masayuki Tanaka, Masatoshi Okutomi, Takehito Hayami
  • Patent number: 9741143
    Abstract: A basis image is converted into a more functional image by image synthesis technology using a number of imaging devices arranged independently of each other. A multocular imaging system is provided with a plurality of imaging parts that can be arranged independently of each other, a similar component search part operable to acquire a basis image outputted from at least one imaging part of the plurality of imaging parts and a reference image outputted from another imaging part of the plurality of imaging parts and to search a similar component included in the reference image for each of components included in the basis image, and an image synthesis part operable to perform a synthesis process on at least one component included in the basis image into a desired image with reference to the similar component extracted by the similar component search part and to output the desired image as a synthesis image.
    Type: Grant
    Filed: April 22, 2014
    Date of Patent: August 22, 2017
    Assignees: NEC Corporation, Tokyo Institute of Technology
    Inventors: Shuji Senda, Akihiko Iketani, Takashi Shibata, Masatoshi Okutomi, Masayuki Tanaka
  • Patent number: 9679370
    Abstract: The present invention provides an image processing device whereby the probability of outputting a restored image which accurately corresponds to an original image which is included in a low-quality input image is improved. This image processing device comprises: an image group generating means for generating, from the input image, using a dictionary which stores a plurality of patch pairs wherein a degradation patch which is a patch of a degraded image wherein a prescribed image is degraded is associated with a restoration patch which is a patch of this prescribed image, a plurality of restored image candidates including a plurality of different instances of content which have a possibility of being the original content of the input image; and an image selection presentation means for clustering the generated plurality of restored image candidates, and selecting and outputting an image candidate on the basis of the result of this clustering.
    Type: Grant
    Filed: December 5, 2013
    Date of Patent: June 13, 2017
    Assignee: NEC CORPORATION
    Inventors: Takashi Shibata, Akihiko Iketani, Shuji Senda
  • Patent number: 9542725
    Abstract: An image processing device according to the present invention includes: a weight calculation unit that determines an area where a feature value of an input image is saved, based on a gradient of a feature value of a pixel of the input image and a direction of the gradient, and calculates a weight for reducing a regularization constraint that is a constraint based on regularization of image processing in the area where the feature value is saved; a regularization term calculation unit that calculates a regularization constraint of a high resolution image restored based on the input image by using the weight; a reconstruction constraint calculation unit that calculates a reconstruction constraint that is a constraint based on reconstruction of the high resolution image; and an image restoring unit that restores the high resolution image from the input image based on the regularization constraint and the reconstruction constraint.
    Type: Grant
    Filed: November 28, 2013
    Date of Patent: January 10, 2017
    Assignee: NEC CORPORATION
    Inventors: Takashi Shibata, Akihiko Iketani, Shuji Senda
  • Patent number: 9508025
    Abstract: An image processing device according to the present invention includes: a patch generation unit which generates an input patch used for comparison on the basis of an input image; a modification parameter estimation unit which estimates a parameter used in blurred modification on the basis of the input image; a blurred image generation unit which generates a blurred image on the basis of a learning image by using the parameter; a patch pair generation unit which generates a patch pair used to compose a restoration image on the basis of the blurred image and the learning image; a selection unit which selects a patch pair used to compose the restoration image on the basis of the input patch; and a composition unit which composes the restoration image on the basis of the patch pair selected by the selection unit.
    Type: Grant
    Filed: November 5, 2013
    Date of Patent: November 29, 2016
    Assignee: NEC CORPORATION
    Inventors: Shuji Senda, Takashi Shibata, Akihiko Iketani
  • Publication number: 20160292835
    Abstract: Provided is an information processing system configured to: receive a plurality of images; select a standard image; search, in extracting partial images for complementing a too bright region/too dark region in the standard image from a reference images, using correction images obtained by subjecting each of the images to multivalued processing for each division of luminance components, for regions having matching shapes of respective regions included in the correction image of the standard image and the correction images of the other images; and complement image portions corresponding to the too bright region and/or too dark region in the correction image of the standard image using image portions, which are matching regions and correspond to appropriately bright regions, to thereby generate a synthetic image.
    Type: Application
    Filed: October 17, 2014
    Publication date: October 6, 2016
    Applicants: NEC Corporation, Tokyo Institute of Technology
    Inventors: Takashi SHIBATA, Shuji SENDA, Masayuki TANAKA, Masatoshi OKUTOMI, Takehito HAYAMI
  • Patent number: 9436981
    Abstract: A dictionary creation device including a blurred image generation unit which outputs a blurred image generated by performing a blurring process to a learning image together with a blur parameter indicating a blurring state of the blurred image, a patch pair generation unit which generates a restoration patch and a blurred patch as a patch pair that is composed of the patches located at the corresponding positions of the learning image and the blurred image, and a registration unit which associates the patch pair with a blur parameter corresponding to the blurred patch in the patch pair and registers them in a dictionary.
    Type: Grant
    Filed: December 10, 2012
    Date of Patent: September 6, 2016
    Assignee: NEC Corporation
    Inventors: Takashi Shibata, Akihiko Iketani, Shuji Senda
  • Publication number: 20160189357
    Abstract: The present invention provides an information processing device in which a degradation process of an input image is accurately estimated and a dictionary necessary for generating a desired restored image from the input image can be obtained. The information processing device is provided with: an image acquisition means that acquires a plurality of study images and an input image; and an estimation means that, on the basis of similarity between an arbitrary region of the input image and each of a plurality of degradation images in a case where regions of the study images corresponding to the arbitrary region are degraded on the basis of each of the plurality of degradation processes, outputs an estimated degradation process corresponding to the degradation process corresponding to the region of the input image.
    Type: Application
    Filed: July 18, 2014
    Publication date: June 30, 2016
    Applicant: NEC Corporation
    Inventors: Takashi SHIBATA, Akihiko IKETANI, Shuji SENDA
  • Patent number: 9344695
    Abstract: An automatic projection image correction system (1) includes: a projection image frame detection unit (101) that detects straight lines forming a frame of a screen-projected image which is projected onto a screen by a projector from a captured image obtained by capturing the screen-projected image using a camera; and a projector plane parameter estimation unit (102) that sets coordinate axes to a projector image, which is an original image of the screen-projected image, and the captured image and estimates at least one of a distance between the screen and the projector, an inclination of the screen with reference to an optical axis of the projector, and a zoom ratio of the projector, using an inclination of the optical axes of the projector and the camera, a distance between the optical centers of the projector and the camera, an intrinsic parameter of the camera, coordinate data of the detected straight lines at coordinates of the captured image, and coordinate data of straight lines corresponding to the fra
    Type: Grant
    Filed: September 11, 2012
    Date of Patent: May 17, 2016
    Assignee: NEC Corporation
    Inventors: Takashi Shibata, Akihiko Iketani, Shuji Senda
  • Patent number: 9317904
    Abstract: Provided is an image processing device that can bring about the sufficient resemblance between an original image and a restored image obtained corresponding to a low resolution input image. The image processing device includes a means that uses a dictionary for storing data associating deteriorated patches which are from a deteriorated image formed by deteriorating a prescribed image, and restoration patches which are from the prescribed image, and calculates, as a degree-of-similarity between plural input patches generated by dividing an input image and the deteriorated patches, a weighted degree-of-similarity between weighted deteriorated patches and weighted input patches, in which forms of the deteriorated patches and the input patches are reconfigured using a patch weight which is continuous weighting; a means that selects, on the basis of the weighted degree-of-similarity, a restoration patch for each input patch; and a means that combines the restoration patches to generate a restored image.
    Type: Grant
    Filed: December 10, 2012
    Date of Patent: April 19, 2016
    Assignee: NEC Corporation
    Inventors: Takashi Shibata, Akihiko Iketani, Shuji Senda
  • Patent number: 9317905
    Abstract: An image processing device, which uses a dictionary which stores data of two or over sets which associate a blurred patch of a blurred image generated by blurring a predetermined image with a restoration patch of the predetermined image. The device includes a processor that processes instructions to generate a tentative restored image from the restoration patch selected based on values indicating similarities between plural input patches generated by dividing an inputted input image and the blurred patch. The processor also processes the instructions to generate a tentative patch by dividing the tentative restored image. The processor further processes the instructions to generate a restored image from the restoration patch selected based on a sum of the value indicating the similarity between the input patch and the blurred patch and a value indicating the similarity between the tentative patch and the restoration patch.
    Type: Grant
    Filed: December 10, 2012
    Date of Patent: April 19, 2016
    Assignee: NEC Corporation
    Inventors: Takashi Shibata, Akihiko Iketani, Shuji Senda
  • Publication number: 20160098852
    Abstract: A basis image is converted into a more functional image by image synthesis technology using a number of imaging devices arranged independently of each other. A multocular imaging system is provided with a plurality of imaging parts that can be arranged independently of each other, a similar component search part operable to acquire a basis image outputted from at least one imaging part of the plurality of imaging parts and a reference image outputted from another imaging part of the plurality of imaging parts and to search a similar component included in the reference image for each of components included in the basis image, and an image synthesis part operable to perform a synthesis process on at least one component included in the basis image into a desired image with reference to the similar component extracted by the similar component search part and to output the desired image as a synthesis image.
    Type: Application
    Filed: April 22, 2014
    Publication date: April 7, 2016
    Applicants: NEC Corporation, Tokyo Institute of Technology
    Inventors: Shuji SENDA, Akihiko IKETANI, Takashi SHIBATA, Masatoshi OKUTOMI, Masayuki TANAKA
  • Patent number: 9280807
    Abstract: For each pixel of an input image, a direction toward which variation in pixel value between the relevant pixel and its peripheral pixels is largest and an amount of the variation in pixel value are computed, where a direction unit vector that indicates the direction toward which the variation is largest and a variation vector that represents the amount of the largest variation in the pixel value are computed. For each pixel, a regularization strength is computed utilizing the direction unit vector, the variation vector, and a regularization strength computing formula so that the larger the amount of the variation in pixel value toward a direction indicated by the direction unit vector, the less the regularization strength. An optimization function is determined based on the input image and the regularization strength for each pixel thereof and assigns a value for each pixel, by which the determined optimization function has the minimum value, to the corresponding pixel of a restored image to be generated.
    Type: Grant
    Filed: June 21, 2012
    Date of Patent: March 8, 2016
    Assignee: NEC Corporation
    Inventors: Takashi Shibata, Akihiko Iketani, Shuji Senda
  • Publication number: 20160055627
    Abstract: An information processing device according to the present invention includes: a proper identifier output unit which outputs proper identifiers for identifying learning images; a feature vector calculation unit which calculates feature vectors of at least a part of patches included in registered patches that are registered in a dictionary for compositing a restored image; and a search similarity calculation unit which calculates a similarity calculation method that classifies the proper identifiers to be given to the registered patches based on the feature vectors.
    Type: Application
    Filed: March 25, 2014
    Publication date: February 25, 2016
    Inventors: TAKASHI SHIBATA, AKIHIKO IKETANI, SHUJI SENDA
  • Patent number: 9196025
    Abstract: In an image processing apparatus, a conditional probability calculating element calculates the probability of existence of an attribute as to each region in an input degraded image, for each attribute. Optimization function determining element uses a conditional probability calculated by the conditional probability calculating element with regard to each region in the degraded image for each attribute, a-priori knowledge defined as a conditional probability of appearance of an attribute in a region of a candidate of a restored image when there is the attribute in the region, and the input degraded image to determine an optimization function using the candidate of the restored image as a variable and yielding a smaller value as the candidate of the restored image is closer to a true restored image. Restored image determining element adopts the candidate of the restored image with which the optimization function yields a minimum value as the restored image.
    Type: Grant
    Filed: September 9, 2010
    Date of Patent: November 24, 2015
    Assignee: NEC CORPORATION
    Inventors: Takashi Shibata, Akihiko Iketani, Shuji Senda
  • Publication number: 20150317767
    Abstract: An image processing device according to the present invention includes: a weight calculation unit that determines an area where a feature value of an input image is saved, based on a gradient of a feature value of a pixel of the input image and a direction of the gradient, and calculates a weight for reducing a regularization constraint that is a constraint based on regularization of image processing in the area where the feature value is saved; a regularization term calculation unit that calculates a regularization constraint of a high resolution image restored based on the input image by using the weight; a reconstruction constraint calculation unit that calculates a reconstruction constraint that is a constraint based on reconstruction of the high resolution image; and an image restoring unit that restores the high resolution image from the input image based on the regularization constraint and the reconstruction constraint.
    Type: Application
    Filed: November 28, 2013
    Publication date: November 5, 2015
    Applicant: NCE Corporation
    Inventors: Takashi SHIBATA, Akihiko IKETANI, Shuji SENDA
  • Publication number: 20150302273
    Abstract: An image processing device according to the present invention includes: a patch generation unit which generates an input patch used for comparison on the basis of an input image; a modification parameter estimation unit which estimates a parameter used in blurred modification on the basis of the input image; a blurred image generation unit which generates a blurred image on the basis of a learning image by using the parameter; a patch pair generation unit which generates a patch pair used to compose a restoration image on the basis of the blurred image and the learning image; a selection unit which selects a patch pair used to compose the restoration image on the basis of the input patch; and a composition unit which composes the restoration image on the basis of the patch pair selected by the selection unit.
    Type: Application
    Filed: November 5, 2013
    Publication date: October 22, 2015
    Applicant: NEC Corporation
    Inventors: Shuji Senda, Takashi Shibata, Akihiko Iketani
  • Publication number: 20150302566
    Abstract: The present invention provides an image processing device whereby the probability of outputting a restored image which accurately corresponds to an original image which is included in a low-quality input image is improved. This image processing device comprises: an image group generating means for generating, from the input image, using a dictionary which stores a plurality of patch pairs wherein a degradation patch which is a patch of a degraded image wherein a prescribed image is degraded is associated with a restoration patch which is a patch of this prescribed image, a plurality of restored image candidates including a plurality of different instances of content which have a possibility of being the original content of the input image; and an image selection presentation means for clustering the generated plurality of restored image candidates, and selecting and outputting an image candidate on the basis of the result of this clustering.
    Type: Application
    Filed: December 5, 2013
    Publication date: October 22, 2015
    Applicant: NEC Corporation
    Inventors: Takashi SHIBATA, Akihiko IKETANI, Shuji SENDA