Patents by Inventor Nao Mishima

Nao Mishima has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11107245
    Abstract: According to one embodiment, an image processing device includes first storage and a processor. The first storage is configured to store a statistical model generated by learning of bokeh that occurs in a first image affected by aberration of a first optical system and varies non-linearly in accordance with a distance to a subject in the first image. The processor is configured to acquire a second image affected by aberration of a second optical system, input the acquired second image into the statistical model corresponding to a lens used in the second optical system and acquire distance information indicating a distance to a subject in the second image.
    Type: Grant
    Filed: March 9, 2020
    Date of Patent: August 31, 2021
    Assignee: KABUSHIKI KAISHA TOSHIBA
    Inventors: Masako Kashiwagi, Nao Mishima
  • Patent number: 11100662
    Abstract: According to one embodiment, an image processing apparatus includes a memory and one or more hardware processors electrically coupled to the memory. The one or more hardware processors acquire a first image of an object including a first shaped blur and a second image of the object including a second shaped blur. The first image and the second image are acquired by capturing at a time through a single image-forming optical system. The one or more hardware processors acquire distance information to the object based on the first image and the second image, with a statistical model that has learnt previously.
    Type: Grant
    Filed: March 7, 2019
    Date of Patent: August 24, 2021
    Assignee: KABUSHIKI KAISHA TOSHIBA
    Inventors: Nao Mishima, Takayuki Sasaki
  • Patent number: 11069076
    Abstract: According to one embodiment, an image processing device includes a hardware processor implemented by one or more processors. The hardware processor is configured to acquire an image captured by a monocular camera. The hardware processor is configured to estimate a distance to an object based on the acquired image. The hardware processor is configured to calculate the distance to the object by considering an atmosphere failure influencing the acquired image and executing a statistical process on the estimated distance.
    Type: Grant
    Filed: March 11, 2019
    Date of Patent: July 20, 2021
    Assignee: KABUSHIKI KAISHA TOSHIBA
    Inventors: Tomoya Tsuruyama, Nao Mishima, Tatsuo Kozakaya, Akihisa Moriya, Jun Yamaguchi, Takayuki Sasaki
  • Patent number: 11030760
    Abstract: According to one embodiment, an image processing device includes storage and a processor. The storage stores a statistical model generated by learning bokeh produced in a first image affected by aberration of an optical system, the bokeh changing nonlinearly in accordance with a distance to a subject in the first image. The processor obtains a second image affected by the aberration of the optical system. The processor inputs the second image to the statistical model and obtains distance information indicating a distance to a subject in the second image.
    Type: Grant
    Filed: August 19, 2019
    Date of Patent: June 8, 2021
    Assignee: KABUSHIKI KAISHA TOSHIBA
    Inventors: Masako Kashiwagi, Nao Mishima, Takayuki Sasaki, Tatsuo Kozakaya
  • Patent number: 11019322
    Abstract: According to one embodiment, an estimation system includes a monocular imaging unit and processing circuitry. The monocular imaging unit acquires, at a time of capturing, an image and first data relating to an actual distance to an object captured in the image. The processing circuitry estimates a position of the imaging unit by using the image and the first data.
    Type: Grant
    Filed: February 28, 2018
    Date of Patent: May 25, 2021
    Assignee: KABUSHIKI KAISHA TOSHIBA
    Inventors: Tatsuma Sakurai, Takuma Yamamoto, Nao Mishima
  • Publication number: 20210082146
    Abstract: According to one embodiment, an image processing device includes first storage and a processor. The first storage is configured to store a statistical model generated by learning of bokeh that occurs in a first image affected by aberration of a first optical system and varies non-linearly in accordance with a distance to a subject in the first image. The processor is configured to acquire a second image affected by aberration of a second optical system, input the acquired second image into the statistical model corresponding to a lens used in the second optical system and acquire distance information indicating a distance to a subject in the second image.
    Type: Application
    Filed: March 9, 2020
    Publication date: March 18, 2021
    Applicant: KABUSHIKI KAISHA TOSHIBA
    Inventors: Masako Kashiwagi, Nao Mishima
  • Publication number: 20210084238
    Abstract: According to one embodiment, an imaging device includes a first optical system including a lens and is configured to control a position of the lens to adjust a focal point. The imaging device includes first storage and a processor. The first storage is configured to store a statistical model generated by learning bokeh which occurs in an image influenced by aberration of a second optical system and changes nonlinearly in accordance with a distance to a subject in the image. The processor is configured to acquire an image influenced by aberration of the first optical system, input the acquired image to the statistical model and acquire distance information, and control the position of the lens included in the first optical system.
    Type: Application
    Filed: March 4, 2020
    Publication date: March 18, 2021
    Applicant: KABUSHIKI KAISHA TOSHIBA
    Inventors: Masako KASHIWAGI, Nao MISHIMA
  • Patent number: 10951835
    Abstract: According to one embodiment, an imaging device includes a first optical system including a lens and is configured to control a position of the lens to adjust a focal point. The imaging device includes first storage and a processor. The first storage is configured to store a statistical model generated by learning bokeh which occurs in an image influenced by aberration of a second optical system and changes nonlinearly in accordance with a distance to a subject in the image. The processor is configured to acquire an image influenced by aberration of the first optical system, input the acquired image to the statistical model and acquire distance information, and control the position of the lens included in the first optical system.
    Type: Grant
    Filed: March 4, 2020
    Date of Patent: March 16, 2021
    Assignee: KABUSHIKI KAISHA TOSHIBA
    Inventors: Masako Kashiwagi, Nao Mishima
  • Patent number: 10914960
    Abstract: An imaging apparatus includes a filter configured to transmit light and an image sensor configured to generate an image according to the light. The filter includes first to fourth filter regions. The first filter region transmits light of a first wavelength region, and does not transmit light of a second wavelength region. The second filter region does not transmit the light of the first wavelength region and transmits the light of the second wavelength region. The third, filter region does not transmit the light of the first, wavelength region and does not transmit the light of the second wavelength region. The fourth filter region transmits the light of the first wavelength region and transmits the light of the second wavelength region.
    Type: Grant
    Filed: August 31, 2017
    Date of Patent: February 9, 2021
    Assignee: Kabushiki Kaisha Toshiba
    Inventors: Yusuke Moriuchi, Nao Mishima
  • Publication number: 20200394464
    Abstract: According to one embodiment, a learning method for causing a second statistical model to learn using a first statistical model is provided. The method includes obtaining a first learning image, cutting out each local area of the obtained first learning image, and obtaining a first prediction value output from the first statistical model by inputting each local area to the first statistical model and obtaining a second prediction value output from the second statistical model by inputting the entire area of the first learning image to the second statistical model, and causing the second statistical model to learn based on a difference between the first prediction value and the second prediction value.
    Type: Application
    Filed: March 4, 2020
    Publication date: December 17, 2020
    Applicant: KABUSHIKI KAISHA TOSHIBA
    Inventors: Nao MISHIMA, Tatsuo KOZAKAYA
  • Patent number: 10841493
    Abstract: According to one embodiment, an optical filter associated with a lens unit having a first end includes a filter part, a filter frame, and an attachment part. The filter part includes a first filter area that transmits light rays of a first wavelength band and a second filter area that transmits light rays of a second wavelength band. The first wavelength band and the second wavelength band include a common wavelength band. The filter frame holds the filter part. The attachment part is coupled with the filter frame and is detachably attached to the first end of the lens unit. When the attachment part is attached to the first end of the lens unit, a distance between the filter part and an aperture within the lens unit is longer than a distance between the first end and the aperture.
    Type: Grant
    Filed: February 25, 2019
    Date of Patent: November 17, 2020
    Assignee: Kabushiki Kaisha Toshiba
    Inventors: Tomoya Tsuruyama, Akihisa Moriya, Nao Mishima, Takayuki Sasaki, Jun Yamaguchi, Tatsuo Kozakaya
  • Patent number: 10785412
    Abstract: An image capturing apparatus includes a sensor controller and a distance calculator. The sensor controller acquires a target image and a first reference image. The point spread function (PSF) of the target image is point-asymmetric, and the PSF of the first reference image being point-symmetric. The image sensor receives light having passed through a filter region that changes PSFs for sensor images of at least one kind into point-asymmetric forms, and then generates the target image for which a PSF has been changed into a point-asymmetric form by the filter region, and the first reference image that is not the target image. The distance calculator calculates the distance to an object captured in the target image and the first reference image, in accordance with the correlations each between an image obtained by convoluting a blur kernel to the target images and the first reference image.
    Type: Grant
    Filed: July 2, 2019
    Date of Patent: September 22, 2020
    Assignee: Kabushiki Kaisha Toshiba
    Inventors: Yusuke Moriuchi, Nao Mishima
  • Publication number: 20200294260
    Abstract: According to one embodiment, an image processing device includes storage and a processor. The storage stores a statistical model generated by learning bokeh produced in a first image affected by aberration of an optical system, the bokeh changing nonlinearly in accordance with a distance to a subject in the first image. The processor obtains a second image affected by the aberration of the optical system. The processor inputs the second image to the statistical model and obtains distance information indicating a distance to a subject in the second image.
    Type: Application
    Filed: August 19, 2019
    Publication date: September 17, 2020
    Applicant: KABUSHIKI KAISHA TOSHIBA
    Inventors: Masako KASHIWAGI, Nao MISHIMA, Takayuki SASAKI, Tatsuo KOZAKAYA
  • Publication number: 20200166807
    Abstract: According to one embodiment, an image processing device includes a hardware processor implemented by one or more processors. The hardware processor acquires a first image of a first object and a second image of a second object which is different from the first object, the images captured by an image capture processing device including an image capturing element and an optical system which images an object image on an image capturing surface of the image capturing element. The hardware processor measures a point spread function of the optical system based on the first image and the second image.
    Type: Application
    Filed: September 4, 2019
    Publication date: May 28, 2020
    Applicant: KABUSHIKI KAISHA TOSHIBA
    Inventors: Takayuki SASAKI, Nao Mishima
  • Publication number: 20200164514
    Abstract: According to one embodiment, a robot motion planning device includes processing circuitry. The processing circuitry receives observation information obtained by observing at least part of a movable range of a robot. The processing circuitry determines, in a case where first observation information is received, a target position to which the robot is to make a motion, using an action-value function and the first observation information. The processing circuitry receives measurement information obtained by measuring a state of the robot, calculates a difference corresponding to the first observation information, using the measurement information, and determines a motion plan of a force-controlled motion of the robot, based on the target position and the difference.
    Type: Application
    Filed: September 11, 2019
    Publication date: May 28, 2020
    Applicant: KABUSHIKI KAISHA TOSHIBA
    Inventors: Toshimitsu KANEKO, Tatsuya TANAKA, Ryosuke NONAKA, Nao MISHIMA, Tatsuo KOZAKAYA
  • Publication number: 20200092482
    Abstract: According to one embodiment, an optical filter associated with a lens unit having a first end includes a filter part, a filter frame, and an attachment part. The filter part includes a first filter area that transmits light rays of a first wavelength band and a second filter area that transmits light rays of a second wavelength band. The first wavelength band and the second wavelength band include a common wavelength band. The filter frame holds the filter part. The attachment part is coupled with the filter frame and is detachably attached to the first end of the lens unit. When the attachment part is attached to the first end of the lens unit, a distance between the filter part and an aperture within the lens unit is longer than a distance between the first end and the aperture.
    Type: Application
    Filed: February 25, 2019
    Publication date: March 19, 2020
    Applicant: KABUSHIKI KAISHA TOSHIBA
    Inventors: Tomoya Tsuruyama, Akihisa Moriya, Nao Mishima, Takayuki Sasaki, Jun Yamaguchi, Tatsuo Kozakaya
  • Publication number: 20200092464
    Abstract: According to one embodiment, an electronic device includes one or more processors. The one or more processors obtain an image captured by a camera with a filter having a first area transmitting light of a first wavelength range and a second area transmitting light of a second wavelength range. The image includes a first color-component image based on the light of the first wavelength range and a second color-component image based on the light of the second wavelength range. The one or more processors notify a user of an effective area for calculation of depth information based on a bias of color information in the first color-component image and the second color-component image.
    Type: Application
    Filed: March 5, 2019
    Publication date: March 19, 2020
    Applicant: KABUSHIKI KAISHA TOSHIBA
    Inventors: Tatsuo KOZAKAYA, Nao MISHIMA, Akihisa MORIYA, Jun YAMAGUCHI, Tomoya TSURUYAMA, Takayuki SASAKI
  • Patent number: 10571246
    Abstract: According to one embodiment, an image processing apparatus includes a memory and one or more processors. The one or more processors are electrically connected to the memory, and calculate blur correction information to make a blur of a first shape of an object approach a blur of a second shape of the object. The first shape of the object is contained in a first component image of one image. The second shape of the object is contained in a second component image of the one image. The one or more processors calculate a distance between an imaging device and the object based on an image distance when the one image is captured and the blur correction information. The image distance is a distance from a lens up to an image forming surface of the object.
    Type: Grant
    Filed: February 28, 2018
    Date of Patent: February 25, 2020
    Assignee: Kabushiki Kaisha Toshiba
    Inventors: Jun Yamaguchi, Yusuke Moriuchi, Nao Mishima, Takayuki Sasaki
  • Publication number: 20200051264
    Abstract: According to one embodiment, an image processing apparatus includes a memory and one or more hardware processors electrically coupled to the memory. The one or more hardware processors acquire a first image of an object including a first shaped blur and a second image of the object including a second shaped blur. The first image and the second image are acquired by capturing at a time through a single image-forming optical system. The one or more hardware processors acquire distance information to the object based on the first image and the second image, with a statistical model that has learnt previously.
    Type: Application
    Filed: March 7, 2019
    Publication date: February 13, 2020
    Applicant: KABUSHIKI KAISHA TOSHIBA
    Inventors: Nao Mishima, Takayuki Sasaki
  • Publication number: 20200051261
    Abstract: According to one embodiment, an image processing device includes a hardware processor implemented by one or more processors, The hardware processor is configured to acquire an image captured by a monocular camera. The hardware processor is configured to estimate a distance to an object based on the acquired image. The hardware processor is configured to calculate the distance to the object by considering an atmosphere failure influencing the acquired image and executing a statistical process on the estimated distance.
    Type: Application
    Filed: March 11, 2019
    Publication date: February 13, 2020
    Applicant: KABUSHIKI KAISHA TOSHIBA
    Inventors: Tomoya Tsuruyama, Nao MISHIMA, Tatsuo KOZAKAYA, Akihisa MORIYA, Jun YAMAGUCHI, Takayuki SASAKI