Patents by Inventor Nao Mishima

Nao Mishima has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11868430
    Abstract: According to one embodiment, an image processing device includes first storage and a processor. The first storage is configured to store a first statistical model generated by learning bokeh which occurs in a first image. The processor is configured to acquire a second image, acquire a bokeh value which indicates bokeh occurring in the second image and an uncertainty level which indicates a level of uncertainty for the bokeh value, generate a first bokeh map based on the bokeh value and uncertainty level, and acquire a second bokeh map obtained by interpolating a bokeh value with respect to the first bokeh map. The bokeh value and the uncertainty level are output from the first statistical model by inputting the second image into the first statistical model.
    Type: Grant
    Filed: September 9, 2021
    Date of Patent: January 9, 2024
    Assignee: Kabushiki Kaisha Toshiba
    Inventors: Tomoya Tsuruyama, Akihito Seki, Nao Mishima, Masako Kashiwagi, Norihiko Nakamura, Aira Hotta
  • Publication number: 20230252344
    Abstract: According to one embodiment, a machine learning apparatus includes a processing circuit. The processing circuit generates a training sample in a VQA format regarding a VQA task based on a sample in a non-VQA format. The training sample in the VQA format includes a combination of an object, a question text regarding the object and an answer text in response to the question text as elements, and the sample in the non-VQA format includes a combination of an object and a label related to the object as elements. The processing circuit trains a statistical model of the VQA task based on the generated training sample in the VQA format.
    Type: Application
    Filed: August 26, 2022
    Publication date: August 10, 2023
    Applicant: KABUSHIKI KAISHA TOSHIBA
    Inventors: Nao MISHIMA, Quoc Viet PHAM, Yusuke HOSOYA, Hiroshi FUJIMURA
  • Patent number: 11722791
    Abstract: According to one embodiment, a ranging device includes storage and a processor. The storage is configured to store a statistical model generated by learning a bokeh that occurs in a first image affected by aberration of an optical system of a capture unit. The processor is configured to acquire a second image captured by the capture unit, acquire focus position information when the second image was captured, acquire a bokeh value indicating a bokeh of a subject in the second image, which is output from the statistical model by inputting the acquired second image to the statistical model, and convert the acquired bokeh value into a distance to the subject based on the acquired focus position information.
    Type: Grant
    Filed: September 1, 2022
    Date of Patent: August 8, 2023
    Assignee: KABUSHIKI KAISHA TOSHIBA
    Inventors: Masako Kashiwagi, Nao Mishima, Akihito Seki
  • Patent number: 11651504
    Abstract: According to one embodiment, a learning method for causing a statistical model to learn is provided. The statistical model is generated by learning a bokeh caused in a first image captured in a first domain in accordance with a distance to a first subject included in the first image, the method includes acquiring a plurality of second images by capturing a second subject from multiple viewpoints in a second domain other than the first domain, and causing the statistical model to learn using the second images.
    Type: Grant
    Filed: September 3, 2021
    Date of Patent: May 16, 2023
    Assignee: Kabushiki Kaisha Toshiba
    Inventors: Nao Mishima, Naoki Nishizawa
  • Publication number: 20230126635
    Abstract: According to one embodiment, a ranging device includes storage and a processor. The storage is configured to store a statistical model generated by learning a bokeh that occurs in a first image affected by aberration of an optical system of a capture unit. The processor is configured to acquire a second image captured by the capture unit, acquire focus position information when the second image was captured, acquire a bokeh value indicating a bokeh of a subject in the second image, which is output from the statistical model by inputting the acquired second image to the statistical model, and convert the acquired bokeh value into a distance to the subject based on the acquired focus position information.
    Type: Application
    Filed: September 1, 2022
    Publication date: April 27, 2023
    Applicant: KABUSHIKI KAISHA TOSHIBA
    Inventors: Masako KASHIWAGI, Nao MISHIMA, Akihito SEKI
  • Publication number: 20230077031
    Abstract: According to one embodiment, a case query apparatus includes a processing circuit. The processing circuit acquires a query condition represented by a query target. The processing circuit acquires a meta query condition represented by a description concerning a viewpoint to focus on when querying a case similar to the query condition. The processing circuit calculates a similarity degree between the query condition and each of a plurality of reference cases represented by a query target. The processing circuit queries a similar reference case similar to the query condition from a viewpoint of the meta query condition, among the plurality of reference cases, based on the similarity degree. The processing circuit presents a query result on the similar reference case.
    Type: Application
    Filed: February 28, 2022
    Publication date: March 9, 2023
    Applicant: KABUSHIKI KAISHA TOSHIBA
    Inventors: Yusuke HOSOYA, Toshiaki NAKASU, Isao MIHARA, Nao MISHIMA, Quoc Viet PHAM
  • Publication number: 20230061831
    Abstract: According to one embodiment, an estimation device includes a processor. The processor is configured to acquire first and second images including a same subject continuously captured by a capture device installed in a mobile object, acquire a first distance to the subject included in the acquired first image and uncertainty of the first distance, extract a useful second distance from the acquired first distance based on the acquired uncertainty of the first distance, and estimate a position and orientation of the mobile object when the second image is captured by the capture device based on the acquired first and second images, and the extracted second distance.
    Type: Application
    Filed: February 23, 2022
    Publication date: March 2, 2023
    Applicant: KABUSHIKI KAISHA TOSHIBA
    Inventors: Naoki NISHIZAWA, Akihito SEKI, Nao MISHIMA
  • Patent number: 11587261
    Abstract: According to one embodiment, an image processing apparatus includes a buffer and processing circuitry. The buffer stores first and second images capturing an object. The circuitry calculates at least one of a first distance to the object in the first image and a second distance to the object in the second image by using a correction parameter for correcting at least one of influences caused by ambient light, a reflection characteristic of the object, or a color of the object, calculates three-dimensional coordinates of the object on a relative scale by using the first and second images, and calculates three-dimensional coordinates of the object on a real scale based on at least one of the first and second distances, and the three-dimensional coordinates of the object on the relative scale.
    Type: Grant
    Filed: February 26, 2018
    Date of Patent: February 21, 2023
    Assignee: Kabushiki Kaisha Toshiba
    Inventors: Jun Yamaguchi, Yusuke Moriuchi, Nao Mishima
  • Publication number: 20230032387
    Abstract: According to one embodiment, a learning method includes acquiring first multi-view images obtained by capturing a first subject and causing a statistical model to learn, based on first and second bokeh values output from the statistical model by inputting first and second images of the first multi-view images. The causing includes acquiring a first distance from the capture device to a first subject in the first image and a second distance from the capture device to a first subject in the second image, discriminating a relationship in length between the first and second distances, and causing the statistical model to learn such that a relationship in magnitude between the first and second bokeh values is equal to the discriminated relationship.
    Type: Application
    Filed: February 28, 2022
    Publication date: February 2, 2023
    Applicant: KABUSHIKI KAISHA TOSHIBA
    Inventors: Nao MISHIMA, Akihito SEKI
  • Publication number: 20220300757
    Abstract: According to one embodiment, an image processing device includes first storage and a processor. The first storage is configured to store a first statistical model generated by learning bokeh which occurs in a first image. The processor is configured to acquire a second image, acquire a bokeh value which indicates bokeh occurring in the second image and an uncertainty level which indicates a level of uncertainty for the bokeh value, generate a first bokeh map based on the bokeh value and uncertainty level, and acquire a second bokeh map obtained by interpolating a bokeh value with respect to the first bokeh map. The bokeh value and the uncertainty level are output from the first statistical model by inputting the second image into the first statistical model.
    Type: Application
    Filed: September 9, 2021
    Publication date: September 22, 2022
    Applicant: KABUSHIKI KAISHA TOSHIBA
    Inventors: Tomoya TSURUYAMA, Akihito SEKI, Nao MISHIMA, Masako KASHIWAGI, Norihiko NAKAMURA, Aira HOTTA
  • Publication number: 20220301210
    Abstract: According to one embodiment, a learning method for causing a statistical model to learn is provided. The statistical model is generated by learning a bokeh caused in a first image captured in a first domain in accordance with a distance to a first subject included in the first image, the method includes acquiring a plurality of second images by capturing a second subject from multiple viewpoints in a second domain other than the first domain, and causing the statistical model to learn using the second images.
    Type: Application
    Filed: September 3, 2021
    Publication date: September 22, 2022
    Applicant: KABUSHIKI KAISHA TOSHIBA
    Inventors: Nao Mishima, Naoki Nishizawa
  • Publication number: 20220270222
    Abstract: According to one embodiment, an image processing device includes storage and a processor. The storage is configured to store a statistical model generated by learning bokeh that occurs in a first image affected by aberration of an optical system and varies non-linearly in accordance with a distance to a subject in the first image. The processor is configured to acquire a second image affected by the aberration of the optical system, perform color correction on the second image to reduce a number of colors expressed in the second image, and input a third image, obtained by performing the color correction on the second image, into the statistical model and acquire first distance information indicating a distance to a subject in the third image.
    Type: Application
    Filed: September 7, 2021
    Publication date: August 25, 2022
    Applicant: KABUSHIKI KAISHA TOSHIBA
    Inventors: Masako KASHIWAGI, Nao MISHIMA, Akihito SEKI
  • Patent number: 11418707
    Abstract: According to one embodiment, an electronic device includes one or more processors. The one or more processors obtain an image captured by a camera with a filter having a first area transmitting light of a first wavelength range and a second area transmitting light of a second wavelength range. The image includes a first color-component image based on the light of the first wavelength range and a second color-component image based on the light of the second wavelength range. The one or more processors notify a user of an effective area for calculation of depth information based on a bias of color information in the first color-component image and the second color-component image.
    Type: Grant
    Filed: March 5, 2019
    Date of Patent: August 16, 2022
    Assignee: KABUSHIKI KAISHA TOSHIBA
    Inventors: Tatsuo Kozakaya, Nao Mishima, Akihisa Moriya, Jun Yamaguchi, Tomoya Tsuruyama, Takayuki Sasaki
  • Publication number: 20220215576
    Abstract: According to an embodiment, an information processing device is configured to: estimate, based on target image data, target position data representing an image-capturing position at which the target image data is captured; estimate, based on the target image data, target depth data representing a distance to an object from the image-capturing position; register new image-capturing information including the target image data, the target position data, and the target depth data; display, on a display device, map data representing a map of an environment in which the image data is captured; and display at least one of image data and depth data included in designated image-capturing information that is designated from among a plurality of pieces of image-capturing information, in association with a pixel position in the map data, the pixel position corresponding to position data included in the designated image-capturing information.
    Type: Application
    Filed: September 2, 2021
    Publication date: July 7, 2022
    Applicant: KABUSHIKI KAISHA TOSHIBA
    Inventors: Yuma SANO, Ryo NAKASHIMA, Masako KASHIWAGI, Nao MISHIMA, Akihito SEKI
  • Patent number: 11379692
    Abstract: According to one embodiment, a learning method for causing a second statistical model to learn using a first statistical model is provided. The method includes obtaining a first learning image, cutting out each local area of the obtained first learning image, and obtaining a first prediction value output from the first statistical model by inputting each local area to the first statistical model and obtaining a second prediction value output from the second statistical model by inputting the entire area of the first learning image to the second statistical model, and causing the second statistical model to learn based on a difference between the first prediction value and the second prediction value.
    Type: Grant
    Filed: March 4, 2020
    Date of Patent: July 5, 2022
    Assignee: KABUSHIKI KAISHA TOSHIBA
    Inventors: Nao Mishima, Tatsuo Kozakaya
  • Publication number: 20220188571
    Abstract: According to one embodiment, a learning method includes acquiring first and second images and causing a statistical model to learn based on a first distance output from the statistical model by inputting a first region of the first image, and a second distance output from the statistical model by inputting a second region of the second image. A relationship in size between a third distance to a subject in the first image and a fourth distance to the subject included in the second image is already known. The causing includes causing the statistical model to learn such that a relationship in size between the first and the second distances is equal to a relationship in size between the third and the fourth distances.
    Type: Application
    Filed: September 7, 2021
    Publication date: June 16, 2022
    Applicant: KABUSHIKI KAISHA TOSHIBA
    Inventors: Nao MISHIMA, Masako KASHIWAGI
  • Patent number: 11333927
    Abstract: According to one embodiment, an image processing device includes a hardware processor implemented by one or more processors. The hardware processor acquires a first image of a first object and a second image of a second object which is different from the first object, the images captured by an image capture processing device including an image capturing element and an optical system which images an object image on an image capturing surface of the image capturing element. The hardware processor measures a point spread function of the optical system based on the first image and the second image.
    Type: Grant
    Filed: September 4, 2019
    Date of Patent: May 17, 2022
    Assignee: KABUSHIKI KAISHA TOSHIBA
    Inventors: Takayuki Sasaki, Nao Mishima
  • Publication number: 20220129693
    Abstract: According to one embodiment, a state determination apparatus includes a processor. The processor acquires a targeted image. The processor acquires a question concerning the targeted image and an expected answer to the question. The processor generates an estimated answer estimated with respect to the question concerning the targeted image using a trained model trained to estimate an answer based on a question concerning an image. The processor determines a state of a target for determination in accordance with a similarity between the expected answer and the estimated answer.
    Type: Application
    Filed: August 30, 2021
    Publication date: April 28, 2022
    Applicant: KABUSHIKI KAISHA TOSHIBA
    Inventors: Quoc Viet PHAM, Toshiaki NAKASU, Nao MISHIMA, Shojun NAKAYAMA
  • Patent number: 11305428
    Abstract: According to one embodiment, a robot motion planning device includes processing circuitry. The processing circuitry receives observation information obtained by observing at least part of a movable range of a robot. The processing circuitry determines, in a case where first observation information is received, a target position to which the robot is to make a motion, using an action-value function and the first observation information. The processing circuitry receives measurement information obtained by measuring a state of the robot, calculates a difference corresponding to the first observation information, using the measurement information, and determines a motion plan of a force-controlled motion of the robot, based on the target position and the difference.
    Type: Grant
    Filed: September 11, 2019
    Date of Patent: April 19, 2022
    Assignee: KABUSHIKI KAISHA TOSHIBA
    Inventors: Toshimitsu Kaneko, Tatsuya Tanaka, Ryosuke Nonaka, Nao Mishima, Tatsuo Kozakaya
  • Publication number: 20210312233
    Abstract: According to one embodiment, a learning method of causing a statistical model for outputting a distance to a subject to learn by using an image including the subject as an input is provided. The method includes acquiring an image for learning including a subject having an already known shape, acquiring a first distance to the subject included in the image for learning, from the image for learning, and causing the statistical model to learn by restraining the first distance with the shape of the subject included in the image for learning.
    Type: Application
    Filed: March 5, 2021
    Publication date: October 7, 2021
    Applicant: KABUSHIKI KAISHA TOSHIBA
    Inventors: Nao MISHIMA, Masako KASHIWAGI