Patents by Inventor Hakaru TAMUKOH

Hakaru TAMUKOH has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11782680
    Abstract: An arithmetic logic unit according to an embodiment of the present technology includes: a plurality of input lines; and a multiply-accumulate operation device. Electrical signals are input to the plurality of input lines.
    Type: Grant
    Filed: July 5, 2019
    Date of Patent: October 10, 2023
    Assignee: Sony Group Corporation
    Inventors: Takashi Morie, Masatoshi Yamaguchi, Hakaru Tamukoh
  • Patent number: 11481919
    Abstract: An image recognition device includes: an image processing device that acquires a feature amount from an image; and an identification device that determines whether a prescribed identification object is present in the image, and identifies the identification object. The identification device includes a BNN that has learned the identification object in advance, and performs identification processing by performing a binary calculation with the BNN on the feature amount acquired by the image processing device. Then, the identification device selects a portion effective for identification from among high-dimensional feature amounts output by the image processing device to reduce the dimensions used in identification processing, and copies low-dimensional feature amounts output by the image processing device to increase dimensions.
    Type: Grant
    Filed: September 26, 2018
    Date of Patent: October 25, 2022
    Assignees: AISIN CORPORATION, KYUSHU INSTITUTE OF TECHNOLOGY
    Inventors: Hideo Yamada, Ryuya Muramatsu, Masatoshi Shibata, Hakaru Tamukoh, Shuichi Enokida, Yuta Yamasaki
  • Patent number: 11392349
    Abstract: Electric charges depending on values of N+ electric signals and values of corresponding positive loads are held in first capture-and-storage circuitry. Electric charges having a size depending on values of (N?N+) electric signals and corresponding absolute values of negative loads are held in second capture-and-storage circuitry. A sum of N+ multiplied values obtained by multiplying each of the positive loads by each of the values of the N+ electric signals is calculated when a voltage held in the first capture-and-storage circuitry reaches a first threshold. A sum of (N?N+) multiplied values obtained by multiplying each of the absolute values by each of the values of the (N?N+) electric signals is calculated when a voltage held in the second capture-and-storage circuitry reaches a second threshold A sum of N multiplied values is obtained by subtracting the sum of (N?N+) multiplied values from the sum of N+ multiplied values.
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: July 19, 2022
    Assignee: Sony Group Corporation
    Inventors: Takashi Morie, Quan Wang, Hakaru Tamukoh
  • Publication number: 20220189134
    Abstract: An image recognition device involves successively extracting co-occurrence pairs in synchronization with a clock, setting a weighting for the portion connecting the input layer and the intermediate layer corresponding to the extracted co-occurrence pairs, and successively inputting a first vote to the input layer. Meanwhile, the intermediate layer adds and stores the successively inputted number of votes. By continuing this operation, a value the same as if a histogram were inputted to an input layer is achieved in the intermediate layer, without creating a histogram. In this way, the image recognition device of this embodiment can perform image recognition while avoiding the creation of a histogram, which consumes vast amounts of memory. As a result of this configuration, it is possible to save memory resources, simplify circuits, and improve calculation speed, and achieve an integrated circuit suitable to an image recognition device.
    Type: Application
    Filed: March 30, 2020
    Publication date: June 16, 2022
    Applicants: AISIN CORPORATION, KYUSHU INSTITUTE OF TECHNOLOGY
    Inventors: Hideo YAMADA, Ryuya MURAMATSU, Masatoshi SHIBATA, Hakaru TAMUKOH
  • Publication number: 20220180546
    Abstract: An image processing device can use a calculation formula based on an ellipse to approximate a base function of a reference GMM. The burden rate according to a co-occurrence correspondence point can be approximately determined by a calculation in which the Manhattan distance to the ellipse and the co-occurrence correspondence point and the width of the ellipse are input to a calculation formula for the burden rate based on the base function. The width of the ellipse is quantized by the nth power of 2 (where n is an integer of 0 or greater), and the calculation can be carried out by means of a bit shift.
    Type: Application
    Filed: March 30, 2020
    Publication date: June 9, 2022
    Applicants: AISIN CORPORATION, KYUSHU INSTITUTE OF TECHNOLOGY
    Inventors: Hideo YAMADA, Masatoshi SHIBATA, Hakaru TAMUKOH, Shuichi ENOKIDA, Kazuki YOSHIHIRO
  • Patent number: 11256950
    Abstract: An image processing device converts an image that is a recognition object image to high-resolution, medium-resolution, and low-resolution images. The device sets the pixel of interest of the high-resolution image, and votes the co-occurrence in a gradient direction with offset pixels, the co-occurrence in the gradient direction pixels in the medium-resolution image, and the co-occurrence in the gradient direction pixels in the low-resolution image, to a co-occurrence matrix. The device creates such a co-occurrence matrix for each pixel combination and for each resolution. The device executes the process on each of the pixels of the high-resolution image, and creates a co-occurrence histogram wherein the elements of a plurality of co-occurrence matrices are arranged in a line. The device normalizes the co-occurrence histogram and extracts, as a feature quantity of the image, a vector quantity having as a component a frequency resulting from the normalization.
    Type: Grant
    Filed: January 31, 2018
    Date of Patent: February 22, 2022
    Assignees: AISIN CORPORATION, KYUSHU INSTITUTE OF TECHNOLOGY
    Inventors: Hideo Yamada, Kazuhiro Kuno, Masatoshi Shibata, Shuichi Enokida, Hakaru Tamukoh
  • Publication number: 20210294573
    Abstract: A multiply-accumulate operation device, circuit and method are disclosed. In on example, a multiply-accumulate operation device includes input lines, multiplication units, an accumulation unit, a charging unit, and an output unit. Pulse signals having pulse widths corresponding to input values are input to the input lines. The multiplication units generate, based on the pulse signals, charges corresponding to multiplication values obtained by multiplying the input values by weight values. The accumulation unit accumulates a sum of the charges corresponding to the multiplication values. The charging unit charges the accumulation unit at a charging speed associated with its accumulation state. The output unit outputs a multiply-accumulate signal representing a sum of the multiplication values by executing threshold determination using a threshold value associated with the accumulation state of the accumulation unit on a voltage held by the accumulation unit after the charging by the charging unit is started.
    Type: Application
    Filed: July 4, 2019
    Publication date: September 23, 2021
    Inventors: Takashi Morie, Masatoshi Yamaguchi, Goki Iwamoto, Hakaru Tamukoh
  • Publication number: 20210271453
    Abstract: An arithmetic logic unit according to an embodiment of the present technology includes: a plurality of input lines; and a multiply-accumulate operation device. Electrical signals are input to the plurality of input lines.
    Type: Application
    Filed: July 5, 2019
    Publication date: September 2, 2021
    Inventors: Takashi Morie, Masatoshi Yamaguchi, Hakaru Tamukoh
  • Patent number: 11017262
    Abstract: A hardware configuration is constructed for calculating at high speed the co-occurrence of luminance gradient directions between differing resolutions for a subject image. In an image processing device, a processing line for high-resolution images, a processing line for medium-resolution images, and a processing line for low-resolution images are arranged in parallel, and the luminance gradient directions are extracted for each pixel simultaneously in parallel from images having the three resolutions. Co-occurrence matrix preparation units prepare co-occurrence matrices by using the luminance gradient directions extracted from these images having the three resolutions, and a histogram preparation unit outputs a histogram as an MRCoHOG feature amount by using these matrices. To concurrently processing the images having the three resolutions, high-speed processing can be performed, and moving pictures output from a camera can be processed in real time.
    Type: Grant
    Filed: March 30, 2017
    Date of Patent: May 25, 2021
    Assignees: EQUOS RESEARCH CO., LTD., KYUSHU INSTITUTE OF TECHNOLOGY
    Inventors: Hideo Yamada, Kazuhiro Kuno, Hakaru Tamukoh, Shuichi Enokida, Shiryu Ooe
  • Publication number: 20210081176
    Abstract: Electric charges depending on values of N+ electric signals and values of corresponding positive loads are held in first capture-and-storage circuitry. Electric charges having a size depending on values of (N?N+) electric signals and corresponding absolute values of negative loads are held in second capture-and-storage circuitry. A sum of N+ multiplied values obtained by multiplying each of the positive loads by each of the values of the N+ electric signals is calculated when a voltage held in the first capture-and-storage circuitry reaches a first threshold. A sum of (N?N+) multiplied values obtained by multiplying each of the absolute values by each of the values of the (N?N+) electric signals is calculated when a voltage held in the second capture-and-storage circuitry reaches a second threshold A sum of N multiplied values is obtained by subtracting the sum of (N?N+) multiplied values from the sum of N+ multiplied values.
    Type: Application
    Filed: September 30, 2020
    Publication date: March 18, 2021
    Inventors: Takashi Morie, Quan Wang, Hakaru Tamukoh
  • Patent number: 10831447
    Abstract: Electric charges depending on values of N+ electric signals and values of corresponding positive loads are held in first capture-and-storage circuitry. Electric charges having a size depending on values of (N?N+) electric signals and corresponding absolute values of negative loads are held in second capture-and-storage circuitry. A sum of N+ multiplied values obtained by multiplying each of the positive loads by each of the values of the N+ electric signals is calculated when a voltage held in the first capture-and-storage circuitry reaches a first threshold. A sum of (N?N+) multiplied values obtained by multiplying each of the absolute values by each of the values of the (N?N+) electric signals is calculated when a voltage held in the second capture-and-storage circuitry reaches a second threshold A sum of N multiplied values is obtained by subtracting the sum of (N?N+) multiplied values from the sum of N+ multiplied values.
    Type: Grant
    Filed: August 3, 2017
    Date of Patent: November 10, 2020
    Assignee: Sony Corporation
    Inventors: Takashi Morie, Quan Wang, Hakaru Tamukoh
  • Publication number: 20200286254
    Abstract: An image recognition device includes: an image processing device that acquires a feature amount from an image; and an identification device that determines whether a prescribed identification object is present in the image, and identifies the identification object. The identification device includes a BNN that has learned the identification object in advance, and performs identification processing by performing a binary calculation with the BNN on the feature amount acquired by the image processing device. Then, the identification device selects a portion effective for identification from among high-dimensional feature amounts output by the image processing device to reduce the dimensions used in identification processing, and copies low-dimensional feature amounts output by the image processing device to increase dimensions.
    Type: Application
    Filed: September 26, 2018
    Publication date: September 10, 2020
    Applicants: EQUOS RESEARCH CO., LTD., KYUSHU INSTITUTE OF TECHNOLOGY
    Inventors: Hideo YAMADA, Ryuya MURAMATSU, Masatoshi SHIBATA, Hakaru TAMUKOH, Shuichi ENOKIDA, Yuta YAMASAKI
  • Publication number: 20200279166
    Abstract: An image recognition device includes: an image processing device that acquires a feature amount from an image; and an identification device that determines whether a prescribed identification object is present in the image, and identifies the identification object. The identification device includes a BNN that has learned the identification object in advance, and performs identification processing by performing a binary calculation with the BNN on the feature amount acquired by the image processing device. Then, the identification device selects a portion effective for identification from among high-dimensional feature amounts output by the image processing device to reduce the dimensions used in identification processing, and copies low-dimensional feature amounts output by the image processing device to increase dimensions.
    Type: Application
    Filed: September 26, 2018
    Publication date: September 3, 2020
    Applicants: EQUOS RESEARCH CO., LTD., KYUSHU INSTITUTE OF TECHNOLOGY
    Inventors: Hideo YAMADA, Ryuya MURAMATSU, Masatoshi SHIBATA, Hakaru TAMUKOH, Shuichi ENOKIDA, Yuta YAMASAKI
  • Publication number: 20190392249
    Abstract: An image processing device converts an image that is a recognition object image to high-resolution, medium-resolution, and low-resolution images. The device sets the pixel of interest of the high-resolution image, and votes the co-occurrence in a gradient direction with offset pixels, the co-occurrence in the gradient direction pixels in the medium-resolution image, and the co-occurrence in the gradient direction pixels in the low-resolution image, to a co-occurrence matrix. The device creates such a co-occurrence matrix for each pixel combination and for each resolution. The device executes the process on each of the pixels of the high-resolution image, and creates a co-occurrence histogram wherein the elements of a plurality of co-occurrence matrices are arranged in a line. The device normalizes the co-occurrence histogram and extracts, as a feature quantity of the image, a vector quantity having as a component a frequency resulting from the normalization.
    Type: Application
    Filed: January 31, 2018
    Publication date: December 26, 2019
    Applicants: EQUOS RESEARCH CO., LTD., KYUSHU INSTITUTE OF TECHNOLOGY
    Inventors: Hideo YAMADA, Kazuhiro KUNO, Masatoshi SHIBATA, Shuichi ENOKIDA, Hakaru TAMUKOH
  • Publication number: 20190171418
    Abstract: Electric charges depending on values of N+ electric signals and values of corresponding positive loads are held in first capture-and-storage circuitry. Electric charges having a size depending on values of (N?N+) electric signals and corresponding absolute values of negative loads are held in second capture-and-storage circuitry. A sum of N+ multiplied values obtained by multiplying each of the positive loads by each of the values of the N+ electric signals is calculated when a voltage held in the first capture-and-storage circuitry reaches a first threshold. A sum of (N?N+) multiplied values obtained by multiplying each of the absolute values by each of the values of the (N?N+) electric signals is calculated when a voltage held in the second capture-and-storage circuitry reaches a second threshold A sum of N multiplied values is obtained by subtracting the sum of (N?N+) multiplied values from the sum of N+ multiplied values.
    Type: Application
    Filed: August 3, 2017
    Publication date: June 6, 2019
    Inventors: Takashi MORIE, Quan WANG, Hakaru TAMUKOH
  • Publication number: 20180322361
    Abstract: A hardware configuration is constructed for calculating at high speed the co-occurrence of luminance gradient directions between differing resolutions for a subject image. In an image processing device, a processing line for high-resolution images, a processing line for medium-resolution images, and a processing line for low-resolution images are arranged in parallel, and the luminance gradient directions are extracted for each pixel simultaneously in parallel from images having the three resolutions. Co-occurrence matrix preparation units prepare co-occurrence matrices by using the luminance gradient directions extracted from these images having the three resolutions, and a histogram preparation unit outputs a histogram as an MRCoHOG feature amount by using these matrices. To concurrently processing the images having the three resolutions, high-speed processing can be performed, and moving pictures output from a camera can be processed in real time.
    Type: Application
    Filed: March 30, 2017
    Publication date: November 8, 2018
    Applicants: EQUOS RESEARCH CO., LTD., KYUSHU INSTITUTE OF TECHNOLOGY
    Inventors: Hideo YAMADA, Kazuhiro KUNO, Hakaru TAMUKOH, Shuichi ENOKIDA, Shiryu OOE