Patents by Inventor Hakaru TAMUKOH
Hakaru TAMUKOH has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11782680Abstract: An arithmetic logic unit according to an embodiment of the present technology includes: a plurality of input lines; and a multiply-accumulate operation device. Electrical signals are input to the plurality of input lines.Type: GrantFiled: July 5, 2019Date of Patent: October 10, 2023Assignee: Sony Group CorporationInventors: Takashi Morie, Masatoshi Yamaguchi, Hakaru Tamukoh
-
Patent number: 11481919Abstract: An image recognition device includes: an image processing device that acquires a feature amount from an image; and an identification device that determines whether a prescribed identification object is present in the image, and identifies the identification object. The identification device includes a BNN that has learned the identification object in advance, and performs identification processing by performing a binary calculation with the BNN on the feature amount acquired by the image processing device. Then, the identification device selects a portion effective for identification from among high-dimensional feature amounts output by the image processing device to reduce the dimensions used in identification processing, and copies low-dimensional feature amounts output by the image processing device to increase dimensions.Type: GrantFiled: September 26, 2018Date of Patent: October 25, 2022Assignees: AISIN CORPORATION, KYUSHU INSTITUTE OF TECHNOLOGYInventors: Hideo Yamada, Ryuya Muramatsu, Masatoshi Shibata, Hakaru Tamukoh, Shuichi Enokida, Yuta Yamasaki
-
Patent number: 11392349Abstract: Electric charges depending on values of N+ electric signals and values of corresponding positive loads are held in first capture-and-storage circuitry. Electric charges having a size depending on values of (N?N+) electric signals and corresponding absolute values of negative loads are held in second capture-and-storage circuitry. A sum of N+ multiplied values obtained by multiplying each of the positive loads by each of the values of the N+ electric signals is calculated when a voltage held in the first capture-and-storage circuitry reaches a first threshold. A sum of (N?N+) multiplied values obtained by multiplying each of the absolute values by each of the values of the (N?N+) electric signals is calculated when a voltage held in the second capture-and-storage circuitry reaches a second threshold A sum of N multiplied values is obtained by subtracting the sum of (N?N+) multiplied values from the sum of N+ multiplied values.Type: GrantFiled: September 30, 2020Date of Patent: July 19, 2022Assignee: Sony Group CorporationInventors: Takashi Morie, Quan Wang, Hakaru Tamukoh
-
Publication number: 20220189134Abstract: An image recognition device involves successively extracting co-occurrence pairs in synchronization with a clock, setting a weighting for the portion connecting the input layer and the intermediate layer corresponding to the extracted co-occurrence pairs, and successively inputting a first vote to the input layer. Meanwhile, the intermediate layer adds and stores the successively inputted number of votes. By continuing this operation, a value the same as if a histogram were inputted to an input layer is achieved in the intermediate layer, without creating a histogram. In this way, the image recognition device of this embodiment can perform image recognition while avoiding the creation of a histogram, which consumes vast amounts of memory. As a result of this configuration, it is possible to save memory resources, simplify circuits, and improve calculation speed, and achieve an integrated circuit suitable to an image recognition device.Type: ApplicationFiled: March 30, 2020Publication date: June 16, 2022Applicants: AISIN CORPORATION, KYUSHU INSTITUTE OF TECHNOLOGYInventors: Hideo YAMADA, Ryuya MURAMATSU, Masatoshi SHIBATA, Hakaru TAMUKOH
-
Publication number: 20220180546Abstract: An image processing device can use a calculation formula based on an ellipse to approximate a base function of a reference GMM. The burden rate according to a co-occurrence correspondence point can be approximately determined by a calculation in which the Manhattan distance to the ellipse and the co-occurrence correspondence point and the width of the ellipse are input to a calculation formula for the burden rate based on the base function. The width of the ellipse is quantized by the nth power of 2 (where n is an integer of 0 or greater), and the calculation can be carried out by means of a bit shift.Type: ApplicationFiled: March 30, 2020Publication date: June 9, 2022Applicants: AISIN CORPORATION, KYUSHU INSTITUTE OF TECHNOLOGYInventors: Hideo YAMADA, Masatoshi SHIBATA, Hakaru TAMUKOH, Shuichi ENOKIDA, Kazuki YOSHIHIRO
-
Patent number: 11256950Abstract: An image processing device converts an image that is a recognition object image to high-resolution, medium-resolution, and low-resolution images. The device sets the pixel of interest of the high-resolution image, and votes the co-occurrence in a gradient direction with offset pixels, the co-occurrence in the gradient direction pixels in the medium-resolution image, and the co-occurrence in the gradient direction pixels in the low-resolution image, to a co-occurrence matrix. The device creates such a co-occurrence matrix for each pixel combination and for each resolution. The device executes the process on each of the pixels of the high-resolution image, and creates a co-occurrence histogram wherein the elements of a plurality of co-occurrence matrices are arranged in a line. The device normalizes the co-occurrence histogram and extracts, as a feature quantity of the image, a vector quantity having as a component a frequency resulting from the normalization.Type: GrantFiled: January 31, 2018Date of Patent: February 22, 2022Assignees: AISIN CORPORATION, KYUSHU INSTITUTE OF TECHNOLOGYInventors: Hideo Yamada, Kazuhiro Kuno, Masatoshi Shibata, Shuichi Enokida, Hakaru Tamukoh
-
Publication number: 20210294573Abstract: A multiply-accumulate operation device, circuit and method are disclosed. In on example, a multiply-accumulate operation device includes input lines, multiplication units, an accumulation unit, a charging unit, and an output unit. Pulse signals having pulse widths corresponding to input values are input to the input lines. The multiplication units generate, based on the pulse signals, charges corresponding to multiplication values obtained by multiplying the input values by weight values. The accumulation unit accumulates a sum of the charges corresponding to the multiplication values. The charging unit charges the accumulation unit at a charging speed associated with its accumulation state. The output unit outputs a multiply-accumulate signal representing a sum of the multiplication values by executing threshold determination using a threshold value associated with the accumulation state of the accumulation unit on a voltage held by the accumulation unit after the charging by the charging unit is started.Type: ApplicationFiled: July 4, 2019Publication date: September 23, 2021Inventors: Takashi Morie, Masatoshi Yamaguchi, Goki Iwamoto, Hakaru Tamukoh
-
Publication number: 20210271453Abstract: An arithmetic logic unit according to an embodiment of the present technology includes: a plurality of input lines; and a multiply-accumulate operation device. Electrical signals are input to the plurality of input lines.Type: ApplicationFiled: July 5, 2019Publication date: September 2, 2021Inventors: Takashi Morie, Masatoshi Yamaguchi, Hakaru Tamukoh
-
Patent number: 11017262Abstract: A hardware configuration is constructed for calculating at high speed the co-occurrence of luminance gradient directions between differing resolutions for a subject image. In an image processing device, a processing line for high-resolution images, a processing line for medium-resolution images, and a processing line for low-resolution images are arranged in parallel, and the luminance gradient directions are extracted for each pixel simultaneously in parallel from images having the three resolutions. Co-occurrence matrix preparation units prepare co-occurrence matrices by using the luminance gradient directions extracted from these images having the three resolutions, and a histogram preparation unit outputs a histogram as an MRCoHOG feature amount by using these matrices. To concurrently processing the images having the three resolutions, high-speed processing can be performed, and moving pictures output from a camera can be processed in real time.Type: GrantFiled: March 30, 2017Date of Patent: May 25, 2021Assignees: EQUOS RESEARCH CO., LTD., KYUSHU INSTITUTE OF TECHNOLOGYInventors: Hideo Yamada, Kazuhiro Kuno, Hakaru Tamukoh, Shuichi Enokida, Shiryu Ooe
-
Publication number: 20210081176Abstract: Electric charges depending on values of N+ electric signals and values of corresponding positive loads are held in first capture-and-storage circuitry. Electric charges having a size depending on values of (N?N+) electric signals and corresponding absolute values of negative loads are held in second capture-and-storage circuitry. A sum of N+ multiplied values obtained by multiplying each of the positive loads by each of the values of the N+ electric signals is calculated when a voltage held in the first capture-and-storage circuitry reaches a first threshold. A sum of (N?N+) multiplied values obtained by multiplying each of the absolute values by each of the values of the (N?N+) electric signals is calculated when a voltage held in the second capture-and-storage circuitry reaches a second threshold A sum of N multiplied values is obtained by subtracting the sum of (N?N+) multiplied values from the sum of N+ multiplied values.Type: ApplicationFiled: September 30, 2020Publication date: March 18, 2021Inventors: Takashi Morie, Quan Wang, Hakaru Tamukoh
-
Patent number: 10831447Abstract: Electric charges depending on values of N+ electric signals and values of corresponding positive loads are held in first capture-and-storage circuitry. Electric charges having a size depending on values of (N?N+) electric signals and corresponding absolute values of negative loads are held in second capture-and-storage circuitry. A sum of N+ multiplied values obtained by multiplying each of the positive loads by each of the values of the N+ electric signals is calculated when a voltage held in the first capture-and-storage circuitry reaches a first threshold. A sum of (N?N+) multiplied values obtained by multiplying each of the absolute values by each of the values of the (N?N+) electric signals is calculated when a voltage held in the second capture-and-storage circuitry reaches a second threshold A sum of N multiplied values is obtained by subtracting the sum of (N?N+) multiplied values from the sum of N+ multiplied values.Type: GrantFiled: August 3, 2017Date of Patent: November 10, 2020Assignee: Sony CorporationInventors: Takashi Morie, Quan Wang, Hakaru Tamukoh
-
Publication number: 20200286254Abstract: An image recognition device includes: an image processing device that acquires a feature amount from an image; and an identification device that determines whether a prescribed identification object is present in the image, and identifies the identification object. The identification device includes a BNN that has learned the identification object in advance, and performs identification processing by performing a binary calculation with the BNN on the feature amount acquired by the image processing device. Then, the identification device selects a portion effective for identification from among high-dimensional feature amounts output by the image processing device to reduce the dimensions used in identification processing, and copies low-dimensional feature amounts output by the image processing device to increase dimensions.Type: ApplicationFiled: September 26, 2018Publication date: September 10, 2020Applicants: EQUOS RESEARCH CO., LTD., KYUSHU INSTITUTE OF TECHNOLOGYInventors: Hideo YAMADA, Ryuya MURAMATSU, Masatoshi SHIBATA, Hakaru TAMUKOH, Shuichi ENOKIDA, Yuta YAMASAKI
-
Publication number: 20200279166Abstract: An image recognition device includes: an image processing device that acquires a feature amount from an image; and an identification device that determines whether a prescribed identification object is present in the image, and identifies the identification object. The identification device includes a BNN that has learned the identification object in advance, and performs identification processing by performing a binary calculation with the BNN on the feature amount acquired by the image processing device. Then, the identification device selects a portion effective for identification from among high-dimensional feature amounts output by the image processing device to reduce the dimensions used in identification processing, and copies low-dimensional feature amounts output by the image processing device to increase dimensions.Type: ApplicationFiled: September 26, 2018Publication date: September 3, 2020Applicants: EQUOS RESEARCH CO., LTD., KYUSHU INSTITUTE OF TECHNOLOGYInventors: Hideo YAMADA, Ryuya MURAMATSU, Masatoshi SHIBATA, Hakaru TAMUKOH, Shuichi ENOKIDA, Yuta YAMASAKI
-
Publication number: 20190392249Abstract: An image processing device converts an image that is a recognition object image to high-resolution, medium-resolution, and low-resolution images. The device sets the pixel of interest of the high-resolution image, and votes the co-occurrence in a gradient direction with offset pixels, the co-occurrence in the gradient direction pixels in the medium-resolution image, and the co-occurrence in the gradient direction pixels in the low-resolution image, to a co-occurrence matrix. The device creates such a co-occurrence matrix for each pixel combination and for each resolution. The device executes the process on each of the pixels of the high-resolution image, and creates a co-occurrence histogram wherein the elements of a plurality of co-occurrence matrices are arranged in a line. The device normalizes the co-occurrence histogram and extracts, as a feature quantity of the image, a vector quantity having as a component a frequency resulting from the normalization.Type: ApplicationFiled: January 31, 2018Publication date: December 26, 2019Applicants: EQUOS RESEARCH CO., LTD., KYUSHU INSTITUTE OF TECHNOLOGYInventors: Hideo YAMADA, Kazuhiro KUNO, Masatoshi SHIBATA, Shuichi ENOKIDA, Hakaru TAMUKOH
-
Publication number: 20190171418Abstract: Electric charges depending on values of N+ electric signals and values of corresponding positive loads are held in first capture-and-storage circuitry. Electric charges having a size depending on values of (N?N+) electric signals and corresponding absolute values of negative loads are held in second capture-and-storage circuitry. A sum of N+ multiplied values obtained by multiplying each of the positive loads by each of the values of the N+ electric signals is calculated when a voltage held in the first capture-and-storage circuitry reaches a first threshold. A sum of (N?N+) multiplied values obtained by multiplying each of the absolute values by each of the values of the (N?N+) electric signals is calculated when a voltage held in the second capture-and-storage circuitry reaches a second threshold A sum of N multiplied values is obtained by subtracting the sum of (N?N+) multiplied values from the sum of N+ multiplied values.Type: ApplicationFiled: August 3, 2017Publication date: June 6, 2019Inventors: Takashi MORIE, Quan WANG, Hakaru TAMUKOH
-
Publication number: 20180322361Abstract: A hardware configuration is constructed for calculating at high speed the co-occurrence of luminance gradient directions between differing resolutions for a subject image. In an image processing device, a processing line for high-resolution images, a processing line for medium-resolution images, and a processing line for low-resolution images are arranged in parallel, and the luminance gradient directions are extracted for each pixel simultaneously in parallel from images having the three resolutions. Co-occurrence matrix preparation units prepare co-occurrence matrices by using the luminance gradient directions extracted from these images having the three resolutions, and a histogram preparation unit outputs a histogram as an MRCoHOG feature amount by using these matrices. To concurrently processing the images having the three resolutions, high-speed processing can be performed, and moving pictures output from a camera can be processed in real time.Type: ApplicationFiled: March 30, 2017Publication date: November 8, 2018Applicants: EQUOS RESEARCH CO., LTD., KYUSHU INSTITUTE OF TECHNOLOGYInventors: Hideo YAMADA, Kazuhiro KUNO, Hakaru TAMUKOH, Shuichi ENOKIDA, Shiryu OOE