Patents by Inventor Tyler J. Kenney
Tyler J. Kenney has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240077904Abstract: Systems and methods for performing matrix operations using a photonic processor are provided. The photonic processor includes encoders configured to encode a numerical value into an optical signal and optical multiplication devices configured to output an electrical signal proportional to a product of one or more encoded values. The optical multiplication devices include a first input waveguide, a second input waveguide, a coupler circuit coupled to the first input waveguide and the second input waveguide, a first detector and a second detector coupled to the coupler circuit, and a circuit coupled to the first detector and second detector and configured to output a current that is proportional to a product of a first input value and a second input value.Type: ApplicationFiled: November 9, 2023Publication date: March 7, 2024Applicant: Lightmatter, Inc.Inventors: Darius Bunandar, Nicholas C. Harris, Tyler J. Kenney
-
Patent number: 11899967Abstract: Aspects of the present disclosure provide an aligned storage strategy for stripes within a long vector for a vector processor, such that the extra computation needed to track strides between input stripes and output stripes may be eliminated. As a result, the stripe locations are located in a more predictable memory access pattern such that memory access bandwidth may be improved and the tendency for memory error may be reduced.Type: GrantFiled: November 15, 2021Date of Patent: February 13, 2024Assignee: Lightmatter, Inc.Inventors: Nicholas Moore, Gongyu Wang, Bradley Dobbie, Tyler J. Kenney, Ayon Basumallik
-
Patent number: 11886942Abstract: Techniques for computing matrix operations for arbitrarily large matrices on a finite-sized hybrid analog-digital matrix processor are described. Techniques for gain adjustment in a finite-sized hybrid analog-digital matrix processor are described which enable the system to obtain higher energy efficiencies, greater physical density and improved numerical accuracy. In some embodiments, these techniques enable maximization of the predictive accuracy of a GEMM-based convolutional neural network using low-precision data representations.Type: GrantFiled: December 8, 2021Date of Patent: January 30, 2024Assignee: Lightmatter, Inc.Inventors: Tyler J. Kenney, Martin B. Z. Forsythe, Tomo Lazovich, Darius Bunandar
-
Patent number: 11860666Abstract: Systems and methods for performing matrix operations using a photonic processor are provided. The photonic processor includes encoders configured to encode a numerical value into an optical signal and optical multiplication devices configured to output an electrical signal proportional to a product of one or more encoded values. The optical multiplication devices include a first input waveguide, a second input waveguide, a coupler circuit coupled to the first input waveguide and the second input waveguide, a first detector and a second detector coupled to the coupler circuit, and a circuit coupled to the first detector and second detector and configured to output a current that is proportional to a product of a first input value and a second input value.Type: GrantFiled: November 1, 2019Date of Patent: January 2, 2024Assignee: Lightmatter, Inc.Inventors: Darius Bunandar, Nicholas C. Harris, Tyler J. Kenney
-
Patent number: 11775779Abstract: Techniques for computing matrix operations for arbitrarily large matrices on a finite-sized hybrid analog-digital matrix processor are described. Techniques for gain adjustment in a finite-sized hybrid analog-digital matrix processor are described which enable the system to obtain higher energy efficiencies, greater physical density and improved numerical accuracy. In some embodiments, these techniques enable maximization of the predictive accuracy of a GEMM-based convolutional neural network using low-precision data representations.Type: GrantFiled: May 3, 2021Date of Patent: October 3, 2023Assignee: Lightmatter, Inc.Inventors: Tyler J. Kenney, Martin B. Z. Forsythe, Tomo Lazovich, Darius Bunandar
-
Publication number: 20220261645Abstract: Methods and systems for training neural networks using low-bitwidth accelerators are described. The methods described herein use moment-penalization functions. For example, a method comprises producing a modified data set by training a neural network using a moment-penalization function and the data set. The moment-penalization function is configured to penalize a moment associated with the neural network. Training the neural network in turn comprises quantizing the data set to obtain a fixed-point data set so that the fixed-point data set represents the data set in a fixed-point representation, and passing the fixed-point data set through an analog accelerator. The inventors have recognized that training a neural network using a modified objective function augments the accuracy and robustness of the neural network notwithstanding the use of low-bitwidth accelerators.Type: ApplicationFiled: February 15, 2022Publication date: August 18, 2022Applicant: Lightmatter, Inc.Inventors: Nicholas Dronen, Tyler J. Kenney, Tomo Lazovich, Ayon Basumallik, Darius Bunandar
-
Publication number: 20220155996Abstract: Aspects of the present disclosure provide an aligned storage strategy for stripes within a long vector for a vector processor, such that the extra computation needed to track strides between input stripes and output stripes may be eliminated. As a result, the stripe locations are located in a more predictable memory access pattern such that memory access bandwidth may be improved and the tendency for memory error may be reduced.Type: ApplicationFiled: November 15, 2021Publication date: May 19, 2022Applicant: Lightmatter, Inc.Inventors: Nicholas Moore, Gongyu Wang, Bradley Dobbie, Tyler J. Kenney, Ayon Basumallik
-
Publication number: 20220100973Abstract: Techniques for computing matrix operations for arbitrarily large matrices on a finite-sized hybrid analog-digital matrix processor are described. Techniques for gain adjustment in a finite-sized hybrid analog-digital matrix processor are described which enable the system to obtain higher energy efficiencies, greater physical density and improved numerical accuracy. In some embodiments, these techniques enable maximization of the predictive accuracy of a GEMM-based convolutional neural network using low-precision data representations.Type: ApplicationFiled: December 8, 2021Publication date: March 31, 2022Applicant: Lightmatter, Inc.Inventors: Tyler J. Kenney, Martin B. Z. Forsythe, Tomo Lazovich, Darius Bunandar
-
Publication number: 20210279432Abstract: Techniques for computing matrix operations for arbitrarily large matrices on a finite-sized hybrid analog-digital matrix processor are described. Techniques for gain adjustment in a finite-sized hybrid analog-digital matrix processor are described which enable the system to obtain higher energy efficiencies, greater physical density and improved numerical accuracy. In some embodiments, these techniques enable maximization of the predictive accuracy of a GEMM-based convolutional neural network using low-precision data representations.Type: ApplicationFiled: May 3, 2021Publication date: September 9, 2021Applicant: Lightmatter, Inc.Inventors: TYLER J. KENNEY, Martin B.Z. Forsythe, Tomo Lazovich, Darius Bunandar
-
Patent number: 11023691Abstract: Techniques for computing matrix operations for arbitrarily large matrices on a finite-sized hybrid analog-digital matrix processor are described. Techniques for gain adjustment in a finite-sized hybrid analog-digital matrix processor are described which enable the system to obtain higher energy efficiencies, greater physical density and improved numerical accuracy. In some embodiments, these techniques enable maximization of the predictive accuracy of a GEMM-based convolutional neural network using low-precision data representations.Type: GrantFiled: August 17, 2020Date of Patent: June 1, 2021Assignee: Lightmatter, Inc.Inventors: Tyler J. Kenney, Martin B. Z. Forsythe, Tomo Lazovich, Darius Bunandar
-
Publication number: 20200380217Abstract: Techniques for computing matrix operations for arbitrarily large matrices on a finite-sized hybrid analog-digital matrix processor are described. Techniques for gain adjustment in a finite-sized hybrid analog-digital matrix processor are described which enable the system to obtain higher energy efficiencies, greater physical density and improved numerical accuracy. In some embodiments, these techniques enable maximization of the predictive accuracy of a GEMM-based convolutional neural network using low-precision data representations.Type: ApplicationFiled: August 17, 2020Publication date: December 3, 2020Applicant: Lightmatter, Inc.Inventors: Tyler J. Kenney, Martin B.Z. Forsythe, Tomo Lazovich, Darius Bunandar
-
Patent number: 10803259Abstract: Techniques for computing matrix operations for arbitrarily large matrices on a finite-sized hybrid analog-digital matrix processor are described. Techniques for gain adjustment in a finite-sized hybrid analog-digital matrix processor are described which enable the system to obtain higher energy efficiencies, greater physical density and improved numerical accuracy. In some embodiments, these techniques enable maximization of the predictive accuracy of a GEMM-based convolutional neural network using low-precision data representations.Type: GrantFiled: February 25, 2020Date of Patent: October 13, 2020Assignee: Lightmatter, Inc.Inventors: Tyler J. Kenney, Martin B. Z. Forsythe, Tomo Lazovich, Darius Bunandar
-
Patent number: 10803258Abstract: Techniques for computing matrix operations for arbitrarily large matrices on a finite-sized hybrid analog-digital matrix processor are described. Techniques for gain adjustment in a finite-sized hybrid analog-digital matrix processor are described which enable the system to obtain higher energy efficiencies, greater physical density and improved numerical accuracy. In some embodiments, these techniques enable maximization of the predictive accuracy of a GEMM-based convolutional neural network using low-precision data representations.Type: GrantFiled: February 25, 2020Date of Patent: October 13, 2020Assignee: Lightmatter, Inc.Inventors: Tyler J. Kenney, Martin B. Z. Forsythe, Tomo Lazovich, Darius Bunandar
-
Publication number: 20200272795Abstract: Techniques for computing matrix operations for arbitrarily large matrices on a finite-sized hybrid analog-digital matrix processor are described. Techniques for gain adjustment in a finite-sized hybrid analog-digital matrix processor are described which enable the system to obtain higher energy efficiencies, greater physical density and improved numerical accuracy. In some embodiments, these techniques enable maximization of the predictive accuracy of a GEMM-based convolutional neural network using low-precision data representations.Type: ApplicationFiled: February 25, 2020Publication date: August 27, 2020Applicant: Lightmatter, Inc.Inventors: Tyler J. Kenney, Martin B.Z. Forsythe, Tomo Lazovich, Darius Bunandar
-
Publication number: 20200272794Abstract: Techniques for computing matrix operations for arbitrarily large matrices on a finite-sized hybrid analog-digital matrix processor are described. Techniques for gain adjustment in a finite-sized hybrid analog-digital matrix processor are described which enable the system to obtain higher energy efficiencies, greater physical density and improved numerical accuracy. In some embodiments, these techniques enable maximization of the predictive accuracy of a GEMM-based convolutional neural network using low-precision data representations.Type: ApplicationFiled: February 25, 2020Publication date: August 27, 2020Applicant: Lightmatter, Inc.Inventors: Tyler J. Kenney, Martin B.Z. Forsythe, Tomo Lazovich, Darius Bunandar
-
Patent number: 10579345Abstract: A computer-implemented method for generating executable code for a hardware architecture comprising a primary functional unit and a non-primary functional unit is provided. Source code is translated into representative primary functional unit instructions for a representative primary functional unit in a representative processor architecture model wherein functionality of the non-primary functional unit in the hardware architecture is modeled by the representative primary functional unit in the representative processor architecture model. The representative primary functional unit instructions are transformed into executable non-primary functional unit instructions for the non-primary functional unit in the hardware architecture.Type: GrantFiled: December 11, 2017Date of Patent: March 3, 2020Assignee: International Business Machines CorporationInventor: Tyler J. Kenney
-
Patent number: 10564942Abstract: An apparatus and computer program product for generating executable code for a hardware architecture comprising a primary functional unit and a non-primary functional unit are provided. Source code is translated into representative primary functional unit instructions for a representative primary functional unit in a representative processor architecture model wherein functionality of the non-primary functional unit in the hardware architecture is modeled by the representative primary functional unit in the representative processor architecture model. The representative primary functional unit instructions are transformed into executable non-primary functional unit instructions for the non-primary functional unit in the hardware architecture.Type: GrantFiled: November 17, 2017Date of Patent: February 18, 2020Assignee: International Business Machines CorporationInventor: Tyler J. Kenney
-
Publication number: 20190155583Abstract: A computer-implemented method for generating executable code for a hardware architecture comprising a primary functional unit and a non-primary functional unit is provided. Source code is translated into representative primary functional unit instructions for a representative primary functional unit in a representative processor architecture model wherein functionality of the non-primary functional unit in the hardware architecture is modeled by the representative primary functional unit in the representative processor architecture model. The representative primary functional unit instructions are transformed into executable non-primary functional unit instructions for the non-primary functional unit in the hardware architecture.Type: ApplicationFiled: December 11, 2017Publication date: May 23, 2019Inventor: Tyler J. Kenney
-
Publication number: 20190155582Abstract: An apparatus and computer program product for generating executable code for a hardware architecture comprising a primary functional unit and a non-primary functional unit are provided. Source code is translated into representative primary functional unit instructions for a representative primary functional unit in a representative processor architecture model wherein functionality of the non-primary functional unit in the hardware architecture is modeled by the representative primary functional unit in the representative processor architecture model. The representative primary functional unit instructions are transformed into executable non-primary functional unit instructions for the non-primary functional unit in the hardware architecture.Type: ApplicationFiled: November 17, 2017Publication date: May 23, 2019Inventor: Tyler J. Kenney