Patents by Inventor Nicholas Fraser

Nicholas Fraser has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20260178694
    Abstract: Embodiments herein relate to applying a Boolean matrix factorization operation to selected neurons, represented as truth tables, in LUT based neural networks. Applying the Boolean matrix factorization operation replaces the original truth table representing the neuron of the neural network with a simplified, approximated truth table derived from the original truth table. The neural network is then simulated, and the cost of the simulated result, as evaluated by a cost function which may for instance incorporate accuracy and resource cost, is compared to a cost threshold value to decide whether to replace the original neuron with its approximated representation.
    Type: Application
    Filed: December 24, 2024
    Publication date: June 25, 2026
    Inventors: Linus Matthias WITSCHEN, Nicholas FRASER, Yaman UMUROGLU, Thomas Bernd PREUSSER, Michaela BLOTT
  • Publication number: 20260064369
    Abstract: Embodiments herein describe generating non-linear thresholds which can be used, for example, in a quantization operation of a neural network layer. In one example, a compiler can receive a set of non-linear thresholds (e.g., rounded integer thresholds) and determine delta values indicating respective differences between two thresholds of the non-linear thresholds. Because the thresholds are non-linear, the delta values are also different. The compiler can calculate residual errors to represent the differences between the deltas with respect to a step size. Using these residual errors, an initial threshold value, a step size between the thresholds, the non-linear thresholds can be calculated as needed, instead of having to store the non-linear thresholds in memory.
    Type: Application
    Filed: August 29, 2024
    Publication date: March 5, 2026
    Inventors: Yaman UMUROGLU, Nicholas FRASER, Thomas Bernd PREUSSER
  • Publication number: 20260012564
    Abstract: A method of producing a reprojected image includes receiving motion data and determining, based on the motion data, if a motion threshold is exceeded. The method also includes generating a depth-based reprojection if the motion threshold is exceeded or generating a non-depth-based reprojection if the motion threshold is not exceeded. In some embodiments, performing the foveated compression of the depth-based reprojection includes determining an eye gaze location of a user and generating a foveation map based on the eye gaze location. The foveation map includes a first region of the depth-based reprojection and a second region of the depth-based reprojection. Performing the foveated compression of the depth-based reprojection also includes compressing the first region using a first quality setting and the second region using a second quality setting.
    Type: Application
    Filed: September 17, 2025
    Publication date: January 8, 2026
    Applicant: Magic Leap, Inc.
    Inventors: Edward Diaz, Nicholas Fraser, Nirajkumar Patel
  • Publication number: 20250111231
    Abstract: Embodiments herein describe pruning of technology-mapped machine learning-related circuits at bit-level granularity, including techniques to efficiently remove look-up tables (LUTs) of a technology-mapped netlist while maintaining a baseline accuracy of an underlying machine learning model. In an embodiment, a LUT output of a current circuit design is replaced with a constant value, and at least the LUT and LUTs within a maximum fanout-free cone (MFFC) are removed, to provide an optimized circuit design. The current circuit design or the optimized circuit design is selected as a solution based on corresponding training data-based accuracies and metrics (e.g., LUT utilization), and optimization criteria. If the optimized circuit design is rejected, inputs to the LUT may be evaluated for pruning. A set of solutions may be evaluated based on validation data-based accuracies and metrics of the corresponding circuit design. Solutions that do not meet a baseline accuracy may be discarded.
    Type: Application
    Filed: September 28, 2023
    Publication date: April 3, 2025
    Inventors: Linus Matthias WITSCHEN, Michaela BLOTT, Nicholas FRASER, Thomas Bernd PREUSSER, Yaman UMUROGLU
  • Patent number: 12067484
    Abstract: An example method of training a neural network includes defining hardware building blocks (HBBs), neuron equivalents (NEQs), and conversion procedures from NEQs to HBBs; defining the neural network using the NEQs in a machine learning framework; training the neural network on a training platform; and converting the neural network as trained into a netlist of HBBs using the conversion procedures to convert the NEQs in the neural network to the HBBs of the netlist.
    Type: Grant
    Filed: June 21, 2019
    Date of Patent: August 20, 2024
    Assignee: XILINX, INC.
    Inventors: Yaman Umuroglu, Nicholas Fraser, Michaela Blott, Kristof Denolf, Kornelis A. Vissers
  • Patent number: 11934932
    Abstract: Examples herein propose operating redundant ML models which have been trained using a boosting technique that considers hardware faults. The embodiments herein describe performing an evaluation process where the performance of a first ML model is measured in the presence of a hardware fault. The errors introduced by the hardware fault can then be used to train a second ML model. In one embodiment, a second evaluation process is performed where the combined performance of both the first and second trained ML models is measured in the presence of a hardware fault. The resulting errors can then be used when training a third ML model. In this manner, the three trained ML models are trained to be error aware. As a result, during operation, if a hardware fault occurs, the three ML models have better performance relative to three ML models that where not trained to be error aware.
    Type: Grant
    Filed: November 10, 2020
    Date of Patent: March 19, 2024
    Assignee: XILINX, INC.
    Inventors: Giulio Gambardella, Nicholas Fraser, Ussama Zahid, Michaela Blott, Kornelis A. Vissers
  • Patent number: 11615300
    Abstract: A neural network system includes an input layer, one or more hidden layers, and an output layer. A first layer circuit implements a first layer of the one or more hidden layers. The first layer includes a first weight space including one or more subgroups. A forward path circuit of the first layer circuit includes a multiply and accumulate circuit to receive an input from a layer preceding the first layer; and provide a first subgroup weighted sum using the input and a first plurality weights associated with a first subgroup. A scaling coefficient circuit provides a first scaling coefficient associated with the first subgroup, and applies the first scaling coefficient to the first subgroup weighted sum to generate a first subgroup scaled weighted sum. An activation circuit generates an activation based on the first subgroup scaled weighted sum and provide the activation to a layer following the first layer.
    Type: Grant
    Filed: June 13, 2018
    Date of Patent: March 28, 2023
    Assignee: XILINX, INC.
    Inventors: Julian Faraone, Michaela Blott, Nicholas Fraser
  • Patent number: 11274955
    Abstract: A sensor device includes a signal transmitting component configured to transmit a signal into a container engaged by the sensor device, wherein a frequency of the signal is selected to allow the signal to at least in part pass through a content fouling at least a portion of the signal transmitting component. The sensor device includes a processor configured to process a received reflected version of the transmitted signal to determine an identifier associated with an amount of content in the container engaged by the sensor device. The sensor device includes a wireless transmitter configured to transmit the identifier associated with the amount of content in the container.
    Type: Grant
    Filed: June 11, 2019
    Date of Patent: March 15, 2022
    Assignee: Nectar, Inc.
    Inventors: Prabhanjan C. Gurumohan, Samuel Bae, Nicholas Fraser, Krishna Gadiyaram, Aayush Phumbhra
  • Publication number: 20200401882
    Abstract: An example method of training a neural network includes defining hardware building blocks (HBBs), neuron equivalents (NEQs), and conversion procedures from NEQs to HBBs; defining the neural network using the NEQs in a machine learning framework; training the neural network on a training platform; and converting the neural network as trained into a netlist of HBBs using the conversion procedures to convert the NEQs in the neural network to the HBBs of the netlist.
    Type: Application
    Filed: June 21, 2019
    Publication date: December 24, 2020
    Applicant: Xilinx, Inc.
    Inventors: Yaman Umuroglu, Nicholas Fraser, Michaela Blott, Kristof Denolf, Kornelis A. Vissers
  • Patent number: 10839286
    Abstract: A neural network system includes an input layer, one or more hidden layers, and an output layer. The input layer receives a training set including a sequence of batches and provides to its following layer output activations associated with the sequence of batches respectively. A first hidden layer receives, from its preceding layer, a first input activation associated with a first batch, receive a first input gradient associated with a second batch preceding the first batch, and provide, to its following layer a first output activation associated with the first batch based on the first input activation and first input gradient. The first and second batches have a delay factor associated with at least two batches. The output layer receives, from its preceding layer, a second input activation, and provide, to its preceding layer, a first output gradient based on the second input activation and the first training set.
    Type: Grant
    Filed: September 14, 2017
    Date of Patent: November 17, 2020
    Assignee: XILINX, INC.
    Inventors: Nicholas Fraser, Michaela Blott
  • Publication number: 20200249066
    Abstract: A device includes a coupling component configured to be coupled to a moveable component of a content dispensing mechanism. The device includes a sensor configured to detect movement of the content dispensing mechanism. The device includes a processor configured to, based at least in part on the detected movement of the content dispensing mechanism, determine one or more values corresponding to an amount of content dispensed by the content dispensing mechanism. The device includes a wireless signal transmitter configured to report the one or more values corresponding to the amount of content dispensed by the content dispensing mechanism.
    Type: Application
    Filed: February 4, 2020
    Publication date: August 6, 2020
    Inventors: Prabhanjan C. Gurumohan, Aayush Phumbhra, Samuel Bae, Nicholas Fraser, Sheshagiri Shenoy, Cedric Lecroc
  • Publication number: 20200104715
    Abstract: An example method of implementing a neural network includes selecting a first neural network architecture from a search space and training the neural network having the first neural network architecture to obtain an accuracy and an implementation cost. The implementation cost is based on a programmable device of an inference platform. The method further includes selecting a second neural network architecture from the search space based on the accuracy and the implementation cost, and outputting weights and hyperparameters for the neural network having the second neural network architecture.
    Type: Application
    Filed: September 28, 2018
    Publication date: April 2, 2020
    Applicant: Xilinx, Inc.
    Inventors: Kristof Denolf, Nicholas Fraser, Kornelis A. Vissers, Giulio Gambardella
  • Publication number: 20200003602
    Abstract: A sensor device includes a signal transmitting component configured to transmit a signal into a container engaged by the sensor device, wherein a frequency of the signal is selected to allow the signal to at least in part pass through a content fouling at least a portion of the signal transmitting component. The sensor device includes a processor configured to process a received reflected version of the transmitted signal to determine an identifier associated with an amount of content in the container engaged by the sensor device. The sensor device includes a wireless transmitter configured to transmit the identifier associated with the amount of content in the container.
    Type: Application
    Filed: June 11, 2019
    Publication date: January 2, 2020
    Inventors: Prabhanjan C. Gurumohan, Samuel Bae, Nicholas Fraser, Krishna Gadiyaram, Aayush Phumbhra
  • Publication number: 20190080223
    Abstract: A neural network system includes an input layer, one or more hidden layers, and an output layer. The input layer receives a training set including a sequence of batches and provides to its following layer output activations associated with the sequence of batches respectively. A first hidden layer receives, from its preceding layer, a first input activation associated with a first batch, receive a first input gradient associated with a second batch preceding the first batch, and provide, to its following layer a first output activation associated with the first batch based on the first input activation and first input gradient. The first and second batches have a delay factor associated with at least two batches. The output layer receives, from its preceding layer, a second input activation, and provide, to its preceding layer, a first output gradient based on the second input activation and the first training set.
    Type: Application
    Filed: September 14, 2017
    Publication date: March 14, 2019
    Applicant: Xilinx, Inc.
    Inventors: Nicholas Fraser, Michaela Blott
  • Publication number: 20180328776
    Abstract: A sensor device includes a transmitter located in a container cover that is configured to engage an opening of a container. The sensor device includes a propagation chamber with a first opening configured to receive a signal emitted by the transmitter and guide the signal out of the propagation chamber via a second opening. Cross-sections of the propagation chamber vary along at least a portion of a length of the propagation chamber and the propagation chamber includes one or more transitions where a rate of change of a property of the propagation chamber changes. The sensor device includes a signal processor included in the container cover and configured to use data associated with a reflection of the emitted signal to determine an identifier of a content fill level of the container.
    Type: Application
    Filed: May 10, 2018
    Publication date: November 15, 2018
    Inventors: Prabhanjan C. Gurumohan, Samuel Bae, Krishna Gadiyaram, Nicholas Fraser