Patents Assigned to Nanotronics Imaging, Inc.
  • Patent number: 11953863
    Abstract: A training set that includes at least two data types corresponding to operations and control of a manufacturing process is obtained. A deep learning processor is trained to predict expected characteristics of output control signals that correspond with one or more corresponding input operating instructions. A first input operating instruction is received from a first signal splitter. A first output control signal is received from a second signal splitter. The deep learning processor correlates the first input operating instruction and the first output control signal. Based on the correlating, the deep learning processor determines that the first output control signal is not within a range of expected values based on the first input operating instruction. Responsive to the determining, an indication of an anomalous activity is provided as a result of detection of the anomalous activity in the manufacturing process.
    Type: Grant
    Filed: June 5, 2023
    Date of Patent: April 9, 2024
    Assignee: Nanotronics Imaging, Inc.
    Inventors: Matthew C. Putman, John B. Putman, Jonathan Lee, Damas Limoge
  • Patent number: 11955686
    Abstract: A system is disclosed herein. The system includes a splitter board. The splitter board includes a microprocessor, a converter, and a bypass relay. The converter includes analog-to-digital circuitry and digital-to-analog circuitry. The bypass relay is configurable between a first state and a second state. In the first state, the bypass relay is configured to direct an input signal to the converter. The converter converts the input signal to a converted input signal and splits the converted input signal into a first portion and a second portion. The first portion is directed to the microprocessor. The second portion is directed to an output port of the splitter board for downstream processes. In the second state, the bypass relay is configured to cause the input signal to bypass the converter. The bypass relay directs the input signal to the output port of the splitter board for the downstream processes.
    Type: Grant
    Filed: June 28, 2023
    Date of Patent: April 9, 2024
    Assignee: Nanotronics Imaging, Inc.
    Inventors: John B. Putman, Matthew C. Putman, Damas Limoge, Michael Moskie, Jonathan Lee
  • Patent number: 11953893
    Abstract: Aspects of the disclosed technology encompass the use of a deep learning controller for monitoring and improving a manufacturing process. In some aspects, a method of the disclosed technology includes steps for: receiving a plurality of control values from two or more stations, at a deep learning controller, wherein the control values are generated at the two or more stations deployed in a manufacturing process, predicting an expected value for an intermediate or final output of an article of manufacture, based on the control values, and determining if the predicted expected value for the article of manufacture is in-specification. In some aspects, the process can further include steps for generating control inputs if the predicted expected value for the article of manufacture is not in-specification. Systems and computer-readable media are also provided.
    Type: Grant
    Filed: June 5, 2023
    Date of Patent: April 9, 2024
    Assignee: Nanotronics Imaging, Inc.
    Inventors: Matthew C. Putman, John B. Putman, Vadim Pinskiy, Damas Limoge
  • Patent number: 11948270
    Abstract: Systems, methods, and computer-readable media for feedback on and improving the accuracy of super-resolution imaging. In some embodiments, a low resolution image of a specimen can be obtained using a low resolution objective of a microscopy inspection system. A super-resolution image of at least a portion of the specimen can be generated from the low resolution image of the specimen using a super-resolution image simulation. Subsequently, an accuracy assessment of the super-resolution image can be identified based on one or more degrees of equivalence between the super-resolution image and one or more actually scanned high resolution images of at least a portion of one or more related specimens identified using a simulated image classifier. Based on the accuracy assessment of the super-resolution image, it can be determined whether to further process the super-resolution image. The super-resolution image can be further processed if it is determined to further process the super-resolution image.
    Type: Grant
    Filed: August 31, 2023
    Date of Patent: April 2, 2024
    Assignee: Nanotronics Imaging , Inc.
    Inventors: Matthew C. Putman, John B. Putman, Vadim Pinskiy, Joseph R. Succar
  • Patent number: 11947671
    Abstract: A simulated process is initiated. The simulated process includes generating, by an emulator, a control signal based on external inputs. The simulated process further includes processing, by a simulator, the control signal to generate simulated response data. The simulated process further includes generating, by a deep learning processor, expected behavioral pattern data based on the simulated response data. An actual process is initiated by initializing setpoints for a process station in a manufacturing system. The actual process includes generating, by the deep learning processor, actual behavioral pattern data based on actual process data from the at least one process station. The deep learning processor compares the expected behavioral pattern to the actual behavioral pattern. Based on the comparing, the deep learning processor determines that anomalous activity is present in the manufacturing system. Based on the anomalous activity being present, the deep learning processor initiates an alert protocol.
    Type: Grant
    Filed: June 5, 2023
    Date of Patent: April 2, 2024
    Assignee: Nanotronics Imaging, Inc.
    Inventors: John B. Putman, Jonathan Lee, Matthew C. Putman
  • Publication number: 20240085863
    Abstract: A deep learning process receives desired process values associated with the one or more process stations. The deep learning processor receives desired target values for one or more key performance indicators of the manufacturing process. The deep learning processor simulates the manufacturing process to generate expected process values and expected target values for the one or more key performance indicators to optimize the one or more key performance indicators. The simulating includes generating a proposed state change of at least one processing parameter of the initial set of processing parameters. The deep learning processor determines that expected process values and the expected target values are within an acceptable limit of the desired process values and the desired target values. Based on the determining, the deep learning processes causes a change to the initial set of processing parameters based on the proposed state change.
    Type: Application
    Filed: August 31, 2023
    Publication date: March 14, 2024
    Applicant: Nanotronics Imaging, Inc.
    Inventors: John B. Putman, Sarah Constantin, Valerie Bordelanne, Damas Limoge, Jonathan Lee
  • Patent number: 11894596
    Abstract: A system is disclosed herein. The system includes a splitter board. The splitter board includes a microprocessor, a converter, and a bypass relay. The converter includes analog-to-digital circuitry and digital-to-analog circuitry. The bypass relay is configurable between a first state and a second state. In the first state, the bypass relay is configured to direct an input signal to the converter. The converter converts the input signal to a converted input signal and splits the converted input signal into a first portion and a second portion. The first portion is directed to the microprocessor. The second portion is directed to an output port of the splitter board for downstream processes. In the second state, the bypass relay is configured to cause the input signal to bypass the converter. The bypass relay directs the input signal to the output port of the splitter board for the downstream processes.
    Type: Grant
    Filed: August 7, 2023
    Date of Patent: February 6, 2024
    Assignee: Nanotronics Imaging, Inc.
    Inventors: John B. Putman, Matthew C. Putman, Damas Limoge, Michael Moskie, Jonathan Lee
  • Patent number: 11889797
    Abstract: A controlled growth system is provided herein. The controlled growth system includes a controlled growth environment, a controller, a sensor, and a computing system. The controlled growth environment is configured to grow a biologic. The controller is in communication with the controlled growth environment. The controller is configured to manage process parameters of the controlled growth environment. The sensor is configured to monitor the biologic during a growth process. The computing system is in communication with the sensor and the controller. The computing system is programmed to perform operations for achieving a desired final quality metric for the biologic.
    Type: Grant
    Filed: June 3, 2021
    Date of Patent: February 6, 2024
    Assignee: Nanotronics Imaging, Inc.
    Inventors: Damas Limoge, Vadim Pinskiy, Parker Musselman
  • Publication number: 20240029239
    Abstract: A manufacturing system is disclosed herein. The manufacturing system includes a monitoring platform and an analytics platform. The monitoring platform is configured to capture data of an operator during assembly of an article of manufacture. The monitoring platform includes one or more cameras and one or more microphones. The analytics platform is in communication with the monitoring platform. The analytics platform is configured to analyze the data captured by the monitoring platform.
    Type: Application
    Filed: July 18, 2023
    Publication date: January 25, 2024
    Applicant: Nanotronics Imaging, Inc.
    Inventors: Jonathan Lee, Anuj Doshi
  • Patent number: 11880028
    Abstract: A method for altering the intensity of light across the field of view of an image sensor in a microscope apparatus having a light source, an image sensor having pixels, and a specimen stage, wherein light from the light source travels along a light path to the specimen stage and then to the image sensor includes interposing a programmable spatial light modulator, pSLM, in the light path between the light source and the image sensor, the pSLM having a plurality of pixels; and modulating the intensity of light passing through one or more pixels of the plurality of pixels of the pSLM to produce an altered illumination landscape at the field of view of the image sensor that differs from an unaltered illumination landscape that would otherwise be produced at the image sensor. Vignetting can be specifically addressed.
    Type: Grant
    Filed: November 11, 2019
    Date of Patent: January 23, 2024
    Assignee: Nanotronics Imaging, Inc.
    Inventors: Matthew C. Putman, John B. Putman, Dylan Fashbaugh, Roarke Horstmeyer
  • Publication number: 20240019678
    Abstract: A microscopy system and method of focusing the same are disclosed herein. The microscopy system may include an objective, and imaging device, an illumination source, an epi-illumination module, and a controller. The imaging device is configured to capture a single image of a specimen positioned on a stage of the microscopy system. The illumination source is configured to illuminate the specimen positioned on the stage. The epi-illumination module includes a focusing mechanism in a first primary optical path of a light generated by the illumination source. The focusing mechanism is tilted in relation to a plane perpendicular to the first primary optical path. The controller is in communication with the illumination source. The controller is configured to focus the microscopy system based on a pattern produced by the focusing mechanism on the single image captured by the imaging device.
    Type: Application
    Filed: October 7, 2022
    Publication date: January 18, 2024
    Applicant: Nanotronics Imaging, Inc.
    Inventors: Patrick Schmidt, Denis Sharoukhov, Tonislav Ivanov, Jonathan Lee
  • Publication number: 20240019817
    Abstract: A training set that includes at least two data types corresponding to operations and control of a manufacturing process is obtained. A deep learning processor is trained to predict expected characteristics of output control signals that correspond with one or more corresponding input operating instructions. A first input operating instruction is received from a first signal splitter. A first output control signal is received from a second signal splitter. The deep learning processor correlates the first input operating instruction and the first output control signal. Based on the correlating, the deep learning processor determines that the first output control signal is not within a range of expected values based on the first input operating instruction. Responsive to the determining, an indication of an anomalous activity is provided as a result of detection of the anomalous activity in the manufacturing process.
    Type: Application
    Filed: June 5, 2023
    Publication date: January 18, 2024
    Applicant: Nanotronics Imaging, Inc.
    Inventors: Matthew C. Putman, John B. Putman, Jonathan Lee, Damas Limoge
  • Publication number: 20230419444
    Abstract: Systems, methods, and computer-readable media for feedback on and improving the accuracy of super-resolution imaging. In some embodiments, a low resolution image of a specimen can be obtained using a low resolution objective of a microscopy inspection system. A super-resolution image of at least a portion of the specimen can be generated from the low resolution image of the specimen using a super-resolution image simulation. Subsequently, an accuracy assessment of the super-resolution image can be identified based on one or more degrees of equivalence between the super-resolution image and one or more actually scanned high resolution images of at least a portion of one or more related specimens identified using a simulated image classifier. Based on the accuracy assessment of the super-resolution image, it can be determined whether to further process the super-resolution image. The super-resolution image can be further processed if it is determined to further process the super-resolution image.
    Type: Application
    Filed: August 31, 2023
    Publication date: December 28, 2023
    Applicant: Nanotronics Imaging , Inc.
    Inventors: Matthew C. Putman, John B. Putman, Vadim PINSKIY, Josephn R. Succar
  • Patent number: 11846765
    Abstract: A process is provided for imaging a surface of a specimen with an imaging system that employs a BD objective having a darkfield channel and a bright field channel, the BD objective having a circumference. The specimen is obliquely illuminated through the darkfield channel with a first arced illuminating light that obliquely illuminates the specimen through a first arc of the circumference. The first arced illuminating light reflecting off of the surface of the specimen is recorded as a first image of the specimen from the first arced illuminating light reflecting off the surface of the specimen, and a processor generates a 3D topography of the specimen by processing the first image through a topographical imaging technique. Imaging apparatus is also provided as are further process steps for other embodiments.
    Type: Grant
    Filed: January 23, 2023
    Date of Patent: December 19, 2023
    Assignee: Nanotronics Imaging, Inc.
    Inventors: Matthew C. Putman, John B. Putman, Julie A. Orlando, Jospeh G. Bulman
  • Publication number: 20230394801
    Abstract: A system and method for generating a training data set for training a machine learning model to detect defects in specimens is described herein. A computing system cause presentation of an image on a device of a user. The image includes at least one defect on an example specimen. The computing system receives an annotated image from the user. The user annotated the image using an input via the device. The input includes a first indication of a location of the defect and a second indication of a class corresponding to the defect. The computing system adjusts the annotated image to standardize the input based on an error profile of the user and the class corresponding to the defect. The computing system uploads the annotated image for training the machine learning model.
    Type: Application
    Filed: August 14, 2023
    Publication date: December 7, 2023
    Applicant: Nanotronics Imaging, Inc.
    Inventors: Anuj Doshi, Jonathan Lee, John B. Putman
  • Publication number: 20230391016
    Abstract: Systems, methods, and media for additive manufacturing are provided. In some embodiments, an additive manufacturing system comprises: a hardware processor that is configured to: receive a captured image; apply a trained failure classifier to a low-resolution version of the captured image; determine that a non-recoverable failure is not present in the printed layer of the object; generate a cropped version of the low-resolution version of the captured image; apply a trained binary error classifier to the cropped version of the low-resolution version of the captured image; determine that an error is present in the printed layer of the object; apply a trained extrusion classifier to the captured image, wherein the trained extrusion classifier generates an extrusion quality score; and adjust a value of a parameter of the print head based on the extrusion quality score to print a subsequent layer of the printed object.
    Type: Application
    Filed: August 21, 2023
    Publication date: December 7, 2023
    Applicant: Nanotronics Imaging, Inc.
    Inventors: Vadim Pinskiy, Matthew C. Putman, Damas Limoge, Aswin Raghav Nirmaleswaran
  • Publication number: 20230387564
    Abstract: A system is disclosed herein. The system includes a splitter board. The splitter board includes a microprocessor, a converter, and a bypass relay. The converter includes analog-to-digital circuitry and digital-to-analog circuitry. The bypass relay is configurable between a first state and a second state. In the first state, the bypass relay is configured to direct an input signal to the converter. The converter converts the input signal to a converted input signal and splits the converted input signal into a first portion and a second portion. The first portion is directed to the microprocessor. The second portion is directed to an output port of the splitter board for downstream processes. In the second state, the bypass relay is configured to cause the input signal to bypass the converter. The bypass relay directs the input signal to the output port of the splitter board for the downstream processes.
    Type: Application
    Filed: August 7, 2023
    Publication date: November 30, 2023
    Applicant: Nanotronics Imaging, Inc.
    Inventors: John B. Putman, Matthew C. Putman, Damas Limoge, Michael Moskie, Jonathan Lee
  • Publication number: 20230367301
    Abstract: Aspects of the disclosed technology encompass the use of a deep-learning controller for monitoring and improving a manufacturing process. In some aspects, a method of the disclosed technology includes steps for: receiving control values associated with a process station in a manufacturing process, predicting an expected value for an article of manufacture output from the process station, and determining if the deep-learning controller can control the manufacturing process based on the expected value. Systems and computer-readable media are also provided.
    Type: Application
    Filed: July 24, 2023
    Publication date: November 16, 2023
    Applicant: Nanotronics Imaging, Inc.
    Inventors: Matthew C. Putman, John B. Putman, Vadim Pinskiy, Damas Limoge
  • Patent number: 11815673
    Abstract: A method and system for mapping fluid objects on a substrate using a microscope inspection system that includes a light source, imaging device, stage for moving a substrate disposed on the stage, and a control module. A computer analysis system includes an object identification module that identifies for each of the objects on the substrate, an object position on the substrate including a set of X, Y, and ? coordinates using algorithms, networks, machines and systems including artificial intelligence and image processing algorithms. At least one of the objects is fluid and has shifted from a prior position or deformed from a prior size.
    Type: Grant
    Filed: May 16, 2022
    Date of Patent: November 14, 2023
    Assignee: Nanotronics Imaging, Inc.
    Inventors: Matthew C. Putman, John B. Putman, John Cruickshank, Julie Orlando, Adele Frankel, Brandon Scott
  • Publication number: 20230359730
    Abstract: A system including a deep learning processor receives one or more control signals from one or more of a factory's process, equipment and control (P/E/C) systems during a manufacturing process. The processor generates expected response data and expected behavioral pattern data for the control signals. The processor receives production response data from the one or more of the factory's P/E/C systems and generates production behavioral pattern data for the production response data. The process compares at least one of: the production response data to the expected response data, and the production behavioral pattern data to the expected behavioral pattern data to detect anomalous activity. As a result of detecting anomalous activity, the processor performs one or more operations to provide notice or cause one or more of the factory's P/E/C systems to address the anomalous activity.
    Type: Application
    Filed: June 28, 2023
    Publication date: November 9, 2023
    Applicant: Nanotronics Imaging, Inc.
    Inventors: Matthew C. Putman, John B. Putman, Vadim Pinskiy, Damas Limoge, Andrew Sundstrom, James Williams, III