Patents Assigned to Nanotronics Imaging, Inc.
  • Patent number: 11209795
    Abstract: Aspects of the disclosed technology provide a computational model that utilizes machine learning for detecting errors during a manual assembly process and determining a sequence of steps to complete the manual assembly process in order to mitigate the detected errors. In some implementations, the disclosed technology evaluates a target object at a step of an assembly process where an error is detected to a nominal object to obtain a comparison. Based on this comparison, a sequence of steps for completion of the assembly process of the target object is obtained. The assembly instructions for creating the target object are adjusted based on this sequence of steps.
    Type: Grant
    Filed: April 20, 2020
    Date of Patent: December 28, 2021
    Assignee: Nanotronics Imaging, Inc.
    Inventors: Matthew C. Putman, Vadim Pinskiy, Eun-Sol Kim, Andrew Sundstrom
  • Publication number: 20210394456
    Abstract: A manufacturing system is disclosed herein. The manufacturing system includes one or more stations, a monitoring platform, and a computing system. The computing system receives an image of the product at a step of the multi-step manufacturing process. The computing system determines a current state of the product based on the image of the product. The computing system determines, via a deep learning model, that the product is not within specification based on the current state of the product and the image of the product. Based on the determining, the computing system adjusts a control logic for at least a following station. The adjusting includes generating, by the deep learning model, a corrective action to be performed by the following station.
    Type: Application
    Filed: September 8, 2021
    Publication date: December 23, 2021
    Applicant: Nanotronics Imaging, Inc.
    Inventors: Fabian Hough, John B. Putman, Matthew C. Putman, Vadim Pinskiy, Damas Limoge, Aswin Raghav Nirmaleswaran, Sadegh Nouri Gooshki
  • Publication number: 20210387421
    Abstract: Additive manufacturing systems using artificial intelligence can identify an anomaly in a printed layer of an object from a generated topographical image of the printed layer. The additive manufacturing systems can also use artificial intelligence to determine a correlation between the identified anomaly and one or more print parameters, and adaptively adjust one or more print parameters. The additive manufacturing systems can also use artificial intelligence to optimize one or more printing parameters to achieve desired mechanical, optical and/or electrical properties.
    Type: Application
    Filed: August 23, 2021
    Publication date: December 16, 2021
    Applicant: Nanotronics Imaging, Inc.
    Inventors: Matthew C. Putman, Vadim Pinskiy, James Williams, III, Damas Limoge, Aswin Raghav Nirmaleswaran, Mario Chris
  • Publication number: 20210378190
    Abstract: A controlled growth system is provided herein. The controlled growth system includes a controlled growth environment, a controller, a sensor, and a computing system. The controlled growth environment is configured to grow a biologic. The controller is in communication with the controlled growth environment. The controller is configured to manage process parameters of the controlled growth environment. The sensor is configured to monitor the biologic during a growth process. The computing system is in communication with the sensor and the controller. The computing system is programmed to perform operations for achieving a desired final quality metric for the biologic.
    Type: Application
    Filed: June 3, 2021
    Publication date: December 9, 2021
    Applicant: Nanotronics Imaging, Inc.
    Inventors: Damas Limoge, Vadim Pinskiy, Parker Musselman
  • Publication number: 20210382990
    Abstract: A system including a deep learning processor receives one or more control signals from one or more of a factory's process, equipment and control (P/E/C) systems during a manufacturing process. The processor generates expected response data and expected behavioral pattern data for the control signals. The processor receives production response data from the one or more of the factory's P/E/C systems and generates production behavioral pattern data for the production response data. The process compares at least one of: the production response data to the expected response data, and the production behavioral pattern data to the expected behavioral pattern data to detect anomalous activity. As a result of detecting anomalous activity, the processor performs one or more operations to provide notice or cause one or more of the factory's P/E/C systems to address the anomalous activity.
    Type: Application
    Filed: August 23, 2021
    Publication date: December 9, 2021
    Applicant: Nanotronics Imaging, Inc.
    Inventors: Matthew C. Putman, John B. Putman, Vadim Pinskiy, Damas Limoge, Andrew Sundstrom, James Williams, III
  • Publication number: 20210365549
    Abstract: A controller emulator, coupled to an interface that exposes the controller emulator to inputs from external sources, provides one or more control signals to a process simulator and a deep learning process. In response, the process simulator simulates response data that is provided to the deep learning processor. The deep learning processor generates expected response data and expected behavioral pattern data for the one or more control signals, as well as actual behavioral pattern data for the simulated response data. A comparison of at least one of the simulated response data to the expected response data and the actual behavioral pattern data to the expected behavioral pattern data is performed to determine whether anomalous activity is detected. As a result of detecting anomalous activity, one or more operations are performed to address the anomalous activity.
    Type: Application
    Filed: August 6, 2021
    Publication date: November 25, 2021
    Applicant: Nanotronics Imaging, Inc.
    Inventors: Matthew C. Putman, John B. Putman, Vadim Pinskiy, Andrew Sundstrom, James Williams, III
  • Publication number: 20210342979
    Abstract: An inspection apparatus includes a specimen stage configured to retain a specimen, at least three imaging devices arranged in a triangular array positioned above the specimen stage, each of the at least three imaging devices configured to capture an image of the specimen, one or more sets of lights positioned between the specimen stage and the at least three imaging devices, and a control system in communication with the at least three imaging devices.
    Type: Application
    Filed: July 14, 2021
    Publication date: November 4, 2021
    Applicant: Nanotronics Imaging, Inc.
    Inventors: Jonathan Lee, Damas Limoge, Matthew C. Putman, John B. Putman, Michael Moskie
  • Patent number: 11156992
    Abstract: Aspects of the disclosed technology encompass the use of a deep-learning controller for monitoring and improving a manufacturing process. In some aspects, a method of the disclosed technology includes steps for: receiving control values associated with a process station in a manufacturing process, predicting an expected value for an article of manufacture output from the process station, and determining if the deep-learning controller can control the manufacturing process based on the expected value. Systems and computer-readable media are also provided.
    Type: Grant
    Filed: October 24, 2019
    Date of Patent: October 26, 2021
    Assignee: Nanotronics Imaging, Inc.
    Inventors: Matthew C. Putman, John B. Putman, Vadim Pinskiy, Damas Limoge
  • Patent number: 11156982
    Abstract: Aspects of the disclosed technology provide an Artificial Intelligence Process Control (AIPC) for automatically detecting errors in a manufacturing workflow of an assembly line process, and performing error mitigation through the update of instructions or guidance given to assembly operators at various stations. In some implementations, the disclosed technology utilizes one or more machine-learning models to perform error detection and/or propagate instructions/assembly modifications necessary to rectify detected errors or to improve the product of manufacture.
    Type: Grant
    Filed: September 30, 2019
    Date of Patent: October 26, 2021
    Assignee: Nanotronics Imaging, Inc.
    Inventors: Matthew C. Putman, Vadim Pinskiy, Eun-Sol Kim, Andrew Sundstrom
  • Patent number: 11156991
    Abstract: Aspects of the disclosed technology encompass the use of a deep learning controller for monitoring and improving a manufacturing process. In some aspects, a method of the disclosed technology includes steps for: receiving a plurality of control values from two or more stations, at a deep learning controller, wherein the control values are generated at the two or more stations deployed in a manufacturing process, predicting an expected value for an intermediate or final output of an article of manufacture, based on the control values, and determining if the predicted expected value for the article of manufacture is in-specification. In some aspects, the process can further include steps for generating control inputs if the predicted expected value for the article of manufacture is not in-specification. Systems and computer-readable media are also provided.
    Type: Grant
    Filed: July 23, 2019
    Date of Patent: October 26, 2021
    Assignee: Nanotronics Imaging, Inc.
    Inventors: Matthew C. Putman, John B. Putman, Vadim Pinskiy, Damas Limoge
  • Publication number: 20210320931
    Abstract: A system including a deep learning processor obtains response data of at least two data types from a set of process stations performing operations as part of a manufacturing process. The system analyzes factory operation and control data to generate expected behavioral pattern data. Further, the system uses the response data to generate actual behavior pattern data for the process stations. Based on an analysis of the actual behavior pattern data in relation to the expected behavioral pattern data, the system determines whether anomalous activity has occurred as a result of the manufacturing process. If it is determined that anomalous activity has occurred, the system provides an indication of this anomalous activity.
    Type: Application
    Filed: June 23, 2021
    Publication date: October 14, 2021
    Applicant: Nanotronics Imaging, Inc.
    Inventors: Matthew C. Putman, John B. Putman, Vadim Pinskiy, Damas Limoge, Andrew Sundstrom, James Williams, III
  • Publication number: 20210318674
    Abstract: Aspects of the disclosed technology encompass the use of a deep-learning controller for monitoring and improving a manufacturing process. In some aspects, a method of the disclosed technology includes steps for: receiving control values associated with a process station in a manufacturing process, predicting an expected value for an article of manufacture output from the process station, and determining if the deep-learning controller can control the manufacturing process based on the expected value. Systems and computer-readable media are also provided.
    Type: Application
    Filed: June 23, 2021
    Publication date: October 14, 2021
    Applicant: Nanotronics Imaging, Inc.
    Inventors: Matthew C. Putman, John B. Putman, Vadim Pinskiy, Damas Limoge
  • Publication number: 20210311465
    Abstract: Aspects of the disclosed technology encompass the use of a deep learning controller for monitoring and improving a manufacturing process. In some aspects, a method of the disclosed technology includes steps for: receiving a plurality of control values from two or more stations, at a deep learning controller, wherein the control values are generated at the two or more stations deployed in a manufacturing process, predicting an expected value for an intermediate or final output of an article of manufacture, based on the control values, and determining if the predicted expected value for the article of manufacture is in-specification. In some aspects, the process can further include steps for generating control inputs if the predicted expected value for the article of manufacture is not in-specification. Systems and computer-readable media are also provided.
    Type: Application
    Filed: June 23, 2021
    Publication date: October 7, 2021
    Applicant: Nanotronics Imaging, Inc.
    Inventors: Matthew C. Putman, John B. Putman, Vadim Pinskiy, Damas Limoge
  • Publication number: 20210311440
    Abstract: A manufacturing system is disclosed herein. The manufacturing system includes one or more stations, a monitoring platform, and a control module. Each station of the one or more stations is configured to perform at least one step in a multi-step manufacturing process for a component. The monitoring platform is configured to monitor progression of the component throughout the multi-step manufacturing process. The control module is configured to dynamically adjust processing parameters of each step of the multi-step manufacturing process to achieve a desired final quality metric for the component.
    Type: Application
    Filed: June 18, 2021
    Publication date: October 7, 2021
    Applicant: Nanotronics Imaging, Inc.
    Inventors: Andrew Sundstrom, Eun-Sol Kim, Damas Limoge, Vadim Pinskiy, Matthew C. Putman
  • Patent number: 11125677
    Abstract: Systems, devices, and methods for combined wafer and photomask inspection are provided. In some embodiments, chucks are provided, the chucks comprising: a removable insert, wherein the removable insert is configured to support a wafer so that an examination surface of the wafer lies within a focal range when the chuck is in a first configuration, wherein the removable insert is inserted into the chuck in the first configuration; and a first structure forming a recess that has a depth sufficient to support a photomask so that an examination surface of the photomask lies within the focal range when the chuck is in a second configuration, wherein the removable insert is not inserted into the chuck in the second configuration.
    Type: Grant
    Filed: April 8, 2019
    Date of Patent: September 21, 2021
    Assignee: Nanotronics Imaging, Inc.
    Inventors: Randolph E. Griffith, Jeff Andresen, Scott Pozzi-Loyola, Michael Moskie, Steve Scranton, Alejandro S. Jaime, John B. Putman
  • Patent number: 11117328
    Abstract: A manufacturing system is disclosed herein. The manufacturing system includes one or more stations, a monitoring platform, and a control module. Each station of the one or more stations is configured to perform at least one step in a multi-step manufacturing process for a product. The monitoring platform is configured to monitor progression of the product throughout the multi-step manufacturing process. The control module is configured to dynamically adjust processing parameters of each step of the multi-step manufacturing process to achieve a desired final quality metric for the product.
    Type: Grant
    Filed: September 9, 2020
    Date of Patent: September 14, 2021
    Assignee: Nanotronics Imaging, Inc.
    Inventors: Fabian Hough, John B. Putman, Matthew C. Putman, Vadim Pinskiy, Damas Limoge, Aswin Raghav Nirmaleswaran, Sadegh Nouri Gooshki
  • Publication number: 20210279520
    Abstract: A computing system generates a training data set for training the prediction model to detect defects present in a target surface of a target specimen and training the prediction model to detect defects present in the target surface of the target specimen based on the training data set. The computing system generates the training data set by identifying a set of images for training the prediction model, the set of images comprising a first subset of images. A deep learning network generates a second subset of images for subsequent labelling based on the set of images comprising the first subset of images. The deep learning network generates a third subset of images for labelling based on the set of images comprising the first subset of images and the labeled second subset of images. The computing system continues the process until a threshold number of labeled images is generated.
    Type: Application
    Filed: March 9, 2021
    Publication date: September 9, 2021
    Applicant: Nanotronics Imaging, Inc.
    Inventors: Tonislav Ivanov, Denis Babeshko, Vadim Pinskiy, Matthew C. Putman, Andrew Sundstrom
  • Publication number: 20210263495
    Abstract: A manufacturing system is disclosed herein. The manufacturing system includes one or more stations, a monitoring platform, and a control module. Each station of the one or more stations is configured to perform at least one step in a multi-step manufacturing process for a component. The monitoring platform is configured to monitor progression of the component throughout the multi-step manufacturing process. The control module is configured to dynamically adjust processing parameters of each step of the multi-step manufacturing process to achieve a desired final quality metric for the component.
    Type: Application
    Filed: February 19, 2021
    Publication date: August 26, 2021
    Applicant: Nanotronics Imaging, Inc.
    Inventors: Matthew C. Putman, Vadim Pinskiy, Damas Limoge, Sadegh Nouri Gooshki, Aswin Raghav Nirmaleswaran, Fabian Hough
  • Patent number: 11100221
    Abstract: A system including a deep learning processor receives one or more control signals from one or more of a factory's process, equipment and control (P/E/C) systems during a manufacturing process. The processor generates expected response data and expected behavioral pattern data for the control signals. The processor receives production response data from the one or more of the factory's P/E/C systems and generates production behavioral pattern data for the production response data. The process compares at least one of: the production response data to the expected response data, and the production behavioral pattern data to the expected behavioral pattern data to detect anomalous activity. As a result of detecting anomalous activity, the processor performs one or more operations to provide notice or cause one or more of the factory's P/E/C systems to address the anomalous activity.
    Type: Grant
    Filed: June 18, 2020
    Date of Patent: August 24, 2021
    Assignee: Nanotronics Imaging, Inc.
    Inventors: Matthew C. Putman, John B. Putman, Vadim Pinskiy, Damas Limoge, Andrew Sundstrom, James Williams, III
  • Patent number: 11099368
    Abstract: A microscope system and method allow for a desired x?-direction scanning along a specimen to be angularly offset from an x-direction of the XY translation stage, and rotates an image sensor associated with the microscope to place the pixel rows of the image sensor substantially parallel to the desired x?-direction. The angle of offset of the x?-direction relative to the x-direction is determined and the XY translation stage is employed to move the specimen relative to the image sensor to different positions along the desired x?-direction without a substantial shift of the image sensor relative to the specimen in a y?-direction, the y?-direction being orthogonal to the x? direction of the specimen. The movement is based on the angle of offset.
    Type: Grant
    Filed: June 29, 2020
    Date of Patent: August 24, 2021
    Assignee: Nanotronics Imaging, Inc.
    Inventors: Matthew C. Putman, John B. Putman, Brandon Scott, Dylan Fashbaugh