Patents by Inventor Ser-Nam Lim

Ser-Nam Lim has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 9785919
    Abstract: Systems and methods for automatically identifying and classifying distress of an aircraft component are provided. In one embodiment, a method includes accessing one or more digital images captured of the aircraft component and providing the one or more digital images as an input to a multi-layer network image classification model. The method further includes generating a classification output for the one or more images from the multi-layer network image classification model and automatically classifying the distress of the aircraft component based at least in part on the classification output.
    Type: Grant
    Filed: December 10, 2015
    Date of Patent: October 10, 2017
    Assignee: General Electric Company
    Inventors: David Scott Diwinsky, Ser Nam Lim, Xiao Bian
  • Publication number: 20170287124
    Abstract: A method for detecting missing tooth in mining shovel, implemented using a processing device, includes receiving a pair of image frames from a camera disposed on a rope mine shovel configured to carry a mining load. A tooth line region corresponding to the pair of image frames is detected to generate a pair of tooth line regions based on a shovel template set. A difference image is determined based on the pair of image frames and the pair of tooth line regions. Further, a response map representative of possible tooth positions is determined based on the difference image using a tooth template matching technique. A tooth line is selected among a plurality of candidate tooth lines based on the response map. Further, a tooth condition is determined based on the tooth line and the difference image. The tooth condition is notified to an operator of the rope mine shovel.
    Type: Application
    Filed: April 5, 2016
    Publication date: October 5, 2017
    Inventors: Ser Nam Lim, Ning Zhou, Joao Vitor Baldini Soares
  • Publication number: 20170169400
    Abstract: Systems and methods for automatically identifying and classifying distress of an aircraft component are provided. In one embodiment, a method includes accessing one or more digital images captured of the aircraft component and providing the one or more digital images as an input to a multi-layer network image classification model. The method further includes generating a classification output for the one or more images from the multi-layer network image classification model and automatically classifying the distress of the aircraft component based at least in part on the classification output.
    Type: Application
    Filed: December 10, 2015
    Publication date: June 15, 2017
    Inventors: David Scott Diwinsky, Ser Nam Lim, Xiao Bian
  • Publication number: 20170167953
    Abstract: A method for performing a visual inspection of a gas turbine engine may generally include inserting a plurality of optical probes through a plurality of access ports of the gas turbine engine. The access ports may be spaced apart axially along a longitudinal axis of the gas turbine engine such that the optical probes provide internal views of the gas turbine engine from a plurality of different axial locations along the gas turbine engine. The method may also include coupling the optical probes to a computing device, rotating the gas turbine engine about the longitudinal axis as the optical probes are used to simultaneously obtain images of an interior of the gas turbine engine at the different axial locations and receiving, with the computing device, image data associated with the images obtained by each of the optical probes at the different axial locations.
    Type: Application
    Filed: December 9, 2015
    Publication date: June 15, 2017
    Inventors: David Scott Diwinsky, Ser Nam Lim
  • Publication number: 20170167285
    Abstract: A method for locating probes within a gas turbine engine may generally include positioning a plurality of location transmitters relative to the engine and inserting a probe through an access port of the engine, wherein the probe includes a probe tip and a location signal receiver configured to receive location-related signals transmitted from the location transmitters. The method may also include determining a current location of the probe tip within the engine based at least in part on the location-related signals and identifying a virtual location of the probe tip within a three-dimensional model of the engine corresponding to the current location of the probe tip within the engine. Moreover, the method may include providing for display the three-dimensional model of the engine, wherein the virtual location of the probe tip is displayed as a visual indicator within the three-dimensional model.
    Type: Application
    Filed: December 9, 2015
    Publication date: June 15, 2017
    Inventors: David Scott Diwinsky, Ser Nam Lim
  • Publication number: 20170167289
    Abstract: A method for locating probes within a gas turbine engine may generally include positioning a plurality of location transmitters relative to the engine and inserting a probe through an access port of the engine, wherein the probe includes a probe tip and a location signal receiver configured to receive location-related signals transmitted from the location transmitters. The method may also include determining a current location of the probe tip within the engine based at least in part on the location-related signals and identifying a virtual location of the probe tip within a three-dimensional model of the engine corresponding to the current location of the probe tip within the engine. Moreover, the method may include providing for display the three-dimensional model of the engine, wherein the virtual location of the probe tip is displayed as a visual indicator within the three-dimensional model.
    Type: Application
    Filed: February 11, 2016
    Publication date: June 15, 2017
    Inventors: David Scott Diwinsky, Ser Nam Lim
  • Publication number: 20170090458
    Abstract: A monitoring system for monitoring a plurality of components is provided. The monitoring system includes a plurality of client systems. The plurality of client systems is configured to generate a plurality of component status reports. The plurality of component status reports is associated with the plurality of components. The monitoring system also includes a component wear monitoring (CWM) computer device configured to receive the plurality of component status reports from the plurality of client systems, generate component status information based on a plurality of component status reports, aggregate the component status information to identify a plurality of images associated with a first component, and compare the plurality of images associated with the first component. The plurality of images represents the first component at different points in time. The CWM computer device is also configured to determine a state of the first component based on the comparison.
    Type: Application
    Filed: September 29, 2015
    Publication date: March 30, 2017
    Inventors: Ser Nam Lim, David Scott Diwinsky, Russell Robert Irving
  • Patent number: 9483820
    Abstract: A method and system for detecting a damaged machine component during operation of the machine are provided. The damaged machine component detection system includes one or more processors, one or more memory devices communicatively coupled to the one or more processors, an image capture device configured to generate a stream of temporally-spaced images of a scene including a machine component of interest, the images generated in real-time, and a grouping model configured to compare features of a current image of the stream of images to features of previously captured images sorted into a plurality of groups of images having similar features, generate an alert if predetermined features of the current image deviate from corresponding features of the grouped images by a predetermined amount, and update the groups with the current image if the predetermined features of the current image are similar to corresponding features of the grouped images by a predetermined amount.
    Type: Grant
    Filed: May 20, 2014
    Date of Patent: November 1, 2016
    Assignee: General Electric Company
    Inventors: Ser Nam Lim, Jilin Tu, Li Guan, Craig Ronald Hoffmann
  • Patent number: 9458735
    Abstract: A method for performing a visual inspection of a gas turbine engine may generally include inserting a plurality of optical probes through a plurality of access ports of the gas turbine engine. The access ports may be spaced apart axially along a longitudinal axis of the gas turbine engine such that the optical probes provide internal views of the gas turbine engine from a plurality of different axial locations along the gas turbine engine. The method may also include coupling the optical probes to a computing device, rotating the gas turbine engine about the longitudinal axis as the optical probes are used to simultaneously obtain images of an interior of the gas turbine engine at the different axial locations and receiving, with the computing device, image data associated with the images obtained by each of the optical probes at the different axial locations.
    Type: Grant
    Filed: February 10, 2016
    Date of Patent: October 4, 2016
    Assignee: General Electric Company
    Inventors: David Scott Diwinsky, Ser Nam Lim
  • Publication number: 20160178532
    Abstract: An optical imaging and processing system includes an optical connection and an optical element disposed at a first end of the optical connection. The first end of the optical connection is configured to extend into a turbine component interior such that the optical element is disposed within the turbine component interior. The system also includes a photodiode array disposed at a second end of the optical connection, where the optical element is configured to transmit a video stream of the turbine component interior to the photodiode array as the optical element is moved within the turbine component interior between multiple vantage points. The system also includes a processor coupled to the photodiode array, wherein the processor is configured to process the video stream to generate a three-dimensional model of at least a portion of the turbine component interior without utilizing a previously defined three-dimensional model input of the turbine component interior.
    Type: Application
    Filed: December 19, 2014
    Publication date: June 23, 2016
    Inventors: Ser Nam Lim, Joseph Vincent Pawlowski, Li Guan, Yogesh Agarwal, Binod Pandey, Srivatsa Dhanvantri
  • Publication number: 20160180199
    Abstract: A novel technique for performing video matting, which is built upon a proposed image matting algorithm that is fully automatic is disclosed. The disclosed methods utilize a PCA-based shape model as a prior for guiding the matting process, so that manual interactions required by most existing image matting methods are unnecessary. By applying the image matting algorithm to these foreground windows, on a per frame basis, a fully automated video matting process is attainable. The process of aligning the shape model with the object is simultaneously optimized based on a quadratic cost function.
    Type: Application
    Filed: February 29, 2016
    Publication date: June 23, 2016
    Inventors: Ting Yu, Peter Henry Tu, Xiaoming Liu, Ser Nam Lim
  • Patent number: 9305345
    Abstract: A method for image based inspection of an object includes receiving an image of an object from an image capture device, wherein the image includes a representation of the object with mil-level precision. The method further includes projecting a measurement feature of the object from the image onto a three-dimensional (3D) model of the object based on a final projection matrix; determining a difference between the projected measurement feature and an existing measurement feature on the 3D model; and sending a notification including the difference between the projected measurement feature and the existing measurement feature.
    Type: Grant
    Filed: April 24, 2014
    Date of Patent: April 5, 2016
    Assignee: General Electric Company
    Inventors: Ser Nam Lim, Jose Abiel Garza, David Scott Diwinsky, Li Guan, Shubao Liu, Xingwei Yang, Jens Rittscher
  • Patent number: 9305357
    Abstract: A novel technique for performing video matting, which is built upon a proposed image matting algorithm that is fully automatic is disclosed. The disclosed methods utilize a PCA-based shape model as a prior for guiding the matting process, so that manual interactions required by most existing image matting methods are unnecessary. By applying the image matting algorithm to these foreground windows, on a per frame basis, a fully automated video matting process is attainable. The process of aligning the shape model with the object is simultaneously optimized based on a quadratic cost function.
    Type: Grant
    Filed: November 7, 2011
    Date of Patent: April 5, 2016
    Assignee: General Electric Company
    Inventors: Ting Yu, Peter Henry Tu, Xiaoming Liu, Ser Nam Lim
  • Patent number: 9297918
    Abstract: An approach for seismic data analysis is provided. In accordance with various embodiments, the active learning approaches are employed in conjunction with an analysis algorithm that is used to process the seismic data. Algorithms that may employ such active learning include, but are not limited to, ranking algorithms and classification algorithms.
    Type: Grant
    Filed: December 28, 2012
    Date of Patent: March 29, 2016
    Assignees: GENERAL ELECTRIC COMPANY, EXXONMOBIL UPSTREAM RESEARCH COMPANY
    Inventors: Ser Nam Lim, John Robert Hare, Jens Rittscher, Jie Yu, Ya Xue
  • Patent number: 9251582
    Abstract: A computer-implemented system for enhanced automated visual inspection of a physical asset includes a visual inspection device capable of generating images of the physical asset and a computing device including a processor and a memory device coupled to the processor. The computing device includes a storage device coupled to the memory device and coupled to the processor. The storage device includes at least one historic image of the physical asset and at least one engineering model substantially representing the physical asset. The computing device is configured to receive, from a present image source, at least one present image of the physical asset captured by the visual inspection device. The computing device is configured to identify at least one matching historic image corresponding to the at least one present image. The computing device is configured to identify at least one matching engineering model corresponding to the at least one present image.
    Type: Grant
    Filed: December 31, 2012
    Date of Patent: February 2, 2016
    Assignee: General Electric Company
    Inventors: Ser Nam Lim, Vinod Padmanabhan Kumar, Russell Robert Irving, John Brandon Laflen, Li Guan, Shubao Liu, Xingwei Yang
  • Publication number: 20150339810
    Abstract: A method and system for detecting a damaged machine component during operation of the machine are provided. The damaged machine component detection system includes one or more processors, one or more memory devices communicatively coupled to the one or more processors, an image capture device configured to generate a stream of temporally-spaced images of a scene including a machine component of interest, the images generated in real-time, and a grouping model configured to compare features of a current image of the stream of images to features of previously captured images sorted into a plurality of groups of images having similar features, generate an alert if predetermined features of the current image deviate from corresponding features of the grouped images by a predetermined amount, and update the groups with the current image if the predetermined features of the current image are similar to corresponding features of the grouped images by a predetermined amount.
    Type: Application
    Filed: May 20, 2014
    Publication date: November 26, 2015
    Applicant: General Electric Company
    Inventors: Ser Nam Lim, Jilin Tu, Li Guan, Craig Ronald Hoffmann
  • Publication number: 20150319410
    Abstract: The borescope includes an insertion tube, a first image processor, a model store unit, a pose calculator, a second image processor, a navigation image calculator and a display. The insertion tube includes a detection head and at least one sensor for receiving signals in the insertion tube and generating sensed signals. The first image processor is for calculating a first image based on first image signals captured by the detection head. The second image processor is for adjusting the initial pose calculated by the pose calculator to a navigation pose until a difference between the first image and a second image calculated based on the navigation pose and a predetermined model falls in an allowable range. The navigation image calculator is for calculating a navigation image based on the navigation pose and the predetermined model. The display is for showing the navigation image.
    Type: Application
    Filed: April 15, 2015
    Publication date: November 5, 2015
    Inventors: Jiajun GU, Yong YANG, Jie HAN, Zirong ZHAI, Kevin George HARDING, Guiju SONG, Ming JIA, Guangping Xie, Ser Nam Lim
  • Publication number: 20150310604
    Abstract: A method for image based inspection of an object includes receiving an image of an object from an image capture device, wherein the image includes a representation of the object with mil-level precision. The method further includes projecting a measurement feature of the object from the image onto a three-dimensional (3D) model of the object based on a final projection matrix; determining a difference between the projected measurement feature and an existing measurement feature on the 3D model; and sending a notification including the difference between the projected measurement feature and the existing measurement feature.
    Type: Application
    Filed: April 24, 2014
    Publication date: October 29, 2015
    Applicant: General Electric Company
    Inventors: Ser Nam Lim, Jose Abiel Garza, David Scott Diwinsky, Li Guan, Shubao Liu, Xingwei Yang, Jens Rittscher
  • Publication number: 20140185912
    Abstract: A computer-implemented system for enhanced automated visual inspection of a physical asset includes a visual inspection device capable of generating images of the physical asset and a computing device including a processor and a memory device coupled to the processor. The computing device includes a storage device coupled to the memory device and coupled to the processor. The storage device includes at least one historic image of the physical asset and at least one engineering model substantially representing the physical asset. The computing device is configured to receive, from a present image source, at least one present image of the physical asset captured by the visual inspection device. The computing device is configured to identify at least one matching historic image corresponding to the at least one present image. The computing device is configured to identify at least one matching engineering model corresponding to the at least one present image.
    Type: Application
    Filed: December 31, 2012
    Publication date: July 3, 2014
    Applicant: GENERAL ELECTRIC COMPANY
    Inventors: Ser Nam Lim, Vinod Padmanabhan Kumar, Russell Robert Irving, John Brandon Laflen, Li Guan, Shubao Liu, Xingwei Yang
  • Publication number: 20140188769
    Abstract: An approach for seismic data analysis is provided. In accordance with various embodiments, the active learning approaches are employed in conjunction with an analysis algorithm that is used to process the seismic data. Algorithms that may employ such active learning include, but are not limited to, ranking algorithms and classification algorithms.
    Type: Application
    Filed: December 28, 2012
    Publication date: July 3, 2014
    Applicant: GENERAL ELECTRIC COMPANY
    Inventors: Ser Nam Lim, John Robert Hare, Jens Rittscher, Jie Yu, Ya Xue