Patents by Inventor Nan ZHU

Nan ZHU has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20220092756
    Abstract: A plurality of different images of a same region of interest in an object are input into a set of neural networks, wherein each image of the region has been captured under a different value of a variable condition. A classification for each image is generated by the set of neural networks, wherein each classification includes a confidence score in a prediction of whether a feature is present in the region. The image classifications are ensembled to generate a final classification for the region. By applying a loss function, a loss is computed based on comparing the final classification to a ground truth of whether the feature is present in the region. The parameters of the set of neural networks are adjusted based on the computed loss.
    Type: Application
    Filed: September 21, 2020
    Publication date: March 24, 2022
    Inventors: JingChang Huang, GUO QIANG HU, Peng Ji, Yuan Yuan Ding, Sheng Nan Zhu, Jinfeng Li
  • Publication number: 20210183038
    Abstract: In an approach for object detection with missing annotations under visual inspection, a processor receives an image. A processor classifies the image being a not-good image using a pre-trained classifier. A not-good image means one or more defect objects being in the image. A processor, in response to classifying the image being the not-good image, detects the one or more defect objects in the not-good image. A processor masks the one or more defect objects in the not-good image. A processor inputs the masked image to train a detector.
    Type: Application
    Filed: December 16, 2019
    Publication date: June 17, 2021
    Inventors: Jian Xu, Guo Qiang Hu, Fan Li, Sheng Nan Zhu, Jinfeng Li, Jun Zhu
  • Patent number: 11030738
    Abstract: A method, a device and a computer program product for image processing are proposed. In the method, whether a first image indicates a defect associated with a target object is determined. In response to determining that the first image indicates the defect, a second image absent from the defect is obtained based on the first image. The defect is identified by comparing the first image with the second image. In this way, the defect associated with the target object in the image can be accurately and efficiently identified or segmented.
    Type: Grant
    Filed: July 5, 2019
    Date of Patent: June 8, 2021
    Assignee: International Business Machines Corporation
    Inventors: Fan Li, Guo Qiang Hu, Sheng Nan Zhu, Jun Zhu, Jing Chang Huang, Peng Ji, Yuan Yuan Ding
  • Publication number: 20210158094
    Abstract: The present disclosure relates to training a machine learning model to classify images. An example method generally includes receiving a training data set including images in a first category and images in a second category. A convolutional neural network (CNN) is trained using the training data set, and a feature map is generated from layers of the CNN based on features of images in the training data set. A first area in the feature map including images in the first category and a second area in the feature map where images in the first category overlap with images in the second category are identified. The first category is split into a first subcategory corresponding to the first area and a second subcategory corresponding to the second area. The CNN is retrained based on the images in the first subcategory, images in the second subcategory, and images in the second category.
    Type: Application
    Filed: November 22, 2019
    Publication date: May 27, 2021
    Inventors: Peng JI, Guo Qiang Hu, Yuan Yuan Ding, Jun Zhu, Jing Chang Huang, Sheng Nan Zhu
  • Publication number: 20210132349
    Abstract: A head-mounted display may include a display system and an optical system in a housing. The display system may have a pixel array that produces light associated with images. The display system may also have a linear polarizer through which light from the pixel array passes and a quarter wave plate through which the light passes after passing through the quarter wave plate. The optical system may be a catadioptric optical system having one or more lens elements. The lens elements may include a plano-convex lens and a plano-concave lens. A partially reflective mirror may be formed on a convex surface of the plano-convex lens. A reflective polarizer may be formed on the planar surface of the plano-convex lens or the concave surface of the plano-concave lens. An additional quarter wave plate may be located between the reflective polarizer and the partially reflective mirror.
    Type: Application
    Filed: January 15, 2021
    Publication date: May 6, 2021
    Inventors: Sajjad A. Khan, Nan Zhu, Graham B. Myhre, Brent J. Bollman, Tyler Anderson, Weibo Cheng, John N. Border
  • Publication number: 20210118141
    Abstract: The present invention relates to a method, system and computer program product for defect enhancement. According to the method, a plurality of proposed regions from a plurality of images taken for a display panel is obtained. Each of proposed region of the plurality of proposed regions include a suspected defect on the display panel. At least two proposed regions from the plurality of proposed regions that deserve to be superimposed based on a set of conditions is determined. The at least two proposed regions for acquiring an enhanced defect are superimposed.
    Type: Application
    Filed: October 17, 2019
    Publication date: April 22, 2021
    Inventors: JingChang Huang, Sheng Nan Zhu, Fan Li, Peng Ji, Jian Xu, Wei Zhao, Jinfeng Li
  • Publication number: 20210118113
    Abstract: A method, a device and a computer program product for image processing are proposed. In the method, a first training image and region information are obtained. The region information indicates a region of a defect in the first training image. A second training image with the defect at least partially removed is generated using an image generator based on the first training image and the region information. The image generator is trained to recover the first training image by replacing pixels included in the region indicated by the region information. The image generator is updated based on the second training image. In this way, the image including the defect can be accurately and efficiently recovered.
    Type: Application
    Filed: October 16, 2019
    Publication date: April 22, 2021
    Inventors: Fan Li, Guo Qiang Hu, Jun Zhu, Sheng Nan Zhu, JingChang Huang, Yuan Yuan Ding, Peng Ji
  • Publication number: 20210073686
    Abstract: Techniques for generating machine learning architectures are provided. A data set is received for training one or more machine learning (ML) models, where the data set comprises labeled exemplars for a plurality of classes. The data set is partitioned into a training set and a testing set. A first ML model is trained using the training set, and a quality of the first ML model with respect to each class of the plurality of classes is evaluated using the testing set. Upon determining that the quality of the first ML model is below a predefined threshold with respect to a first class and a second class of the plurality of classes, a subset of the training set is identified, where each exemplar in the subset corresponds to either the first class or the second class. A second ML model is trained using the subset of the training set.
    Type: Application
    Filed: September 6, 2019
    Publication date: March 11, 2021
    Inventors: Yuan Yuan Ding, GUO QIANG HU, Jun Zhu, Jing Chang Huang, Sheng Nan Zhu, Fan LI, Peng Ji
  • Publication number: 20210058405
    Abstract: A shared electronic device management method is implemented in a shared electronic device management device. The method includes receiving a function instruction, obtaining verification information, linking the obtained verification information to verification information in a database, determining whether the obtained verification information meets a first preset condition, implementing the function instruction if the obtained verification information meets the first preset condition, and outputting a prompt if the obtained verification information does not meet the first preset condition. The function instruction includes any one of retrieving, depositing, and repairing a shared electronic device. The verification information includes user verification information and shared electronic device verification information.
    Type: Application
    Filed: January 3, 2020
    Publication date: February 25, 2021
    Inventors: BO ZHANG, TAO ZHAO, LIN LIU, XIAO-NAN ZHU, JIAN-GUO CHAN, SHAO-BING HOU, ZHI-LI SU, XIANG RU, ZHI-PING ZHANG
  • Patent number: 10928613
    Abstract: A head-mounted display may include a display system and an optical system in a housing. The display system may have a pixel array that produces light associated with images. The display system may also have a linear polarizer through which light from the pixel array passes and a quarter wave plate through which the light passes after passing through the quarter wave plate. The optical system may be a catadioptric optical system having one or more lens elements. The lens elements may include a plano-convex lens and a plano-concave lens. A partially reflective mirror may be formed on a convex surface of the plano-convex lens. A reflective polarizer may be formed on the planar surface of the plano-convex lens or the concave surface of the plano-concave lens. An additional quarter wave plate may be located between the reflective polarizer and the partially reflective mirror.
    Type: Grant
    Filed: January 30, 2020
    Date of Patent: February 23, 2021
    Assignee: Apple Inc.
    Inventors: Sajjad A. Khan, Nan Zhu, Graham B. Myhre, Brent J. Bollman, Tyler Anderson, Weibo Cheng, John N. Border
  • Patent number: 10896341
    Abstract: A computer implemented method for surface defect inspection that includes recording an optical image of a surface including a defect; converting the optical image including the defect into a heat map; extracting a region of interest including the defect from the heat map; and comparing the region of interest including the defect from the heat map to a binary classification model using a sliding window based voting mechanism to determine if the defect is greater than or less than a threshold failure value.
    Type: Grant
    Filed: November 15, 2018
    Date of Patent: January 19, 2021
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Sheng Nan Zhu, Guo Qiang Hu, Jun Zhu, Jing Chang Huang, Peng Ji
  • Publication number: 20210004945
    Abstract: A method, a device and a computer program product for image processing are proposed. In the method, whether a first image indicates a defect associated with a target object is determined. In response to determining that the first image indicates the defect, a second image absent from the defect is obtained based on the first image. The defect is identified by comparing the first image with the second image. In this way, the defect associated with the target object in the image can be accurately and efficiently identified or segmented.
    Type: Application
    Filed: July 5, 2019
    Publication date: January 7, 2021
    Inventors: FAN LI, GUO QIANG HU, Sheng Nan Zhu, JUN ZHU, Jing Chang Huang, Peng Ji, Yuan Yuan Ding
  • Publication number: 20200365831
    Abstract: An electronic device may have a support structure that supports a display and lenses. Each lens may be a reflective lens such as a catadioptric lens that receives polarized image light from the display and provides a corresponding image to an eye box. The display may be an emissive display with pixels that include light-emitting diodes. The light-emitting diodes may be overlapped by a light recycling layer such as a reflective polarizer or cholesteric liquid crystal layer. The light recycling layer recycles emitted light to enhance display efficiency.
    Type: Application
    Filed: February 26, 2020
    Publication date: November 19, 2020
    Inventors: Aleksandr N. Polyakov, Aditi G. Kanhere, Brandon E. Clarke, Cheng Chen, John N. Border, Nan Zhu, Rui Liu, Wei-Liang Hsu
  • Publication number: 20200174284
    Abstract: A head-mounted display may include a display system and an optical system in a housing. The display system may have displays that produce images. Positioners may be used to move the displays relative to the eye positions of a user's eyes. An adjustable optical system may include tunable lenses such as tunable cylindrical liquid crystal lenses. The displays may be viewed through the lenses when the user's eyes are at the eye positions. A sensor may be incorporated into the head-mounted display to measure refractive errors in the user's eyes. The sensor may include waveguides and volume holograms, and a camera for gathering light that has reflected from the retinas of the user's eyes. Viewing comfort may be enhanced by adjusting display positions relative to the eye positions and/or by adjusting lens settings based on the content being presented on the display and/or measured refractive errors.
    Type: Application
    Filed: May 3, 2018
    Publication date: June 4, 2020
    Inventors: Victoria C. Chan, Christina G. Gambacorta, Graham B. Myhre, Hyungryul Choi, Nan Zhu, Phil M. Hobson, William W. Sprague, Edward A. Valko, Qiong Huang, Branko Petljanski, Paul V. Johnson, Brandon E. Clarke, Elijah H. Kleeman
  • Publication number: 20200166738
    Abstract: A head-mounted display may include a display system and an optical system in a housing. The display system may have a pixel array that produces light associated with images. The display system may also have a linear polarizer through which light from the pixel array passes and a quarter wave plate through which the light passes after passing through the quarter wave plate. The optical system may be a catadioptric optical system having one or more lens elements. The lens elements may include a plano-convex lens and a plano-concave lens. A partially reflective mirror may be formed on a convex surface of the plano-convex lens. A reflective polarizer may be formed on the planar surface of the plano-convex lens or the concave surface of the plano-concave lens. An additional quarter wave plate may be located between the reflective polarizer and the partially reflective mirror.
    Type: Application
    Filed: January 30, 2020
    Publication date: May 28, 2020
    Inventors: Sajjad A. Khan, Nan Zhu, Graham B. Myhre, Brent J. Bollman, Tyler Anderson, Weibo Cheng, John N. Border
  • Publication number: 20200160083
    Abstract: A computer implemented method for surface defect inspection that includes recording an optical image of a surface including a defect; converting the optical image including the defect into a heat map; extracting a region of interest including the defect from the heat map; and comparing the region of interest including the defect from the heat map to a binary classification model using a sliding window based voting mechanism to determine if the defect is greater than or less than a threshold failure value.
    Type: Application
    Filed: November 15, 2018
    Publication date: May 21, 2020
    Inventors: Sheng Nan Zhu, Guo Qiang Hu, Jun Zhu, Jing Chang Huang, Peng Ji
  • Publication number: 20200089014
    Abstract: An electronic device may have a display that emits image light, a waveguide, and an input coupler that couples the image light into the waveguide. Beam splitter structures may be embedded within the waveguide. The beam splitter structures may partially reflect the image light multiple times and may serve to generate replicated beams of light that are coupled out of the waveguide by an output coupler. The beam splitter structures may replicate the beams across two dimensions to provide an eye box with uniform-intensity light from the display across its area. The beam splitter structures may include stacked partially reflective beam splitter layers, sandwiched transparent substrate layers having different indices of refraction, a thick volume hologram interposed between substrate layers, or combinations of these or other structures. The reflectivity of the beam splitter structures may vary discretely or continuously across the lateral area of the waveguide.
    Type: Application
    Filed: August 20, 2019
    Publication date: March 19, 2020
    Inventors: Guolin Peng, Eric J. Hansotte, Francesco Aieta, Graham B. Myhre, Hyungryul Choi, Nan Zhu, Paul J. Gelsinger-Austin, Se Baek Oh, Scott M. DeLapp, Bradley C. Steele
  • Patent number: 10591707
    Abstract: A head-mounted display may include a display system and an optical system in a housing. The display system may have a pixel array that produces light associated with images. The display system may also have a linear polarizer through which light from the pixel array passes and a quarter wave plate through which the light passes after passing through the quarter wave plate. The optical system may be a catadioptric optical system having one or more lens elements. The lens elements may include a plano-convex lens and a plano-concave lens. A partially reflective mirror may be formed on a convex surface of the plano-convex lens. A reflective polarizer may be formed on the planar surface of the plano-convex lens or the concave surface of the plano-concave lens. An additional quarter wave plate may be located between the reflective polarizer and the partially reflective mirror.
    Type: Grant
    Filed: December 18, 2018
    Date of Patent: March 17, 2020
    Assignee: Apple Inc.
    Inventors: Sajjad A. Khan, Nan Zhu, Graham B. Myhre, Brent J. Bollman, Tyler Anderson, Weibo Cheng, John N. Border
  • Publication number: 20190146198
    Abstract: A head-mounted display may include a display system and an optical system in a housing. The display system may have a pixel array that produces light associated with images. The display system may also have a linear polarizer through which light from the pixel array passes and a quarter wave plate through which the light passes after passing through the quarter wave plate. The optical system may be a catadioptric optical system having one or more lens elements. The lens elements may include a plano-convex lens and a plano-concave lens. A partially reflective mirror may be formed on a convex surface of the plano-convex lens. A reflective polarizer may be formed on the planar surface of the plano-convex lens or the concave surface of the plano-concave lens. An additional quarter wave plate may be located between the reflective polarizer and the partially reflective mirror.
    Type: Application
    Filed: December 18, 2018
    Publication date: May 16, 2019
    Inventors: Sajjad A. Khan, Nan Zhu, Graham B. Myhre, Brent J. Bollman, Tyler Anderson, Weibo Cheng, John N. Border
  • Patent number: 10284260
    Abstract: An electronic device includes: a connection establishing unit and a power line communication module; wherein, the connection establishing unit is configured to establish power line connections; the power line communication module comprising: a listening unit is configured to listen to a data packet, transmitted over a power line, from the other electronic devices after the power line connections are established; and a broadcast unit is configured to broadcast data packets after the power line connections are established, and broadcast no data packet and keep silent upon detection on data packet from other electronic devices has been received in a preset time duration. With the technical solutions of the disclosure, electromagnetic conductive radiation and interference produced by the electronic device to other power consuming devices can be avoided.
    Type: Grant
    Filed: July 12, 2016
    Date of Patent: May 7, 2019
    Assignees: HISENSE CO., LTD., HISENSE USA CORPORATION
    Inventor: Nan Zhu