Patents by Inventor Nan ZHU
Nan ZHU has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20220092756Abstract: A plurality of different images of a same region of interest in an object are input into a set of neural networks, wherein each image of the region has been captured under a different value of a variable condition. A classification for each image is generated by the set of neural networks, wherein each classification includes a confidence score in a prediction of whether a feature is present in the region. The image classifications are ensembled to generate a final classification for the region. By applying a loss function, a loss is computed based on comparing the final classification to a ground truth of whether the feature is present in the region. The parameters of the set of neural networks are adjusted based on the computed loss.Type: ApplicationFiled: September 21, 2020Publication date: March 24, 2022Inventors: JingChang Huang, GUO QIANG HU, Peng Ji, Yuan Yuan Ding, Sheng Nan Zhu, Jinfeng Li
-
Publication number: 20210183038Abstract: In an approach for object detection with missing annotations under visual inspection, a processor receives an image. A processor classifies the image being a not-good image using a pre-trained classifier. A not-good image means one or more defect objects being in the image. A processor, in response to classifying the image being the not-good image, detects the one or more defect objects in the not-good image. A processor masks the one or more defect objects in the not-good image. A processor inputs the masked image to train a detector.Type: ApplicationFiled: December 16, 2019Publication date: June 17, 2021Inventors: Jian Xu, Guo Qiang Hu, Fan Li, Sheng Nan Zhu, Jinfeng Li, Jun Zhu
-
Patent number: 11030738Abstract: A method, a device and a computer program product for image processing are proposed. In the method, whether a first image indicates a defect associated with a target object is determined. In response to determining that the first image indicates the defect, a second image absent from the defect is obtained based on the first image. The defect is identified by comparing the first image with the second image. In this way, the defect associated with the target object in the image can be accurately and efficiently identified or segmented.Type: GrantFiled: July 5, 2019Date of Patent: June 8, 2021Assignee: International Business Machines CorporationInventors: Fan Li, Guo Qiang Hu, Sheng Nan Zhu, Jun Zhu, Jing Chang Huang, Peng Ji, Yuan Yuan Ding
-
Publication number: 20210158094Abstract: The present disclosure relates to training a machine learning model to classify images. An example method generally includes receiving a training data set including images in a first category and images in a second category. A convolutional neural network (CNN) is trained using the training data set, and a feature map is generated from layers of the CNN based on features of images in the training data set. A first area in the feature map including images in the first category and a second area in the feature map where images in the first category overlap with images in the second category are identified. The first category is split into a first subcategory corresponding to the first area and a second subcategory corresponding to the second area. The CNN is retrained based on the images in the first subcategory, images in the second subcategory, and images in the second category.Type: ApplicationFiled: November 22, 2019Publication date: May 27, 2021Inventors: Peng JI, Guo Qiang Hu, Yuan Yuan Ding, Jun Zhu, Jing Chang Huang, Sheng Nan Zhu
-
Publication number: 20210132349Abstract: A head-mounted display may include a display system and an optical system in a housing. The display system may have a pixel array that produces light associated with images. The display system may also have a linear polarizer through which light from the pixel array passes and a quarter wave plate through which the light passes after passing through the quarter wave plate. The optical system may be a catadioptric optical system having one or more lens elements. The lens elements may include a plano-convex lens and a plano-concave lens. A partially reflective mirror may be formed on a convex surface of the plano-convex lens. A reflective polarizer may be formed on the planar surface of the plano-convex lens or the concave surface of the plano-concave lens. An additional quarter wave plate may be located between the reflective polarizer and the partially reflective mirror.Type: ApplicationFiled: January 15, 2021Publication date: May 6, 2021Inventors: Sajjad A. Khan, Nan Zhu, Graham B. Myhre, Brent J. Bollman, Tyler Anderson, Weibo Cheng, John N. Border
-
Publication number: 20210118141Abstract: The present invention relates to a method, system and computer program product for defect enhancement. According to the method, a plurality of proposed regions from a plurality of images taken for a display panel is obtained. Each of proposed region of the plurality of proposed regions include a suspected defect on the display panel. At least two proposed regions from the plurality of proposed regions that deserve to be superimposed based on a set of conditions is determined. The at least two proposed regions for acquiring an enhanced defect are superimposed.Type: ApplicationFiled: October 17, 2019Publication date: April 22, 2021Inventors: JingChang Huang, Sheng Nan Zhu, Fan Li, Peng Ji, Jian Xu, Wei Zhao, Jinfeng Li
-
Publication number: 20210118113Abstract: A method, a device and a computer program product for image processing are proposed. In the method, a first training image and region information are obtained. The region information indicates a region of a defect in the first training image. A second training image with the defect at least partially removed is generated using an image generator based on the first training image and the region information. The image generator is trained to recover the first training image by replacing pixels included in the region indicated by the region information. The image generator is updated based on the second training image. In this way, the image including the defect can be accurately and efficiently recovered.Type: ApplicationFiled: October 16, 2019Publication date: April 22, 2021Inventors: Fan Li, Guo Qiang Hu, Jun Zhu, Sheng Nan Zhu, JingChang Huang, Yuan Yuan Ding, Peng Ji
-
Publication number: 20210073686Abstract: Techniques for generating machine learning architectures are provided. A data set is received for training one or more machine learning (ML) models, where the data set comprises labeled exemplars for a plurality of classes. The data set is partitioned into a training set and a testing set. A first ML model is trained using the training set, and a quality of the first ML model with respect to each class of the plurality of classes is evaluated using the testing set. Upon determining that the quality of the first ML model is below a predefined threshold with respect to a first class and a second class of the plurality of classes, a subset of the training set is identified, where each exemplar in the subset corresponds to either the first class or the second class. A second ML model is trained using the subset of the training set.Type: ApplicationFiled: September 6, 2019Publication date: March 11, 2021Inventors: Yuan Yuan Ding, GUO QIANG HU, Jun Zhu, Jing Chang Huang, Sheng Nan Zhu, Fan LI, Peng Ji
-
Publication number: 20210058405Abstract: A shared electronic device management method is implemented in a shared electronic device management device. The method includes receiving a function instruction, obtaining verification information, linking the obtained verification information to verification information in a database, determining whether the obtained verification information meets a first preset condition, implementing the function instruction if the obtained verification information meets the first preset condition, and outputting a prompt if the obtained verification information does not meet the first preset condition. The function instruction includes any one of retrieving, depositing, and repairing a shared electronic device. The verification information includes user verification information and shared electronic device verification information.Type: ApplicationFiled: January 3, 2020Publication date: February 25, 2021Inventors: BO ZHANG, TAO ZHAO, LIN LIU, XIAO-NAN ZHU, JIAN-GUO CHAN, SHAO-BING HOU, ZHI-LI SU, XIANG RU, ZHI-PING ZHANG
-
Patent number: 10928613Abstract: A head-mounted display may include a display system and an optical system in a housing. The display system may have a pixel array that produces light associated with images. The display system may also have a linear polarizer through which light from the pixel array passes and a quarter wave plate through which the light passes after passing through the quarter wave plate. The optical system may be a catadioptric optical system having one or more lens elements. The lens elements may include a plano-convex lens and a plano-concave lens. A partially reflective mirror may be formed on a convex surface of the plano-convex lens. A reflective polarizer may be formed on the planar surface of the plano-convex lens or the concave surface of the plano-concave lens. An additional quarter wave plate may be located between the reflective polarizer and the partially reflective mirror.Type: GrantFiled: January 30, 2020Date of Patent: February 23, 2021Assignee: Apple Inc.Inventors: Sajjad A. Khan, Nan Zhu, Graham B. Myhre, Brent J. Bollman, Tyler Anderson, Weibo Cheng, John N. Border
-
Patent number: 10896341Abstract: A computer implemented method for surface defect inspection that includes recording an optical image of a surface including a defect; converting the optical image including the defect into a heat map; extracting a region of interest including the defect from the heat map; and comparing the region of interest including the defect from the heat map to a binary classification model using a sliding window based voting mechanism to determine if the defect is greater than or less than a threshold failure value.Type: GrantFiled: November 15, 2018Date of Patent: January 19, 2021Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Sheng Nan Zhu, Guo Qiang Hu, Jun Zhu, Jing Chang Huang, Peng Ji
-
Publication number: 20210004945Abstract: A method, a device and a computer program product for image processing are proposed. In the method, whether a first image indicates a defect associated with a target object is determined. In response to determining that the first image indicates the defect, a second image absent from the defect is obtained based on the first image. The defect is identified by comparing the first image with the second image. In this way, the defect associated with the target object in the image can be accurately and efficiently identified or segmented.Type: ApplicationFiled: July 5, 2019Publication date: January 7, 2021Inventors: FAN LI, GUO QIANG HU, Sheng Nan Zhu, JUN ZHU, Jing Chang Huang, Peng Ji, Yuan Yuan Ding
-
Publication number: 20200365831Abstract: An electronic device may have a support structure that supports a display and lenses. Each lens may be a reflective lens such as a catadioptric lens that receives polarized image light from the display and provides a corresponding image to an eye box. The display may be an emissive display with pixels that include light-emitting diodes. The light-emitting diodes may be overlapped by a light recycling layer such as a reflective polarizer or cholesteric liquid crystal layer. The light recycling layer recycles emitted light to enhance display efficiency.Type: ApplicationFiled: February 26, 2020Publication date: November 19, 2020Inventors: Aleksandr N. Polyakov, Aditi G. Kanhere, Brandon E. Clarke, Cheng Chen, John N. Border, Nan Zhu, Rui Liu, Wei-Liang Hsu
-
Publication number: 20200174284Abstract: A head-mounted display may include a display system and an optical system in a housing. The display system may have displays that produce images. Positioners may be used to move the displays relative to the eye positions of a user's eyes. An adjustable optical system may include tunable lenses such as tunable cylindrical liquid crystal lenses. The displays may be viewed through the lenses when the user's eyes are at the eye positions. A sensor may be incorporated into the head-mounted display to measure refractive errors in the user's eyes. The sensor may include waveguides and volume holograms, and a camera for gathering light that has reflected from the retinas of the user's eyes. Viewing comfort may be enhanced by adjusting display positions relative to the eye positions and/or by adjusting lens settings based on the content being presented on the display and/or measured refractive errors.Type: ApplicationFiled: May 3, 2018Publication date: June 4, 2020Inventors: Victoria C. Chan, Christina G. Gambacorta, Graham B. Myhre, Hyungryul Choi, Nan Zhu, Phil M. Hobson, William W. Sprague, Edward A. Valko, Qiong Huang, Branko Petljanski, Paul V. Johnson, Brandon E. Clarke, Elijah H. Kleeman
-
Publication number: 20200166738Abstract: A head-mounted display may include a display system and an optical system in a housing. The display system may have a pixel array that produces light associated with images. The display system may also have a linear polarizer through which light from the pixel array passes and a quarter wave plate through which the light passes after passing through the quarter wave plate. The optical system may be a catadioptric optical system having one or more lens elements. The lens elements may include a plano-convex lens and a plano-concave lens. A partially reflective mirror may be formed on a convex surface of the plano-convex lens. A reflective polarizer may be formed on the planar surface of the plano-convex lens or the concave surface of the plano-concave lens. An additional quarter wave plate may be located between the reflective polarizer and the partially reflective mirror.Type: ApplicationFiled: January 30, 2020Publication date: May 28, 2020Inventors: Sajjad A. Khan, Nan Zhu, Graham B. Myhre, Brent J. Bollman, Tyler Anderson, Weibo Cheng, John N. Border
-
Publication number: 20200160083Abstract: A computer implemented method for surface defect inspection that includes recording an optical image of a surface including a defect; converting the optical image including the defect into a heat map; extracting a region of interest including the defect from the heat map; and comparing the region of interest including the defect from the heat map to a binary classification model using a sliding window based voting mechanism to determine if the defect is greater than or less than a threshold failure value.Type: ApplicationFiled: November 15, 2018Publication date: May 21, 2020Inventors: Sheng Nan Zhu, Guo Qiang Hu, Jun Zhu, Jing Chang Huang, Peng Ji
-
Publication number: 20200089014Abstract: An electronic device may have a display that emits image light, a waveguide, and an input coupler that couples the image light into the waveguide. Beam splitter structures may be embedded within the waveguide. The beam splitter structures may partially reflect the image light multiple times and may serve to generate replicated beams of light that are coupled out of the waveguide by an output coupler. The beam splitter structures may replicate the beams across two dimensions to provide an eye box with uniform-intensity light from the display across its area. The beam splitter structures may include stacked partially reflective beam splitter layers, sandwiched transparent substrate layers having different indices of refraction, a thick volume hologram interposed between substrate layers, or combinations of these or other structures. The reflectivity of the beam splitter structures may vary discretely or continuously across the lateral area of the waveguide.Type: ApplicationFiled: August 20, 2019Publication date: March 19, 2020Inventors: Guolin Peng, Eric J. Hansotte, Francesco Aieta, Graham B. Myhre, Hyungryul Choi, Nan Zhu, Paul J. Gelsinger-Austin, Se Baek Oh, Scott M. DeLapp, Bradley C. Steele
-
Patent number: 10591707Abstract: A head-mounted display may include a display system and an optical system in a housing. The display system may have a pixel array that produces light associated with images. The display system may also have a linear polarizer through which light from the pixel array passes and a quarter wave plate through which the light passes after passing through the quarter wave plate. The optical system may be a catadioptric optical system having one or more lens elements. The lens elements may include a plano-convex lens and a plano-concave lens. A partially reflective mirror may be formed on a convex surface of the plano-convex lens. A reflective polarizer may be formed on the planar surface of the plano-convex lens or the concave surface of the plano-concave lens. An additional quarter wave plate may be located between the reflective polarizer and the partially reflective mirror.Type: GrantFiled: December 18, 2018Date of Patent: March 17, 2020Assignee: Apple Inc.Inventors: Sajjad A. Khan, Nan Zhu, Graham B. Myhre, Brent J. Bollman, Tyler Anderson, Weibo Cheng, John N. Border
-
Publication number: 20190146198Abstract: A head-mounted display may include a display system and an optical system in a housing. The display system may have a pixel array that produces light associated with images. The display system may also have a linear polarizer through which light from the pixel array passes and a quarter wave plate through which the light passes after passing through the quarter wave plate. The optical system may be a catadioptric optical system having one or more lens elements. The lens elements may include a plano-convex lens and a plano-concave lens. A partially reflective mirror may be formed on a convex surface of the plano-convex lens. A reflective polarizer may be formed on the planar surface of the plano-convex lens or the concave surface of the plano-concave lens. An additional quarter wave plate may be located between the reflective polarizer and the partially reflective mirror.Type: ApplicationFiled: December 18, 2018Publication date: May 16, 2019Inventors: Sajjad A. Khan, Nan Zhu, Graham B. Myhre, Brent J. Bollman, Tyler Anderson, Weibo Cheng, John N. Border
-
Patent number: 10284260Abstract: An electronic device includes: a connection establishing unit and a power line communication module; wherein, the connection establishing unit is configured to establish power line connections; the power line communication module comprising: a listening unit is configured to listen to a data packet, transmitted over a power line, from the other electronic devices after the power line connections are established; and a broadcast unit is configured to broadcast data packets after the power line connections are established, and broadcast no data packet and keep silent upon detection on data packet from other electronic devices has been received in a preset time duration. With the technical solutions of the disclosure, electromagnetic conductive radiation and interference produced by the electronic device to other power consuming devices can be avoided.Type: GrantFiled: July 12, 2016Date of Patent: May 7, 2019Assignees: HISENSE CO., LTD., HISENSE USA CORPORATIONInventor: Nan Zhu