Patents by Inventor Nan ZHU

Nan ZHU has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240103301
    Abstract: A head-mounted display may include a display system and an optical system in a housing. The display system may have displays that produce images. Positioners may be used to move the displays relative to the eye positions of a user's eyes. An adjustable optical system may include tunable lenses such as tunable cylindrical liquid crystal lenses. The displays may be viewed through the lenses when the user's eyes are at the eye positions. A sensor may be incorporated into the head-mounted display to measure refractive errors in the user's eyes. The sensor may include waveguides and volume holograms, and a camera for gathering light that has reflected from the retinas of the user's eyes. Viewing comfort may be enhanced by adjusting display positions relative to the eye positions and/or by adjusting lens settings based on the content being presented on the display and/or measured refractive errors.
    Type: Application
    Filed: December 6, 2023
    Publication date: March 28, 2024
    Inventors: Victoria C. Chan, Christina G. Gambacorta, Graham B. Myhre, Hyungryul Choi, Nan Zhu, Phil M. Hobson, William W. Sprague, Edward A. Valko, Qiong Huang, Branko Petljanski, Paul V. Johnson, Brandon E. Clarke, Elijah H. Kleeman
  • Patent number: 11932624
    Abstract: The present invention provides compounds, compositions thereof, and methods of using the same.
    Type: Grant
    Filed: October 10, 2022
    Date of Patent: March 19, 2024
    Assignee: Kymera Therapeutics, Inc.
    Inventors: Nan Ji, Matthew M. Weiss, Xiaozhang Zheng, Xiao Zhu
  • Patent number: 11936411
    Abstract: Systems, methods, and apparatuses, including electronic devices and computer-readable storage media, for adaptively switching wireless connections between antennas of a wearable electronic device and a host electronic device. One device includes a wearable electronic device with a first and second housing, each housing including two or more antennas. The wearable electronic device is configured to establish and monitor a wireless cross-link between two antennas in different housings, or between antennas in one housing and antennas of a host electronic device. The wearable electronic device can monitor the integrity of the wireless cross-link, and establish an updated cross-link in response to the wireless cross-link not meeting a predetermined integrity threshold. The wearable electronic device can monitor a wireless cross-head link between housings of a wearable electronic device at the same time as a wireless cross-body link between the wearable electronic device and the host electronic device.
    Type: Grant
    Filed: November 18, 2022
    Date of Patent: March 19, 2024
    Assignee: Google LLC
    Inventors: Vijay Asrani, Jiang Zhu, Nan Xu
  • Patent number: 11874530
    Abstract: A head-mounted display may include a display system and an optical system in a housing. The display system may have displays that produce images. Positioners may be used to move the displays relative to the eye positions of a user's eyes. An adjustable optical system may include tunable lenses such as tunable cylindrical liquid crystal lenses. The displays may be viewed through the lenses when the user's eyes are at the eye positions. A sensor may be incorporated into the head-mounted display to measure refractive errors in the user's eyes. The sensor may include waveguides and volume holograms, and a camera for gathering light that has reflected from the retinas of the user's eyes. Viewing comfort may be enhanced by adjusting display positions relative to the eye positions and/or by adjusting lens settings based on the content being presented on the display and/or measured refractive errors.
    Type: Grant
    Filed: May 3, 2018
    Date of Patent: January 16, 2024
    Assignee: Apple Inc.
    Inventors: Victoria C. Chan, Christina G. Gambacorta, Graham B. Myhre, Hyungryul Choi, Nan Zhu, Phil M. Hobson, William W. Sprague, Edward A. Valko, Qiong Huang, Branko Petljanski, Paul V. Johnson, Brandon E. Clarke, Elijah H. Kleeman
  • Patent number: 11869257
    Abstract: A method for detecting and labeling a target object in a 2D image includes receiving a plurality of 2D images from a visual sensor, manually marking points of the target object on each of the 2D images, generating from the 2D images a 3D world coordinate system of the environment surrounding the target object, mapping each of the marked points on the 2D images to the 3D world coordinate system using a simultaneous localization and mapping (SLAM) engine, automatically generating a 3D bounding box covering all the marked points mapped to the 3D world coordinate system, mapping the 3D bounding box to each of the 2D images, generating a label for the target object on each of the 2D images using a machine learning object detection model, and training the machine learning object detection model based on the generated label for the target object.
    Type: Grant
    Filed: March 19, 2021
    Date of Patent: January 9, 2024
    Assignee: International Business Machines Corporation
    Inventors: Guoqiang Hu, Sheng Nan Zhu, Yuan Yuan Ding, Hong Bing Zhang, Dan Zhang, Tian Tian Chai
  • Patent number: 11803056
    Abstract: An electronic device may have a display that emits image light, a waveguide, and an input coupler that couples the image light into the waveguide. Beam splitter structures may be embedded within the waveguide. The beam splitter structures may partially reflect the image light multiple times and may serve to generate replicated beams of light that are coupled out of the waveguide by an output coupler. The beam splitter structures may replicate the beams across two dimensions to provide an eye box with uniform-intensity light from the display across its area. The beam splitter structures may include stacked partially reflective beam splitter layers, sandwiched transparent substrate layers having different indices of refraction, a thick volume hologram interposed between substrate layers, or combinations of these or other structures. The reflectivity of the beam splitter structures may vary discretely or continuously across the lateral area of the waveguide.
    Type: Grant
    Filed: August 20, 2019
    Date of Patent: October 31, 2023
    Assignee: Apple Inc.
    Inventors: Guolin Peng, Eric J. Hansotte, Francesco Aieta, Graham B. Myhre, Hyungryul Choi, Nan Zhu, Paul J. Gelsinger-Austin, Se Baek Oh, Scott M. DeLapp, Bradley C. Steele
  • Publication number: 20230333359
    Abstract: A head-mounted display may include a display system and an optical system in a housing. The display system may have a pixel array that produces light associated with images. The display system may also have a linear polarizer through which light from the pixel array passes and a quarter wave plate through which the light passes after passing through the quarter wave plate. The optical system may be a catadioptric optical system having one or more lens elements. The lens elements may include a plano-convex lens and a plano-concave lens. A partially reflective minor may be formed on a convex surface of the plano-convex lens. A reflective polarizer may be formed on the planar surface of the plano-convex lens or the concave surface of the plano-concave lens. An additional quarter wave plate may be located between the reflective polarizer and the partially reflective mirror.
    Type: Application
    Filed: June 26, 2023
    Publication date: October 19, 2023
    Inventors: Sajjad A. Khan, Nan Zhu, Graham B. Myhre, Brent J. Bollman, Tyler Anderson, Weibo Cheng, John N. Border
  • Patent number: 11778856
    Abstract: An electronic device may have a support structure that supports a display and lenses. Each lens may be a reflective lens such as a catadioptric lens that receives polarized image light from the display and provides a corresponding image to an eye box. The display may be an emissive display with pixels that include light-emitting diodes. The light-emitting diodes may be overlapped by a light recycling layer such as a reflective polarizer or cholesteric liquid crystal layer. The light recycling layer recycles emitted light to enhance display efficiency.
    Type: Grant
    Filed: February 26, 2020
    Date of Patent: October 3, 2023
    Assignee: Apple Inc.
    Inventors: Aleksandr N. Polyakov, Aditi G. Kanhere, Brandon E. Clarke, Cheng Chen, John N. Border, Nan Zhu, Rui Liu, Wei-Liang Hsu
  • Patent number: 11740446
    Abstract: A head-mounted display may include a display system and an optical system in a housing. The display system may have a pixel array that produces light associated with images. The display system may also have a linear polarizer through which light from the pixel array passes and a quarter wave plate through which the light passes after passing through the quarter wave plate. The optical system may be a catadioptric optical system having one or more lens elements. The lens elements may include a plano-convex lens and a plano-concave lens. A partially reflective mirror may be formed on a convex surface of the plano-convex lens. A reflective polarizer may be formed on the planar surface of the plano-convex lens or the concave surface of the plano-concave lens. An additional quarter wave plate may be located between the reflective polarizer and the partially reflective mirror.
    Type: Grant
    Filed: January 15, 2021
    Date of Patent: August 29, 2023
    Assignee: Apple Inc.
    Inventors: Sajjad A. Khan, Nan Zhu, Graham B. Myhre, Brent J. Bollman, Tyler Anderson, Weibo Cheng, John N. Border
  • Patent number: 11686637
    Abstract: A silicon carbide-based micro-electro-mechanical system (MEMS) combined temperature-pressure sensor chip and a preparation thereof. The chip includes a peripheric pressure-measuring unit and a center temperature-measuring unit. The pressure-measuring unit includes a silicon carbide substrate with a raised island and a pressure sensitive diaphragm formed by etching the back of the substrate. The raised island and the pressure-sensitive diaphragm constitute a membrane-island structure. Four piezoresistive strips are arranged symmetrically along a circumferential direction of a root of the pressure-sensitive diaphragm and between the raised island and the pressure-sensitive diaphragm. The temperature-measuring unit includes the raised island and a thin-film thermocouple arranged thereon.
    Type: Grant
    Filed: January 25, 2022
    Date of Patent: June 27, 2023
    Assignee: XI'AN JIAOTONG UNIVERSITY
    Inventors: Xudong Fang, Ziyan Fang, Chen Wu, Hao Sun, Libo Zhao, Bian Tian, Zhuangde Jiang, Wubin Deng, Bonan Gao, Junxia Wu, Songli Wang, Nan Zhu
  • Patent number: 11615634
    Abstract: A system, method, and computer program product provides a way to separate connected or adhered adjacent characters of a digital image for license plate recognition. As a threshold processing, the method performs a recognition of character adhesion by obtaining character parameters using an image processor. The parameters include a horizontal max crossing and a ratio of width and height. A first rule-based module is used responsive to the character parameters to distinguish the adhered characters (character adhesions) that are easy to judge, leaving the uncertain part to a character adhesion classifier model for discrimination. Character adhesion data is obtained by data augmentation including the adding of a random distance between two single characters to create class like adhered characters. Then the character adhesion classifier model of single character and character adhesion data is trained. Any uncertain part can be distinguished by the trained character adhesion classifier model.
    Type: Grant
    Filed: July 1, 2021
    Date of Patent: March 28, 2023
    Assignee: International Business Machines Corporation
    Inventors: Sheng Nan Zhu, Guoqiang Hu, Yuan Yuan Ding, Peng Ji, Fan Li, Jian Xu
  • Patent number: 11587233
    Abstract: The present invention relates to a method, system and computer program product for defect enhancement. According to the method, a plurality of proposed regions from a plurality of images taken for a display panel is obtained. Each of proposed region of the plurality of proposed regions include a suspected defect on the display panel. At least two proposed regions from the plurality of proposed regions that deserve to be superimposed based on a set of conditions is determined. The at least two proposed regions for acquiring an enhanced defect are superimposed.
    Type: Grant
    Filed: October 17, 2019
    Date of Patent: February 21, 2023
    Assignee: International Business Machines Corporation
    Inventors: JingChang Huang, Sheng Nan Zhu, Fan Li, Peng Ji, Jian Xu, Wei Zhao, Jinfeng Li
  • Publication number: 20230004747
    Abstract: A system, method, and computer program product provides a way to separate connected or adhered adjacent characters of a digital image for license plate recognition. As a threshold processing, the method performs a recognition of character adhesion by obtaining character parameters using an image processor. The parameters include a horizontal max crossing and a ratio of width and height. A first rule-based module is used responsive to the character parameters to distinguish the adhered characters (character adhesions) that are easy to judge, leaving the uncertain part to a character adhesion classifier model for discrimination. Character adhesion data is obtained by data augmentation including the adding of a random distance between two single characters to create class like adhered characters. Then the character adhesion classifier model of single character and character adhesion data is trained. Any uncertain part can be distinguished by the trained character adhesion classifier model.
    Type: Application
    Filed: July 1, 2021
    Publication date: January 5, 2023
    Inventors: Sheng Nan Zhu, GUOQIANG HU, Yuan Yuan Ding, Peng Ji, Fan Li, Jian Xu
  • Publication number: 20220300738
    Abstract: A method for detecting and labeling a target object in a 2D image includes receiving a plurality of 2D images from a visual sensor, manually marking points of the target object on each of the 2D images, generating from the 2D images a 3D world coordinate system of the environment surrounding the target object, mapping each of the marked points on the 2D images to the 3D world coordinate system using a simultaneous localization and mapping (SLAM) engine, automatically generating a 3D bounding box covering all the marked points mapped to the 3D world coordinate system, mapping the 3D bounding box to each of the 2D images, generating a label for the target object on each of the 2D images using a machine learning object detection model, and training the machine learning object detection model based on the generated label for the target object.
    Type: Application
    Filed: March 19, 2021
    Publication date: September 22, 2022
    Inventors: Guoqiang Hu, Sheng Nan Zhu, Yuan Yuan Ding, Hong Bing Zhang, Dan Zhang, Tian Tian Chai
  • Patent number: 11431724
    Abstract: A shared electronic device management method is implemented in a shared electronic device management device. The method includes receiving a function instruction, obtaining verification information, linking the obtained verification information to verification information in a database, determining whether the obtained verification information meets a first preset condition, implementing the function instruction if the obtained verification information meets the first preset condition, and outputting a prompt if the obtained verification information does not meet the first preset condition. The function instruction includes any one of retrieving, depositing, and repairing a shared electronic device. The verification information includes user verification information and shared electronic device verification information.
    Type: Grant
    Filed: January 3, 2020
    Date of Patent: August 30, 2022
    Assignees: HONGFUJIN PRECISION ELECTRONICS (ZHENGZHOU) CO., LTD., HON HAI PRECISION INDUSTRY CO., LTD.
    Inventors: Bo Zhang, Tao Zhao, Lin Liu, Xiao-Nan Zhu, Jian-Guo Chan, Shao-Bing Hou, Zhi-Li Su, Xiang Ru, Zhi-Ping Zhang
  • Patent number: 11354793
    Abstract: In an approach for object detection with missing annotations under visual inspection, a processor receives an image. A processor classifies the image being a not-good image using a pre-trained classifier. A not-good image means one or more defect objects being in the image. A processor, in response to classifying the image being the not-good image, detects the one or more defect objects in the not-good image. A processor masks the one or more defect objects in the not-good image. A processor inputs the masked image to train a detector.
    Type: Grant
    Filed: December 16, 2019
    Date of Patent: June 7, 2022
    Assignee: International Business Machines Corporation
    Inventors: Jian Xu, Guo Qiang Hu, Fan Li, Sheng Nan Zhu, Jinfeng Li, Jun Zhu
  • Patent number: 11341370
    Abstract: The present disclosure relates to training a machine learning model to classify images. An example method generally includes receiving a training data set including images in a first category and images in a second category. A convolutional neural network (CNN) is trained using the training data set, and a feature map is generated from layers of the CNN based on features of images in the training data set. A first area in the feature map including images in the first category and a second area in the feature map where images in the first category overlap with images in the second category are identified. The first category is split into a first subcategory corresponding to the first area and a second subcategory corresponding to the second area. The CNN is retrained based on the images in the first subcategory, images in the second subcategory, and images in the second category.
    Type: Grant
    Filed: November 22, 2019
    Date of Patent: May 24, 2022
    Assignee: International Business Machines Corporation
    Inventors: Peng Ji, Guo Qiang Hu, Yuan Yuan Ding, Jun Zhu, Jing Chang Huang, Sheng Nan Zhu
  • Publication number: 20220146352
    Abstract: A silicon carbide-based micro-electro-mechanical system (MEMS) combined temperature-pressure sensor chip and a preparation thereof. The chip includes a peripheric pressure-measuring unit and a center temperature-measuring unit. The pressure-measuring unit includes a silicon carbide substrate with a raised island and a pressure sensitive diaphragm formed by etching the back of the substrate. The raised island and the pressure-sensitive diaphragm constitute a membrane-island structure. Four piezoresistive strips are arranged symmetrically along a circumferential direction of a root of the pressure-sensitive diaphragm and between the raised island and the pressure-sensitive diaphragm. The temperature-measuring unit includes the raised island and a thin-film thermocouple arranged thereon.
    Type: Application
    Filed: January 25, 2022
    Publication date: May 12, 2022
    Inventors: Xudong FANG, Ziyan FANG, Chen WU, Hao SUN, Libo ZHAO, Bian TIAN, Zhuangde JIANG, Wubin DENG, Bonan GAO, Junxia WU, Songli WANG, Nan ZHU
  • Patent number: 11301969
    Abstract: Some implementations provide improved user experiences on head mounted devices (HMDs) that provide near eye viewing, e.g., HMDs that display distorted images and provide lenses that undistort the images for the user. The images are produced using distortion that is corrected dynamically based on context to conserve device resources. To do so, a context associated with a state of the user, the HMD, or content being viewed on the HMD is tracked during the user experience. For example, the device may predict pupil position, eye state, eye gaze direction, or eye fixation, content type, connection mode, and other context. The device uses the tracked context to determine how to correct distortion for the images at different points during the user experience. For example, new distortion corrections may be computed and used while the user's gaze is moving and previously-determined distortion corrections may be used while the user's gaze is fixed.
    Type: Grant
    Filed: September 19, 2019
    Date of Patent: April 12, 2022
    Assignee: Apple Inc.
    Inventors: Moinul Khan, Simon Fortin-Deschenes, Yanli Zhang, Bennett S. Wilburn, Sterling G. Orsten, Nan Zhu, James Zhou
  • Patent number: 11295439
    Abstract: A method, a device and a computer program product for image processing are proposed. In the method, a first training image and region information are obtained. The region information indicates a region of a defect in the first training image. A second training image with the defect at least partially removed is generated using an image generator based on the first training image and the region information. The image generator is trained to recover the first training image by replacing pixels included in the region indicated by the region information. The image generator is updated based on the second training image. In this way, the image including the defect can be accurately and efficiently recovered.
    Type: Grant
    Filed: October 16, 2019
    Date of Patent: April 5, 2022
    Assignee: International Business Machines Corporation
    Inventors: Fan Li, Guo Qiang Hu, Jun Zhu, Sheng Nan Zhu, JingChang Huang, Yuan Yuan Ding, Peng Ji