Patents by Inventor Nan ZHU
Nan ZHU has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 12140741Abstract: A head-mounted display may include a display system and an optical system in a housing. The display system may have a pixel array that produces light associated with images. The display system may also have a linear polarizer through which light from the pixel array passes and a quarter wave plate through which the light passes after passing through the quarter wave plate. The optical system may be a catadioptric optical system having one or more lens elements. The lens elements may include a plano-convex lens and a plano-concave lens. A partially reflective mirror may be formed on a convex surface of the plano-convex lens. A reflective polarizer may be formed on the planar surface of the plano-convex lens or the concave surface of the plano-concave lens. An additional quarter wave plate may be located between the reflective polarizer and the partially reflective mirror.Type: GrantFiled: June 26, 2023Date of Patent: November 12, 2024Assignee: Apple Inc.Inventors: Sajjad A. Khan, Nan Zhu, Graham B. Myhre, Brent J. Bollman, Tyler Anderson, Weibo Cheng, John N. Border
-
Publication number: 20240262058Abstract: A method of manufacturing a meniscus lens includes providing an optical lens substrate having a non-planar deposition surface and depositing a resinous layer over the deposition surface to form the lens. Such a printed lens may have a radius of curvature of less than approximately 80 mm, sag of from approximately 2 mm to approximately 20 mm, a maximum thickness of less than approximately 40 mm, and a minimum thickness variation of at least approximately 2 mm.Type: ApplicationFiled: December 26, 2023Publication date: August 8, 2024Inventors: Rongzhi Huang, Nan Zhu, Jordy Rooijakkers, Daniel Puskas, Brent Bollman, Anqi Ji, Jason Lozo, Alexander Sohn, Marvin Dion Alim, Sho Nakahara, Kurt Jenkins, Keyuan Huang, Fang Peng, Hanqing Zhao, Yu Li, Weiyao Li, Amir Ryan Zamiri, Terence Johnson Lop Shie Chan, Yoshitaka Sato
-
Publication number: 20240103301Abstract: A head-mounted display may include a display system and an optical system in a housing. The display system may have displays that produce images. Positioners may be used to move the displays relative to the eye positions of a user's eyes. An adjustable optical system may include tunable lenses such as tunable cylindrical liquid crystal lenses. The displays may be viewed through the lenses when the user's eyes are at the eye positions. A sensor may be incorporated into the head-mounted display to measure refractive errors in the user's eyes. The sensor may include waveguides and volume holograms, and a camera for gathering light that has reflected from the retinas of the user's eyes. Viewing comfort may be enhanced by adjusting display positions relative to the eye positions and/or by adjusting lens settings based on the content being presented on the display and/or measured refractive errors.Type: ApplicationFiled: December 6, 2023Publication date: March 28, 2024Inventors: Victoria C. Chan, Christina G. Gambacorta, Graham B. Myhre, Hyungryul Choi, Nan Zhu, Phil M. Hobson, William W. Sprague, Edward A. Valko, Qiong Huang, Branko Petljanski, Paul V. Johnson, Brandon E. Clarke, Elijah H. Kleeman
-
Patent number: 11874530Abstract: A head-mounted display may include a display system and an optical system in a housing. The display system may have displays that produce images. Positioners may be used to move the displays relative to the eye positions of a user's eyes. An adjustable optical system may include tunable lenses such as tunable cylindrical liquid crystal lenses. The displays may be viewed through the lenses when the user's eyes are at the eye positions. A sensor may be incorporated into the head-mounted display to measure refractive errors in the user's eyes. The sensor may include waveguides and volume holograms, and a camera for gathering light that has reflected from the retinas of the user's eyes. Viewing comfort may be enhanced by adjusting display positions relative to the eye positions and/or by adjusting lens settings based on the content being presented on the display and/or measured refractive errors.Type: GrantFiled: May 3, 2018Date of Patent: January 16, 2024Assignee: Apple Inc.Inventors: Victoria C. Chan, Christina G. Gambacorta, Graham B. Myhre, Hyungryul Choi, Nan Zhu, Phil M. Hobson, William W. Sprague, Edward A. Valko, Qiong Huang, Branko Petljanski, Paul V. Johnson, Brandon E. Clarke, Elijah H. Kleeman
-
Patent number: 11869257Abstract: A method for detecting and labeling a target object in a 2D image includes receiving a plurality of 2D images from a visual sensor, manually marking points of the target object on each of the 2D images, generating from the 2D images a 3D world coordinate system of the environment surrounding the target object, mapping each of the marked points on the 2D images to the 3D world coordinate system using a simultaneous localization and mapping (SLAM) engine, automatically generating a 3D bounding box covering all the marked points mapped to the 3D world coordinate system, mapping the 3D bounding box to each of the 2D images, generating a label for the target object on each of the 2D images using a machine learning object detection model, and training the machine learning object detection model based on the generated label for the target object.Type: GrantFiled: March 19, 2021Date of Patent: January 9, 2024Assignee: International Business Machines CorporationInventors: Guoqiang Hu, Sheng Nan Zhu, Yuan Yuan Ding, Hong Bing Zhang, Dan Zhang, Tian Tian Chai
-
Patent number: 11803056Abstract: An electronic device may have a display that emits image light, a waveguide, and an input coupler that couples the image light into the waveguide. Beam splitter structures may be embedded within the waveguide. The beam splitter structures may partially reflect the image light multiple times and may serve to generate replicated beams of light that are coupled out of the waveguide by an output coupler. The beam splitter structures may replicate the beams across two dimensions to provide an eye box with uniform-intensity light from the display across its area. The beam splitter structures may include stacked partially reflective beam splitter layers, sandwiched transparent substrate layers having different indices of refraction, a thick volume hologram interposed between substrate layers, or combinations of these or other structures. The reflectivity of the beam splitter structures may vary discretely or continuously across the lateral area of the waveguide.Type: GrantFiled: August 20, 2019Date of Patent: October 31, 2023Assignee: Apple Inc.Inventors: Guolin Peng, Eric J. Hansotte, Francesco Aieta, Graham B. Myhre, Hyungryul Choi, Nan Zhu, Paul J. Gelsinger-Austin, Se Baek Oh, Scott M. DeLapp, Bradley C. Steele
-
Publication number: 20230333359Abstract: A head-mounted display may include a display system and an optical system in a housing. The display system may have a pixel array that produces light associated with images. The display system may also have a linear polarizer through which light from the pixel array passes and a quarter wave plate through which the light passes after passing through the quarter wave plate. The optical system may be a catadioptric optical system having one or more lens elements. The lens elements may include a plano-convex lens and a plano-concave lens. A partially reflective minor may be formed on a convex surface of the plano-convex lens. A reflective polarizer may be formed on the planar surface of the plano-convex lens or the concave surface of the plano-concave lens. An additional quarter wave plate may be located between the reflective polarizer and the partially reflective mirror.Type: ApplicationFiled: June 26, 2023Publication date: October 19, 2023Inventors: Sajjad A. Khan, Nan Zhu, Graham B. Myhre, Brent J. Bollman, Tyler Anderson, Weibo Cheng, John N. Border
-
Patent number: 11778856Abstract: An electronic device may have a support structure that supports a display and lenses. Each lens may be a reflective lens such as a catadioptric lens that receives polarized image light from the display and provides a corresponding image to an eye box. The display may be an emissive display with pixels that include light-emitting diodes. The light-emitting diodes may be overlapped by a light recycling layer such as a reflective polarizer or cholesteric liquid crystal layer. The light recycling layer recycles emitted light to enhance display efficiency.Type: GrantFiled: February 26, 2020Date of Patent: October 3, 2023Assignee: Apple Inc.Inventors: Aleksandr N. Polyakov, Aditi G. Kanhere, Brandon E. Clarke, Cheng Chen, John N. Border, Nan Zhu, Rui Liu, Wei-Liang Hsu
-
Patent number: 11740446Abstract: A head-mounted display may include a display system and an optical system in a housing. The display system may have a pixel array that produces light associated with images. The display system may also have a linear polarizer through which light from the pixel array passes and a quarter wave plate through which the light passes after passing through the quarter wave plate. The optical system may be a catadioptric optical system having one or more lens elements. The lens elements may include a plano-convex lens and a plano-concave lens. A partially reflective mirror may be formed on a convex surface of the plano-convex lens. A reflective polarizer may be formed on the planar surface of the plano-convex lens or the concave surface of the plano-concave lens. An additional quarter wave plate may be located between the reflective polarizer and the partially reflective mirror.Type: GrantFiled: January 15, 2021Date of Patent: August 29, 2023Assignee: Apple Inc.Inventors: Sajjad A. Khan, Nan Zhu, Graham B. Myhre, Brent J. Bollman, Tyler Anderson, Weibo Cheng, John N. Border
-
Patent number: 11686637Abstract: A silicon carbide-based micro-electro-mechanical system (MEMS) combined temperature-pressure sensor chip and a preparation thereof. The chip includes a peripheric pressure-measuring unit and a center temperature-measuring unit. The pressure-measuring unit includes a silicon carbide substrate with a raised island and a pressure sensitive diaphragm formed by etching the back of the substrate. The raised island and the pressure-sensitive diaphragm constitute a membrane-island structure. Four piezoresistive strips are arranged symmetrically along a circumferential direction of a root of the pressure-sensitive diaphragm and between the raised island and the pressure-sensitive diaphragm. The temperature-measuring unit includes the raised island and a thin-film thermocouple arranged thereon.Type: GrantFiled: January 25, 2022Date of Patent: June 27, 2023Assignee: XI'AN JIAOTONG UNIVERSITYInventors: Xudong Fang, Ziyan Fang, Chen Wu, Hao Sun, Libo Zhao, Bian Tian, Zhuangde Jiang, Wubin Deng, Bonan Gao, Junxia Wu, Songli Wang, Nan Zhu
-
Patent number: 11615634Abstract: A system, method, and computer program product provides a way to separate connected or adhered adjacent characters of a digital image for license plate recognition. As a threshold processing, the method performs a recognition of character adhesion by obtaining character parameters using an image processor. The parameters include a horizontal max crossing and a ratio of width and height. A first rule-based module is used responsive to the character parameters to distinguish the adhered characters (character adhesions) that are easy to judge, leaving the uncertain part to a character adhesion classifier model for discrimination. Character adhesion data is obtained by data augmentation including the adding of a random distance between two single characters to create class like adhered characters. Then the character adhesion classifier model of single character and character adhesion data is trained. Any uncertain part can be distinguished by the trained character adhesion classifier model.Type: GrantFiled: July 1, 2021Date of Patent: March 28, 2023Assignee: International Business Machines CorporationInventors: Sheng Nan Zhu, Guoqiang Hu, Yuan Yuan Ding, Peng Ji, Fan Li, Jian Xu
-
Patent number: 11587233Abstract: The present invention relates to a method, system and computer program product for defect enhancement. According to the method, a plurality of proposed regions from a plurality of images taken for a display panel is obtained. Each of proposed region of the plurality of proposed regions include a suspected defect on the display panel. At least two proposed regions from the plurality of proposed regions that deserve to be superimposed based on a set of conditions is determined. The at least two proposed regions for acquiring an enhanced defect are superimposed.Type: GrantFiled: October 17, 2019Date of Patent: February 21, 2023Assignee: International Business Machines CorporationInventors: JingChang Huang, Sheng Nan Zhu, Fan Li, Peng Ji, Jian Xu, Wei Zhao, Jinfeng Li
-
Publication number: 20230004747Abstract: A system, method, and computer program product provides a way to separate connected or adhered adjacent characters of a digital image for license plate recognition. As a threshold processing, the method performs a recognition of character adhesion by obtaining character parameters using an image processor. The parameters include a horizontal max crossing and a ratio of width and height. A first rule-based module is used responsive to the character parameters to distinguish the adhered characters (character adhesions) that are easy to judge, leaving the uncertain part to a character adhesion classifier model for discrimination. Character adhesion data is obtained by data augmentation including the adding of a random distance between two single characters to create class like adhered characters. Then the character adhesion classifier model of single character and character adhesion data is trained. Any uncertain part can be distinguished by the trained character adhesion classifier model.Type: ApplicationFiled: July 1, 2021Publication date: January 5, 2023Inventors: Sheng Nan Zhu, GUOQIANG HU, Yuan Yuan Ding, Peng Ji, Fan Li, Jian Xu
-
Publication number: 20220300738Abstract: A method for detecting and labeling a target object in a 2D image includes receiving a plurality of 2D images from a visual sensor, manually marking points of the target object on each of the 2D images, generating from the 2D images a 3D world coordinate system of the environment surrounding the target object, mapping each of the marked points on the 2D images to the 3D world coordinate system using a simultaneous localization and mapping (SLAM) engine, automatically generating a 3D bounding box covering all the marked points mapped to the 3D world coordinate system, mapping the 3D bounding box to each of the 2D images, generating a label for the target object on each of the 2D images using a machine learning object detection model, and training the machine learning object detection model based on the generated label for the target object.Type: ApplicationFiled: March 19, 2021Publication date: September 22, 2022Inventors: Guoqiang Hu, Sheng Nan Zhu, Yuan Yuan Ding, Hong Bing Zhang, Dan Zhang, Tian Tian Chai
-
Patent number: 11431724Abstract: A shared electronic device management method is implemented in a shared electronic device management device. The method includes receiving a function instruction, obtaining verification information, linking the obtained verification information to verification information in a database, determining whether the obtained verification information meets a first preset condition, implementing the function instruction if the obtained verification information meets the first preset condition, and outputting a prompt if the obtained verification information does not meet the first preset condition. The function instruction includes any one of retrieving, depositing, and repairing a shared electronic device. The verification information includes user verification information and shared electronic device verification information.Type: GrantFiled: January 3, 2020Date of Patent: August 30, 2022Assignees: HONGFUJIN PRECISION ELECTRONICS (ZHENGZHOU) CO., LTD., HON HAI PRECISION INDUSTRY CO., LTD.Inventors: Bo Zhang, Tao Zhao, Lin Liu, Xiao-Nan Zhu, Jian-Guo Chan, Shao-Bing Hou, Zhi-Li Su, Xiang Ru, Zhi-Ping Zhang
-
Patent number: 11354793Abstract: In an approach for object detection with missing annotations under visual inspection, a processor receives an image. A processor classifies the image being a not-good image using a pre-trained classifier. A not-good image means one or more defect objects being in the image. A processor, in response to classifying the image being the not-good image, detects the one or more defect objects in the not-good image. A processor masks the one or more defect objects in the not-good image. A processor inputs the masked image to train a detector.Type: GrantFiled: December 16, 2019Date of Patent: June 7, 2022Assignee: International Business Machines CorporationInventors: Jian Xu, Guo Qiang Hu, Fan Li, Sheng Nan Zhu, Jinfeng Li, Jun Zhu
-
Patent number: 11341370Abstract: The present disclosure relates to training a machine learning model to classify images. An example method generally includes receiving a training data set including images in a first category and images in a second category. A convolutional neural network (CNN) is trained using the training data set, and a feature map is generated from layers of the CNN based on features of images in the training data set. A first area in the feature map including images in the first category and a second area in the feature map where images in the first category overlap with images in the second category are identified. The first category is split into a first subcategory corresponding to the first area and a second subcategory corresponding to the second area. The CNN is retrained based on the images in the first subcategory, images in the second subcategory, and images in the second category.Type: GrantFiled: November 22, 2019Date of Patent: May 24, 2022Assignee: International Business Machines CorporationInventors: Peng Ji, Guo Qiang Hu, Yuan Yuan Ding, Jun Zhu, Jing Chang Huang, Sheng Nan Zhu
-
Publication number: 20220146352Abstract: A silicon carbide-based micro-electro-mechanical system (MEMS) combined temperature-pressure sensor chip and a preparation thereof. The chip includes a peripheric pressure-measuring unit and a center temperature-measuring unit. The pressure-measuring unit includes a silicon carbide substrate with a raised island and a pressure sensitive diaphragm formed by etching the back of the substrate. The raised island and the pressure-sensitive diaphragm constitute a membrane-island structure. Four piezoresistive strips are arranged symmetrically along a circumferential direction of a root of the pressure-sensitive diaphragm and between the raised island and the pressure-sensitive diaphragm. The temperature-measuring unit includes the raised island and a thin-film thermocouple arranged thereon.Type: ApplicationFiled: January 25, 2022Publication date: May 12, 2022Inventors: Xudong FANG, Ziyan FANG, Chen WU, Hao SUN, Libo ZHAO, Bian TIAN, Zhuangde JIANG, Wubin DENG, Bonan GAO, Junxia WU, Songli WANG, Nan ZHU
-
Patent number: 11301969Abstract: Some implementations provide improved user experiences on head mounted devices (HMDs) that provide near eye viewing, e.g., HMDs that display distorted images and provide lenses that undistort the images for the user. The images are produced using distortion that is corrected dynamically based on context to conserve device resources. To do so, a context associated with a state of the user, the HMD, or content being viewed on the HMD is tracked during the user experience. For example, the device may predict pupil position, eye state, eye gaze direction, or eye fixation, content type, connection mode, and other context. The device uses the tracked context to determine how to correct distortion for the images at different points during the user experience. For example, new distortion corrections may be computed and used while the user's gaze is moving and previously-determined distortion corrections may be used while the user's gaze is fixed.Type: GrantFiled: September 19, 2019Date of Patent: April 12, 2022Assignee: Apple Inc.Inventors: Moinul Khan, Simon Fortin-Deschenes, Yanli Zhang, Bennett S. Wilburn, Sterling G. Orsten, Nan Zhu, James Zhou
-
Patent number: 11295439Abstract: A method, a device and a computer program product for image processing are proposed. In the method, a first training image and region information are obtained. The region information indicates a region of a defect in the first training image. A second training image with the defect at least partially removed is generated using an image generator based on the first training image and the region information. The image generator is trained to recover the first training image by replacing pixels included in the region indicated by the region information. The image generator is updated based on the second training image. In this way, the image including the defect can be accurately and efficiently recovered.Type: GrantFiled: October 16, 2019Date of Patent: April 5, 2022Assignee: International Business Machines CorporationInventors: Fan Li, Guo Qiang Hu, Jun Zhu, Sheng Nan Zhu, JingChang Huang, Yuan Yuan Ding, Peng Ji