Patents by Inventor Lei Nie

Lei Nie has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230214985
    Abstract: A product recognition method and device, a model training method and device, and an electronic device are provided. The product recognition method includes: obtaining image data of a product; performing defect recognition on the image data based on a first recognition model, to obtain a first recognition result, wherein the first recognition model is configured to recognize a defective product; performing qualification recognition on the image data based on a second recognition model to obtain a second recognition result, wherein the second recognition model is configured to recognize a qualified product; determining a target recognition result of the product based on the first recognition result and the second recognition result.
    Type: Application
    Filed: March 10, 2023
    Publication date: July 6, 2023
    Applicant: Beijing Baidu Netcom Science Technology Co., Ltd.
    Inventors: Shuo LI, Feng HUANG, Lei NIE, Xuepeng ZHAO, Luyan CHEN
  • Patent number: 11681875
    Abstract: The present application discloses a method for image text recognition, an apparatus, a device, and a storage medium, and relates to image processing technologies in the field of cloud computing. A specific implementation is: acquiring an image to be processed, where at least one text line exists in the image to be processed; processing each text line in the image to be processed to obtain a composite encoded vector corresponding to each word in each text line, where the composite encoded vector carries semantic information and position information; and determining a text recognition result of the image to be processed according to the semantic information and the position information carried in the composite encoded vector corresponding to each word in each text line. This technical solution can accurately distinguish adjacent fields with small pixel spacing in the image and improve the accuracy of text recognition in the image.
    Type: Grant
    Filed: August 4, 2020
    Date of Patent: June 20, 2023
    Assignee: BEIJING BAIDU NETCOM SCIENCE TECHNOLOGY CO., LTD.
    Inventors: Xiangkai Huang, Leyi Wang, Lei Nie, Siyu An, Minghao Liu, Jiangliang Guo
  • Publication number: 20230188816
    Abstract: A system includes a camera housing and a control device associated with an autonomous vehicle. The camera housing houses a camera, and is mounted to an autonomous vehicle. The camera housing comprises a glass positioned in front of the camera. The glass is coated with a set of materials comprising a hydrophobic material and an anti-reflective material. The set of materials is configured to reduce ghosting effect on an image captured by the camera. The camera housing further comprises a top portion and a bottom portion. The top portion extends beyond the bottom portion to form a tilt angle. The tilt angle is configured to reduce indirect light from coming into a field of view of the camera. The processor facilitates autonomous driving of the autonomous vehicle using at least the image. The ghosting effect is reduced in the image due to using the set of materials.
    Type: Application
    Filed: December 8, 2022
    Publication date: June 15, 2023
    Inventors: Lei Nie, Todd B. Skinner, Xiaoling Han, Lei Wang
  • Patent number: 11676358
    Abstract: The present application discloses a method and apparatus for digitizing paper data, an electronic device and a storage medium, relating to fields of image processing and cloud computing, in particular to image recognition technologies. The method includes: determining a standard template according to an image to be processed and mark information corresponding to the image to be processed, wherein the image to be processed is obtained by photographing paper data and the standard template is used to represent a reference coordinate system of the image to be processed; recognizing graphic handwriting information comprised in the image to be processed; and generating digitized data corresponding to the image to be processed according to the graphic handwriting information and the standard template.
    Type: Grant
    Filed: June 16, 2021
    Date of Patent: June 13, 2023
    Assignee: Beijing Baidu Netcom Science Technology Co., Ltd.
    Inventors: Yabo Liu, Jianfa Zou, Lei Nie, Feng Huang
  • Patent number: 11615524
    Abstract: A product defect detection method and apparatus, an electronic device, and a storage medium are provided. A method includes: acquiring a multi-channel image of a target product; inputting the multi-channel image to a defect detection model, wherein the defect detection model includes a plurality of convolutional branches, a merging module and a convolutional headbranch; performing feature extraction on each channel in the multi-channel image by using the plurality of convolutional branches, to obtain a plurality of first characteristic information; merging the plurality of first characteristic information by using the merging module, to obtain second characteristic information; performing feature extraction on the second characteristic information by using the convolutional headbranch, to obtain third characteristic information to be output by the defect detection model; and determining defect information of the target product based on the third characteristic information.
    Type: Grant
    Filed: January 7, 2021
    Date of Patent: March 28, 2023
    Assignee: Beijing Baidu Netcom Science Technology Co., Ltd.
    Inventors: Ye Su, Lei Nie, Jianfa Zou, Feng Huang
  • Publication number: 20230020379
    Abstract: Embodiments of this application disclose a method for updating a captured picture in a game application performed by a computer device. The method includes: displaying, on a graphical interface, a first captured picture of a game scene of a game application and a lens operation control in the first captured picture; and displaying a second captured picture in response to a touch operation performed by a user on the lens operation control, the second captured picture being obtained by adjusting a pose of a lens within a plane where the lens is located based on the touch operation and capturing a picture of the game scene of the game application with the pose-adjusted lens, and the plane where the lens is located being a plane that is perpendicular to an orientation of the lens.
    Type: Application
    Filed: September 22, 2022
    Publication date: January 19, 2023
    Inventors: Zhixing CHEN, Lei NIE
  • Patent number: 11555921
    Abstract: Embodiments of the present disclosure provide a method and apparatus for predicting a severe convection weather. The method may include: acquiring a current radar echo map sequence, the current radar echo map sequence being a radar echo map sequence within a current time period; generating, based on the current radar echo map sequence, a future radar echo map sequence, the future radar echo map sequence being a radar echo map sequence within a future time period; and inputting the future radar echo map sequence into a pre-trained severe convection weather predicting model to obtain a severe convection weather intensity predicting map, where the severe convection weather predicting model is used to predict the intensity of a severe convection weather.
    Type: Grant
    Filed: December 19, 2019
    Date of Patent: January 17, 2023
    Assignee: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
    Inventors: Huihui Xiao, Lei Nie, Jiangliang Guo, Xu Li
  • Publication number: 20220305429
    Abstract: A filter element for coupling adsorption and regeneration of volatile organic compounds and a purification device are provided. The filter element includes a filter element body, a photocatalytic mechanism and adsorption-filtration body(s). The adsorption-filtration body(s) may be of a hollow columnar structure where the photocatalytic mechanism is located. VOCs are quickly adsorbed by the adsorption-filtration body(s), then thermal desorption regeneration is performed on the adsorption-filtration body(s) during a time interval of stopping discharging of the exhaust gas, and a photocatalysis technology is used to cyclically purify the thermally desorbed VOCs, which achieves the synergy of high-density and purification in the two technologies. Furthermore, it takes full advantages of high adsorption, filtration and purification efficiency, low photolysis catalysis costs, and easy operation and maintenance of the on-site regeneration.
    Type: Application
    Filed: June 17, 2021
    Publication date: September 29, 2022
    Applicant: BEIJING MUNICIPAL RESEARCH INSTITUTE OF ENVIRONMENTAL PROTECTION
    Inventors: Aijun SHI, Lei NIE, Wanqing HE, Tianyi WANG, Zhen YAO, Zhiping WANG
  • Publication number: 20220270228
    Abstract: A method and an apparatus for obtaining information are provided. The method may include: obtaining at least one image feature from a to-be-inspected image, where the to-be-inspected image includes an image of a to-be-inspected item, and the image feature is used to represent surface feature information of the to-be-inspected item; and importing the to-be-inspected image and the at least one image feature into a pre-trained defect detection model to obtain defect information corresponding to the to-be-inspected item, where the defect detection model is obtained by training using a sample image, a sample image feature and sample defect information, and configured to represent a corresponding relationship between the to-be-inspected image and the at least one image feature.
    Type: Application
    Filed: July 19, 2021
    Publication date: August 25, 2022
    Inventors: Ye Su, Sike Ren, Lei Nie, Feng Huang
  • Publication number: 20220229759
    Abstract: The present disclosure relates to intelligent driving technology, and provides a method, device, and system for simulation test. The method includes: retrieving data in a first format for a first sensor from a database; processing the data in the first format to obtain corresponding data in a second format, the second format being a format of data collection of the first sensor; and transmitting the data in the second format to a second computing device capable of performing a simulation test based on the data in the second format. The present disclosure can provide a simulation test solution for an intelligent system by providing a simulation test environment closer to the real-world environment.
    Type: Application
    Filed: January 18, 2022
    Publication date: July 21, 2022
    Inventors: Yuyong WANG, Qingyu SUI, Pingyuan JI, Jianan HAO, Lei NIE, Haocheng WANG
  • Publication number: 20220182213
    Abstract: Devices, systems, and methods for hardware-based time synchronization for heterogenous sensors are described. An example method includes generating a plurality of input trigger pulses having a nominal pulse-per-second (PPS) rate, generating, based on timing information derived from the plurality of input trigger pulses, a plurality of output trigger pulses, and transmitting the plurality of output trigger pulses to a sensor of a plurality of sensors, wherein a frequency of the plurality of output trigger pulses corresponds to a target operating frequency of the sensor, wherein, in a case that a navigation system coupled to the synchronization unit is functioning correctly, the plurality of input trigger pulses is generated based on a nominal PPS signal from the navigation unit, and wherein, in a case that the navigation system is not functioning correctly, the plurality of input trigger pulses is generated based on a simulated clock source of the synchronization unit.
    Type: Application
    Filed: February 26, 2021
    Publication date: June 9, 2022
    Inventors: Xiaoling HAN, Junjun XIN, Lei NIE, Yue PAN, Yu ZHANG, Jade E. DAY, Zehua HUANG, Esayas NAIZGHI, Pingyuan JI, Zhiqi GONG
  • Publication number: 20220036533
    Abstract: Provided are an image defect detection method and apparatus, an electronic device, a storage medium and a product. The method includes acquiring a to-be-detected image; obtaining a restored image corresponding to the to-be-detected image based on the to-be-detected image, at least one mask image group and a plurality of defect-free positive sample images, where each mask image group includes at least two binary images having a complementary relationship, and different mask image groups have different image sizes; and locating a defect of the to-be-detected image based on the to-be-detected image and each restored image. The solution solves the problem in which a related defect detection method requires numerous manual operations and has a low detection accuracy due to subjective factors of a worker.
    Type: Application
    Filed: August 11, 2021
    Publication date: February 3, 2022
    Applicant: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
    Inventors: Huihui XIAO, Lei NIE, Jianfa ZOU, Feng HUANG
  • Publication number: 20220004752
    Abstract: The present application discloses a method and apparatus for digitizing paper data, an electronic device and a storage medium, relating to fields of image processing and cloud computing, in particular to image recognition technologies. According to the solution provided by the present application, graphic handwriting information included in an image to be processed can be recognized, and the handwriting information can be combined with a reference coordinate system of the image to be processed to obtain digitized data, in this way, paper data can still be converted into digitized data even when graphic data is included in the paper data.
    Type: Application
    Filed: June 16, 2021
    Publication date: January 6, 2022
    Inventors: Yabo Liu, Jianfa Zou, Lei Nie, Feng Huang
  • Publication number: 20210404952
    Abstract: A method for selection of a calibration set and a validation set based on spectral similarity and modeling. The method includes: performing NIR spectrometry on original samples to obtain a spectral matrix of the original samples; randomly selecting m samples as an independent test set; calculating spectral similarity between each of the samples in the independent test set and each of the remaining samples in the original samples respectively to obtain g samples having the highest similarity to be written into the validation set; and calculating spectral similarity between each of the samples in the validation set and each of the remaining samples in the original samples respectively to obtain n samples having the highest similarity to be written into the calibration set. Based on the validation set and the calibration set selected through the method, an obtained model can predict unknown samples more accurately.
    Type: Application
    Filed: October 14, 2020
    Publication date: December 30, 2021
    Applicant: SHANDONG UNIVERSITY
    Inventors: Lei NIE, Yue SUN, Hengchang ZANG, Yingzi ZENG, Xiaoyan LIU, Mei SU, Meng YUAN, Linlin WANG, Hong JIANG, Guangyi CHU
  • Publication number: 20210405651
    Abstract: A method for controlling an autonomous vehicle includes collecting data about a surrounding of the autonomous vehicle, the data including global information of where the autonomous vehicle is positioned; deriving, at least in part based on the collected data, a perceived environment based on localizing the global information; determining a driving condition of the autonomous vehicle based on the perceived environment; modifying, according to the determined driving condition, a first configuration parameter of a sensor to adjust an amount of output data from the sensor; and simultaneously adjusting, according to the determined driving condition, a second configuration parameter for processing the output data to allow consistent data capturing and processing of the output data. A control system can employ such a method, and an autonomous vehicle can utilize such a control system.
    Type: Application
    Filed: June 25, 2021
    Publication date: December 30, 2021
    Inventors: Yue PAN, Lei NIE, Dangyi LIU, Juexiao NING, Jun LUO
  • Publication number: 20210407062
    Abstract: A product defect detection method and apparatus, an electronic device, and a storage medium are provided. A method includes: acquiring a multi-channel image of a target product; inputting the multi-channel image to a defect detection model, wherein the defect detection model includes a plurality of convolutional branches, a merging module and a convolutional headbranch; performing feature extraction on each channel in the multi-channel image by using the plurality of convolutional branches, to obtain a plurality of first characteristic information; merging the plurality of first characteristic information by using the merging module, to obtain second characteristic information; performing feature extraction on the second characteristic information by using the convolutional headbranch, to obtain third characteristic information to be output by the defect detection model; and determining defect information of the target product based on the third characteristic information.
    Type: Application
    Filed: January 7, 2021
    Publication date: December 30, 2021
    Applicant: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
    Inventors: Ye SU, Lei NIE, Jianfa ZOU, Feng HUANG
  • Publication number: 20210344849
    Abstract: Disclosed are devices and systems for an optimized sensor layout for an autonomous or semi-autonomous vehicle. In one aspect, the system includes a vehicle capable of semi-autonomous or autonomous operation. A plurality of forward-facing cameras is coupled to the vehicle and configured to have a field of view in front of the vehicle. At least three forward-facing cameras of the plurality of forward-facing cameras have different focal lengths. A right-side camera is coupled to the right side of the vehicle, the right-side camera configured to have a field of view to the right of the vehicle. A left-side camera is coupled to the left side of the vehicle, the left-side camera is configured to have a field of view to the left of the vehicle.
    Type: Application
    Filed: July 13, 2021
    Publication date: November 4, 2021
    Inventor: Lei NIE
  • Patent number: 11076109
    Abstract: Disclosed are devices and systems for an optimized sensor layout for an autonomous or semi-autonomous vehicle. In one aspect, the system includes a vehicle capable of semi-autonomous or autonomous operation. A plurality of forward-facing cameras is coupled to the vehicle and configured to have a field of view in front of the vehicle. At least three forward-facing cameras of the plurality of forward-facing cameras have different focal lengths. A right-side camera is coupled to the right side of the vehicle, the right-side camera configured to have a field of view to the right of the vehicle. A left-side camera is coupled to the left side of the vehicle, the left-side camera is configured to have a field of view to the left of the vehicle.
    Type: Grant
    Filed: September 16, 2019
    Date of Patent: July 27, 2021
    Assignee: TUSIMPLE, INC.
    Inventor: Lei Nie
  • Publication number: 20210084235
    Abstract: Disclosed are devices and systems for an optimized sensor layout for an autonomous or semi-autonomous vehicle. In one aspect, the system includes a vehicle capable of semi-autonomous or autonomous operation. A plurality of forward-facing cameras is coupled to the vehicle and configured to have a field of view in front of the vehicle. At least three forward-facing cameras of the plurality of forward-facing cameras have different focal lengths. A right-side camera is coupled to the right side of the vehicle, the right-side camera configured to have a field of view to the right of the vehicle. A left-side camera is coupled to the left side of the vehicle, the left-side camera is configured to have a field of view to the left of the vehicle.
    Type: Application
    Filed: September 16, 2019
    Publication date: March 18, 2021
    Inventor: Lei NIE
  • Publication number: 20210081729
    Abstract: The present application discloses a method for image text recognition, an apparatus, a device, and a storage medium, and relates to image processing technologies in the field of cloud computing. A specific implementation is: acquiring an image to be processed, where at least one text line exists in the image to be processed; processing each text line in the image to be processed to obtain a composite encoded vector corresponding to each word in each text line, where the composite encoded vector carries semantic information and position information; and determining a text recognition result of the image to be processed according to the semantic information and the position information carried in the composite encoded vector corresponding to each word in each text line. This technical solution can accurately distinguish adjacent fields with small pixel spacing in the image and improve the accuracy of text recognition in the image.
    Type: Application
    Filed: August 4, 2020
    Publication date: March 18, 2021
    Inventors: Xiangkai HUANG, Leyi WANG, Lei NIE, Siyu AN, Minghao LIU, Jiangliang GUO