Patents by Inventor Yandong Guo
Yandong Guo has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240029297Abstract: Provided are a visual positioning method, a non-transitory computer-readable storage medium and an electronic device. Surface normal vectors of a current image frame is obtained. A first transformation parameter between the current image frame and a reference image frame is determined, by projecting the surface normal vectors to a Manhattan coordinate system. A matching operation between feature points of the current image frame and feature points of the reference image frame is performed, and a second transformation parameter between the current image frame and the reference image frame is determined based on a matching result. A target transformation parameter is obtained, based on the first transformation parameter and the second transformation parameter. A visual localization result corresponding to the current image frame is output, based on the target transformation parameter.Type: ApplicationFiled: September 25, 2023Publication date: January 25, 2024Inventors: Yuhao Zhou, Jijunnan Li, Yandong Guo
-
Patent number: 11332145Abstract: Apparatus for controlling a brightness of a display of a vehicle includes: an infrared illuminator, configured to emit infrared light in the vehicle; a near infrared (NIR) light sensing unit, configured to capture reflected infrared light; an image data processing unit, configured to analyze the reflected infrared light to generate a feedback; an imaging control unit, configured to adjust, in response to the feedback, one or more of a plurality of properties of the NIR light sensing unit, so that readouts of the NIR light sensing unit are within a first range, wherein the image data processing unit generates a calculated NIR intensity readout under the adjusted properties; a reconstruction unit, configured to reconstruct a human perceived brightness based on the calculated NIR intensity readout; and the display, configured to adjust the brightness. The NIR light sensing unit is a unit of a driver monitoring system (DMS).Type: GrantFiled: June 13, 2019Date of Patent: May 17, 2022Assignee: GUANGZHOU XIAOPENG AUTOPILOT TECHNOLOGY CO., LTD.Inventors: Zhe Li, Cheng Lu, Tianpeng Feng, Yandong Guo, Jun Ma
-
Patent number: 11176384Abstract: An apparatus for object detection around a vehicle includes an imaging device mounted on the vehicle and a computing device. The imaging device is used to capture a video of an exterior environment of the vehicle. The computing device is used to execute a DSFPN module in order to provide a DSFPN model detector, which functions as a perception unit to process and analyze the video captured by the imaging device and to estimate a scale, a location and categories of an object. The DSFPN model detector includes a bottom-up subnet provided with auxiliary prediction heads, and a top-down subnet provided with prediction heads. When the DSFPN model detector is performed in a model training stage, both the prediction heads and the auxiliary prediction heads are used. In a detection stage, only the prediction heads are used in the DSFPN model detector, and the auxiliary prediction heads are removed.Type: GrantFiled: September 18, 2020Date of Patent: November 16, 2021Assignee: XMOTORS.AI INC.Inventors: Fan Yang, Tianshuo Zhang, Cheng Lu, Yandong Guo
-
Patent number: 11068701Abstract: Apparatus for vehicle driver recognition includes: a NIR LED illuminator, configured to emit NIR light in the vehicle; a NIR light sensing unit, configured to capture reflected NIR light; an image controlling and processing unit, configured to coordinate the NIR LED illuminator and the NIR light sensing unit, and analyze the reflected NIR light to generate an image; a face detector, configured to determine that a human face exists in the image, and identify a face region; a face feature extractor, configured to analyze the face region to extract a feature vector representing the face region; a face feature dictionary, configured to store existing feature vectors; a face retrieval system, configured to generate an identification result, indicating whether a similarity between the feature vector and any of the existing feature vectors is greater than a first threshold; and a user interface, configured to display the identification result.Type: GrantFiled: June 13, 2019Date of Patent: July 20, 2021Assignee: XMOTORS.AI INC.Inventors: Cong Zhang, Tianpeng Feng, Cheng Lu, Yandong Guo, Jun Ma
-
Publication number: 20200394390Abstract: Apparatus for vehicle driver recognition includes: a NIR LED illuminator, configured to emit NIR light in the vehicle; a NIR light sensing unit, configured to capture reflected NIR light; an image controlling and processing unit, configured to coordinate the NIR LED illuminator and the NIR light sensing unit, and analyze the reflected NIR light to generate an image; a face detector, configured to determine that a human face exists in the image, and identify a face region; a face feature extractor, configured to analyze the face region to extract a feature vector representing the face region; a face feature dictionary, configured to store existing feature vectors; a face retrieval system, configured to generate an identification result, indicating whether a similarity between the feature vector and any of the existing feature vectors is greater than a first threshold; and a user interface, configured to display the identification result.Type: ApplicationFiled: June 13, 2019Publication date: December 17, 2020Inventors: Cong Zhang, Tianpeng Feng, Cheng Lu, Yandong Guo, Jun Ma
-
Publication number: 20200391749Abstract: Apparatus for controlling a brightness of a display of a vehicle includes: an infrared illuminator, configured to emit infrared light in the vehicle; a near infrared (NIR) light sensing unit, configured to capture reflected infrared light; an image data processing unit, configured to analyze the reflected infrared light to generate a feedback; an imaging control unit, configured to adjust, in response to the feedback, one or more of a plurality of properties of the NIR light sensing unit, so that readouts of the NIR light sensing unit are within a first range, wherein the image data processing unit generates a calculated NIR intensity readout under the adjusted properties; a reconstruction unit, configured to reconstruct a human perceived brightness based on the calculated NIR intensity readout; and the display, configured to adjust the brightness. The NIR light sensing unit is a unit of a driver monitoring system (DMS).Type: ApplicationFiled: June 13, 2019Publication date: December 17, 2020Inventors: Zhe Li, Cheng Lu, Tianpeng Feng, Yandong Guo, Jun Ma
-
Patent number: 10696305Abstract: Apparatus and method for measuring physiological information of a living subject in a vehicle are provided. The apparatus includes an illumination unit configured to emit light at a wavelength and illuminate a region of interest (ROI) of the living subject with the emitted light; a light sensing unit configured to remotely acquire signals of light in a range of wavelengths reflected from the ROI of the living subject responsive to the illumination; a remote photoplethysmography (PPG) extraction unit configured to extract PPG signals from the acquired signals of light; a PPG processing unit configured to process the extracted PPG signals in the form of vital signs and subsequently determine a physical and psychological status of the living subject according to the vital signs; and a control unit configured to activate the illumination unit in a time-varying pattern and to activate the light sensing unit accordingly.Type: GrantFiled: November 15, 2018Date of Patent: June 30, 2020Assignee: XMOTORS.AI INC.Inventors: Tianshuo Zhang, Yandong Guo, Cheng Lu
-
Patent number: 10691981Abstract: Methods, systems, and computer programs are presented for training a deep neural network (DNN). One method includes an operation for training a predecessor network defined for image recognition of items, where parameters of a predecessor classifier are initialized with random numbers sampled from a predetermined distribution, and the predecessor classifier utilizes an image-classification probability function without bias. The method further includes an operation for training a successor network defined for image recognition of items in a plurality of classes, where parameters of a successor classifier are initialized with parameters learned from the predecessor network, and the successor classifier utilizes the image-classification probability function without bias. Further, the method includes operations for receiving an image for recognition, and recognizing the image utilizing the successor classifier.Type: GrantFiled: March 11, 2019Date of Patent: June 23, 2020Assignee: Microsoft Technology Licensing, LLCInventors: Yandong Guo, Yuxiao Hu, Christopher J Buehler, Cornelia Carapcea, Lei Zhang
-
Publication number: 20200156648Abstract: Apparatus and method for measuring physiological information of a living subject in a vehicle are provided. The apparatus includes an illumination unit configured to emit light at a wavelength and illuminate a region of interest (ROI) of the living subject with the emitted light; a light sensing unit configured to remotely acquire signals of light in a range of wavelengths reflected from the ROI of the living subject responsive to the illumination; a remote photoplethysmography (PPG) extraction unit configured to extract PPG signals from the acquired signals of light; a PPG processing unit configured to process the extracted PPG signals in the form of vital signs and subsequently determine a physical and psychological status of the living subject according to the vital signs; and a control unit configured to activate the illumination unit in a time-varying pattern and to activate the light sensing unit accordingly.Type: ApplicationFiled: November 15, 2018Publication date: May 21, 2020Inventors: Tianshuo Zhang, Yandong Guo, Cheng Lu
-
Patent number: 10546232Abstract: Methods, systems, and computer programs are presented for a classifier that recognizes images when at least one class includes just a few training samples. One method includes identifying a training set containing samples, each sample associated with a class from many classes. Further, the method divides the training set into a base and a novel set based on the number of samples in each class, trains a first classifier with the base set, and trains a second classifier using the training set. The second classifier is trained with promotion of the novel set and based on minimizing a loss function that comprises a first term and a second term, the first term associated with a first summation for the samples of the training set, the second term associated with a second summation for the samples of the novel set. Further, the method classifies an item with the trained second classifier.Type: GrantFiled: October 2, 2017Date of Patent: January 28, 2020Assignee: Microsoft Technology Licensing, LLCInventors: Yandong Guo, Lei Zhang
-
Publication number: 20190385073Abstract: Systems and methods for visual recognition via light weight neural network are disclosed. A method includes accessing an input matrix. The method includes processing the input matrix through a plurality of convolution layers from a neural network architecture, each convolution layer including a convolution layer kernel, to generate a processed matrix, the convolution layer kernel being a first square, a side dimension of the first square being an integer greater than or equal to two. The method includes processing, at the processing hardware, the processed matrix through at least one squeeze layer, the at least one squeeze layer including a squeeze layer kernel, to generate an output matrix, the squeeze layer kernel being a second square with a side dimension of one, the at least one squeeze layer replacing at least one convolution layer from the neural network architecture. The method includes providing a representation of the output matrix.Type: ApplicationFiled: June 19, 2018Publication date: December 19, 2019Inventors: Yandong Guo, Lei Zhang
-
Publication number: 20190311258Abstract: Strategies for improved neural network fine tuning. Parameters of the task-specific layer of a neural network are initialized using approximate solutions derived by a variant of a linear discriminant analysis algorithm. One method includes: inputting training data into a deep neural network having an output layer from which output is generated in a manner consistent with one or more classification tasks; evaluating a distribution of the data in a feature space between a hidden layer and the output layer; and initializing, non-randomly, the parameters of the output layer based on the evaluated distribution of the data in the feature space.Type: ApplicationFiled: April 5, 2018Publication date: October 10, 2019Inventors: Lei ZHANG, Rong XIAO, Christopher BUEHLER, Anna Samantha ROTH, Yandong GUO, Jianfeng WANG
-
Publication number: 20190205705Abstract: Methods, systems, and computer programs are presented for training a deep neural network (DNN). One method includes an operation for training a predecessor network defined for image recognition of items, where parameters of a predecessor classifier are initialized with random numbers sampled from a predetermined distribution, and the predecessor classifier utilizes an image-classification probability function without bias. The method further includes an operation for training a successor network defined for image recognition of items in a plurality of classes, where parameters of a successor classifier are initialized with parameters learned from the predecessor network, and the successor classifier utilizes the image-classification probability function without bias. Further, the method includes operations for receiving an image for recognition, and recognizing the image utilizing the successor classifier.Type: ApplicationFiled: March 11, 2019Publication date: July 4, 2019Inventors: Yandong Guo, Yuxiao Hu, Christopher J. Buehler, Cornelia Carapcea, Lei Zhang
-
Patent number: 10262240Abstract: Methods, systems, and computer programs are presented for training a deep neural network (DNN). One method includes an operation for training a predecessor network defined for image recognition of items, where parameters of a predecessor classifier are initialized with random numbers sampled from a predetermined distribution, and the predecessor classifier utilizes an image-classification probability function without bias. The method further includes an operation for training a successor network defined for image recognition of items in a plurality of classes, where parameters of a successor classifier are initialized with parameters learned from the predecessor network, and the successor classifier utilizes the image-classification probability function without bias. Further, the method includes operations for receiving an image for recognition, and recognizing the image utilizing the successor classifier.Type: GrantFiled: August 14, 2017Date of Patent: April 16, 2019Assignee: Microsoft Technology Licensing, LLCInventors: Yandong Guo, Yuxiao Hu, Christopher J Buehler, Cornelia Carapcea, Lei Zhang
-
Patent number: 10248666Abstract: A method of creating a hierarchical dictionary comprises, with a processor, extracting a number of symbols from a first image, constructing a number of refinement dictionary entries based on the symbols, the refinement dictionary entries forming a refinement dictionary, grouping a number of the refinement dictionary entries into clusters to form a number of refinement dictionary entry clusters, and constructing a number of direct dictionary entries for each of the refinement dictionary entry clusters, the direct dictionary entries forming a direct dictionary.Type: GrantFiled: April 30, 2013Date of Patent: April 2, 2019Assignees: Hewlett-Packard Development Company, L.P., Purdue Research FoundationInventors: Dejan Depalov, Peter Bauer, Yandong Guo, Jay Allebach, Charles A. Bouman
-
Publication number: 20190050689Abstract: Methods, systems, and computer programs are presented for training a deep neural network (DNN). One method includes an operation for training a predecessor network defined for image recognition of items, where parameters of a predecessor classifier are initialized with random numbers sampled from a predetermined distribution, and the predecessor classifier utilizes an image-classification probability function without bias. The method further includes an operation for training a successor network defined for image recognition of items in a plurality of classes, where parameters of a successor classifier are initialized with parameters learned from the predecessor network, and the successor classifier utilizes the image-classification probability function without bias. Further, the method includes operations for receiving an image for recognition, and recognizing the image utilizing the successor classifier.Type: ApplicationFiled: August 14, 2017Publication date: February 14, 2019Inventors: Yandong Guo, Yuxiao Hu, Christopher J Buehler, Cornelia Carapcea, Lei Zhang
-
Patent number: 10185885Abstract: A system and method for text line detection are described Examples include detection of symbols in an image received from an image-capturing device. In examples, for each of at least some of the symbols, neighboring symbols within a local region a given distance from the symbol are analyzed in order to determine a direction for a line in the local region. In examples, based on the determined directions for the lines, text lines in the image are identified.Type: GrantFiled: October 31, 2014Date of Patent: January 22, 2019Assignees: Hewlett-Packard Development Company, L.P., Purdue Research FoundationInventors: Peter Bauer, Yandong Guo, Jan Allebach, Charles Bouman
-
Publication number: 20190012526Abstract: Methods, systems, and computer programs are presented for a classifier that recognizes images when at least one class includes just a few training samples. One method includes identifying a training set containing samples, each sample associated with a class from many classes. Further, the method divides the training set into a base and a novel set based on the number of samples in each class, trains a first classifier with the base set, and trains a second classifier using the training set. The second classifier is trained with promotion of the novel set and based on minimizing a loss function that comprises a first term and a second term, the first term associated with a first summation for the samples of the training set, the second term associated with a second summation for the samples of the novel set. Further, the method classifies an item with the trained second classifier.Type: ApplicationFiled: October 2, 2017Publication date: January 10, 2019Inventors: Yandong Guo, Lei Zhang
-
Patent number: 10061866Abstract: A user query may be evaluated to provide a result set. In case the results do not reflect the user's intent, the device may provide recourse options for adjusting the query in a manner that yields more desirable results, e.g., a suggestion at the top of the result set for a different spelling, or recommendations at the end of the results set for additional query techniques that may yield more accurate results. However, such presentation of recourse options may clutter the user interface and/or go unnoticed by the user. Instead, an adjusted query may be identified with an interpreted probability of reflecting the intent of the query. An adjustment option describing the adjusted query may be inserted into the result set, between a higher-probability first result and a lower-probability second result. Selection of the adjustment option may cause the adjusted query to be evaluated on behalf of the user.Type: GrantFiled: June 25, 2015Date of Patent: August 28, 2018Assignee: Microsoft Technology Licensing, LLCInventors: Yogesh Ajit Vaidya, Hua Ding, Nan Wu, Aaron Chun Win Yuen, Karim Hasham, Parthasarathy Govindarajen, Arun Sacheti, Yanfeng Sun, Yandong Guo, Deepak Santhanam
-
Publication number: 20170262726Abstract: A system and method for text line detection are described Examples include detection of symbols in an image received from an image-capturing device. In examples, for each of at least some of the symbols, neighboring symbols within a local region a given distance from the symbol are analyzed in order to determine a direction for a line in the local regions In examples, based on the determined directions for the lines, text lines in the image are identified.Type: ApplicationFiled: October 31, 2014Publication date: September 14, 2017Inventors: Peter Bauer, Yandong Guo, Jan Allebach, Charles Bouman