Patents by Inventor Manoj Aggarwal

Manoj Aggarwal has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 12277794
    Abstract: An input device determines presence of an actual user, instead of an artifact, by using multi-wavelength reflectance spectroscopy. Light sources are operated to illuminate an object with different colors of light at different times. A detector determines, at those different times, intensity data indicative of intensity light of these different colors as reflected from the object. The intensity data is processed to determine whether the object is part of a user or is an artifact. For example, if the object is deemed to be a user, biometric input may be acquired. The biometric input may then be processed to identify the user. The input device may be used at various locations, such as at an entry portal, point of sale, and so forth.
    Type: Grant
    Filed: June 3, 2021
    Date of Patent: April 15, 2025
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Baomin Wang, Umer Shahid, Tianyi Wang, Georgios Skolianos, Rui Zhao, Manoj Aggarwal, Gerard Guy Medioni
  • Patent number: 12271456
    Abstract: Maintaining the security of biometric data is an utmost priority. Biometric data is secured using one or more techniques. With one technique, biometric input such as images of a user's palm is used to generate first primary data (PD). The original biometric input is deleted from temporary secure storage while the first PD is securely stored. The first PD may then be processed later to determine a second PD. The first PD may then be deleted, and the second PD subsequently used. With another technique, biometric input or a PD may be processed by a first model to determine first secondary data (SD) that is representative of features of a particular user within a first embedding space. Later the PD may be processed by a second model to determine a second SD in a second embedding space. The first SD is deleted, and the second SD subsequently used.
    Type: Grant
    Filed: June 23, 2022
    Date of Patent: April 8, 2025
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Manoj Aggarwal, Gerard Guy Medioni, Chad Desjardins, Dilip Kumar
  • Patent number: 12254718
    Abstract: User enrollment to a biometric identification system begins on selected general input devices (GID) such as smartphones. The user may enter identification data (e.g. name) and use a red-green-blue (RGB) camera of the GID to acquire a first image (e.g. hand). The first image is processed using both a first model to determine a first representation and a second model to determine a second representation. Upon presentation of a hand at a biometric input device, a second image is acquired using a first modality and a third image is acquired using a second modality. The second image is processed using the first model to determine a third representation. The third image is processed using the second model to determine a fourth representation. Given a match between both the first and third representations, as well as the second and fourth representations, enrollment is completed by storing the third and fourth representations.
    Type: Grant
    Filed: March 25, 2024
    Date of Patent: March 18, 2025
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Quanfu Fan, Hongcheng Wang, Carlos D. Castillo, Manoj Aggarwal, Gerard Guy Medioni
  • Patent number: 12236709
    Abstract: This disclosure describes techniques for identifying users that are enrolled for use of a user-recognition system and updating enrollment data of these users over time. To enroll in the user-recognition system, the user may initially scan his or her palm. The resulting image data may later be used when the user requests to be identified by the system by again scanning his or her palm. However, because the characteristics of user palms may change over the time, the user-recognition system may continue to build more and more data for use in recognizing the user, in addition to removing older data that may no longer accurately represent current characteristics of respective user palms.
    Type: Grant
    Filed: March 28, 2022
    Date of Patent: February 25, 2025
    Assignee: Amazon Technologies, Inc.
    Inventors: Manoj Aggarwal, Jason Garfield, Korwin Jon Smith, Jordan Tyler Williams
  • Patent number: 12230052
    Abstract: Images of a hand are obtained by a camera. A pose of the hand relative to the camera may vary due to rotation, translation, articulation of joints in the hand, and so forth. Avatars comprising texture maps from images of actual hands and three-dimensional models that describe the shape of those hands are manipulated into different poses and articulations to produce synthetic images. Given that the mapping of points on an avatar to the synthetic image is known, highly accurate annotation data is produced that relates particular points on the avatar to the synthetic image. An artificial neural network (ANN) is trained using the synthetic images and corresponding annotation data. The trained ANN processes a first image of a hand to produce a second image of the hand that appears to be in a standardized or canonical pose. The second image may then be processed to identify the user.
    Type: Grant
    Filed: December 12, 2019
    Date of Patent: February 18, 2025
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Igor Kviatkovsky, Nadav Israel Bhonker, Yevgeni Nogin, Roman Goldenberg, Manoj Aggarwal, Gerard Guy Medioni
  • Patent number: 12190566
    Abstract: Enhanced training data representative of possible inputs is used to train a machine learning system. For example, a machine learning system to determine identity based on an image of a human palm may be trained using enhanced training data comprising images. The enhanced training data may comprise source images that have been modified to appear to depict synthetic artifacts that attempt to simulate human palms, augmented images of dirty hands, and so forth. A synthetic artifact image may be produced by selectively removing some data from a source image. An augmented image may be produced by selectively blending the source image with features extracted from sample images. These images may then be used as training data to train the machine learning system.
    Type: Grant
    Filed: February 28, 2022
    Date of Patent: January 7, 2025
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Lavisha Aggarwal, Manoj Aggarwal, Gerard Guy Medioni, Dilip Kumar
  • Patent number: 12131575
    Abstract: A biometric identification system acquires a multimodal image. The system is trained to determine three embeddings: a first embedding associated with features present in a first modality, an intersection embedding associated with features present in both the first and a second modality, and an XOR embedding associated with features that are not shared between the first modality and the second modality. Once trained, the system may process a multimodal query image to determine query embedding data. Additional information, such as minutiae depicted in the multimodal query image may also be determined. The query embedding data, and in some implementations the additional information, may be compared with enrolled embedding data associated with a previously enrolled user. If the comparison exceeds a threshold value, an identity may be asserted.
    Type: Grant
    Filed: May 13, 2022
    Date of Patent: October 29, 2024
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Manoj Aggarwal, Gerard Guy Medioni, Rajeev Ranjan, Joshua Engelsma, Baomin Wang, Abhinav Kashyap, Dilip Kumar
  • Patent number: 12086225
    Abstract: An image of at least a portion of a user during enrollment to a biometric identification system is acquired and processed with a first model to determine a first embedding that is representative of features in that image in a first embedding space. The first embedding may be stored for later comparison to identify the user, while the image is not stored. A second model that uses a second embedding space may be later developed. A transformer is trained to accept as input an embedding from the first model and produce as output an embedding consistent with the second embedding space. The previously stored first embedding may be converted to a second embedding in a second embedding space using the transformer. As a result, new embedding models may be implemented without requiring storage of user images for later reprocessing with the new models or requiring re-enrollment by users.
    Type: Grant
    Filed: September 22, 2021
    Date of Patent: September 10, 2024
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Gerard Guy Medioni, Manoj Aggarwal, Alon Shoshan, Igor Kviatkovsky, Nadav Israel Bhonker, Lior Zamir, Dilip Kumar
  • Publication number: 20240233444
    Abstract: User enrollment to a biometric identification system begins with a pre-enrollment process on selected general input devices (GID) such as smartphones. The user may enter identification data such as their name and use a camera of the GID to acquire first image data, such as of their hand. The first image data is processed to determine a first representation. Upon presentation of a hand at a biometric input device, second image data is acquired. The second image data is processed to determine a second representation. If the second representation is deemed to be associated with the first representation, the enrollment process may be completed by storing the second representation for subsequent use.
    Type: Application
    Filed: January 10, 2023
    Publication date: July 11, 2024
    Inventors: MANOJ AGGARWAL, GERARD GUY MEDIONI, CHAD DESJARDINS, DILIP KUMAR
  • Publication number: 20240153301
    Abstract: A biometric identification system processes input data acquired by input devices to determine embeddings used to identify a user. Different types of input devices or hardware configurations of input devices may produce different output. Each hardware configuration may be associated with respective representation data. A set of transformer networks are used to transform an embedding from one representation data associated with a first type of device or hardware configuration to another. This enables user participation via different configurations of hardware without requiring users to re-enroll for different input devices or hardware configurations. Opportunistic updates are made to the embeddings as embeddings native to a particular configuration of hardware are acquired from the user.
    Type: Application
    Filed: October 31, 2022
    Publication date: May 9, 2024
    Inventors: MANOJ AGGARWAL, GERARD GUY MEDIONI
  • Patent number: 11900711
    Abstract: An identification system includes one or more infrared light sources and a camera that acquires images of a user's palm. For example, at a first time, one or more first images may be acquired by the camera using infrared light with a first polarization that represent external characteristics of the user's palm. At a second time, one or more second images may be acquired using infrared light with a second polarization that represent internal characteristics of the user's palm. These images are processed to determine a first set of feature vectors and a second set of feature vectors. A current signature may be determined using the first set of feature vectors and the second set of feature vectors. In addition, a user may be identified based on a comparison of the current signature and previously stored reference signatures that are associated with candidate user identifiers.
    Type: Grant
    Filed: October 21, 2020
    Date of Patent: February 13, 2024
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Dilip Kumar, Manoj Aggarwal, George Leifman, Gerard Guy Medioni, Nikolai Orlov, Natan Peterfreund, Korwin Jon Smith, Dmitri Veikherman, Sora Kim
  • Patent number: 11868443
    Abstract: A neural network is trained to process input data and generate a classification value that characterizes the input with respect to an ordered continuum of classes. For example, the input data may comprise an image and the classification value may be indicative of a quality of the image. The ordered continuum of classes may represent classes of quality of the image ranging from “worst”, “bad”, “normal”, “good”, to “best”. During training, loss values are determined using an ordered classification loss function. The ordered classification loss function maintains monotonicity in the loss values that corresponds to placement in the continuum. For example, the classification value for a “bad” image will be less than the classification value indicative of a “best” image. The classification value may be used for subsequent processing. For example, biometric input data may be required to have a minimum classification value for further processing.
    Type: Grant
    Filed: May 12, 2021
    Date of Patent: January 9, 2024
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Rajeev Ranjan, Prithviraj Banerjee, Manoj Aggarwal, Gerard Guy Medioni, Dilip Kumar
  • Patent number: 11854301
    Abstract: A person may attempt to gain access to a facility via transaction data, such as images of a hand of the person or other identifying information as acquired by an input device. Possible fraud may be detected by comparing the transaction data with previously stored exclusion data. The exclusion data may include known bad data or synthetic trained data for detecting possible fraud. If the biometric input matches or is similar to the exclusion data, possible fraud is detected and the person is prompted for additional data. The reply data acquired from the person is compared with the exclusion data to determine if possible fraud is still detected. If so, additional prompts are presented to the person until the reply data provides enough confidence of no fraud or until the transaction is terminated.
    Type: Grant
    Filed: April 6, 2023
    Date of Patent: December 26, 2023
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Manoj Aggarwal, Brad Musick, Gerard Guy Medioni, Rui Zhao, Zhen Han
  • Patent number: 11823488
    Abstract: Biometric input, such as an image of a hand, may be processed to determine embedding vector data that may be used to identify users. Accuracy of the identification is improved by using high resolution inputs to a deep convolutional neural network (DCNN) that is trained to generate the embedding vector data that is representative of features in the input. Training data sets are expensive to develop and thus may be relatively small. During training of the DCNN, confidence loss values corresponding to the entire input as well as particular patches or portions of the input are determined. These patch-wise confidence loss values mitigate potential overfitting during training of the DCNN and improve overall performance of the trained DCNN to determine embedding vector data suitable for identification.
    Type: Grant
    Filed: March 29, 2021
    Date of Patent: November 21, 2023
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Rajeev Ranjan, Manoj Aggarwal, Gerard Guy Medioni
  • Patent number: 11816932
    Abstract: This disclosure describes techniques for identifying users that are enrolled for use of a user-recognition system and updating identification data of these users over time. To enroll in the user-recognition system, the user may initially scan his or her palm. The resulting image data may later be used when the user requests to be identified by the system by again scanning his or her palm. However, because the characteristics of user palms may change over the time, the user-recognition system may periodically perform processes for updating the identification data stored in association with the user in order to maintain or increase an accuracy of the user-recognition system.
    Type: Grant
    Filed: June 29, 2021
    Date of Patent: November 14, 2023
    Assignee: Amazon Technologies, Inc.
    Inventors: Zheng Tang, Lior Zamir, Prithviraj Banerjee, Manoj Aggarwal, Gerard Guy Medioni, Dilip Kumar
  • Patent number: 11804060
    Abstract: A pair of input images acquired using a first modality and a second modality is processed using a multi-classifier trained to determine classification data indicative of whether the pair is normal or abnormal. A pair may be deemed abnormal if one or both input images are obscured or inconsistent with one another. Training data comprising normal and abnormal images are used to train the multi-classifier. During training, the multi-classifier uses an objective function that includes cross entropy loss, distance loss, and discrepancy loss to process the training data. During use, the trained multi-classifier processes a pair of input images. If the resulting classification data indicates the pair of input images are normal, the pair of input images may be processed to assert an identity.
    Type: Grant
    Filed: July 26, 2021
    Date of Patent: October 31, 2023
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Rui Zhao, Manoj Aggarwal, Gerard Guy Medioni, Dilip Kumar
  • Patent number: 11756036
    Abstract: Techniques for an identity-verification system to analyze image data representing palms of users using a segmented, characteristic-based approach. The system may compare palm-feature data representing characteristics of a palm of a user (or “query palm”) with stored palm-feature data of palms for user profiles (or “stored palms”). For instance, the system may identify characteristics of the query palm having salient or discriminative features, and compare palm-feature data for those discriminative characteristics to palm-feature data representing corresponding characteristics of stored palms of enrolled users. Additionally, the system may compare characteristics of the query palm with corresponding characteristics of stored palms until the system is confident that the query palm corresponds to a stored palm of a user profile.
    Type: Grant
    Filed: December 13, 2019
    Date of Patent: September 12, 2023
    Assignee: Amazon Technologies, Inc.
    Inventors: Manoj Aggarwal, Prithviraj Banerjee, Gerard Guy Medioni, Brad Musick
  • Patent number: 11734949
    Abstract: Images of a hand are obtained by a camera. These images may depict the fingers and palm of the user. A pose of the hand relative to the camera may vary due to rotation, translation, articulation of joints in the hand, and so forth. One or more canonical images are generated by mapping the images to a canonical model. A first embedding model is used to determine a first embedding vector representative of the palm as depicted in the canonical images. A second embedding model is used to determine a set of second embedding vectors, each representative of individual fingers as depicted in the canonical images. Embedding distances in the embedding space from the embedding vectors to a closest match of previously stored embedding vectors are multiplied together to determine an overall distance. If the overall distance is less than a threshold value, an identity of a user is asserted.
    Type: Grant
    Filed: March 23, 2021
    Date of Patent: August 22, 2023
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Igor Kviatkovsky, Shunit Haviv, Manoj Aggarwal, Gal Novich, Gerard Guy Medioni
  • Patent number: 11714877
    Abstract: A machine learning system to determine an identity of a user is trained using triplets of ad hoc synthetic data and actual data. The data may comprise multimodal images of a hand. Each triplet comprises an anchor, a positive, and a negative image. Synthetic triplets for different synthesized identities are generated on an ad hoc basis and provided as input during training of the machine learning system. The machine learning system uses a pairwise label-based loss function, such as a triplet loss function during training. Synthetic triplets may be generated to provide more challenging training data, to provide training data for categories that are underrepresented in the actual data, and so forth. The system uses substantially less memory during training, and the synthetic triplets need not be retained further reducing memory use. Ongoing training is supported as new actual triplets become available, and may be supplemented by additional synthetic triplets.
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: August 1, 2023
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Alon Shoshan, Miriam Farber, Nadav Israel Bhonker, Igor Kviatkovsky, Manoj Aggarwal, Gerard Guy Medioni
  • Patent number: 11705133
    Abstract: This disclosure describes techniques for identifying users that are enrolled for use of a user-recognition system. To be identified using the user-recognition system, a user may first enroll in the system by stating an utterance at a first device having a first microphone. In response, the first microphone may generate first audio data. Later, when the user would like to be identified by the system, the user may state the utterance again, although this time to a second device having a second microphone. This second microphone may accordingly generate second audio data. Because the acoustic response of the first microphone may differ from the acoustic response of the second microphone, however, this disclosure describes techniques to apply a relative transfer function to one or both of the first or second audio data prior to comparing these data so as to increase the recognition accuracy of the system.
    Type: Grant
    Filed: December 6, 2018
    Date of Patent: July 18, 2023
    Assignee: Amazon Technologies, Inc.
    Inventors: Manoj Aggarwal, Dmitri Veikherman