Patents by Inventor Manoj Aggarwal

Manoj Aggarwal has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240153301
    Abstract: A biometric identification system processes input data acquired by input devices to determine embeddings used to identify a user. Different types of input devices or hardware configurations of input devices may produce different output. Each hardware configuration may be associated with respective representation data. A set of transformer networks are used to transform an embedding from one representation data associated with a first type of device or hardware configuration to another. This enables user participation via different configurations of hardware without requiring users to re-enroll for different input devices or hardware configurations. Opportunistic updates are made to the embeddings as embeddings native to a particular configuration of hardware are acquired from the user.
    Type: Application
    Filed: October 31, 2022
    Publication date: May 9, 2024
    Inventors: MANOJ AGGARWAL, GERARD GUY MEDIONI
  • Patent number: 11900711
    Abstract: An identification system includes one or more infrared light sources and a camera that acquires images of a user's palm. For example, at a first time, one or more first images may be acquired by the camera using infrared light with a first polarization that represent external characteristics of the user's palm. At a second time, one or more second images may be acquired using infrared light with a second polarization that represent internal characteristics of the user's palm. These images are processed to determine a first set of feature vectors and a second set of feature vectors. A current signature may be determined using the first set of feature vectors and the second set of feature vectors. In addition, a user may be identified based on a comparison of the current signature and previously stored reference signatures that are associated with candidate user identifiers.
    Type: Grant
    Filed: October 21, 2020
    Date of Patent: February 13, 2024
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Dilip Kumar, Manoj Aggarwal, George Leifman, Gerard Guy Medioni, Nikolai Orlov, Natan Peterfreund, Korwin Jon Smith, Dmitri Veikherman, Sora Kim
  • Patent number: 11868443
    Abstract: A neural network is trained to process input data and generate a classification value that characterizes the input with respect to an ordered continuum of classes. For example, the input data may comprise an image and the classification value may be indicative of a quality of the image. The ordered continuum of classes may represent classes of quality of the image ranging from “worst”, “bad”, “normal”, “good”, to “best”. During training, loss values are determined using an ordered classification loss function. The ordered classification loss function maintains monotonicity in the loss values that corresponds to placement in the continuum. For example, the classification value for a “bad” image will be less than the classification value indicative of a “best” image. The classification value may be used for subsequent processing. For example, biometric input data may be required to have a minimum classification value for further processing.
    Type: Grant
    Filed: May 12, 2021
    Date of Patent: January 9, 2024
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Rajeev Ranjan, Prithviraj Banerjee, Manoj Aggarwal, Gerard Guy Medioni, Dilip Kumar
  • Patent number: 11854301
    Abstract: A person may attempt to gain access to a facility via transaction data, such as images of a hand of the person or other identifying information as acquired by an input device. Possible fraud may be detected by comparing the transaction data with previously stored exclusion data. The exclusion data may include known bad data or synthetic trained data for detecting possible fraud. If the biometric input matches or is similar to the exclusion data, possible fraud is detected and the person is prompted for additional data. The reply data acquired from the person is compared with the exclusion data to determine if possible fraud is still detected. If so, additional prompts are presented to the person until the reply data provides enough confidence of no fraud or until the transaction is terminated.
    Type: Grant
    Filed: April 6, 2023
    Date of Patent: December 26, 2023
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Manoj Aggarwal, Brad Musick, Gerard Guy Medioni, Rui Zhao, Zhen Han
  • Patent number: 11823488
    Abstract: Biometric input, such as an image of a hand, may be processed to determine embedding vector data that may be used to identify users. Accuracy of the identification is improved by using high resolution inputs to a deep convolutional neural network (DCNN) that is trained to generate the embedding vector data that is representative of features in the input. Training data sets are expensive to develop and thus may be relatively small. During training of the DCNN, confidence loss values corresponding to the entire input as well as particular patches or portions of the input are determined. These patch-wise confidence loss values mitigate potential overfitting during training of the DCNN and improve overall performance of the trained DCNN to determine embedding vector data suitable for identification.
    Type: Grant
    Filed: March 29, 2021
    Date of Patent: November 21, 2023
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Rajeev Ranjan, Manoj Aggarwal, Gerard Guy Medioni
  • Patent number: 11816932
    Abstract: This disclosure describes techniques for identifying users that are enrolled for use of a user-recognition system and updating identification data of these users over time. To enroll in the user-recognition system, the user may initially scan his or her palm. The resulting image data may later be used when the user requests to be identified by the system by again scanning his or her palm. However, because the characteristics of user palms may change over the time, the user-recognition system may periodically perform processes for updating the identification data stored in association with the user in order to maintain or increase an accuracy of the user-recognition system.
    Type: Grant
    Filed: June 29, 2021
    Date of Patent: November 14, 2023
    Assignee: Amazon Technologies, Inc.
    Inventors: Zheng Tang, Lior Zamir, Prithviraj Banerjee, Manoj Aggarwal, Gerard Guy Medioni, Dilip Kumar
  • Patent number: 11804060
    Abstract: A pair of input images acquired using a first modality and a second modality is processed using a multi-classifier trained to determine classification data indicative of whether the pair is normal or abnormal. A pair may be deemed abnormal if one or both input images are obscured or inconsistent with one another. Training data comprising normal and abnormal images are used to train the multi-classifier. During training, the multi-classifier uses an objective function that includes cross entropy loss, distance loss, and discrepancy loss to process the training data. During use, the trained multi-classifier processes a pair of input images. If the resulting classification data indicates the pair of input images are normal, the pair of input images may be processed to assert an identity.
    Type: Grant
    Filed: July 26, 2021
    Date of Patent: October 31, 2023
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Rui Zhao, Manoj Aggarwal, Gerard Guy Medioni, Dilip Kumar
  • Patent number: 11756036
    Abstract: Techniques for an identity-verification system to analyze image data representing palms of users using a segmented, characteristic-based approach. The system may compare palm-feature data representing characteristics of a palm of a user (or “query palm”) with stored palm-feature data of palms for user profiles (or “stored palms”). For instance, the system may identify characteristics of the query palm having salient or discriminative features, and compare palm-feature data for those discriminative characteristics to palm-feature data representing corresponding characteristics of stored palms of enrolled users. Additionally, the system may compare characteristics of the query palm with corresponding characteristics of stored palms until the system is confident that the query palm corresponds to a stored palm of a user profile.
    Type: Grant
    Filed: December 13, 2019
    Date of Patent: September 12, 2023
    Assignee: Amazon Technologies, Inc.
    Inventors: Manoj Aggarwal, Prithviraj Banerjee, Gerard Guy Medioni, Brad Musick
  • Patent number: 11734949
    Abstract: Images of a hand are obtained by a camera. These images may depict the fingers and palm of the user. A pose of the hand relative to the camera may vary due to rotation, translation, articulation of joints in the hand, and so forth. One or more canonical images are generated by mapping the images to a canonical model. A first embedding model is used to determine a first embedding vector representative of the palm as depicted in the canonical images. A second embedding model is used to determine a set of second embedding vectors, each representative of individual fingers as depicted in the canonical images. Embedding distances in the embedding space from the embedding vectors to a closest match of previously stored embedding vectors are multiplied together to determine an overall distance. If the overall distance is less than a threshold value, an identity of a user is asserted.
    Type: Grant
    Filed: March 23, 2021
    Date of Patent: August 22, 2023
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Igor Kviatkovsky, Shunit Haviv, Manoj Aggarwal, Gal Novich, Gerard Guy Medioni
  • Patent number: 11714877
    Abstract: A machine learning system to determine an identity of a user is trained using triplets of ad hoc synthetic data and actual data. The data may comprise multimodal images of a hand. Each triplet comprises an anchor, a positive, and a negative image. Synthetic triplets for different synthesized identities are generated on an ad hoc basis and provided as input during training of the machine learning system. The machine learning system uses a pairwise label-based loss function, such as a triplet loss function during training. Synthetic triplets may be generated to provide more challenging training data, to provide training data for categories that are underrepresented in the actual data, and so forth. The system uses substantially less memory during training, and the synthetic triplets need not be retained further reducing memory use. Ongoing training is supported as new actual triplets become available, and may be supplemented by additional synthetic triplets.
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: August 1, 2023
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Alon Shoshan, Miriam Farber, Nadav Israel Bhonker, Igor Kviatkovsky, Manoj Aggarwal, Gerard Guy Medioni
  • Patent number: 11705133
    Abstract: This disclosure describes techniques for identifying users that are enrolled for use of a user-recognition system. To be identified using the user-recognition system, a user may first enroll in the system by stating an utterance at a first device having a first microphone. In response, the first microphone may generate first audio data. Later, when the user would like to be identified by the system, the user may state the utterance again, although this time to a second device having a second microphone. This second microphone may accordingly generate second audio data. Because the acoustic response of the first microphone may differ from the acoustic response of the second microphone, however, this disclosure describes techniques to apply a relative transfer function to one or both of the first or second audio data prior to comparing these data so as to increase the recognition accuracy of the system.
    Type: Grant
    Filed: December 6, 2018
    Date of Patent: July 18, 2023
    Assignee: Amazon Technologies, Inc.
    Inventors: Manoj Aggarwal, Dmitri Veikherman
  • Patent number: 11688198
    Abstract: A biometric identification system uses inputs acquired using different modalities. A model having an intersection branch and an XOR branch is trained to determine an embedding using features present in all modalities (an intersection of modalities), and features that are distinctive to each modality (an XOR of that modality relative to the other modality(s)). During training, a first loss function is used to determine a first loss value with respect to the branches. Probability distributions are determined for the output from the branches, corresponding to the intersection and XORs of each modality. A second loss function uses these probability distributions to determine a second loss value. A total loss function for training the model may be a sum of the first loss and the second loss. Once trained, the model may process query inputs to determine embedding data for comparison with embedding data of a previously enrolled user.
    Type: Grant
    Filed: December 3, 2021
    Date of Patent: June 27, 2023
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Rajeev Ranjan, Gerard Guy Medioni, Manoj Aggarwal, Dilip Kumar
  • Patent number: 11670104
    Abstract: A scanner acquires a set of images of a hand of a user to facilitate identification. These images may vary, due to changes in relative position, pose, lighting, obscuring objects such as a sleeve, and so forth. A first neural network determines output data comprising a spatial mask and a feature map for individual images in the set. The output data for two or more images is combined to provide aggregate data that is representative of the two or more images. The aggregate data may then be processed using a second neural network, such as convolutional neural network, to determine an embedding vector. The embedding vector may be stored and associated with a user account. At a later time, images acquired from the scanner may be processed to produce an embedding vector that is compared to the stored embedding vector to identify a user at the scanner.
    Type: Grant
    Filed: November 13, 2020
    Date of Patent: June 6, 2023
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Lior Zamir, Miriam Farber, Igor Kviatkovsky, Nadav Israel Bhonker, Manoj Aggarwal, Gerard Guy Medioni
  • Patent number: 11663805
    Abstract: This disclosure describes a user-recognition system that may perform one or more verification methods upon identifying a previous image that matches a current image of a palm of a user. For instance, the user-recognition system may perform the verification method(s) as part of the recognition method (e.g., after recognizing a matching image), in response to an audit process, in response to a request to re-analyze the image data (e.g., because a user indicates that he or she was not associated with a particular purchase or shopping session), and/or the like.
    Type: Grant
    Filed: March 23, 2021
    Date of Patent: May 30, 2023
    Assignee: Amazon Technologies, Inc.
    Inventors: Zheng Tang, Prithviraj Banerjee, Manoj Aggarwal, Gerard Guy Medioni
  • Patent number: 11625947
    Abstract: Biometric input, such as images of a hand obtained by a biometric input device, may be used to identify a person. An attacker may attempt to gain access by presenting false biometric data with an artificial biometric model, such as a fake hand. During a suspected attack, the attacker is prompted for additional data. For example, email address, telephone number, payment information, and so forth. This provides additional information about the attack while prolonging the time spent by the attacker on the attack. Information explicitly indicating failure is delayed or not presented at all. Data associated with an attack is placed into an exclusion list and further analyzed to recognize and mitigate future attacks. A subsequent attempt that corresponds to exclusion data proceeds with presenting prompts, gathering further information and consuming more of the attacker's time and resources.
    Type: Grant
    Filed: March 3, 2020
    Date of Patent: April 11, 2023
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Manoj Aggarwal, Brad Musick, Gerard Guy Medioni, Rui Zhao, Zhen Han
  • Patent number: 11537813
    Abstract: During a training phase, a first machine learning system is trained using actual data, such as multimodal images of a hand, to generate synthetic image data. During training, the first system determines latent vector spaces associated with identity, appearance, and so forth. During a generation phase, latent vectors from the latent vector spaces are generated and used as input to the first machine learning system to generate candidate synthetic image data. The candidate image data is assessed to determine suitability for inclusion into a set of synthetic image data that may be used for subsequent use in training a second machine learning system to recognize an identity of a hand presented by a user. For example, the candidate synthetic image data is compared to previously generated synthetic image data to avoid duplicative synthetic identities. The second machine learning system is then trained using the approved candidate synthetic image data.
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: December 27, 2022
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Igor Kviatkovsky, Nadav Israel Bhonker, Alon Shoshan, Manoj Aggarwal, Gerard Guy Medioni
  • Patent number: 11527092
    Abstract: Images of a hand may be used to identify users. Quality, detail, and so forth of these images may vary. An image is processed to determine a first spatial mask. A first neural network comprising many layers uses the first spatial mask at a first layer and a second spatial mask at a second layer to process images and produce an embedding vector representative of features in the image. The first spatial mask provides information about particular portions of the input image, and is determined by processing the image with an algorithm such as an orientation certainty level (OCL) algorithm. The second spatial mask is determined using unsupervised training and represents weights of particular portions of the input image as represented at the second layer. The use of the masks allows the first neural network to learn to use or disregard particular portions of the image, improving overall accuracy.
    Type: Grant
    Filed: November 16, 2020
    Date of Patent: December 13, 2022
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Miriam Farber, Manoj Aggarwal, Gerard Guy Medioni
  • Patent number: 11288490
    Abstract: This disclosure describes techniques for identifying users that are enrolled for use of a user-recognition system and updating enrollment data of these users over time. To enroll in the user-recognition system, the user may initially scan his or her palm. The resulting image data may later be used when the user requests to be identified by the system by again scanning his or her palm. However, because the characteristics of user palms may change over the time, the user-recognition system may continue to build more and more data for use in recognizing the user, in addition to removing older data that may no longer accurately represent current characteristics of respective user palms.
    Type: Grant
    Filed: January 21, 2021
    Date of Patent: March 29, 2022
    Assignee: Amazon Technologies, Inc.
    Inventors: Manoj Aggarwal, Jason Garfield, Korwin Jon Smith, Jordan Tyler Williams
  • Publication number: 20210196406
    Abstract: Described are methods and systems for operating devices in an operating room (OR), according to some embodiments. An OR hub can provide an operations user interface (UI) that is provisioned by a hub software developer to enable authorized users to access permitted software functions run by the system software on the OR hub to operate one or more medical devices in the OR. The operations UI can be configured to prevent an interaction of the one or more medical devices and the OR hub with a user until that user is authenticated through the operations U. In some embodiments, the operations UI of the OR hub implements role-based security in which the operations UI provides an authenticated user with different sets of permitted software and/or security functions based on a type of credential possessed by the authenticated user.
    Type: Application
    Filed: December 30, 2020
    Publication date: July 1, 2021
    Applicant: Stryker Corporation
    Inventors: Amit A. MAHADIK, Ramanan PARAMASIVAN, Suraj BHAT, Afshin JILA, Manoj AGGARWAL, Sourabh CHOUDHARY
  • Patent number: 11017203
    Abstract: This disclosure describes techniques for identifying users that are enrolled for use of a user-recognition system and updating enrollment data of these users over time. To enroll in the user-recognition system, the user may initially scan his or her palm. The resulting image data may later be used when the user requests to be identified by the system by again scanning his or her palm. However, because the characteristics of user palms may change over the time, the user-recognition system may continue to build more and more data for use in recognizing the user, in addition to removing older data that may no longer accurately represent current characteristics of respective user palms.
    Type: Grant
    Filed: June 19, 2019
    Date of Patent: May 25, 2021
    Assignee: Amazon Technologies, Inc.
    Inventors: Manoj Aggarwal, Jason Garfield, Korwin Jon Smith, Jordan Tyler Williams