Patents by Inventor Manoj Aggarwal
Manoj Aggarwal has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 12277794Abstract: An input device determines presence of an actual user, instead of an artifact, by using multi-wavelength reflectance spectroscopy. Light sources are operated to illuminate an object with different colors of light at different times. A detector determines, at those different times, intensity data indicative of intensity light of these different colors as reflected from the object. The intensity data is processed to determine whether the object is part of a user or is an artifact. For example, if the object is deemed to be a user, biometric input may be acquired. The biometric input may then be processed to identify the user. The input device may be used at various locations, such as at an entry portal, point of sale, and so forth.Type: GrantFiled: June 3, 2021Date of Patent: April 15, 2025Assignee: AMAZON TECHNOLOGIES, INC.Inventors: Baomin Wang, Umer Shahid, Tianyi Wang, Georgios Skolianos, Rui Zhao, Manoj Aggarwal, Gerard Guy Medioni
-
Patent number: 12271456Abstract: Maintaining the security of biometric data is an utmost priority. Biometric data is secured using one or more techniques. With one technique, biometric input such as images of a user's palm is used to generate first primary data (PD). The original biometric input is deleted from temporary secure storage while the first PD is securely stored. The first PD may then be processed later to determine a second PD. The first PD may then be deleted, and the second PD subsequently used. With another technique, biometric input or a PD may be processed by a first model to determine first secondary data (SD) that is representative of features of a particular user within a first embedding space. Later the PD may be processed by a second model to determine a second SD in a second embedding space. The first SD is deleted, and the second SD subsequently used.Type: GrantFiled: June 23, 2022Date of Patent: April 8, 2025Assignee: AMAZON TECHNOLOGIES, INC.Inventors: Manoj Aggarwal, Gerard Guy Medioni, Chad Desjardins, Dilip Kumar
-
Patent number: 12254718Abstract: User enrollment to a biometric identification system begins on selected general input devices (GID) such as smartphones. The user may enter identification data (e.g. name) and use a red-green-blue (RGB) camera of the GID to acquire a first image (e.g. hand). The first image is processed using both a first model to determine a first representation and a second model to determine a second representation. Upon presentation of a hand at a biometric input device, a second image is acquired using a first modality and a third image is acquired using a second modality. The second image is processed using the first model to determine a third representation. The third image is processed using the second model to determine a fourth representation. Given a match between both the first and third representations, as well as the second and fourth representations, enrollment is completed by storing the third and fourth representations.Type: GrantFiled: March 25, 2024Date of Patent: March 18, 2025Assignee: AMAZON TECHNOLOGIES, INC.Inventors: Quanfu Fan, Hongcheng Wang, Carlos D. Castillo, Manoj Aggarwal, Gerard Guy Medioni
-
Patent number: 12236709Abstract: This disclosure describes techniques for identifying users that are enrolled for use of a user-recognition system and updating enrollment data of these users over time. To enroll in the user-recognition system, the user may initially scan his or her palm. The resulting image data may later be used when the user requests to be identified by the system by again scanning his or her palm. However, because the characteristics of user palms may change over the time, the user-recognition system may continue to build more and more data for use in recognizing the user, in addition to removing older data that may no longer accurately represent current characteristics of respective user palms.Type: GrantFiled: March 28, 2022Date of Patent: February 25, 2025Assignee: Amazon Technologies, Inc.Inventors: Manoj Aggarwal, Jason Garfield, Korwin Jon Smith, Jordan Tyler Williams
-
Patent number: 12230052Abstract: Images of a hand are obtained by a camera. A pose of the hand relative to the camera may vary due to rotation, translation, articulation of joints in the hand, and so forth. Avatars comprising texture maps from images of actual hands and three-dimensional models that describe the shape of those hands are manipulated into different poses and articulations to produce synthetic images. Given that the mapping of points on an avatar to the synthetic image is known, highly accurate annotation data is produced that relates particular points on the avatar to the synthetic image. An artificial neural network (ANN) is trained using the synthetic images and corresponding annotation data. The trained ANN processes a first image of a hand to produce a second image of the hand that appears to be in a standardized or canonical pose. The second image may then be processed to identify the user.Type: GrantFiled: December 12, 2019Date of Patent: February 18, 2025Assignee: AMAZON TECHNOLOGIES, INC.Inventors: Igor Kviatkovsky, Nadav Israel Bhonker, Yevgeni Nogin, Roman Goldenberg, Manoj Aggarwal, Gerard Guy Medioni
-
Patent number: 12190566Abstract: Enhanced training data representative of possible inputs is used to train a machine learning system. For example, a machine learning system to determine identity based on an image of a human palm may be trained using enhanced training data comprising images. The enhanced training data may comprise source images that have been modified to appear to depict synthetic artifacts that attempt to simulate human palms, augmented images of dirty hands, and so forth. A synthetic artifact image may be produced by selectively removing some data from a source image. An augmented image may be produced by selectively blending the source image with features extracted from sample images. These images may then be used as training data to train the machine learning system.Type: GrantFiled: February 28, 2022Date of Patent: January 7, 2025Assignee: AMAZON TECHNOLOGIES, INC.Inventors: Lavisha Aggarwal, Manoj Aggarwal, Gerard Guy Medioni, Dilip Kumar
-
Patent number: 12131575Abstract: A biometric identification system acquires a multimodal image. The system is trained to determine three embeddings: a first embedding associated with features present in a first modality, an intersection embedding associated with features present in both the first and a second modality, and an XOR embedding associated with features that are not shared between the first modality and the second modality. Once trained, the system may process a multimodal query image to determine query embedding data. Additional information, such as minutiae depicted in the multimodal query image may also be determined. The query embedding data, and in some implementations the additional information, may be compared with enrolled embedding data associated with a previously enrolled user. If the comparison exceeds a threshold value, an identity may be asserted.Type: GrantFiled: May 13, 2022Date of Patent: October 29, 2024Assignee: AMAZON TECHNOLOGIES, INC.Inventors: Manoj Aggarwal, Gerard Guy Medioni, Rajeev Ranjan, Joshua Engelsma, Baomin Wang, Abhinav Kashyap, Dilip Kumar
-
Patent number: 12086225Abstract: An image of at least a portion of a user during enrollment to a biometric identification system is acquired and processed with a first model to determine a first embedding that is representative of features in that image in a first embedding space. The first embedding may be stored for later comparison to identify the user, while the image is not stored. A second model that uses a second embedding space may be later developed. A transformer is trained to accept as input an embedding from the first model and produce as output an embedding consistent with the second embedding space. The previously stored first embedding may be converted to a second embedding in a second embedding space using the transformer. As a result, new embedding models may be implemented without requiring storage of user images for later reprocessing with the new models or requiring re-enrollment by users.Type: GrantFiled: September 22, 2021Date of Patent: September 10, 2024Assignee: AMAZON TECHNOLOGIES, INC.Inventors: Gerard Guy Medioni, Manoj Aggarwal, Alon Shoshan, Igor Kviatkovsky, Nadav Israel Bhonker, Lior Zamir, Dilip Kumar
-
Publication number: 20240233444Abstract: User enrollment to a biometric identification system begins with a pre-enrollment process on selected general input devices (GID) such as smartphones. The user may enter identification data such as their name and use a camera of the GID to acquire first image data, such as of their hand. The first image data is processed to determine a first representation. Upon presentation of a hand at a biometric input device, second image data is acquired. The second image data is processed to determine a second representation. If the second representation is deemed to be associated with the first representation, the enrollment process may be completed by storing the second representation for subsequent use.Type: ApplicationFiled: January 10, 2023Publication date: July 11, 2024Inventors: MANOJ AGGARWAL, GERARD GUY MEDIONI, CHAD DESJARDINS, DILIP KUMAR
-
Publication number: 20240153301Abstract: A biometric identification system processes input data acquired by input devices to determine embeddings used to identify a user. Different types of input devices or hardware configurations of input devices may produce different output. Each hardware configuration may be associated with respective representation data. A set of transformer networks are used to transform an embedding from one representation data associated with a first type of device or hardware configuration to another. This enables user participation via different configurations of hardware without requiring users to re-enroll for different input devices or hardware configurations. Opportunistic updates are made to the embeddings as embeddings native to a particular configuration of hardware are acquired from the user.Type: ApplicationFiled: October 31, 2022Publication date: May 9, 2024Inventors: MANOJ AGGARWAL, GERARD GUY MEDIONI
-
Patent number: 11900711Abstract: An identification system includes one or more infrared light sources and a camera that acquires images of a user's palm. For example, at a first time, one or more first images may be acquired by the camera using infrared light with a first polarization that represent external characteristics of the user's palm. At a second time, one or more second images may be acquired using infrared light with a second polarization that represent internal characteristics of the user's palm. These images are processed to determine a first set of feature vectors and a second set of feature vectors. A current signature may be determined using the first set of feature vectors and the second set of feature vectors. In addition, a user may be identified based on a comparison of the current signature and previously stored reference signatures that are associated with candidate user identifiers.Type: GrantFiled: October 21, 2020Date of Patent: February 13, 2024Assignee: AMAZON TECHNOLOGIES, INC.Inventors: Dilip Kumar, Manoj Aggarwal, George Leifman, Gerard Guy Medioni, Nikolai Orlov, Natan Peterfreund, Korwin Jon Smith, Dmitri Veikherman, Sora Kim
-
Patent number: 11868443Abstract: A neural network is trained to process input data and generate a classification value that characterizes the input with respect to an ordered continuum of classes. For example, the input data may comprise an image and the classification value may be indicative of a quality of the image. The ordered continuum of classes may represent classes of quality of the image ranging from “worst”, “bad”, “normal”, “good”, to “best”. During training, loss values are determined using an ordered classification loss function. The ordered classification loss function maintains monotonicity in the loss values that corresponds to placement in the continuum. For example, the classification value for a “bad” image will be less than the classification value indicative of a “best” image. The classification value may be used for subsequent processing. For example, biometric input data may be required to have a minimum classification value for further processing.Type: GrantFiled: May 12, 2021Date of Patent: January 9, 2024Assignee: AMAZON TECHNOLOGIES, INC.Inventors: Rajeev Ranjan, Prithviraj Banerjee, Manoj Aggarwal, Gerard Guy Medioni, Dilip Kumar
-
Patent number: 11854301Abstract: A person may attempt to gain access to a facility via transaction data, such as images of a hand of the person or other identifying information as acquired by an input device. Possible fraud may be detected by comparing the transaction data with previously stored exclusion data. The exclusion data may include known bad data or synthetic trained data for detecting possible fraud. If the biometric input matches or is similar to the exclusion data, possible fraud is detected and the person is prompted for additional data. The reply data acquired from the person is compared with the exclusion data to determine if possible fraud is still detected. If so, additional prompts are presented to the person until the reply data provides enough confidence of no fraud or until the transaction is terminated.Type: GrantFiled: April 6, 2023Date of Patent: December 26, 2023Assignee: AMAZON TECHNOLOGIES, INC.Inventors: Manoj Aggarwal, Brad Musick, Gerard Guy Medioni, Rui Zhao, Zhen Han
-
Patent number: 11823488Abstract: Biometric input, such as an image of a hand, may be processed to determine embedding vector data that may be used to identify users. Accuracy of the identification is improved by using high resolution inputs to a deep convolutional neural network (DCNN) that is trained to generate the embedding vector data that is representative of features in the input. Training data sets are expensive to develop and thus may be relatively small. During training of the DCNN, confidence loss values corresponding to the entire input as well as particular patches or portions of the input are determined. These patch-wise confidence loss values mitigate potential overfitting during training of the DCNN and improve overall performance of the trained DCNN to determine embedding vector data suitable for identification.Type: GrantFiled: March 29, 2021Date of Patent: November 21, 2023Assignee: AMAZON TECHNOLOGIES, INC.Inventors: Rajeev Ranjan, Manoj Aggarwal, Gerard Guy Medioni
-
Patent number: 11816932Abstract: This disclosure describes techniques for identifying users that are enrolled for use of a user-recognition system and updating identification data of these users over time. To enroll in the user-recognition system, the user may initially scan his or her palm. The resulting image data may later be used when the user requests to be identified by the system by again scanning his or her palm. However, because the characteristics of user palms may change over the time, the user-recognition system may periodically perform processes for updating the identification data stored in association with the user in order to maintain or increase an accuracy of the user-recognition system.Type: GrantFiled: June 29, 2021Date of Patent: November 14, 2023Assignee: Amazon Technologies, Inc.Inventors: Zheng Tang, Lior Zamir, Prithviraj Banerjee, Manoj Aggarwal, Gerard Guy Medioni, Dilip Kumar
-
Patent number: 11804060Abstract: A pair of input images acquired using a first modality and a second modality is processed using a multi-classifier trained to determine classification data indicative of whether the pair is normal or abnormal. A pair may be deemed abnormal if one or both input images are obscured or inconsistent with one another. Training data comprising normal and abnormal images are used to train the multi-classifier. During training, the multi-classifier uses an objective function that includes cross entropy loss, distance loss, and discrepancy loss to process the training data. During use, the trained multi-classifier processes a pair of input images. If the resulting classification data indicates the pair of input images are normal, the pair of input images may be processed to assert an identity.Type: GrantFiled: July 26, 2021Date of Patent: October 31, 2023Assignee: AMAZON TECHNOLOGIES, INC.Inventors: Rui Zhao, Manoj Aggarwal, Gerard Guy Medioni, Dilip Kumar
-
Patent number: 11756036Abstract: Techniques for an identity-verification system to analyze image data representing palms of users using a segmented, characteristic-based approach. The system may compare palm-feature data representing characteristics of a palm of a user (or “query palm”) with stored palm-feature data of palms for user profiles (or “stored palms”). For instance, the system may identify characteristics of the query palm having salient or discriminative features, and compare palm-feature data for those discriminative characteristics to palm-feature data representing corresponding characteristics of stored palms of enrolled users. Additionally, the system may compare characteristics of the query palm with corresponding characteristics of stored palms until the system is confident that the query palm corresponds to a stored palm of a user profile.Type: GrantFiled: December 13, 2019Date of Patent: September 12, 2023Assignee: Amazon Technologies, Inc.Inventors: Manoj Aggarwal, Prithviraj Banerjee, Gerard Guy Medioni, Brad Musick
-
Patent number: 11734949Abstract: Images of a hand are obtained by a camera. These images may depict the fingers and palm of the user. A pose of the hand relative to the camera may vary due to rotation, translation, articulation of joints in the hand, and so forth. One or more canonical images are generated by mapping the images to a canonical model. A first embedding model is used to determine a first embedding vector representative of the palm as depicted in the canonical images. A second embedding model is used to determine a set of second embedding vectors, each representative of individual fingers as depicted in the canonical images. Embedding distances in the embedding space from the embedding vectors to a closest match of previously stored embedding vectors are multiplied together to determine an overall distance. If the overall distance is less than a threshold value, an identity of a user is asserted.Type: GrantFiled: March 23, 2021Date of Patent: August 22, 2023Assignee: AMAZON TECHNOLOGIES, INC.Inventors: Igor Kviatkovsky, Shunit Haviv, Manoj Aggarwal, Gal Novich, Gerard Guy Medioni
-
Patent number: 11714877Abstract: A machine learning system to determine an identity of a user is trained using triplets of ad hoc synthetic data and actual data. The data may comprise multimodal images of a hand. Each triplet comprises an anchor, a positive, and a negative image. Synthetic triplets for different synthesized identities are generated on an ad hoc basis and provided as input during training of the machine learning system. The machine learning system uses a pairwise label-based loss function, such as a triplet loss function during training. Synthetic triplets may be generated to provide more challenging training data, to provide training data for categories that are underrepresented in the actual data, and so forth. The system uses substantially less memory during training, and the synthetic triplets need not be retained further reducing memory use. Ongoing training is supported as new actual triplets become available, and may be supplemented by additional synthetic triplets.Type: GrantFiled: September 30, 2020Date of Patent: August 1, 2023Assignee: AMAZON TECHNOLOGIES, INC.Inventors: Alon Shoshan, Miriam Farber, Nadav Israel Bhonker, Igor Kviatkovsky, Manoj Aggarwal, Gerard Guy Medioni
-
Patent number: 11705133Abstract: This disclosure describes techniques for identifying users that are enrolled for use of a user-recognition system. To be identified using the user-recognition system, a user may first enroll in the system by stating an utterance at a first device having a first microphone. In response, the first microphone may generate first audio data. Later, when the user would like to be identified by the system, the user may state the utterance again, although this time to a second device having a second microphone. This second microphone may accordingly generate second audio data. Because the acoustic response of the first microphone may differ from the acoustic response of the second microphone, however, this disclosure describes techniques to apply a relative transfer function to one or both of the first or second audio data prior to comparing these data so as to increase the recognition accuracy of the system.Type: GrantFiled: December 6, 2018Date of Patent: July 18, 2023Assignee: Amazon Technologies, Inc.Inventors: Manoj Aggarwal, Dmitri Veikherman