Patents by Inventor Felipe Perez
Felipe Perez has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240020534Abstract: A non-autoregressive transformer model is improved to maintain output quality while reducing a number of iterative applications of the model by training parameters of a student model based on a teacher model. The teacher model is applied several iterations to a masked output and a student model is applied one iteration, such that the respective output token predictions for the masked positions can be compared and a loss propagated to the student. The loss may be based on token distributions rather than the specific output tokens alone, and may additionally consider hidden state losses. The teacher model may also be updated for use in further training based on the updated model, for example, by updating its parameters as a moving average.Type: ApplicationFiled: June 6, 2023Publication date: January 18, 2024Inventors: Juan Felipe Perez Vallejo, Maksims Volkovs, Sajad Norouzi, Rasa Hosseinzadeh
-
Publication number: 20230267367Abstract: A recommendation system generates item recommendations for a user based on a distance between a user embedding and item embeddings. To train the item and user embeddings, the recommendation system user-item pairs as training data to focus on difficult items based on the positive and negative items with respect to individual users in the training set. In training, the weight of individual user-item pairs in affecting the user and item embeddings may be determined based on the distance of the particular user-item pair between user embedding and item embedding, as well as the comparative distance for other items of the same type for that user and for the distance of user-item pairs for other users, which may regulate the distances across types and across the training batch.Type: ApplicationFiled: October 19, 2022Publication date: August 24, 2023Inventors: Maksims Volkovs, Zhaoyue Cheng, Juan Felipe Perez Vallejo, Jianing Sun, Zhaolin Gao
-
Publication number: 20230252301Abstract: An online system trains a transformer architecture by an initialization method which allows the transformer architecture to be trained without normalization layers of learning rate warmup, resulting in significant improvements in computational efficiency for transformer architectures. Specifically, an attention block included in an encoder or a decoder of the transformer architecture generates the set of attention representations by applying a key matrix to the input key, a query matrix to the input query, a value matrix to the input value to generate an output, and applying an output matrix to the output to generate the set of attention representations. The initialization method may be performed by scaling the parameters of the value matrix and the output matrix with a factor that is inverse to a number of the set of encoders or a number of the set of decoders.Type: ApplicationFiled: April 19, 2023Publication date: August 10, 2023Inventors: Maksims Volkovs, Xiao Shi Huang, Juan Felipe Perez Vallejo
-
Patent number: 11686218Abstract: A gas turbine engine having a bearing housing with a housing cavity and a shaft rotating about a rotation axis. One or more bearings support the shaft. A housing supporting the bearing and defining a chamber axially adjacent to the bearing. A seal assembly is in the housing between the chamber and an exterior of the chamber. The seal assembly includes a seal supported by the housing and surrounding the shaft so as to define an annular gap between an inner surface of the seal and an outer surface associated to the shaft, the gap defining a part of a sealing path of the seal assembly for air to flow from said exterior into the chamber. An impeller rotates with the shaft and located radially inward of the gap relative to the rotation axis, the impeller oriented to drive oil toward the bearing.Type: GrantFiled: August 21, 2020Date of Patent: June 27, 2023Assignee: PRATT & WHITNEY CANADA CORP.Inventors: Stuart Hodgson, Felipe Perez, Daniel Poirier, Nadim Antoine Najjar
-
Patent number: 11663488Abstract: An online system trains a transformer architecture by an initialization method which allows the transformer architecture to be trained without normalization layers of learning rate warmup, resulting in significant improvements in computational efficiency for transformer architectures. Specifically, an attention block included in an encoder or a decoder of the transformer architecture generates the set of attention representations by applying a key matrix to the input key, a query matrix to the input query, a value matrix to the input value to generate an output, and applying an output matrix to the output to generate the set of attention representations. The initialization method may be performed by scaling the parameters of the value matrix and the output matrix with a factor that is inverse to a number of the set of encoders or a number of the set of decoders.Type: GrantFiled: February 5, 2021Date of Patent: May 30, 2023Assignee: THE TORONTO-DOMINION BANKInventors: Maksims Volkovs, Xiao Shi Huang, Juan Felipe Perez Vallejo
-
Publication number: 20230119108Abstract: An autoencoder model includes an encoder portion and a decoder portion. The encoder encodes an input token sequence to an input sequence representation that is decoded by the decoder to generate an output token sequence. The autoencoder model may decode multiple output tokens in parallel, such that the decoder may be applied iteratively. The decoder may receive an output estimate from a prior iteration to predict output tokens. To improve positional representation and reduce positional errors and repetitive tokens, the autoencoder may include a trained layer for combining token embeddings with positional encodings. In addition, the model may be trained with a corrective loss based on output predictions when the model receives a masked input as the output estimate.Type: ApplicationFiled: October 18, 2022Publication date: April 20, 2023Inventors: Maksims Volkovs, Juan Felipe Perez Vallejo, Xiao Shi Huang
-
Patent number: 11594147Abstract: An interactive system and method for development of the voice, preferably for singing. The system and methods provide and utilize an animated, interactive, preferably 3D, visual character for illustrating the various human physiological components involved in producing vocals, and how best to strengthen and train such components to prevent injury. The system and methods are designed to visually replicate how the human body, and more specifically the internal organs for voice, interact and synchronize muscular movements that are involved in abdominal support, release of air control, and neural stimulation, in unison with Larynx mobility and gravity.Type: GrantFiled: February 27, 2019Date of Patent: February 28, 2023Assignee: VOIXTEK VR, LLCInventors: Juan Felipe Perez, Ronald Warren Anderson
-
Publication number: 20220300903Abstract: A computing device configured to communicate with a central server in order to predict likelihood of fraud in current transactions for a target claim. The computing device then extracts from information stored in the central server (relating to the target claim and past transactions for past claims including those marked as fraud), a plurality of distinct sets of features: text-based features derived from the descriptions of communications between the requesting device and the endpoint device, graph-based features derived from information relating to a network of claims and policies connected through shared information, and tabular features derived from the details related to claim information and exposure details. The features are input into a machine learning model for generating a likelihood of fraud in the current transactions and triggering an action based on the likelihood of fraud (e.g. stopping subsequent related transactions to the target claim).Type: ApplicationFiled: March 19, 2021Publication date: September 22, 2022Inventors: XIAO SHI HUANG, SANDRA AZIZ, JUAN FELIPE PEREZ VALLEJO, JEAN-CHRISTOPHE BOUËTTÉ, JENNIFER BOUCHARD, MATHIEU JEAN RÉMI RAVAUT, MAKSIMS VOLKOVS, TOMI JOHAN POUTANEN, JOSEPH PUN, GHAITH KAZMA, OLIVIER GANDOUET
-
Publication number: 20220270155Abstract: A recommendation system generates recommendations for user-item pairs based on embeddings in hyperbolic space. Each user and item may be associated with a local hyperbolic embedding representing the user or item in hyperbolic space. The hyperbolic embedding may be modified by neighborhood information. Because the hyperbolic space may have no closed form for combining neighbor information, the local embedding may be converted to a tangent space for neighborhood aggregation information and converted back to hyperbolic space for a neighborhood-aware embedding to be used in the recommendation score.Type: ApplicationFiled: February 17, 2022Publication date: August 25, 2022Inventors: Maksims Volkovs, Zhaoyue Cheng, Juan Felipe Perez Vallejo, Jianing Sun, Saba Zuberi
-
Publication number: 20220056814Abstract: A gas turbine engine having a bearing housing with a housing cavity and a shaft rotating about a rotation axis. One or more bearings support the shaft. A housing supporting the bearing and defining a chamber axially adjacent to the bearing. A seal assembly is in the housing between the chamber and an exterior of the chamber. The seal assembly includes a seal supported by the housing and surrounding the shaft so as to define an annular gap between an inner surface of the seal and an outer surface associated to the shaft, the gap defining a part of a sealing path of the seal assembly for air to flow from said exterior into the chamber. An impeller rotates with the shaft and located radially inward of the gap relative to the rotation axis, the impeller oriented to drive oil toward the bearing.Type: ApplicationFiled: August 21, 2020Publication date: February 24, 2022Inventors: Stuart HODGSON, Felipe PEREZ, Daniel POIRIER, Nadim Antoine NAJJAR
-
Publication number: 20210255862Abstract: An online system trains a transformer architecture by an initialization method which allows the transformer architecture to be trained without normalization layers of learning rate warmup, resulting in significant improvements in computational efficiency for transformer architectures. Specifically, an attention block included in an encoder or a decoder of the transformer architecture generates the set of attention representations by applying a key matrix to the input key, a query matrix to the input query, a value matrix to the input value to generate an output, and applying an output matrix to the output to generate the set of attention representations. The initialization method may be performed by scaling the parameters of the value matrix and the output matrix with a factor that is inverse to a number of the set of encoders or a number of the set of decoders.Type: ApplicationFiled: February 5, 2021Publication date: August 19, 2021Inventors: Maksims Volkovs, Xiao Shi Huang, Juan Felipe Perez Vallejo
-
Publication number: 20190266914Abstract: An interactive system and method for development of the voice, preferably for singing. The system and methods provide and utilize an animated, interactive, preferably 3D, visual character for illustrating the various human physiological components involved in producing vocals, and how best to strengthen and train such components to prevent injury. The system and methods are designed to visually replicate how the human body, and more specifically the internal organs for voice, interact and synchronize muscular movements that are involved in abdominal support, release of air control, and neural stimulation, in unison with Larynx mobility and gravity.Type: ApplicationFiled: February 27, 2019Publication date: August 29, 2019Inventors: Juan Felipe Perez, Ronald Warren Anderson
-
Publication number: 20060142677Abstract: A massage tool to enable people to speed up the massaging action in various parts of the human body and is convertible to one handle roller.Type: ApplicationFiled: December 2, 2005Publication date: June 29, 2006Inventor: Felipe Perez