Patents by Inventor Agus Sudjianto
Agus Sudjianto has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 12229782Abstract: Disclosed is an example approach in which network and non-network features are used to train a predictive machine learning model that is implemented to predict financial crime and fraud. Graphical network features may be generated by applying financial entity risk vectors to a network model with representations of various types of networks. The network model may comprise transactional, non-social, and/or social networks, with edges corresponding to linkages that may be weighted according to various characteristics (such as frequency, amount, type, recency, etc.). The graphical network features may be fed to the predictive model to generate a likelihood and/or prediction with respect to a financial crime. A perceptible alert is generated on one or more computing devices if a financial crime is predicted or deemed sufficiently likely. The alert may identify a subset of the set of financial entities involved in the financial crime and present graphical representations of networks and linkages.Type: GrantFiled: April 19, 2023Date of Patent: February 18, 2025Assignee: Wells Fargo Bank, N.A.Inventors: Wayne B. Shoumaker, Harsh Singhal, Suhas Sreehari, Agus Sudjianto, Ye Yu
-
Patent number: 12217143Abstract: Computing systems and technical methods that transform data structures and pierce opacity difficulties associated with complex machine learning algorithms are disclosed. Advances include a framework and techniques that include: i) global diagnostics; ii) locally interpretable models LIME-SUP-R and LIME-SUP-D; and iii) explainable neural networks.Type: GrantFiled: March 5, 2019Date of Patent: February 4, 2025Assignee: Wells Fargo Bank, N.A.Inventors: Vijayan N. Nair, Agus Sudjianto, Jie Chen, Kurt Schieding, Linwei Hu, Xiaoyu Liu, Joel Vaughan
-
Publication number: 20240403200Abstract: This disclosure describes techniques that include validation or other assessments of digital systems, such as machine learning models and other statistical models. In one example, this disclosure describes a method that includes receiving, by a validation computing system and from a development system, a request to perform a test on a model configured to execute on the development system; outputting, by the validation computing system to the development system and in response to the request, an instruction; enabling the development system to process the instruction; receiving, by the validation computing system, test response data; evaluating, by the validation system, the test response data.Type: ApplicationFiled: August 15, 2024Publication date: December 5, 2024Inventors: Fernando Cela Diaz, Agus Sudjianto, Harsh Singhal, Ningzhou Zeng, Kai Arne Krueger, Harsh Vardhan Tiwari, Ridhi Puppala, Karan H. Jeswani
-
Patent number: 12106407Abstract: Systems, apparatuses, methods, and computer program products are disclosed for generating a single-index model (SIM) tree. An example method includes receiving a data set and a maximum tree depth. The example method further includes screening a set of variables from the data set to form split variables. The method may include, while maximum tree depth has not been reached, (i) generating a fast SIM estimation for nodes of a tree level, (ii) for each node, selecting a split point and split variable based on the fast SIM estimation, (iii) based on the selected split points and split variables, generating nodes for a next tree level, each including a subset of data, and (iv) repeating steps (i), (ii), and (iii). The method may include fitting a SIM for each leaf node at maximum tree depth based on a subset of the data set represented by the leaf node.Type: GrantFiled: May 2, 2023Date of Patent: October 1, 2024Assignee: Wells Fargo Bank, N.A.Inventors: Agus Sudjianto, Aijun Zhang, Zebin Yang
-
Patent number: 12086054Abstract: This disclosure describes techniques that include validation or other assessments of digital systems, such as machine learning models and other statistical models. In one example, this disclosure describes a method that includes receiving, by a validation computing system and from a development system, a request to perform a test on a model configured to execute on the development system; outputting, by the validation computing system to the development system and in response to the request, an instruction; enabling the development system to process the instruction; receiving, by the validation computing system, test response data; evaluating, by the validation system, the test response data.Type: GrantFiled: October 20, 2022Date of Patent: September 10, 2024Assignee: Wells Fargo Bank, N.A.Inventors: Fernando Cela Diaz, Agus Sudjianto, Harsh Singhal, Ningzhou Zeng, Kai Arne Krueger, Harsh Vardhan Tiwari, Ridhi Puppala, Karan H. Jeswani
-
Patent number: 12086053Abstract: This disclosure describes techniques that include validation or other assessments of digital systems, such as machine learning models and other statistical models. In one example, this disclosure describes a method that includes receiving, by a validation computing system and from a development system, a request to perform a test on a model configured to execute on the development system; outputting, by the validation computing system to the development system and in response to the request, an instruction; enabling the development system to process the instruction; receiving, by the validation computing system, test response data; evaluating, by the validation system, the test response data.Type: GrantFiled: June 3, 2022Date of Patent: September 10, 2024Assignee: Wells Fargo Bank, N.A.Inventors: Fernando Cela Diaz, Agus Sudjianto, Harsh Singhal, Ningzhou Zeng
-
Publication number: 20240289548Abstract: Systems, apparatuses, methods, and computer program products are disclosed for screening data instances based on a target text of a target corpus. A screening device analyzes a target corpus to generate at least two term dictionaries for the target corpus. The screening apparatus, based on a frequency of a term in the target corpus, determines a term weight for the term; for each data instance, determines term scores for the data instance and the target text based on the term weights; filters the data instances based on the term scores, to generate a short list of data instances; determines term similarity scores between each data instance of the short list and target text based on the term weights; and provides a data instance determined to likely correspond to the target text and an indication of the corresponding term similarity score(s). A term is a word or an n-gram.Type: ApplicationFiled: May 1, 2024Publication date: August 29, 2024Inventors: Mina Naghshnejad, Angelina Yang, Tarun Joshi, Vijayan Nair, Harsh Singhal, Agus Sudjianto
-
Patent number: 12073181Abstract: Systems, apparatuses, methods, and computer program products are disclosed for determining robustness information for an NLP model. Modification rules, such as replacement rules and/or insertion rules, are used to generate instances of modified test data based on instances of test data that comprise words and have a syntax and a semantic meaning. The instances of test data and modified test data are provided to the NLP model and the output of the NLP model is analyzed to determine output changing instances of modified test data, which are instances of modified test data yielded output from the NLP model that is different and/or not similar to the output yielded from the NLP model for the corresponding instance of test data. Robustness information for the NLP model is determined based at least in part on the output changing instances of modified test data.Type: GrantFiled: April 21, 2023Date of Patent: August 27, 2024Assignee: Wells Fargo Bank, N.A.Inventors: Tarun Joshi, Rahul Singh, Vijayan Nair, Agus Sudjianto
-
Patent number: 12001791Abstract: Systems, apparatuses, methods, and computer program products are disclosed for screening data instances based on a target text of a target corpus. A screening device analyzes a target corpus to generate at least two term dictionaries for the target corpus. The screening apparatus, based on a frequency of a term in the target corpus, determines a term weight for the term; for each data instance, determines term scores for the data instance and the target text based on the term weights; filters the data instances based on the term scores, to generate a short list of data instances; determines term similarity scores between each data instance of the short list and target text based on the term weights; and provides a data instance determined to likely correspond to the target text and an indication of the corresponding term similarity score(s). A term is a word or an n-gram.Type: GrantFiled: October 11, 2022Date of Patent: June 4, 2024Assignee: Wells Fargo Bank, N.A.Inventors: Mina Naghshnejad, Angelina Yang, Tarun Joshi, Vijayan Nair, Harsh Singhal, Agus Sudjianto
-
Patent number: 11907882Abstract: The innovation disclosed and claimed herein, in one aspect thereof, comprises systems and methods of validating models guided by machine learning algorithms. The innovation can begin by receiving a risk model for validation having multiple sets of data. A first data set is selected from as an input. Outputs are generated for validation. One output can be generating a second set of analysis results using a comparable algorithm to the risk model. Another output can be generating a second set of variables and transformations using a machine learning algorithm and an untransformed set of the selected variables to assess the set of selected transformations. Another output can be generating a third set of variables using one or more machine learning algorithms and an extended feature set of variables to assess the selected variables. The outputs are compared to the analysis results, coefficients, selected variables, and selected transformations. A report of the comparison is generated.Type: GrantFiled: August 25, 2022Date of Patent: February 20, 2024Assignee: Wells Fargo Bank, N.A.Inventors: Vijayan Narayana Nair, Agus Sudjianto, Weicheng Liu, Jie Chen, Kevin David Oden
-
Publication number: 20240013295Abstract: Systems, apparatuses, methods, and computer program products are disclosed for generating a predictive contribution report for an attribute using machine learning techniques. An example method includes generating an entity score for an entity using a predictive analysis machine learning model. The method further includes, in an instance the entity score fails to satisfy a determination decision threshold, selecting a reference entity from a plurality of candidate reference entities and determining a plurality of per-candidate feature contribution scores using a predictive analysis machine learning model. The method further includes generating a predictive contribution report, where the predictive contribution report includes an indication that the entity does not satisfy the determination decision threshold, and an indication of one or more candidate features associated with largest contributions to the entity score.Type: ApplicationFiled: June 16, 2023Publication date: January 11, 2024Inventors: Vijayan Nair, Linwei Hu, Jie Chen, Agus Sudjianto, Tianshu Feng, Zhanyang Zhang
-
Publication number: 20230419176Abstract: Systems, apparatuses, methods, and computer program products are disclosed for generating a predictive temporal feature impact report using a feature engineering machine with attention for time series (FEATS model). An example method includes receiving an entity input data object. The method further includes determining one or more attention head scores for each feature attention head included in the FEATS model based at least in part on one or more per-temporal feature time impact scores over each time window for each temporal feature set. The method further includes generating a predictive temporal feature impact report based at least in part on at least one of the one or more attention head scores for each attention head or the one or more per-temporal feature time impact scores for each temporal feature time point as determined in each attention head.Type: ApplicationFiled: March 27, 2023Publication date: December 28, 2023Inventors: Tianjie Wang, Joel Vaughan, Vijayan Nair, Agus Sudjianto, Jie Chen
-
Patent number: 11763049Abstract: Systems, apparatuses, methods, and computer program products are disclosed for generating time series. A time series simulator receives information corresponding to a request for time series. The information is formatted into input data by the time series simulator. The input data comprises at least one continuous condition. A generator network of the continuous condition generative adversarial network (CCGAN) generates the time series based directly on a value of the at least one continuous condition. The time series is provided such that the time series is at least one of (a) provided as input to an analysis pipeline or (b) received by a user computing device wherein a representation of at least a portion of the one or more time series is provided via an interactive user interface of the user computing device.Type: GrantFiled: January 3, 2023Date of Patent: September 19, 2023Assignee: Wells Fargo Bank, N.AInventors: Rao Fu, Shutian Zeng, Yiping Zhuang, Agus Sudjianto, Jie Chen
-
Publication number: 20230267661Abstract: Systems, apparatuses, methods, and computer program products are disclosed for generating a single-index model (SIM) tree. An example method includes receiving a data set and a maximum tree depth. The example method further includes screening a set of variables from the data set to form split variables. The method may include, while maximum tree depth has not been reached, (i) generating a fast SIM estimation for nodes of a tree level, (ii) for each node, selecting a split point and split variable based on the fast SIM estimation, (iii) based on the selected split points and split variables, generating nodes for a next tree level, each including a subset of data, and (iv) repeating steps (i), (ii), and (iii). The method may include fitting a SIM for each leaf node at maximum tree depth based on a subset of the data set represented by the leaf node.Type: ApplicationFiled: May 2, 2023Publication date: August 24, 2023Inventors: Agus Sudjianto, Aijun Zhang, Zebin Yang
-
Publication number: 20230259707Abstract: Systems, apparatuses, methods, and computer program products are disclosed for determining robustness information for an NLP model. Modification rules, such as replacement rules and/or insertion rules, are used to generate instances of modified test data based on instances of test data that comprise words and have a syntax and a semantic meaning. The instances of test data and modified test data are provided to the NLP model and the output of the NLP model is analyzed to determine output changing instances of modified test data, which are instances of modified test data yielded output from the NLP model that is different and/or not similar to the output yielded from the NLP model for the corresponding instance of test data. Robustness information for the NLP model is determined based at least in part on the output changing instances of modified test data.Type: ApplicationFiled: April 21, 2023Publication date: August 17, 2023Inventors: Tarun JOSHI, Rahul SINGH, Vijayan NAIR, Agus SUDJIANTO
-
Publication number: 20230252480Abstract: Disclosed is an example approach in which network and non-network features are used to train a predictive machine learning model that is implemented to predict financial crime and fraud. Graphical network features may be generated by applying financial entity risk vectors to a network model with representations of various types of networks. The network model may comprise transactional, non-social, and/or social networks, with edges corresponding to linkages that may be weighted according to various characteristics (such as frequency, amount, type, recency, etc.). The graphical network features may be fed to the predictive model to generate a likelihood and/or prediction with respect to a financial crime. A perceptible alert is generated on one or more computing devices if a financial crime is predicted or deemed sufficiently likely. The alert may identify a subset of the set of financial entities involved in the financial crime and present graphical representations of networks and linkages.Type: ApplicationFiled: April 19, 2023Publication date: August 10, 2023Applicant: Wells Fargo Bank, N.A.Inventors: Wayne B. Shoumaker, Harsh Singhal, Suhas Sreehari, Agus Sudjianto, Ye Yu
-
Patent number: 11688113Abstract: Systems, apparatuses, methods, and computer program products are disclosed for generating a single-index model (SIM) tree. An example method includes receiving a data set and a maximum tree depth. The example method further includes screening a set of variables from the data set to form split variables. The method may include, while maximum tree depth has not been reached, (i) generating a fast SIM estimation for nodes of a tree level, (ii) for each node, selecting a split point and split variable based on the fast SIM estimation, (iii) based on the selected split points and split variables, generating nodes for a next tree level, each including a subset of data, and (iv) repeating steps (i), (ii), and (iii). The method may include fitting a SIM for each leaf node at maximum tree depth based on a subset of the data set represented by the leaf node.Type: GrantFiled: July 6, 2021Date of Patent: June 27, 2023Assignee: Wells Fargo Bank, N.A.Inventors: Agus Sudjianto, Aijun Zhang, Zebin Yang
-
Patent number: 11669687Abstract: Systems, apparatuses, methods, and computer program products are disclosed for determining robustness information for an NLP model. Modification rules, such as replacement rules and/or insertion rules, are used to generate instances of modified test data based on instances of test data that comprise words and have a syntax and a semantic meaning. The instances of test data and modified test data are provided to the NLP model and the output of the NLP model is analyzed to determine output changing instances of modified test data, which are instances of modified test data yielded output from the NLP model that is different and/or not similar to the output yielded from the NLP model for the corresponding instance of test data. Robustness information for the NLP model is determined based at least in part on the output changing instances of modified test data. White and/or black box attacks may be performed.Type: GrantFiled: November 12, 2020Date of Patent: June 6, 2023Assignee: Wells Fargo Bank, N.A.Inventors: Tarun Joshi, Rahul Singh, Vijayan Nair, Agus Sudjianto
-
Patent number: 11640609Abstract: Disclosed is an example approach in which network and non-network features are used to train a predictive machine learning model that is implemented to predict financial crime and fraud. Graphical network features may be generated by applying financial entity risk vectors to a network model with representations of various types of networks. The network model may comprise transactional, non-social, and/or social networks, with edges corresponding to linkages that may be weighted according to various characteristics (such as frequency, amount, type, recency, etc.). The graphical network features may be fed to the predictive model to generate a likelihood and/or prediction with respect to a financial crime. A perceptible alert is generated on one or more computing devices if a financial crime is predicted or deemed sufficiently likely. The alert may identify a subset of the set of financial entities involved in the financial crime and present graphical representations of networks and linkages.Type: GrantFiled: December 13, 2019Date of Patent: May 2, 2023Assignee: Wells Fargo Bank, N.A.Inventors: Wayne B. Shoumaker, Harsh Singhal, Suhas Sreehari, Agus Sudjianto, Ye Yu
-
Patent number: 11574096Abstract: Systems, apparatuses, methods, and computer program products are disclosed for generating time series. A time series simulator receives information corresponding to a request for time series. The information is formatted into input data by the time series simulator. The input data comprises at least one continuous condition. A generator network of the continuous condition generative adversarial network (CCGAN) generates the time series based directly on a value of the at least one continuous condition. The time series is provided such that the time series is at least one of (a) provided as input to an analysis pipeline or (b) received by a user computing device wherein a representation of at least a portion of the one or more time series is provided via an interactive user interface of the user computing device.Type: GrantFiled: May 24, 2021Date of Patent: February 7, 2023Assignee: WELLS FARGO BANK, N.A.Inventors: Rao Fu, Shutian Zeng, Yiping Zhuang, Agus Sudjianto, Jie Chen