Abstract: In variants, the method can include determining training data, determining a router, and using the router. In variants, using the router can include receiving a runtime prompt, predicting performance scores for the runtime prompt for each of a set of candidate models, optionally predicting operational metrics for responding to the runtime prompt for each of the set of candidate models, selecting a candidate model based on the predicted performance scores and optionally the predicted operational metrics, and optionally determining a response based on the runtime prompt.
Type:
Application
Filed:
April 24, 2025
Publication date:
August 21, 2025
Applicant:
Martian Learning, Inc.
Inventors:
Shriyash K. Upadhyay, Etan J. Ginsberg, Dory Zidon, Luka Samkharadze
Abstract: In variants, the method can include generating mapping model training data, determining the mapping model, and predicting a program based on a transformer. The method can optionally include evaluating the mapping model, running analyses on the program, and/or utilizing the program and/or generated program analyses. The method functions to convert transformer models into programs that can be characterized and/or analyzed using program analysis techniques.
Type:
Grant
Filed:
August 12, 2024
Date of Patent:
July 29, 2025
Assignee:
Martian Learning, Inc.
Inventors:
Shriyash K. Upadhyay, Etan J. Ginsberg, Luka Samkharadze
Abstract: In variants, the method can include determining training data, determining a router, and using the router. In variants, using the router can include receiving a runtime prompt, predicting performance scores for the runtime prompt for each of a set of candidate models, optionally predicting operational metrics for responding to the runtime prompt for each of the set of candidate models, selecting a candidate model based on the predicted performance scores and optionally the predicted operational metrics, and optionally determining a response based on the runtime prompt.
Type:
Grant
Filed:
August 12, 2024
Date of Patent:
May 27, 2025
Assignee:
Martian Learning, Inc.
Inventors:
Shriyash K. Upadhyay, Etan J. Ginsberg, Dory Zidon, Luka Samkharadze
Abstract: In variants, the method can include generating mapping model training data, determining the mapping model, and predicting a program based on a transformer. The method can optionally include evaluating the mapping model, running analyses on the program, and/or utilizing the program and/or generated program analyses. The method functions to convert transformer models into programs that can be characterized and/or analyzed using program analysis techniques.
Abstract: In variants, the method can include determining training data, determining a router, and using the router. In variants, using the router can include receiving a runtime prompt, predicting performance scores for the runtime prompt for each of a set of candidate models, optionally predicting operational metrics for responding to the runtime prompt for each of the set of candidate models, selecting a candidate model based on the predicted performance scores and optionally the predicted operational metrics, and optionally determining a response based on the runtime prompt.
Type:
Application
Filed:
August 12, 2024
Publication date:
February 13, 2025
Applicant:
Martian Learning, Inc.
Inventors:
Shriyash K. Upadhyay, Etan J. Ginsberg, Dory Zidon