Abstract: A system, method, and computer-program product includes obtaining, via an application programming interface (API), a test object that includes application usage data of a deployed AI application for a target time span, executing, in real-time by one or more computer processors, one or more application behavior tests that assess an operational behavior of the deployed AI application, detecting, by the one or more computer processors, that a misbehavior occurred in the deployed AI application during the target time span and one or more deviant features contributing to the misbehavior in response to executing the one or more application behavior tests, and returning, by the one or more computer processors, the one or more deviant features contributing to the misbehavior to a subscribing entity associated with the deployed AI application.
Type:
Grant
Filed:
May 23, 2025
Date of Patent:
December 23, 2025
Assignee:
Distributional, Inc.
Inventors:
Michael McCourt, Renaud Bourassa-Denis, Keith Laban, Olivia Kim, Ian Dewancker, Bolong Cheng, Halley Vance, Scott Clark
Abstract: A system, method, and computer-program product includes obtaining, via an application programming interface (API), a test object that includes application usage data of a deployed AI application for a target time span, executing, in real-time by one or more computer processors, one or more application behavior tests that assess an operational behavior of the deployed AI application, detecting, by the one or more computer processors, that a misbehavior occurred in the deployed AI application during the target time span and one or more deviant features contributing to the misbehavior in response to executing the one or more application behavior tests, and returning, by the one or more computer processors, the one or more deviant features contributing to the misbehavior to a subscribing entity associated with the deployed AI application.
Type:
Application
Filed:
May 23, 2025
Publication date:
December 4, 2025
Applicant:
Distributional, Inc.
Inventors:
Michael McCourt, Renaud Bourassa-Denis, Keith Laban, Olivia Kim, Ian Dewancker, Bolong Cheng, Halley Vance, Scott Clark