Abstract: An AI orchestration system dynamically manages multiple artificial intelligence (AI) agents within a cloud computing environment to efficiently process user requests. A model orchestration subsystem determines whether a request is handled locally using a domain-specific database or by invoking one or more AI agents. The system maintains AI agents in active and inactive states, provisioning computing resources for inactive agents as needed. Real-time model metrics guide the selection of target AI agents, and if a degrading performance trend is detected, the system preemptively spins up additional AI instances. The system provisions processor cycles, memory, and network bandwidth through a cloud-based resource manager, instantiates containerized execution environments or virtual machines, and performs automated load balancing among AI instances.
Type:
Grant
Filed:
April 1, 2025
Date of Patent:
November 25, 2025
Assignee:
Proactive AI Lab, Inc.
Inventors:
Maria Renhui Zhang, Chuan Ren, Mikita Dvornik, Xue Liu, Xi Chen, Timothy Howes