Abstract: A system for generating customized knowledge assessments comprises a context gatherer configured to collect test taker work data from data sources and exemplar test formats, wherein the context gatherer preprocesses collected test taker work data to extract concepts, frameworks, and skill patterns. The system includes a multi-agent orchestra comprising specialized agents including a context analysis agent, a question generation agent, a quality assurance agent, a validation agent, and a refinement agent. A system controller coordinates the specialized agents and manages bidirectional communication between them. A dual-layer validation system comprises a first validation layer configured to perform structural validation using schema checking and a second validation layer comprising a fine-tuned language model configured to perform semantic validation including duplicate detection and relevance scoring. An output generator produces formatted assessment outputs based on validated assessment questions.