Can the rule be explained?
Require the source, the expert’s rationale, and the conditions where a rule applies. Identify contradictions that need review.
AI Skill ValidationTurn expert judgment into a clear plan for AI Agent Skills. Define the decisions, evidence, exceptions, and acceptance criteria before capture begins.
Engineer the reasoning behind the work.
01 / Define the work
A useful skill starts with a specific piece of work. What should the agent recognize? What evidence should it examine? Which decision should it help someone make?
Build the project around that outcome. Define the situation, the people who understand it, and the limits of the agent’s role. This gives every topic, question, and capture session a purpose.
02 / Map the reasoning
Experts recognize the detail that makes one case different from the last. Organize topics around those distinctions, then ask questions that expose the decision behind the action.
Capture the signal, the comparison, and the context the expert checked first.
Ask for the exception, the conflicting evidence, and a case where the usual response failed.
Define missing inputs and decisions that need someone with the authority to act.
Check whether the changed component could explain the failures. Timing supports an investigation, but does not establish the cause.
“What would you check before recommending a rollback?”
Look for earlier changes and other causes. Capture why the release timeline changes the investigation instead of treating every error spike the same way.
“Which other changes would you investigate, and why?”
Request the missing timestamps or an incident owner’s review. Make uncertainty an explicit branch so the agent knows what evidence it needs next.
“What is the minimum evidence needed to continue?”
An illustrative reasoning map. Each project defines its own rules and boundaries.
03 / Plan the capture
Turn the reasoning map into a focused capture plan. Connect each topic to the right expert, the evidence to bring, and the questions that still need an answer.
If an explanation lacks a source or leaves an exception unresolved, carry that gap into the next session. The project plan should make the next useful conversation obvious.
Group related questions around a concrete judgment, such as distinguishing a release defect from an unrelated incident.
Match topics to the experts who have made the decision. Ask them to bring the cases that reveal how they think.
Organize questions, supporting sources, and expected capture time. Use AI-assisted questions and prompts written by the designer to pursue the missing detail.
04 / Set the criteria
Set acceptance criteria while planning the skill. Reviewers need to know what evidence to expect, which scenarios to examine, and what should send the work back for another expert conversation.
Require the source, the expert’s rationale, and the conditions where a rule applies. Identify contradictions that need review.
AI Skill ValidationSpecify a routine case, a difficult variation, and a case with missing evidence. Define the expected reasoning and when to escalate.
AI Skill PlaygroundIdentify who reviews the skill, what must be resolved before publication, and who is responsible when the underlying work changes.
AI Agent Skill CatalogStart with one decision
Bring a workflow and a case that required judgment. We can help turn it into a focused skill project, from the first question to the criteria for review.