io.github.mdfifty50-boop/qc-validator
MCP server for runtime quality validation of AI agent outputs — hallucination detection, scope compl
Versions
0.1.0latestTools 6
validate_output Score agent output quality against configurable criteria. Checks length, required keywords, forbidden patterns, claim density, and task relevance.
check_hallucination_risk Estimate hallucination likelihood in agent output. If source text is provided, checks grounding. Otherwise flags outputs with high counts of specific numbers, dates, and URLs.
check_scope_compliance Validate that agent output stays within a defined scope contract. Checks allowed/forbidden topics, word limits, and required sections.
log_validation Store a validation result for trending and failure pattern analysis. Accumulates per-agent statistics over time.
get_failure_patterns Analyze common failure modes for a specific agent. Returns pass rate, average score, most frequent issue types, and quality trend direction.
generate_quality_report Generate a quality dashboard for all validated agents. Shows per-agent summaries, overall pass rate, worst/best performers, and actionable recommendations.
Permissions 1
env_vars low