Back to search
B
77.5 /100

io.github.dbsectrainer/mcp-eval-runner

Author dbsectrainer
Scanned 13d ago

A standardized testing harness for MCP servers and agent workflows

MCP Registry

Versions

1.0.0scored
first seen May 19, 2026

Trust breakdown

PermissionsTool SafetyAuthAnnotationsCode QualityStabilitySpecVuln HistoryAuthorTransparencyCommunity

Tools 4

list_cases
annotations: none low

Enumerate all available fixtures with their step counts and assertion types.

regression_report
annotations: none low

Compare current state to the last run and return what changed (regressions, fixes, new cases).

compare_results
annotations: none low

Diff two named run results by run ID. Shows regressions, fixes, new and removed cases.

run_id_a string run_id_b string
search_test
annotations: verified low

tool_names array
readOnlyHint true

Permissions 3

filesystem Server uses filesystem capabilities via: fs sync ops
low
shell Server uses shell capabilities via: child_process, spawn()
high
env_vars Server uses env_vars capabilities via: process.env
low

Scan Findings 24

low
Tool 'list_cases' has no annotations annotation_checker · 100%
low
Tool 'regression_report' has no annotations annotation_checker · 100%
low
Tool 'compare_results' has no annotations annotation_checker · 100%
info
Tool 'search_test' annotations are consistent annotation_checker · 80%
info
Sandbox failed to start for behavioral verification behavioral_verifier · 100%
medium
Vulnerable dependency: @modelcontextprotocol/sdk@1.30.0 (GHSA-22jm-h49p-29qw) dependency_analyzer · 95%
medium
Vulnerable dependency: @modelcontextprotocol/sdk@1.30.0 (GHSA-46jr-4wx8-v453) dependency_analyzer · 95%
medium
Vulnerable dependency: @modelcontextprotocol/sdk@1.30.0 (GHSA-6prh-2h8m-c8cw) dependency_analyzer · 95%
medium
Vulnerable dependency: @modelcontextprotocol/sdk@1.30.0 (GHSA-6qxp-vccf-f47h) dependency_analyzer · 95%
medium
Vulnerable dependency: @modelcontextprotocol/sdk@1.30.0 (GHSA-rvq5-wwqv-78pq) dependency_analyzer · 95%
medium
Buffer.from base64 in dbsectrainer-mcp-eval-runner-bb72647/src/auth.ts:17 entropy_analyzer · 75%
info
package.json metadata manifest_parser · 100%
info
Tool: list_cases manifest_parser · 70%
info
Tool: regression_report manifest_parser · 70%
info
Tool: compare_results manifest_parser · 70%
info
Tool: search_test manifest_parser · 75%
info
Transport: stdio manifest_parser · 90%
info
Required env vars (5) manifest_parser · 80%
info
Sandbox failed to start for output poisoning scan output_poisoning · 100%
low
Permission: filesystem access detected permission_analyzer · 90%
high
Permission: shell access detected permission_analyzer · 95%
low
Permission: env_vars access detected permission_analyzer · 90%
info
SBOM generated: 323 components sbom_generator · 100%
medium
No build provenance detected (SLSA L0) slsa_assessor · 90%