Back to search
B
77.5 /100

io.github.dbsectrainer/mcp-eval-runner

Author dbsectrainer
Scanned 48d ago

A standardized testing harness for MCP servers and agent workflows

MCP Registry

Versions

1.0.0scored
first seen May 19, 2026

Trust breakdown

PermissionsTool SafetyAuthAnnotationsCode QualityStabilitySpecVuln HistoryAuthorTransparencyCommunity

Tools 4

list_cases
annotations: none low

Enumerate all available fixtures with their step counts and assertion types.

regression_report
annotations: none low

Compare current state to the last run and return what changed (regressions, fixes, new cases).

compare_results
annotations: none low

Diff two named run results by run ID. Shows regressions, fixes, new and removed cases.

run_id_a string run_id_b string
search_test
annotations: verified low

tool_names array
readOnlyHint true

Permissions 3

filesystem Server uses filesystem capabilities via: fs sync ops
low
shell Server uses shell capabilities via: child_process, spawn()
high
env_vars Server uses env_vars capabilities via: process.env
low

Scan Findings 28

low
Tool 'list_cases' has no annotations annotation_checker · 100%
low
Tool 'regression_report' has no annotations annotation_checker · 100%
low
Tool 'compare_results' has no annotations annotation_checker · 100%
info
Tool 'search_test' annotations are consistent annotation_checker · 80%
info
Sandbox failed to start for behavioral verification behavioral_verifier · 100%
medium
Vulnerable dependency: @modelcontextprotocol/sdk@1.12.0 (GHSA-345p-7cg4-v4c7) dependency_analyzer · 95%
medium
Vulnerable dependency: @modelcontextprotocol/sdk@1.12.0 (GHSA-8r9q-7v3j-jr4g) dependency_analyzer · 95%
medium
Vulnerable dependency: @modelcontextprotocol/sdk@1.12.0 (GHSA-w48q-cv73-mx4w) dependency_analyzer · 95%
medium
Vulnerable dependency: js-yaml@4.1.0 (GHSA-2883-xcg3-v3hh) dependency_analyzer · 95%
medium
Vulnerable dependency: js-yaml@4.1.0 (GHSA-52cp-r559-cp3m) dependency_analyzer · 95%
medium
Vulnerable dependency: js-yaml@4.1.0 (GHSA-5p4m-2wfm-xmqj) dependency_analyzer · 95%
medium
Vulnerable dependency: js-yaml@4.1.0 (GHSA-h67p-54hq-rp68) dependency_analyzer · 95%
medium
Vulnerable dependency: js-yaml@4.1.0 (GHSA-mh29-5h37-fv8m) dependency_analyzer · 95%
medium
Vulnerable dependency: vitest@4.1.0 (GHSA-82fw-gwwq-j7x9) dependency_analyzer · 95%
medium
Buffer.from base64 in dbsectrainer-mcp-eval-runner-4a42592/src/auth.ts:17 entropy_analyzer · 75%
info
package.json metadata manifest_parser · 100%
info
Tool: list_cases manifest_parser · 70%
info
Tool: regression_report manifest_parser · 70%
info
Tool: compare_results manifest_parser · 70%
info
Tool: search_test manifest_parser · 75%
info
Transport: streamable-http manifest_parser · 80%
info
Required env vars (5) manifest_parser · 80%
info
Sandbox failed to start for output poisoning scan output_poisoning · 100%
low
Permission: filesystem access detected permission_analyzer · 90%
high
Permission: shell access detected permission_analyzer · 95%
low
Permission: env_vars access detected permission_analyzer · 90%
info
SBOM generated: 320 components sbom_generator · 100%
medium
No build provenance detected (SLSA L0) slsa_assessor · 90%