andriikhanin/mcp-agent-security-test-suite

No problems traced to this repository code in these checks. 2 static matches retained as context.

2 hardcoded secret matches retained as context; full list in the evidence.

OSV scanned supported lockfiles; unpinned dependencies and unsupported formats are outside this check.

A short run cannot establish that code is safe.

Connections show IP addresses; proxies can hide the final hostname.

Tracing covers dispatched commands and their children, not the whole OS; guest root can interfere with tracing.

Full safety evidence →

• The tool is an offline synthetic contract-testing tool: Real input produced the expected result: "status": "PASS"

  Source: This is an **offline synthetic contract-testing tool**

  Input: fixtures/scenario-denial.json

  Expected: PASS

  Command: node src/cli.mjs scenario fixtures/scenario-denial.json

  Observed: …"status": "PASS", "scenario": "access-boundaries", "checks": 11, "actualFinal": { "allowed": 2, "denied": 9, "reads": 1, "writes": 1, "notes": 1 }, "mismatches": [], "steps": [ { "step": 1, "decision": "DENY", "reason": "OWNER_MISMATCH", "effect": "NONE", "outcome": "SUCCESS" }, { "step": 2, "decision": "DENY", "reason": "AUDIENCE_MISMATCH", "effect": "NONE", "outcome": "SUCCESS" }, { "step": 3, "decision": "DENY", "reason": "INSUFFICIENT_SCOPE", "effect": "NO

Examples

• Quickstart scenario run: command completed successfully

  Source: README.md / Quickstart

  Input: fixtures/scenario-denial.json

  Expected: PASS

  Command: node src/cli.mjs scenario fixtures/scenario-denial.json

  Observed: n": "DENY", "reason": "APPROVAL_REQUIRED", "effect": "NONE", "outcome": "SUCCESS" }, { "step": 10, "decision": "ALLOW", "reason": "AUTHORIZED", "effect": "WRITE", "outcome": "SUCCESS" }, { "step": 11, "decision": "ALLOW", "reason": "AUTHORIZED", "effect": "READ", "outcome": "SUCCESS" } ], "reportSchemaVersion": 1, "command": "scenario", "exitCode": 0, "summary": { "failureCount": 0, "reportedFindings": 0, "findingsTruncated": false, "ruleCodes": [] }, "guidance": [] }

Local or hosted: local

Run synthetic scenario contract check

pwd; git status --short --branch; rg --files -g 'README*' -g 'pyproject.toml' -g 'package.json' -g 'requirements*.txt' -g 'Makefile' -g 'AGENTS.md' -g '.github/**' | head -80; python3 --version; sed -n '1,240p' README.md
rg --files | head -20; node --version; npm --version; rg -n '^## |^```sh|^```bash' README.md | tail -60; ls -la
grep -nE '^## |^```sh|^```bash' README.md | tail -70; cat package.json; ls .coldpass
sed -n '608,630p' README.md; node src/cli.mjs scenario fixtures/scenario-denial.json
node src/cli.mjs --help | head -15
mkdir -p .coldpass; cat > .coldpass/probe.json <<'EOF'
{"kind":"cli","argv":["node","src/cli.mjs","scenario","fixtures/scenario-denial.json"],"cwd":"<guest-path>","expected_text":"\"status\": \"PASS\""}
EOF
cat > .coldpass/claims.json <<'EOF'
[{"kind":"claim","claim":"Scenario fixture produces synthetic policy results","source":"scenario — synthetic authorization, replay, scoped resources and failure semantics","input":"fixtures/scenario-denial.json","expected":"PASS","probe_kind":"cli","argv":["node","src/cli.mjs","scenario","fixtures/scenario-denial.json"],"expected_text":"\"status\": \"PASS\"","cwd":"<guest-path>"}]
EOF
cat > .coldpass/examples.json <<'EOF'
[{"kind":"example","claim":"Quickstart scenario run","source":"README.md / Quickstart","input":"fixtures/scenario-denial.json","expected":"PASS","argv":["node","src/cli.mjs","scenario","fixtures/scenario-denial.json"],"cwd":"<guest-path>","expected_text":"\"status\": \"PASS\""}]
EOF
cat > .coldpass/cycles.json <<'EOF'
{"detected":false,"checks":[],"reason":"Inspected README entrypoints and package scripts; the documented operations are one-shot CLI contract checks, with no scheduler or recurring cycle."}
EOF

<env-var>=<guest-path> python3 -I <guest-path> --validate --replay
sed -n '18,26p' README.md
cat > .coldpass/claims.json <<'EOF'
[{"kind":"claim","claim":"The tool is an offline synthetic contract-testing tool","source":"This is an **offline synthetic contract-testing tool**","input":"fixtures/scenario-denial.json","expected":"PASS","probe_kind":"cli","argv":["node","src/cli.mjs","scenario","fixtures/scenario-denial.json"],"expected_text":"\"status\": \"PASS\"","cwd":"<guest-path>"}]
EOF

<env-var>=<guest-path> python3 -I <guest-path> --validate --replay
cat > .coldpass/report.json <<'EOF'
{"outcome":"working","fault_owner":null,"operation":"Run synthetic scenario contract check","operation_scope":"README Quickstart scenario fixture; Node.js >=20 prerequisite","steps":["Read README Quickstart and confirmed Node.js 22.23.4 satisfies the >=20 requirement","Ran node src/cli.mjs scenario fixtures/scenario-denial.json; output reported PASS with 11 checks","Saved probe, exact README claim, example and cycle assessment","Validated and replayed evidence with the coldpass checker"],"deviations":["None"],"stuck_step":null,"main_blocker":null,"plain_failure":null,"suggested_fix":null}
EOF