coldpass

plimsollmark/plimsoll

GitHub ↗ · How this check works

Per-setup public labels: Linux / Haiku: Works · Linux / Luna: Works

Static status badge · SVG · read-only JSON. Embed with ![Coldpass status](https://coldpass.dev/badge/plimsollmark--plimsoll.svg).

mcp-server

Works

The recorded run passed on 2 setups.

Answers apply to each recorded setup, revision and operation. Earlier observations remain in Run details.

Tested on Linux
PlatformHaikuLuna
Linuxyesyes

Linux / Haiku 5.5: yes · Oct 27, 2026 · e543f3c78de9 · claude-code / 2.1.310 (Claude Code)
Recorded operation: go run./examples/minimal

Linux / Luna: yes · Oct 27, 2026 · e543f3c78de9 · codex / codex-cli 0.164.0
Recorded operation: go run./examples/minimal

Does what it says
1 of 1 claims checked out
  • The local quickstart runs the WASM sandbox and returns department totals.: Real input produced the expected result: {"Engineering":59000000,"Sales":20300000,"Operations":9800000}

    Source: With Go installed:

    Input: README minimal quickstart with SANDBOX_PROVIDER=wasm

    Expected: stdout totals for Engineering, Sales and Operations

    Command: go run ./examples/minimal

    Observed: {"Engineering":59000000,"Sales":20300000,"Operations":9800000}

MCP
Documented only
Local or hosted
both local and hosted
Both a local install and a hosted service
Needs keys or browser
None seen
Maintained
Maintained
actively maintained: last commit 0 days ago; 110 commits and 0 merged PRs in 90 days; 0 open issues, 0 open PRs; latest release 2026-10-27

Last commit Oct 27, 2026

Setup time
2 min 19 s
2 min 19 s to a working result
Issue
none found in recorded check
Examples
1 of 1 ran as expected
  • Run the documented local quickstart.: command completed successfully

    Source: README.md#Run something locally

    Input: SANDBOX_PROVIDER=wasm

    Expected: A successful WASM process run and department totals.

    Command: go run ./examples/minimal

    Observed: provider wasm isolation process exit code 0 timed out false truncated stdout=false stderr=false duration 374ms stdout {"Engineering":59000000,"Sales":20300000,"Operations":9800000}

Evidence
README behavior checked
Agent interfaces
CLI, MCP (documented only)
CLI, MCP (documented only)

Observed interfaces were exercised by the checker. Documentation alone does not confirm compatibility.

Tested with
Codex / Luna
  • Linux: Codex / Luna · agent codex-cli 0.164.0 · Checked operation passed · Oct 27, 2026 on e543f3c78de9

Each entry describes its recorded operation and source revision.

Safety
No unexpected network or file activity found in these checks

No problems traced to this repository code in these checks; a short run cannot prove safety. 400 listed items (named-host connections, static matches, dependency advisories) are below and do not change this verdict. 6 static matches retained as context.

Source contains encoded blob; review its purpose. docs/trainers/mcp-tour.js

Gitleaks found a possible hardcoded secret; value withheld. docs/callers.md

OSV reports a known vulnerability in this dependency version. 27 distinct locations. 189 findings.

Full event, path and process lists for each observed setup:

Run details

Haiku 5.5

Native agent · Checked operation passed

Checked operation go run ./examples/minimal

Agent-reported scope: Run the README quickstart: SANDBOX_PROVIDER=wasm go run ./examples/minimal, which executes one JavaScript snippet in the in-process wasm sandbox and prints the department totals.

Run details
run
plimsollmark--plimsoll-claude-haiku-5-5-1793145239219658611
date
Oct 27, 2026
time to working
153.0s
product hosting / execution
Local command in the guest
recorded operation scope
product operation
model
claude-haiku-5-5
agent / version
claude-code / 2.1.310 (Claude Code)
platform
linux
reported cost
$0.011477
Recorded source
https://github.com/plimsollmark/plimsoll
Backend
hyperv
Tool transport
mcp-assigned-vm
Requested source pin (not an observed revision)
{"commit": "e543f3c78de95cdfbe659774cf72efdb9a176829", "url": "https://github.com/plimsollmark/plimsoll"}
Test version
readme-d5b140d3c0f8b95c2dd6fe6fc381a303cacb92679582c22317d8e78b572f0cf2
revision
e543f3c78de95cdfbe659774cf72efdb9a176829
Whose fault: not assigned · resolved

Safety: Review signals: 4 encoded blob, 1 hardcoded secret, 195 known vulnerability. 3 static matches retained as context.

Review signals: 4 encoded blob, 1 hardcoded secret, 195 known vulnerability. 3 static matches retained as context.

Source contains encoded blob; review its purpose. docs/trainers/mcp-tour.js

Gitleaks found a possible hardcoded secret; value withheld. docs/callers.md

OSV reports a known vulnerability in this dependency version. 27 distinct locations. 189 findings.

3 hardcoded secret matches retained as context; full list in the evidence.

OSV scanned supported lockfiles; unpinned dependencies and unsupported formats are outside this check.

A short run cannot establish that code is safe.

Connections show IP addresses; proxies can hide the final hostname.

Tracing covers dispatched commands and their children, not the whole OS; guest root can interfere with tracing.

Only 200 of 316 findings are stored; the summary counts all of them.

Full safety evidence →

Answers recorded for this run
  • The minimal example runs without a daemon, Docker, credentials or network: Real input produced the expected result: "Sales":20300000

    Source: The example's execution needs no daemon, Docker, credentials or outbound network.

    Input: go run ./examples/minimal with SANDBOX_PROVIDER=wasm

    Expected: JSON totals per department printed by the sandboxed snippet

    Command: go run ./examples/minimal

    Observed: "Sales":20300000,"Operations":9800000}

  • The example explicitly selects a provider: Real input produced the expected result: provider wasm

    Source: The example explicitly selects a provider.

    Input: go run ./examples/minimal with SANDBOX_PROVIDER=wasm

    Expected: provider line reports wasm

    Command: go run ./examples/minimal

    Observed: provider wasm isolation process exit code 0 timed out false truncated stdout=false stderr=false duration 359ms stdout {"Engineering":59000000,"Sales":20300000,"Operations":9800000}

Examples

  • Quickstart: run the minimal sandbox example with the wasm provider: command completed successfully

    Source: README.md#run-something-locally

    Input: SANDBOX_PROVIDER=wasm go run ./examples/minimal

    Expected: provider wasm, isolation process, exit code 0, stdout with department totals

    Command: go run ./examples/minimal

    Observed: provider wasm isolation process exit code 0 timed out false truncated stdout=false stderr=false duration 346ms stdout {"Engineering":59000000,"Sales":20300000,"Operations":9800000}

Local or hosted: both

What the agent did

Run the README quickstart: SANDBOX_PROVIDER=wasm go run ./examples/minimal, which executes one JavaScript snippet in the in-process wasm sandbox and prints the department totals.

cd <guest-path> && pwd && ls -la && git status 2>&1 | head -3; id -u; python3 --version; cat /etc/os-release | head -2; echo "CDP=$CDP_URL"; ls /inputs 2>&1
cd <guest-path> && ls README* && wc -c README* && head -c 7000 README.md
cd <guest-path> && tail -c +7000 README.md | head -c 6000
cd <guest-path> && cat go.mod | head -8; echo ---; cat toolchain.versions; echo ---; which go; go version 2>&1; ls /usr/local/go 2>&1 | head -2
cd <guest-path> && go version && time (SANDBOX_PROVIDER=wasm timeout 900 go run ./examples/minimal > /tmp/minimal.out 2>&1; echo "exit=$?") ; tail -c 3000 /tmp/minimal.out
cd <guest-path> && tail -c +13000 README.md | head -c 6400
cd <guest-path> && grep -n -i -E "cron|schedul|--once|--now|webhook|ticker|loop" README.md | head; echo ---; ls examples | head -40; echo ---; ls docs | head -40; echo; ls cmd
cd <guest-path> && grep -rn -E "time\.NewTicker|time\.Tick\(|cron" cmd/plimsolld examples/minimal 2>/dev/null | head -5; echo "rc=$?"; ls -la .coldpass; cat examples/minimal/*.go | head -60
cd <guest-path> && sed -n 645,675p cmd/plimsolld/main.go
cd <guest-path> && grep -rln -E "func \(.*\) (Preflight|Reconcile[A-Za-z]*)\(" sandbox | head -20; echo ---; ls sandbox | head -40
cd <guest-path> && grep -n -E "func \(.*\) (Preflight|Reconcile[A-Za-z]*)\(" sandbox/wasm.go; grep -n -E "OrphanReconciler|Preflighter" sandbox/*.go | grep -v _test | head -8; grep -n -B2 -A12 "func (.*) Preflight(" sandbox/wasm.go | head -30
cd <guest-path> && cat > probe.json <<'EOF'
{"kind":"cli","argv":["go","run","./examples/minimal"],"cwd":"<guest-path>","env":{"SANDBOX_PROVIDER":"wasm"},"expected_text":"\"Sales\":20300000"}
EOF
cat > claims.json <<'EOF'
[{"kind":"claim","claim":"The minimal example runs without a daemon, Docker, credentials or network","source":"The example's execution needs no daemon, Docker, credentials or outbound network.","input":"go run ./examples/minimal with SANDBOX_PROVIDER=wasm","expected":"JSON totals per department printed by the sandboxed snippet","probe_kind":"cli","argv":["go","run","./examples/minimal"],"env":{"SANDBOX_PROVIDER":"wasm"},"expected_text":"\"Sales\":20300000","cwd":"<guest-path>"},
{"kind":"claim","claim":"The example explicitly selects a provider","source":"The example explicitly selects a provider.","input":"go run ./examples/minimal with SANDBOX_PROVIDER=wasm","expected":"provider line reports wasm","probe_kind":"cli","argv":["go","run","./examples/minimal"],"env":{"SANDBOX_PROVIDER":"wasm"},"expected_text":"provider   wasm","cwd":"<guest-path>"}]
EOF
cat > examples.json <<'EOF'
[{"kind":"example","claim":"Quickstart: run the minimal sandbox example with the wasm provider","source":"README.md#run-something-locally","input":"SANDBOX_PROVIDER=wasm go run ./examples/minimal","expected":"provider wasm, isolation process, exit code 0, stdout with department totals","argv":["go","run","./examples/minimal"],"cwd":"<guest-path>","env":{"SANDBOX_PROVIDER":"wasm"},"expected_text":"\"Sales\":20300000"}]
EOF
cat > cycles.json <<'EOF'
{"detected":false,"reason":"README has no cron, schedule, --once, --now or webhook behaviour. The only loop found is cmd/plimsolld/main.go (time.NewTicker(time.Minute), ~line 658), a daemon-internal isolation re-check that logs only on a failed preflight; the wasm Preflight returns nil so a successful cycle has no observable output. The README quickstart does not start plimsolld, so no cycle was triggered.","checks":[]}
EOF
for f in *.json; do python3 -I -m json.tool "$f" >/dev/null && echo "ok $f"; done
cd <guest-path> && cat > report.json <<'EOF'
{"outcome":"working","fault_owner":null,"operation":"Run the README quickstart: SANDBOX_PROVIDER=wasm go run ./examples/minimal, which executes one JavaScript snippet in the in-process wasm sandbox and prints the department totals.","operation_scope":"Local only. Needs Go (installed 1.26.10 via the module toolchain line; /usr/bin/go on Ubuntu 24.04). No daemon, Docker, credentials or outbound network needed for the run itself. Go module downloads needed network on first run. Daemon plimsolld and gVisor/Docker/hosted providers were not exercised.","steps":["SANDBOX_PROVIDER=wasm go run ./examples/minimal"],"deviations":["Used the README's installed Go (/usr/bin/go, version go1.26.10 downloaded by the toolchain line) instead of a separate install step; no install was needed.","Did not start plimsolld or run the Docker/gVisor/hosted providers; the README quickstart does not require them."],"stuck_step":null,"main_blocker":null,"plain_failure":null,"suggested_fix":"None for the quickstart. The daemon's one-minute isolation re-check was not triggered and is not covered by this run."}
EOF
python3 -I -m json.tool report.json >/dev/null && echo ok; cd <guest-path> && <env-var>=<guest-path> timeout 900 python3 -I <guest-path> --validate --replay 2>&1 | tail -c 4000
Earlier attempts (1)

Luna

Native agent · Checked operation passed

Checked operation go run ./examples/minimal

Agent-reported scope: Run the README minimal Go example with the WASM provider

Run details
run
plimsollmark--plimsoll-gpt-6-luna-1793145477910439947
date
Oct 27, 2026
time to working
138.6s
product hosting / execution
Local command in the guest
recorded operation scope
product operation
model
gpt-6-luna
agent / version
codex / codex-cli 0.164.0
platform
linux
reported cost
not reported (not assumed free)
Recorded source
https://github.com/plimsollmark/plimsoll
Backend
hyperv
Tool transport
mcp-assigned-vm
Requested source pin (not an observed revision)
{"commit": "e543f3c78de95cdfbe659774cf72efdb9a176829", "url": "https://github.com/plimsollmark/plimsoll"}
Test version
readme-38e6b13f3b13804effb95797e3466b1a1334da7a232d897cbc8965867f802605
revision
e543f3c78de95cdfbe659774cf72efdb9a176829
Whose fault: not assigned · resolved

Safety: Review signals: 4 encoded blob, 1 hardcoded secret, 195 known vulnerability. 3 static matches retained as context.

Review signals: 4 encoded blob, 1 hardcoded secret, 195 known vulnerability. 3 static matches retained as context.

Source contains encoded blob; review its purpose. docs/trainers/mcp-tour.js

Gitleaks found a possible hardcoded secret; value withheld. docs/callers.md

OSV reports a known vulnerability in this dependency version. 27 distinct locations. 189 findings.

3 hardcoded secret matches retained as context; full list in the evidence.

OSV scanned supported lockfiles; unpinned dependencies and unsupported formats are outside this check.

A short run cannot establish that code is safe.

Connections show IP addresses; proxies can hide the final hostname.

Tracing covers dispatched commands and their children, not the whole OS; guest root can interfere with tracing.

Only 200 of 316 findings are stored; the summary counts all of them.

Full safety evidence →

Answers recorded for this run
  • The local quickstart runs the WASM sandbox and returns department totals.: Real input produced the expected result: {"Engineering":59000000,"Sales":20300000,"Operations":9800000}

    Source: With Go installed:

    Input: README minimal quickstart with SANDBOX_PROVIDER=wasm

    Expected: stdout totals for Engineering, Sales and Operations

    Command: go run ./examples/minimal

    Observed: {"Engineering":59000000,"Sales":20300000,"Operations":9800000}

Examples

  • Run the documented local quickstart.: command completed successfully

    Source: README.md#Run something locally

    Input: SANDBOX_PROVIDER=wasm

    Expected: A successful WASM process run and department totals.

    Command: go run ./examples/minimal

    Observed: provider wasm isolation process exit code 0 timed out false truncated stdout=false stderr=false duration 374ms stdout {"Engineering":59000000,"Sales":20300000,"Operations":9800000}

Local or hosted: both

What the agent did

Run the README minimal Go example with the WASM provider

pwd && ls -la && sed -n '1,240p' README.md && python3 --version && id -u
rg -n 'go version|toolchain|go run ./examples/minimal|provider|Go ' README.md go.mod toolchain.versions && go version && git status --short && find .coldpass -maxdepth 2 -type f -print
grep -nE 'go version|toolchain|go run ./examples/minimal|provider|Go ' README.md go.mod toolchain.versions; go version; git status --short; find .coldpass -maxdepth 2 -type f -print
sed -n '1,160p' examples/minimal/main.go; cat go.mod; sed -n '1,120p' examples/minimal/README.md 2>/dev/null; ls .coldpass
SANDBOX_PROVIDER=wasm go run ./examples/minimal
find <guest-path> -maxdepth 2 -name check.py -o -name coldpass-preflight.py; mkdir -p .coldpass; cat > .coldpass/probe.json <<'EOF'
{"kind":"cli","argv":["go","run","./examples/minimal"],"cwd":"<guest-path>","env":{"SANDBOX_PROVIDER":"wasm"},"expected_text":"{\"Engineering\":59000000,\"Sales\":20300000,\"Operations\":9800000}"}
EOF
cat > .coldpass/claims.json <<'EOF'
[{"kind":"claim","claim":"The local quickstart runs the WASM sandbox and returns department totals.","source":"provider   wasm","input":"README minimal quickstart with SANDBOX_PROVIDER=wasm","expected":"stdout totals for Engineering, Sales and Operations","probe_kind":"cli","argv":["go","run","./examples/minimal"],"expected_text":"{\"Engineering\":59000000,\"Sales\":20300000,\"Operations\":9800000}","cwd":"<guest-path>","env":{"SANDBOX_PROVIDER":"wasm"}}]
EOF
cat > .coldpass/examples.json <<'EOF'
[{"kind":"example","claim":"Run the documented local quickstart.","source":"README.md#Run something locally","input":"SANDBOX_PROVIDER=wasm","expected":"A successful WASM process run and department totals.","argv":["go","run","./examples/minimal"],"cwd":"<guest-path>","env":{"SANDBOX_PROVIDER":"wasm"},"expected_text":"{\"Engineering\":59000000,\"Sales\":20300000,\"Operations\":9800000}"}]
EOF
cat > .coldpass/cycles.json <<'EOF'
{"detected":false,"reason":"README and inspected entry point describe a single sandbox execution; no scheduler, recurring loop, or webhook cycle is exposed by this quickstart.","checks":[]}
EOF

python3 - <<'PY'
import json
p='.coldpass/claims.json'
x=json.load(open(p)); x[0]['source']='With Go installed:'; open(p,'w').write(json.dumps(x,indent=2)+'\n')
PY
<env-var>=<guest-path> python3 -I <guest-path> --validate --replay
cat > .coldpass/report.json <<'EOF'
{"outcome":"working","fault_owner":null,"operation":"Run the README minimal Go example with the WASM provider","operation_scope":"Local in-process JavaScript execution; Go 1.26.10 toolchain and Go dependencies fetched automatically","steps":["Read README quickstart","Ran SANDBOX_PROVIDER=wasm go run ./examples/minimal","Validated and replayed probe, README claim, example, and cycle evidence"],"deviations":[],"stuck_step":null,"main_blocker":null,"plain_failure":null,"suggested_fix":null}
EOF