coldpass

Per-setup public labels: Linux / Haiku: Works · Linux / Luna: Works

Static status badge · SVG · read-only JSON. Embed with ![Coldpass status](https://coldpass.dev/badge/loadn-ai--loadn.svg).

agent-harness

Works

The recorded run passed on 2 setups.

Answers apply to each recorded setup, revision and operation. Earlier observations remain in Run details.

Tested on Linux
PlatformHaikuLuna
Linuxyesyes

Linux / Haiku 5.5: yes · Oct 28, 2026 · 544915ab78d0 · claude-code / 2.1.310 (Claude Code)
Recorded operation: <guest-path> -p --dangerously-skip-permissions 'say hi'

Linux / Luna: yes · Oct 28, 2026 · 544915ab78d0 · codex / codex-cli 0.164.0
Recorded operation: /tmp/loadn-run/bin/loadn -p --dangerously-skip-permissions 'say hello'

Does what it says
1 of 1 claims checked out
  • Headless one-shot prompt prints the agent reply to stdout: Real input produced the expected result: LOADN_E2E_OK_7731

    Source: # one-shot, human-readable output

    Input: say hi

    Expected: reply text printed

    Command: <guest-path> -p --dangerously-skip-permissions 'say hi'

    Observed: LOADN_E2E_OK_7731 2026-10-28 13:39:24,415 loadn.tools.grep WARNING rg 不可用——Grep 走纯 Python 扫描兜底(速度慢,rg -g/--multiline 参数语义降级:glob 仍生效、multiline 逐行近似) 2026-10-28 13:39:24,470 loadn.core.models WARNING 模型 'fake' 不在目录(models.json)——窗口按保守 128k 估算(补目录可消除本告警) 2026-10-28 13:39:24,470 loadn.core.cache_warmer INFO cache-warm 不发:cache economics unavailable(目录无价格)

MCP
No
Local or hosted
local
Local: runs on your machine
Needs keys or browser
None seen
Maintained
Maintained
actively maintained: last commit 0 days ago; 553 commits and 0 merged PRs in 90 days; 0 open issues, 10 open PRs; latest release 2026-10-28

Last commit Oct 28, 2026

Setup time
2 min 2 s
2 min 2 s to a working result
Issue
none found in recorded check
Examples
1 of 1 ran as expected
  • Structured JSON result output from the headless quickstart: command completed successfully

    Source: README.md First run section

    Input: say hi

    Expected: JSON result containing the reply text

    Command: <guest-path> -p --output-format json --dangerously-skip-permissions 'say hi'

    Observed: t_tokens": 10000, "cache_creation_input_tokens": 0}, "modelUsage": {"fake": {"inputTokens": 1000, "outputTokens": 200, "cacheReadInputTokens": 10000, "cacheCreationInputTokens": 0, "webSearchRequests": 0, "costUSD": 0.00488}}, "num_turns": 1, "duration_ms": 2495} 2026-10-28 13:39:27,983 loadn.tools.grep WARNING rg 不可用——Grep 走纯 Python 扫描兜底(速度慢,rg -g/--multiline 参数语义降级:glob 仍生效、multiline 逐行近似) 2026-10-28 13:39:28,038 loadn.core.models WARNING 模型 'fake' 不在目录(models.json)——窗口按保守 128k 估算(补目录可消除本告警) 2026-10-28 13:39:28,039 loadn.core.cache_warmer INFO cache-warm 不发:cache economics unavailable(目录无价格)

Evidence
README behavior checked
Agent interfaces
CLI
CLI

Observed interfaces were exercised by the checker. Documentation alone does not confirm compatibility.

Tested with
Claude Code / Haiku 5.5
  • Linux: Claude Code / Haiku 5.5 · agent 2.1.310 (Claude Code) · Checked operation passed · Oct 28, 2026 on 544915ab78d0

Each entry describes its recorded operation and source revision.

Safety
No unexpected network or file activity found in these checks

No problems traced to this repository code in these checks; a short run cannot prove safety. 34 listed items (named-host connections, static matches, dependency advisories) are below and do not change this verdict. 10 static matches retained as context.

OSV reports a known vulnerability in this dependency version. 11 distinct locations. 17 findings.

Reviewed as expected for a test run: attempted writes that failed, so nothing was written.

Full event, path and process lists for each observed setup:

Repair history and test corrections
Current diagnosis: test · harness_fix_required

native Claude returned a different model

Repair record fix-e0e6b6d63d0dbd6d02bd · current status JSON. Original run outcomes remain unchanged.

Failed run: loadn-ai/loadn · Oct 28, 2026 · Our test failed; no repo verdict.

Run details

Haiku 5.5

Native agent · Checked operation passed

Checked operation <guest-path> -p --dangerously-skip-permissions 'say hi'

Agent-reported scope: Install the loadn engine from the pinned source and run a headless one-shot prompt (loadn -p) that prints the reply to stdout

Run details
run
loadn-ai--loadn-claude-haiku-5-5-1793194627626699441
date
Oct 28, 2026
time to working
121.5s
product hosting / execution
Local command in the guest
recorded operation scope
product operation
model
claude-haiku-5-5
agent / version
claude-code / 2.1.310 (Claude Code)
platform
linux
reported cost
$0.012016
Recorded source
https://github.com/loadn-ai/loadn
Backend
hyperv
Tool transport
mcp-assigned-vm
Requested source pin (not an observed revision)
{"commit": "544915ab78d0e0363b7bfb7b96cf07ebcbf1bf18", "url": "https://github.com/loadn-ai/loadn"}
Test version
readme-2d57868128a84902c09a58991c46c5fe288928e55b1de8282ab5003e13159c2f
revision
544915ab78d0e0363b7bfb7b96cf07ebcbf1bf18
Whose fault: not assigned · resolved

Double-checks failed run: loadn-ai/loadn · Oct 28, 2026.

Safety: Review signals: 17 known vulnerability. 5 static matches retained as context.

Review signals: 17 known vulnerability. 5 static matches retained as context.

Reviewed as expected for a test run: attempted writes that failed, so nothing was written.

OSV reports a known vulnerability in this dependency version. 11 distinct locations. 17 findings.

5 hardcoded secret matches retained as context; full list in the evidence.

OSV scanned supported lockfiles; unpinned dependencies and unsupported formats are outside this check.

A short run cannot establish that code is safe.

Connections show IP addresses; proxies can hide the final hostname.

Tracing covers dispatched commands and their children, not the whole OS; guest root can interfere with tracing.

Full safety evidence →

Answers recorded for this run
  • Headless one-shot prompt prints the agent reply to stdout: Real input produced the expected result: LOADN_E2E_OK_7731

    Source: # one-shot, human-readable output

    Input: say hi

    Expected: reply text printed

    Command: <guest-path> -p --dangerously-skip-permissions 'say hi'

    Observed: LOADN_E2E_OK_7731 2026-10-28 13:39:24,415 loadn.tools.grep WARNING rg 不可用——Grep 走纯 Python 扫描兜底(速度慢,rg -g/--multiline 参数语义降级:glob 仍生效、multiline 逐行近似) 2026-10-28 13:39:24,470 loadn.core.models WARNING 模型 'fake' 不在目录(models.json)——窗口按保守 128k 估算(补目录可消除本告警) 2026-10-28 13:39:24,470 loadn.core.cache_warmer INFO cache-warm 不发:cache economics unavailable(目录无价格)

Examples

  • Structured JSON result output from the headless quickstart: command completed successfully

    Source: README.md First run section

    Input: say hi

    Expected: JSON result containing the reply text

    Command: <guest-path> -p --output-format json --dangerously-skip-permissions 'say hi'

    Observed: t_tokens": 10000, "cache_creation_input_tokens": 0}, "modelUsage": {"fake": {"inputTokens": 1000, "outputTokens": 200, "cacheReadInputTokens": 10000, "cacheCreationInputTokens": 0, "webSearchRequests": 0, "costUSD": 0.00488}}, "num_turns": 1, "duration_ms": 2495} 2026-10-28 13:39:27,983 loadn.tools.grep WARNING rg 不可用——Grep 走纯 Python 扫描兜底(速度慢,rg -g/--multiline 参数语义降级:glob 仍生效、multiline 逐行近似) 2026-10-28 13:39:28,038 loadn.core.models WARNING 模型 'fake' 不在目录(models.json)——窗口按保守 128k 估算(补目录可消除本告警) 2026-10-28 13:39:28,039 loadn.core.cache_warmer INFO cache-warm 不发:cache economics unavailable(目录无价格)

Local or hosted: local

What the agent did

Install the loadn engine from the pinned source and run a headless one-shot prompt (loadn -p) that prints the reply to stdout

cd <guest-path> && ls -la && cat README.md | head -c 6000 && python3 --version
cd <guest-path> && grep -n -i "quick\|install\|pip \|## " README.md | head -80; ls .coldpass
cd <guest-path> && sed -n 221,312p README.md
python3 --version; which python3.10 python3.11 python3.12 uv 2>/dev/null; echo "CDP=$CDP_URL"; curl -s -m 10 -w "\nHTTP %{http_code}\n" $CDP_URL/json/version
cd <guest-path> && python3 -m venv ~/.venvs/loadn 2>&1 | tail -3; ~/.venvs/loadn/bin/pip install -q -e . 2>&1 | tail -15; echo EXIT=$?; ~/.venvs/loadn/bin/loadn --version 2>&1 | head -3
cd <guest-path> && sed -n 312,350p README.md; grep -rn "LOADN_FAKE_DIR" loadn/*.py loadn/**/*.py | head -8
cd <guest-path> && sed -n 1,140p loadn/providers/fake.py
mkdir -p /tmp/loadn-run/fake /tmp/loadn-run/home && echo "LOADN_E2E_OK_7731" > /tmp/loadn-run/fake/reply && cd /tmp/loadn-run && LOADN_PROVIDER=fake LOADN_FAKE_DIR=/tmp/loadn-run/fake LOADN_HOME=/tmp/loadn-run/home ~/.venvs/loadn/bin/loadn -p --dangerously-skip-permissions "say hi" < /dev/null; echo EXIT=$?
cd <guest-path> && echo $HOME; grep -rn "\-\-once\|\-\-now\|croniter\|def tick\|while True" loadn_webui loadn --include=*.py | grep -v test | head -12; sed -n 160,170p README.md | cut -c1-300
cd <guest-path> && sed -n 115,150p loadn_webui/scheduler.py; grep -n "scheduler\|schedule" loadn_webui/cli.py 2>/dev/null | head; ls loadn_webui | head -50
cd <guest-path> && mkdir -p .coldpass && cat > .coldpass/probe.json <<'EOF'
{"kind":"cli","argv":["<guest-path>","-p","--dangerously-skip-permissions","say hi"],"cwd":"<guest-path>","stdin":"","env":{"LOADN_PROVIDER":"fake","LOADN_FAKE_DIR":"/tmp/loadn-run/fake","LOADN_HOME":"/tmp/loadn-run/home"},"expected_text":"LOADN_E2E_OK_7731"}
EOF
cat > .coldpass/claims.json <<'EOF'
[{"kind":"claim","claim":"Headless one-shot prompt prints the agent's reply to stdout","source":"README.md","source_file":"README.md","quote":"# one-shot, human-readable output","input":"say hi","expected":"reply text printed","probe_kind":"cli","argv":["<guest-path>","-p","--dangerously-skip-permissions","say hi"],"stdin":"","expected_text":"LOADN_E2E_OK_7731","cwd":"<guest-path>","env":{"LOADN_PROVIDER":"fake","LOADN_FAKE_DIR":"/tmp/loadn-run/fake","LOADN_HOME":"/tmp/loadn-run/home"}}]
EOF
cat > .coldpass/examples.json <<'EOF'
[{"kind":"example","claim":"Structured JSON result output from the headless quickstart","source":"README.md First run section","input":"list the todos","expected":"JSON result containing the reply text","argv":["<guest-path>","-p","--output-format","json","--dangerously-skip-permissions","say hi"],"cwd":"<guest-path>","env":{"LOADN_PROVIDER":"fake","LOADN_FAKE_DIR":"/tmp/loadn-run/fake","LOADN_HOME":"/tmp/loadn-run/home"},"stdin":"","expected_text":"LOADN_E2E_OK_7731"}]
EOF
cat > .coldpass/cycles.json <<'EOF'
{"detected":false,"checks":[],"reason":"Inspected README.md and entrypoints. The only scheduler (loadn_webui/scheduler.py, tick()/_loop every CHECK_INTERVAL, exposed via 'loadn-web schedule') belongs to the loadn-web platform, which needs the webui extra, database init and a server; the engine quickstart has no cron/--once/--now trigger. Not exercised."}
EOF
python3 -I -c "import json;[json.load(open('.coldpass/'+f)) for f in ['probe.json','claims.json','examples.json','cycles.json']];print('ok')"
cd <guest-path> && cat > .coldpass/claims.json <<'EOF'
[{"kind":"claim","claim":"Headless one-shot prompt prints the agent reply to stdout","source":"# one-shot, human-readable output","source_file":"README.md","input":"say hi","expected":"reply text printed","probe_kind":"cli","argv":["<guest-path>","-p","--dangerously-skip-permissions","say hi"],"stdin":"","expected_text":"LOADN_E2E_OK_7731","cwd":"<guest-path>","env":{"LOADN_PROVIDER":"fake","LOADN_FAKE_DIR":"/tmp/loadn-run/fake","LOADN_HOME":"/tmp/loadn-run/home"}}]
EOF
sed -i 's/"input":"list the todos"/"input":"say hi"/; s/"source":"README.md First run section"/"source":"README.md First run section"/' .coldpass/examples.json
<env-var>=<guest-path> python3 -I <guest-path> --validate --replay 2>&1 | tail -60
cd <guest-path> && cat > .coldpass/report.json <<'EOF'
{"outcome":"working","fault_owner":null,"operation":"Install the loadn engine from the pinned source and run a headless one-shot prompt (loadn -p) that prints the reply to stdout","operation_scope":"Python 3.12.3 venv at <guest-path>; editable install of the workspace source; LOADN_PROVIDER=fake with a control-file reply (no real model endpoint or API credentials, so no live LLM call was made); no browser needed","steps":["python3 -m venv ~/.venvs/loadn","pip install -e .  (in the venv, from the workspace)","loadn --version -> loadn 0.7.68","LOADN_PROVIDER=fake LOADN_FAKE_DIR=/tmp/loadn-run/fake LOADN_HOME=/tmp/loadn-run/home loadn -p --dangerously-skip-permissions \"say hi\" -> prints LOADN_E2E_OK_7731, exit 0","loadn -p --output-format json (same fake env) -> JSON result, exit 0"],"deviations":["No endpoint or API key available, so the fake provider (documented in README Development setup as LOADN_PROVIDER=fake) was used instead of Anthropic/OpenAI-compatible endpoint; real-model behavior is untested.","Installed from the local workspace with pip install -e . rather than from PyPI or git+https (both are documented in README Install the engine); same package source at the pinned commit.","Full pytest suite (1600+ tests per README) was not run; validation relied on the documented headless CLI operation.","Cycle check: loadn-web scheduler (webui extra) was inspected but not run; detected=false.","Harmless warnings printed to stderr: rg not installed (Grep falls back to pure Python) and model 'fake' not in models.json."],"stuck_step":null,"main_blocker":null,"plain_failure":null,"suggested_fix":"None required for the engine quickstart. Optionally install ripgrep to silence the Grep fallback warning and add a models.json entry for custom model names."}
EOF
python3 -I -c "import json;json.load(open('.coldpass/report.json'));print('ok')"
Earlier attempts (1)

Luna

Native agent · Checked operation passed

Checked operation /tmp/loadn-run/bin/loadn -p --dangerously-skip-permissions 'say hello'

Agent-reported scope: Run a one-shot loadn CLI turn with the README fake provider setup

Run details
run
loadn-ai--loadn-gpt-6-luna-1793190085090151963
date
Oct 28, 2026
time to working
105.7s
product hosting / execution
Local command in the guest
recorded operation scope
product operation
model
gpt-6-luna
agent / version
codex / codex-cli 0.164.0
platform
linux
reported cost
not reported (not assumed free)
Recorded source
https://github.com/loadn-ai/loadn
Backend
hyperv
Tool transport
mcp-assigned-vm
Requested source pin (not an observed revision)
{"commit": "544915ab78d0e0363b7bfb7b96cf07ebcbf1bf18", "url": "https://github.com/loadn-ai/loadn"}
Test version
readme-604d73685be33b2939b2632791fb1de37972f659febb28a139c60d6e81057c18
revision
544915ab78d0e0363b7bfb7b96cf07ebcbf1bf18
Whose fault: not assigned · resolved

Safety: Review signals: 17 known vulnerability. 5 static matches retained as context.

Review signals: 17 known vulnerability. 5 static matches retained as context.

Reviewed as expected for a test run: attempted writes that failed, so nothing was written.

OSV reports a known vulnerability in this dependency version. 11 distinct locations. 17 findings.

5 hardcoded secret matches retained as context; full list in the evidence.

OSV scanned supported lockfiles; unpinned dependencies and unsupported formats are outside this check.

A short run cannot establish that code is safe.

Connections show IP addresses; proxies can hide the final hostname.

Tracing covers dispatched commands and their children, not the whole OS; guest root can interfere with tracing.

Full safety evidence →

Answers recorded for this run
  • The fake provider replays control files from LOADN_FAKE_DIR.: Real input produced the expected result: 收到:say hello(fake)

    Source: The fake provider (`LOADN_PROVIDER=fake`) replays control files from `$LOADN_FAKE_DIR` — the same protocol used by the end-to-end CLI tests.

    Input: say hello

    Expected: 收到:say hello(fake)

    Command: /tmp/loadn-run/bin/loadn -p --dangerously-skip-permissions 'say hello'

    Observed: 收到:say hello(fake) 2026-10-28 12:23:27,228 loadn.tools.grep WARNING rg 不可用——Grep 走纯 Python 扫描兜底(速度慢,rg -g/--multiline 参数语义降级:glob 仍生效、multiline 逐行近似) 2026-10-28 12:23:27,274 loadn.core.models WARNING 模型 'fake' 不在目录(models.json)——窗口按保守 128k 估算(补目录可消除本告警) 2026-10-28 12:23:27,274 loadn.core.cache_warmer INFO cache-warm 不发:cache economics unavailable(目录无价格)

Examples

  • Use the fake provider for a one-shot headless turn.: command completed successfully

    Source: README.md / Development setup

    Input: say hello

    Expected: fake provider response

    Command: /tmp/loadn-run/bin/loadn -p --dangerously-skip-permissions 'say hello'

    Observed: 收到:say hello(fake) 2026-10-28 12:23:30,469 loadn.tools.grep WARNING rg 不可用——Grep 走纯 Python 扫描兜底(速度慢,rg -g/--multiline 参数语义降级:glob 仍生效、multiline 逐行近似) 2026-10-28 12:23:30,514 loadn.core.models WARNING 模型 'fake' 不在目录(models.json)——窗口按保守 128k 估算(补目录可消除本告警) 2026-10-28 12:23:30,514 loadn.core.cache_warmer INFO cache-warm 不发:cache economics unavailable(目录无价格)

Local or hosted: local

What the agent did

Run a one-shot loadn CLI turn with the README fake provider setup

pwd && ls -la && rg --files -g 'README*' -g 'pyproject.toml' -g 'package.json' -g 'requirements*' -g 'Makefile' -g '*.md' | head -80
cat README.md
python3 --version && python3 -m pip --version && python3 -m venv /tmp/loadn-venv && /tmp/loadn-venv/bin/python -m pip install -e '.[dev]'
python3 -m venv /tmp/loadn-run && /tmp/loadn-run/bin/pip install -e . && sed -n '1,240p' tests/test_cli.py && ls -la
find tests -maxdepth 2 -type f | head -40; ls -la .coldpass; LOADN_PROVIDER=fake LOADN_FAKE_DIR=<guest-path> /tmp/loadn-run/bin/loadn -p --dangerously-skip-permissions 'say hello'
mkdir -p .coldpass && cat > .coldpass/probe.json <<'EOF'
{"kind":"cli","argv":["/tmp/loadn-run/bin/loadn","-p","--dangerously-skip-permissions","say hello"],"cwd":"<guest-path>","env":{"LOADN_PROVIDER":"fake","LOADN_FAKE_DIR":"<guest-path>"},"expected_text":"收到:say hello(fake)"}
EOF
cat > .coldpass/claims.json <<'EOF'
[
  {"kind":"claim","claim":"The fake provider replays control files from $LOADN_FAKE_DIR.","source":"The fake provider (`LOADN_PROVIDER=fake`) replays control files from `$LOADN_FAKE_DIR`","input":"say hello","expected":"收到:say hello(fake)","probe_kind":"cli","argv":["/tmp/loadn-run/bin/loadn","-p","--dangerously-skip-permissions","say hello"],"env":{"LOADN_PROVIDER":"fake","LOADN_FAKE_DIR":"<guest-path>"},"expected_text":"收到:say hello(fake)","cwd":"<guest-path>"}
]
EOF
cat > .coldpass/examples.json <<'EOF'
[
  {"kind":"example","claim":"Use the fake provider for a one-shot headless turn.","source":"README.md / Development setup","input":"say hello","expected":"fake provider response","argv":["/tmp/loadn-run/bin/loadn","-p","--dangerously-skip-permissions","say hello"],"cwd":"<guest-path>","env":{"LOADN_PROVIDER":"fake","LOADN_FAKE_DIR":"<guest-path>"},"expected_text":"收到:say hello(fake)"}
]
EOF
cat > .coldpass/cycles.json <<'EOF'
{"detected":false,"checks":[],"reason":"Inspected the README documented CLI entrypoints; no product scheduler or recurring cycle trigger is documented."}
EOF
<env-var>=<guest-path> python3 -I <guest-path> --validate --replay
python3 - <<'PY'
p='.coldpass/claims.json'
s=open(p).read().replace('The fake provider (`LOADN_PROVIDER=fake`) replays control files from `$LOADN_FAKE_DIR`','The fake provider (`LOADN_PROVIDER=fake`) replays control files from `$LOADN_FAKE_DIR` — the same protocol used by the end-to-end CLI tests.')
open(p,'w').write(s)
PY
<env-var>=<guest-path> python3 -I <guest-path> --validate --replay
python3 - <<'PY'
import json
p='.coldpass/claims.json'; a=json.load(open(p)); a[0]['source']='The fake provider (`LOADN_PROVIDER=fake`) replays control files from `$LOADN_FAKE_DIR` — the same protocol used by the end-to-end CLI tests.'; a[0]['claim']='The fake provider replays control files from LOADN_FAKE_DIR.'; json.dump(a,open(p,'w'),ensure_ascii=False,indent=2)
PY
<env-var>=<guest-path> python3 -I <guest-path> --validate --replay
python3 - <<'PY'
r=open('README.md').read()
needle='The fake provider (`LOADN_PROVIDER=fake`)'
i=r.index(needle); print(repr(r[i:i+160]))
PY
python3 - <<'PY'
import json
p='.coldpass/claims.json'; a=json.load(open(p)); a[0]['source']='The fake provider (`LOADN_PROVIDER=fake`) replays control files from\n`$LOADN_FAKE_DIR` — the same protocol used by the end-to-end CLI tests.'; json.dump(a,open(p,'w'),ensure_ascii=False,indent=2)
PY
<env-var>=<guest-path> python3 -I <guest-path> --validate --replay
cat > .coldpass/report.json <<'EOF'
{"outcome":"working","fault_owner":null,"operation":"Run a one-shot loadn CLI turn with the README fake provider setup","operation_scope":"Python 3.12.3 in an isolated venv; editable repository install and fake provider using evals/fake control files","steps":["Read README.md; confirmed Python 3.10+ requirement and documented fake provider workflow.","Created /tmp/loadn-run and installed the repository with pip install -e .; also installed dev extras in /tmp/loadn-venv.","Ran loadn -p --dangerously-skip-permissions 'say hello' with LOADN_PROVIDER=fake and LOADN_FAKE_DIR=<guest-path>; observed '收到:say hello(fake)'.","Validated and replayed probe, README claim, example, and cycle evidence successfully."],"deviations":["First claim validation attempt failed because the README source quote crossed a hard-wrapped line; corrected it to include the newline exactly.","Grep logged that rg is unavailable and it is using its Python fallback; the requested CLI operation still succeeded."],"stuck_step":null,"main_blocker":null,"plain_failure":null,"suggested_fix":null}
EOF
ls -la .coldpass

No product verdict. Run record.