coldpass

Per-setup public labels: Linux / Haiku: Works

Static status badge · SVG · read-only JSON. Embed with ![Coldpass status](https://coldpass.dev/badge/PyCQA--pyflakes.svg).

coding

Works

The recorded run passed on 1 setup.

Answers apply to each recorded setup, revision and operation. Earlier observations remain in Run details.

Tested on Linux
PlatformHaikuLuna
Linuxyes

Linux / Haiku 5.5: yes · Oct 27, 2026 · f0a8b98156ba · claude-code / 2.1.310 (Claude Code)
Recorded operation: <guest-path> -m pyflakes

Does what it says
2 of 2 claims checked out
  • Pyflakes checks Python source files for errors: Real input produced the expected result: undefined name 'undefined_name'

    Source: A simple program which checks Python source files for errors.

    Input: import os x = undefined_name (stdin)

    Expected: reports undefined name

    Command: <guest-path> -m pyflakes

    Observed: undefined name 'undefined_name'

  • Pyflakes detects various errors such as unused imports: Real input produced the expected result: 'os' imported but unused

    Source: Pyflakes analyzes programs and detects various errors.

    Input: import os x = undefined_name (stdin)

    Expected: reports unused import os

    Command: <guest-path> -m pyflakes

    Observed: 'os' imported but unused <stdin>:2:5: undefined name 'undefined_name'

MCP
No
Local or hosted
local
Local: runs on your machine
Needs keys or browser
None seen
Maintained
Maintained
actively maintained: last commit 12 days ago; 53 commits and 49 merged PRs in 90 days; 44 open issues, 16 open PRs; 19 of 24 recent threads got a maintainer reply, median first reply 0.5h; no releases

Last commit Oct 14, 2026

Setup time
1 min 37 s
1 min 37 s to a working result
Issue
none found in recorded check
Examples
2 of 2 ran as expected
  • Check the checkout with the documented python -m pyflakes . invocation: command completed successfully with no output

    Source: README.rst: You can also invoke Pyflakes with python#.# -m pyflakes .

    Input: checkout directory (.)

    Expected: no findings, exit 0

    Command: <guest-path> -m pyflakes .

  • Repository unit tests run via tox command: command completed successfully

    Source: tox.ini

    Input: unittest discover pyflakes

    Expected: all tests pass

    Command: <guest-path> -m unittest discover pyflakes

    Observed: .ss..s..........s....................s.......................................................................................................................................................sssssssss.........................s.................................................................s.................................s.s..s.......................................................s.........s............................................................................ss..s..........s. ---------------------------------------------------------------------- Ran 795 tests in 1.079s OK (skipped=28)

Evidence
README behavior checked
Agent interfaces
CLI
CLI

Observed interfaces were exercised by the checker. Documentation alone does not confirm compatibility.

Tested with
Claude Code / Haiku 5.5
  • Linux: Claude Code / Haiku 5.5 · agent 2.1.310 (Claude Code) · Checked operation passed · Oct 27, 2026 on f0a8b98156ba

Each entry describes its recorded operation and source revision.

Safety
No unexpected network or file activity found in these checks

No problems traced to this repository code in these checks; a short run cannot prove safety.

Reviewed as expected for a test run: attempted writes that failed, so nothing was written.

Full event, path and process lists for each observed setup:

Repair history and test corrections
Current diagnosis: unknown · harness_fix_required

Validator rejects the documented Python module invocation as agent-written code, including with the documented module form.

Repair record fix-75a2e0dfa3886a8b5998 · current status JSON. Original run outcomes remain unchanged.

Failed run: PyCQA/pyflakes · Oct 27, 2026 · Not tested.

Run details

Haiku 5.5

Native agent · Checked operation passed

Checked operation <guest-path> -m pyflakes

Agent-reported scope: Check Python source for errors with the pyflakes command-line tool (python -m pyflakes), reading source from stdin and from the checkout directory

Run details
run
PyCQA--pyflakes-claude-haiku-5-5-1793087582110967415
date
Oct 27, 2026
time to working
97.3s
product hosting / execution
Local command in the guest
recorded operation scope
product operation
model
claude-haiku-5-5
agent / version
claude-code / 2.1.310 (Claude Code)
platform
linux
reported cost
$0.013847
Recorded source
https://github.com/PyCQA/pyflakes
Backend
hyperv
Tool transport
mcp-assigned-vm
Requested source pin (not an observed revision)
{"commit": "f0a8b98156ba1645a45bc7d77dcfe79dbbf11f10", "url": "https://github.com/PyCQA/pyflakes"}
Test version
readme-d5b140d3c0f8b95c2dd6fe6fc381a303cacb92679582c22317d8e78b572f0cf2
revision
f0a8b98156ba1645a45bc7d77dcfe79dbbf11f10
Whose fault: not assigned · resolved

Safety: No problems traced to this repository code in these checks.

No problems traced to this repository code in these checks.

OSV scanned supported lockfiles; unpinned dependencies and unsupported formats are outside this check.

A short run cannot establish that code is safe.

Connections show IP addresses; proxies can hide the final hostname.

Tracing covers dispatched commands and their children, not the whole OS; guest root can interfere with tracing.

Full safety evidence →

Answers recorded for this run
  • Pyflakes checks Python source files for errors: Real input produced the expected result: undefined name 'undefined_name'

    Source: A simple program which checks Python source files for errors.

    Input: import os x = undefined_name (stdin)

    Expected: reports undefined name

    Command: <guest-path> -m pyflakes

    Observed: undefined name 'undefined_name'

  • Pyflakes detects various errors such as unused imports: Real input produced the expected result: 'os' imported but unused

    Source: Pyflakes analyzes programs and detects various errors.

    Input: import os x = undefined_name (stdin)

    Expected: reports unused import os

    Command: <guest-path> -m pyflakes

    Observed: 'os' imported but unused <stdin>:2:5: undefined name 'undefined_name'

Examples

  • Check the checkout with the documented python -m pyflakes . invocation: command completed successfully with no output

    Source: README.rst: You can also invoke Pyflakes with python#.# -m pyflakes .

    Input: checkout directory (.)

    Expected: no findings, exit 0

    Command: <guest-path> -m pyflakes .

  • Repository unit tests run via tox command: command completed successfully

    Source: tox.ini

    Input: unittest discover pyflakes

    Expected: all tests pass

    Command: <guest-path> -m unittest discover pyflakes

    Observed: .ss..s..........s....................s.......................................................................................................................................................sssssssss.........................s.................................................................s.................................s.s..s.......................................................s.........s............................................................................ss..s..........s. ---------------------------------------------------------------------- Ran 795 tests in 1.079s OK (skipped=28)

Local or hosted: local

What the agent did

Check Python source for errors with the pyflakes command-line tool (python -m pyflakes), reading source from stdin and from the checkout directory

cd <guest-path> && ls -la && id -u && python3 --version && cat README.md | head -c 6000
cd <guest-path> && git status 2>&1 | head -5; ls /inputs 2>&1; echo CDP=$CDP_URL; curl -s -m 10 -i $CDP_URL/json/version | head -20
cd <guest-path> && cat README.rst && echo ---- && cat tox.ini requirements-dev.txt setup.cfg && ls -la .coldpass bin
mkdir -p <guest-path> && cd <guest-path> && python3 -m venv <guest-path> 2>&1 | tail -3; ls <guest-path> 2>&1 | head
<guest-path> install --upgrade pyflakes 2>&1 | tail -5; <guest-path> -m pip show pyflakes 2>&1 | head -3
cd <guest-path> && <guest-path> -c "import pyflakes,sys;print(pyflakes.__file__)" ; <guest-path> -m pyflakes --version; echo rc=$?; <guest-path> -m pyflakes pyflakes/checker.py; echo rc=$?; printf 'import os\nx = undefined_name\n' > <guest-path>; <guest-path> -m pyflakes <guest-path>; echo rc=$?
cd <guest-path> && <guest-path> -m pyflakes . ; echo rc=$?; <guest-path> -m unittest discover pyflakes 2>&1 | tail -5; echo rc=$?
cd <guest-path> && cat > probe.json <<'EOF'
{"kind":"cli","argv":["<guest-path>","-m","pyflakes","<guest-path>"],"cwd":"<guest-path>","expected_returncode":1,"expected_text":"undefined name 'undefined_name'"}
EOF
cat > claims.json <<'EOF'
[
{"kind":"claim","claim":"Pyflakes checks Python source files for errors","source":"A simple program which checks Python source files for errors.","input":"<guest-path>","expected":"reports undefined name","probe_kind":"cli","argv":["<guest-path>","-m","pyflakes","<guest-path>"],"expected_returncode":1,"expected_text":"undefined name 'undefined_name'","cwd":"<guest-path>"},
{"kind":"claim","claim":"Pyflakes detects unused imports and undefined names","source":"Pyflakes analyzes programs and detects various errors.","input":"<guest-path>","expected":"reports unused import os","probe_kind":"cli","argv":["<guest-path>","-m","pyflakes","<guest-path>"],"expected_returncode":1,"expected_text":"'os' imported but unused","cwd":"<guest-path>"},
{"kind":"claim","claim":"python -m pyflakes . is a documented invocation","source":"You can also invoke Pyflakes with ``python#.# -m pyflakes .`` if you want","input":"checkout directory","expected":"no findings, exit 0","probe_kind":"cli","argv":["<guest-path>","-m","pyflakes","."],"expected_text":"","cwd":"<guest-path>"}
]
EOF
python3 -I -m json.tool probe.json >/dev/null && python3 -I -m json.tool claims.json >/dev/null && echo ok
cd <guest-path> && cat > examples.json <<'EOF'
[
{"kind":"example","claim":"Repository unit tests run via tox command","source":"tox.ini","input":"unittest discover pyflakes","expected":"all tests pass","argv":["<guest-path>","-m","unittest","discover","pyflakes"],"cwd":"<guest-path>","expected_text":"OK (skipped=28)"}
]
EOF
cat > cycles.json <<'EOF'
{"detected":false,"reason":"Entry points inspected (bin/pyflakes, pyflakes/__main__.py, pyflakes/api.py, README.rst, tox.ini): pyflakes is a one-shot linter run per invocation; no cron, scheduler, loop, webhook, --once or --now option exists.","checks":[]}
EOF
python3 -I -m json.tool examples.json >/dev/null && python3 -I -m json.tool cycles.json >/dev/null && echo ok; ls <guest-path> <guest-path>
cd <guest-path> && ls <guest-path> && <env-var>=<guest-path> python3 -I <guest-path> --validate --replay 2>&1 | tail -c 5000
cd <guest-path> && grep -n "source_file\|README" check.py | head -40; grep -n "agent-written" check.py | head
cd <guest-path> && sed -n 1275,1292p check.py; sed -n 900,912p check.py; grep -n "def is_agent\|agent_written\|def _agent" check.py | head
cd <guest-path> && sed -n 357,372p check.py
cd <guest-path> && grep -n "stdin\|'-'" pyflakes/api.py pyflakes/__main__.py | head; grep -n "def main" -A12 pyflakes/api.py | head -30
cd <guest-path> && cat > probe.json <<'EOF'
{"kind":"cli","argv":["<guest-path>","-m","pyflakes"],"cwd":"<guest-path>","stdin":"import os\nx = undefined_name\n","expected_returncode":1,"expected_text":"undefined name 'undefined_name'"}
EOF
cat > claims.json <<'EOF'
[
{"kind":"claim","claim":"Pyflakes checks Python source files for errors","source_file":"README.rst","source":"A simple program which checks Python source files for errors.","input":"import os\nx = undefined_name\n (stdin)","expected":"reports undefined name","probe_kind":"cli","argv":["<guest-path>","-m","pyflakes"],"stdin":"import os\nx = undefined_name\n","expected_returncode":1,"expected_text":"undefined name 'undefined_name'","cwd":"<guest-path>"},
{"kind":"claim","claim":"Pyflakes detects various errors such as unused imports","source_file":"README.rst","source":"Pyflakes analyzes programs and detects various errors.","input":"import os\nx = undefined_name\n (stdin)","expected":"reports unused import os","probe_kind":"cli","argv":["<guest-path>","-m","pyflakes"],"stdin":"import os\nx = undefined_name\n","expected_returncode":1,"expected_text":"'os' imported but unused","cwd":"<guest-path>"}
]
EOF
cat > examples.json <<'EOF'
[
{"kind":"example","claim":"Check the checkout with the documented python -m pyflakes . invocation","source":"README.rst: You can also invoke Pyflakes with python#.# -m pyflakes .","input":"checkout directory (.)","expected":"no findings, exit 0","argv":["<guest-path>","-m","pyflakes","."],"cwd":"<guest-path>"},
{"kind":"example","claim":"Repository unit tests run via tox command","source":"tox.ini","input":"unittest discover pyflakes","expected":"all tests pass","argv":["<guest-path>","-m","unittest","discover","pyflakes"],"cwd":"<guest-path>","expected_text":"OK (skipped=28)"}
]
EOF
python3 -I -m json.tool probe.json >/dev/null && python3 -I -m json.tool claims.json >/dev/null && python3 -I -m json.tool examples.json >/dev/null && echo ok
cd <guest-path> && <env-var>=<guest-path> python3 -I <guest-path> --validate --replay 2>&1 | tail -c 6000
cd <guest-path> && cat > report.json <<'EOF'
{"outcome":"working","fault_owner":null,"operation":"Check Python source for errors with the pyflakes command-line tool (python -m pyflakes), reading source from stdin and from the checkout directory","operation_scope":"Linux guest, Python 3.12.3 venv at <guest-path>, pyflakes run from the checked-out source snapshot (workspace is not a git repo; pinned commit f0a8b98156ba1645a45bc7d77dcfe79dbbf11f10 not verified because no git metadata was available; source was used as provided)","steps":["python3 -m venv <guest-path>","<guest-path> install --upgrade pyflakes (README Installation)","cd <guest-path> && <guest-path> -m pyflakes . (README Useful tips; exit 0, no findings)","printf 'import os\\nx = undefined_name\\n' | <guest-path> -m pyflakes (reports unused import os and undefined name; exit 1)","<guest-path> -m unittest discover pyflakes (tox.ini test command; 795 tests, OK, skipped=28)"],"deviations":["The README says pip install --upgrade pyflakes, which installed PyPI pyflakes 4.0.3 into the venv; the probes ran the checkout's own pyflakes source because the working directory comes first on sys.path (confirmed by printing pyflakes.__file__ from the workspace).","The workspace has no .git directory, so the git init/fetch/reset pin step could not be applied and the pinned commit was not verified.","The checker path /inputs/coldpass-preflight.py does not exist in this guest; used <guest-path> instead.","First probe used a sample .py file outside the workspace, which the checker treats as agent-written code; replaced with the documented stdin invocation (pyflakes reads stdin when no path is given, pyflakes/api.py)."],"stuck_step":null,"main_blocker":null,"plain_failure":null,"suggested_fix":"None for the product. Optional: provide the git metadata for the pinned commit so the source revision can be verified."}
EOF
python3 -I -m json.tool report.json >/dev/null && echo ok && cd <guest-path> && <env-var>=<guest-path> python3 -I <guest-path> --validate --replay 2>&1 | head -c 300

No product verdict. Run record.

No product verdict. Run record.