coldpass

mgedmin/check-manifest

GitHub ↗ · How this check works

Per-setup public labels: Linux / Haiku: Works · Linux / Luna: Works

Static status badge · SVG · read-only JSON. Embed with ![Coldpass status](https://coldpass.dev/badge/mgedmin--check-manifest.svg).

coding

Works

The recorded run passed on 2 setups.

Answers apply to each recorded setup, revision and operation. Earlier observations remain in Run details.

Tested on Linux
PlatformHaikuLuna
Linuxyesyes

Linux / Haiku 5.5: yes · Oct 27, 2026 · 5073ecd69f87 · claude-code / 2.1.310 (Claude Code)
Recorded operation: /tmp/cm-venv/bin/check-manifest --ignore notes.txt /tmp/cm-demo

Linux / Luna: yes · Oct 27, 2026 · 5073ecd69f87 · codex / codex-cli 0.164.0
Recorded operation: <guest-path> <guest-path>

Does what it says
1 of 1 claims checked out
  • Checks that a Python MANIFEST.in file is complete.: Real input produced the expected result: lists of files in version control and sdist match

    Source: Check a Python MANIFEST.in file for completeness

    Input: <guest-path>

    Expected: lists of files in version control and sdist match

    Command: <guest-path> <guest-path>

    Observed: lists of files in version control and sdist match

MCP
No
Local or hosted
local
Local: runs on your machine
Needs keys or browser
None seen
Maintained
Maintained
actively maintained: last commit 8 days ago; 1 commits and 1 merged PRs in 90 days; 23 open issues, 6 open PRs; 33 of 38 recent threads got a maintainer reply, median first reply 17.4h; no releases

Last commit Oct 18, 2026

Setup time
54 s
54 s to a working result
Issue
none found in recorded check
Examples
1 of 1 ran as expected
  • Run the documented quick start check against this package checkout.: command completed successfully

    Source: README.rst / Quick start

    Input: the current source tree

    Expected: manifest and sdist file lists match

    Command: <guest-path> <guest-path>

    Observed: lists of files in version control and sdist match

Evidence
README behavior checked
Agent interfaces
CLI
CLI

Observed interfaces were exercised by the checker. Documentation alone does not confirm compatibility.

Tested with
Codex / Luna
  • Linux: Codex / Luna · agent codex-cli 0.164.0 · Checked operation passed · Oct 27, 2026 on 5073ecd69f87

Each entry describes its recorded operation and source revision.

Safety
No unexpected network or file activity found in these checks

No problems traced to this repository code in these checks; a short run cannot prove safety.

Reviewed as expected for a test run: a Python interpreter or package manager probed its own interpreter file under a system program folder; attempted writes that failed, so nothing was written.

Reviewed as expected for a test run: attempted writes that failed, so nothing was written.

Full event, path and process lists for each observed setup:

Run details

Haiku 5.5

Native agent · Checked operation passed

Checked operation /tmp/cm-venv/bin/check-manifest --ignore notes.txt /tmp/cm-demo

Agent-reported scope: Run check-manifest to compare files tracked in git against the sdist contents, reporting missing files and honoring --ignore

Run details
run
mgedmin--check-manifest-claude-haiku-5-5-1793087582134496196
date
Oct 27, 2026
time to working
294.4s
product hosting / execution
Local command in the guest
recorded operation scope
product operation
model
claude-haiku-5-5
agent / version
claude-code / 2.1.310 (Claude Code)
platform
linux
reported cost
$0.011751
Recorded source
https://github.com/mgedmin/check-manifest
Backend
hyperv
Tool transport
mcp-assigned-vm
Requested source pin (not an observed revision)
{"commit": "5073ecd69f872358611507c3d09409b1b5df2971", "url": "https://github.com/mgedmin/check-manifest"}
Test version
readme-d5b140d3c0f8b95c2dd6fe6fc381a303cacb92679582c22317d8e78b572f0cf2
revision
5073ecd69f872358611507c3d09409b1b5df2971
Whose fault: not assigned · resolved

Safety: No problems traced to this repository code in these checks.

No problems traced to this repository code in these checks.

Reviewed as expected for a test run: a Python interpreter or package manager probed its own interpreter file under a system program folder; attempted writes that failed, so nothing was written.

OSV scanned supported lockfiles; unpinned dependencies and unsupported formats are outside this check.

A short run cannot establish that code is safe.

Connections show IP addresses; proxies can hide the final hostname.

Tracing covers dispatched commands and their children, not the whole OS; guest root can interfere with tracing.

Full safety evidence →

Answers recorded for this run
  • check-manifest reports when version-controlled files are missing from the sdist: Real input produced the expected result: missing from sdist

    Source: lists of files in version control and sdist do not match!

    Input: /tmp/cm-demo (notes.txt tracked in git but not in MANIFEST.in)

    Expected: nonzero exit with mismatch report

    Command: /tmp/cm-venv/bin/check-manifest /tmp/cm-demo

    Observed: missing from sdist: notes.txt

  • --ignore skips files matching the patterns: Real input produced the expected result: lists of files in version control and sdist match

    Source: ignore files/directories matching these

    Input: --ignore notes.txt /tmp/cm-demo

    Expected: lists match, exit 0

    Command: /tmp/cm-venv/bin/check-manifest --ignore notes.txt /tmp/cm-demo

    Observed: lists of files in version control and sdist match

Examples

  • Quick start: check the source tree in place: command completed successfully

    Source: README.rst Quick start

    Input: check-manifest on the checkout

    Expected: lists match

    Command: /tmp/cm-venv/bin/check-manifest -v

    Observed: listing source files under version control: 12 files and directories building an sdist: check_manifest-0.52.dev0.tar.gz: 12 files and directories copying source files to a temporary directory building a clean sdist: check_manifest-0.52.dev0.tar.gz: 12 files and directories lists of files in version control and sdist match

  • Repository test suite (tox envlist uses pytest): command completed successfully

    Source: Makefile test target / tox.ini

    Input: pytest in checkout

    Expected: all tests pass

    Command: /tmp/cm-venv/bin/python -m pytest -p no:cacheprovider -q

    Observed: ........................................................................ [ 48%] ........ssssss....ssssssssssssss........................................ [ 96%] ..... [100%] 129 passed, 20 skipped in 42.37s

Local or hosted: local

What the agent did

Run check-manifest to compare files tracked in git against the sdist contents, reporting missing files and honoring --ignore

cd <guest-path> && pwd && ls -la && git status 2>&1 | head -3; id -u; python3 --version; cat README* 2>/dev/null | head -150
cd <guest-path> && sed -n 150,400p README.rst; ls -la .coldpass; cat tox.ini | head -30; ls /inputs 2>&1; echo $CDP_URL; cat setup.cfg | head -40
cd <guest-path> && git --version && git init -q && git remote add origin https://github.com/mgedmin/check-manifest && timeout 300 git fetch --depth 1 origin 5073ecd69f872358611507c3d09409b1b5df2971 2>&1 | tail -5; git reset --mixed FETCH_HEAD 2>&1; git log --oneline -1; git status --short | head
python3 -m venv /tmp/cm-venv 2>&1 | tail -3; /tmp/cm-venv/bin/pip install -q --upgrade pip 2>&1 | tail -3; /tmp/cm-venv/bin/pip install -q <guest-path> 2>&1 | tail -5; echo rc=$?; /tmp/cm-venv/bin/check-manifest --version
cd <guest-path> && /tmp/cm-venv/bin/check-manifest -v; echo rc=$?; git status --short | head
mkdir -p /tmp/cm-demo/mypkg && cd /tmp/cm-demo && printf 'from setuptools import setup\nsetup(name="mypkg", version="0.1", packages=["mypkg"])\n' > setup.py && printf '"""demo"""\n' > mypkg/__init__.py && printf 'hello\n' > notes.txt && git init -q && git add -A && git -c user.email=a@b -c user.name=demo commit -qm init && git ls-files
cd <guest-path> && /tmp/cm-venv/bin/check-manifest /tmp/cm-demo; echo rc=$?; /tmp/cm-venv/bin/check-manifest --ignore notes.txt /tmp/cm-demo; echo rc=$?
cd <guest-path> && cat Makefile | head -40; grep -n "test" setup.py | head; grep -n -A4 "extras_require" setup.py setup.cfg | head -20
/tmp/cm-venv/bin/pip install -q pytest wheel 2>&1 | tail -3; cd <guest-path> && timeout 900 /tmp/cm-venv/bin/python -m pytest -p no:cacheprovider -q 2>&1 | tail -15; echo rc=${PIPESTATUS[0]}
cd <guest-path> && cat > probe.json <<'EOF'
{"kind":"cli","argv":["/tmp/cm-venv/bin/check-manifest","--ignore","notes.txt","/tmp/cm-demo"],"cwd":"<guest-path>","expected_text":"lists of files in version control and sdist match"}
EOF
cat > claims.json <<'EOF'
[{"kind":"claim","claim":"check-manifest reports when version-controlled files are missing from the sdist","source":"lists of files in version control and sdist do not match!","source_file":"README.rst","input":"/tmp/cm-demo (notes.txt tracked in git but not in MANIFEST.in)","expected":"nonzero exit with mismatch report","probe_kind":"cli","argv":["/tmp/cm-venv/bin/check-manifest","/tmp/cm-demo"],"expected_returncode":1,"expected_text":"missing from sdist","cwd":"<guest-path>"},
{"kind":"claim","claim":"--ignore skips files matching the patterns","source":"ignore files/directories matching these","source_file":"README.rst","input":"--ignore notes.txt /tmp/cm-demo","expected":"lists match, exit 0","probe_kind":"cli","argv":["/tmp/cm-venv/bin/check-manifest","--ignore","notes.txt","/tmp/cm-demo"],"expected_text":"lists of files in version control and sdist match","cwd":"<guest-path>"}]
EOF
cat > examples.json <<'EOF'
[{"kind":"example","claim":"Quick start: check the source tree in place","source":"README.rst Quick start","input":"check-manifest on the checkout","expected":"lists match","argv":["/tmp/cm-venv/bin/check-manifest","-v"],"cwd":"<guest-path>","expected_text":"lists of files in version control and sdist match"},
{"kind":"example","claim":"Repository test suite (tox envlist uses pytest)","source":"Makefile test target / tox.ini","input":"pytest in checkout","expected":"all tests pass","argv":["/tmp/cm-venv/bin/python","-m","pytest","-p","no:cacheprovider","-q"],"cwd":"<guest-path>","expected_text":"129 passed"}]
EOF
cat > cycles.json <<'EOF'
{"detected":false,"reason":"check-manifest is a one-shot CLI (README Quick start, Command-line reference). No scheduler, cron, loop, webhook, --once or --now entry point exists in check_manifest.py; the only recurring usage is the pre-commit hook in README Version control integration, which runs per commit and is not a product cycle.","checks":[]}
EOF
for f in probe claims examples cycles; do python3 -I -m json.tool $f.json >/dev/null && echo "$f ok"; done
ls <guest-path> 2>&1; cd <guest-path> && <env-var>=<guest-path> timeout 1200 python3 -I <guest-path> --validate --replay 2>&1 | tail -60; echo rc=${PIPESTATUS[0]}
cd <guest-path> && git status --short --ignored | head; ls -a
cd <guest-path> && rm -rf build check_manifest.egg-info __pycache__ && <env-var>=<guest-path> timeout 1200 python3 -I <guest-path> --validate --replay 2>&1 | python3 -c "import sys,json; d=json.loads(sys.stdin.read()); print(d['valid'], d['problems'], d['replay']['status'])"; git status --short --ignored
cd <guest-path> && cat > report.json <<'EOF'
{"outcome":"working","fault_owner":null,"operation":"Run check-manifest to compare files tracked in git against the sdist contents, reporting missing files and honoring --ignore","operation_scope":"Local CLI from the pinned commit 5073ecd69f872358611507c3d09409b1b5df2971 (version 0.52.dev0), installed into /tmp/cm-venv with Python 3.12.3; requires a git repository (git 2.43.0). Tested on the checkout itself and on a demo project at /tmp/cm-demo with one tracked file missing from the sdist.","steps":["git init; git remote add origin https://github.com/mgedmin/check-manifest; git fetch --depth 1 origin 5073ecd69f872358611507c3d09409b1b5df2971; git reset --mixed FETCH_HEAD","python3 -m venv /tmp/cm-venv; /tmp/cm-venv/bin/pip install <guest-path>  (README Quick start uses pip install check-manifest; installed from the pinned source instead)","/tmp/cm-venv/bin/check-manifest -v  (README Quick start, run in checkout: lists match, rc 0)","/tmp/cm-venv/bin/check-manifest /tmp/cm-demo  (mismatch: missing from sdist notes.txt, rc 1)","/tmp/cm-venv/bin/check-manifest --ignore notes.txt /tmp/cm-demo  (lists match, rc 0)","/tmp/cm-venv/bin/python -m pytest -p no:cacheprovider -q  (Makefile test target equivalent: 129 passed, 20 skipped)"],"deviations":["README quick start says pip install check-manifest (PyPI); installed from the pinned local checkout instead so the tested code is the pinned commit.","Ran pytest directly in the venv instead of tox -p auto (tox not installed); same test suite via the test extra.","Probe/claim demo project /tmp/cm-demo is a constructed fixture (one tracked file missing from MANIFEST.in), created outside the checkout; no product source was edited.","checker path is <guest-path>; /inputs/coldpass-preflight.py does not exist in this guest."],"stuck_step":null,"main_blocker":null,"plain_failure":null,"suggested_fix":null}
EOF
python3 -I -m json.tool report.json >/dev/null && echo report ok; ls -la <guest-path>
Earlier attempts (1)

Luna

Native agent · Checked operation passed

Checked operation <guest-path> <guest-path>

Agent-reported scope: check-manifest CLI manifest completeness check

Run details
run
mgedmin--check-manifest-gpt-6-luna-1793088056010737990
date
Oct 27, 2026
time to working
53.8s
product hosting / execution
Local command in the guest
recorded operation scope
product operation
model
gpt-6-luna
agent / version
codex / codex-cli 0.164.0
platform
linux
reported cost
not reported (not assumed free)
Recorded source
https://github.com/mgedmin/check-manifest
Backend
hyperv
Tool transport
mcp-assigned-vm
Requested source pin (not an observed revision)
{"commit": "5073ecd69f872358611507c3d09409b1b5df2971", "url": "https://github.com/mgedmin/check-manifest"}
Test version
readme-38e6b13f3b13804effb95797e3466b1a1334da7a232d897cbc8965867f802605
revision
5073ecd69f872358611507c3d09409b1b5df2971
Whose fault: not assigned · resolved

Safety: No problems traced to this repository code in these checks.

No problems traced to this repository code in these checks.

Reviewed as expected for a test run: attempted writes that failed, so nothing was written.

OSV scanned supported lockfiles; unpinned dependencies and unsupported formats are outside this check.

A short run cannot establish that code is safe.

Connections show IP addresses; proxies can hide the final hostname.

Tracing covers dispatched commands and their children, not the whole OS; guest root can interfere with tracing.

Full safety evidence →

Answers recorded for this run
  • Checks that a Python MANIFEST.in file is complete.: Real input produced the expected result: lists of files in version control and sdist match

    Source: Check a Python MANIFEST.in file for completeness

    Input: <guest-path>

    Expected: lists of files in version control and sdist match

    Command: <guest-path> <guest-path>

    Observed: lists of files in version control and sdist match

Examples

  • Run the documented quick start check against this package checkout.: command completed successfully

    Source: README.rst / Quick start

    Input: the current source tree

    Expected: manifest and sdist file lists match

    Command: <guest-path> <guest-path>

    Observed: lists of files in version control and sdist match

Local or hosted: local

What the agent did

check-manifest CLI manifest completeness check

pwd && ls -la && sed -n '1,240p' README.md && python3 --version && id -u
cat README.rst && python3 --version && id -u && sed -n '1,200p' setup.py && cat tox.ini
git init && git remote add origin https://github.com/mgedmin/check-manifest && git fetch --depth 1 origin 5073ecd69f872358611507c3d09409b1b5df2971 && git reset --mixed FETCH_HEAD
python3 -m venv <guest-path> && <guest-path> -m pip install -e . && <guest-path> .
mkdir -p .coldpass && cat > .coldpass/probe.json <<'EOF'
{"kind":"cli","argv":["<guest-path>","<guest-path>"],"cwd":"<guest-path>","expected_text":"lists of files in version control and sdist match"}
EOF
cat > .coldpass/claims.json <<'EOF'
[
  {"kind":"claim","claim":"Checks that a Python MANIFEST.in file is complete.","source":"Check a Python MANIFEST.in file for completeness","input":"<guest-path>","expected":"lists of files in version control and sdist match","probe_kind":"cli","argv":["<guest-path>","<guest-path>"],"expected_text":"lists of files in version control and sdist match","cwd":"<guest-path>"}
]
EOF
cat > .coldpass/examples.json <<'EOF'
[
  {"kind":"example","claim":"Run the documented quick start check against this package checkout.","source":"README.rst / Quick start","input":"the current source tree","expected":"manifest and sdist file lists match","argv":["<guest-path>","<guest-path>"],"cwd":"<guest-path>","expected_text":"lists of files in version control and sdist match"}
]
EOF
cat > .coldpass/cycles.json <<'EOF'
{"detected":false,"reason":"README and package entry points describe a one-shot manifest check; no scheduler, loop, webhook, or cycle trigger was found.","checks":[]}
EOF
cat > .coldpass/report.json <<'EOF'
{"outcome":"working","fault_owner":null,"operation":"check-manifest CLI manifest completeness check","operation_scope":"Python 3.12.3; editable install in a venv; run against the pinned source checkout","steps":["python3 -m venv <guest-path>","<guest-path> -m pip install -e .","<guest-path> ."],"deviations":["Initialized Git metadata and fetched/reset to the requested pinned commit because the supplied source snapshot had no .git directory."],"stuck_step":null,"main_blocker":null,"plain_failure":null,"suggested_fix":null}
EOF
<env-var>=<guest-path> python3 -I <guest-path> --validate --replay
python3 - <<'PY'
import json
p='.coldpass/claims.json'
x=json.load(open(p))
x[0]['source_file']='README.rst'
json.dump(x,open(p,'w'),indent=2)
PY
<env-var>=<guest-path> python3 -I <guest-path> --validate --replay