coldpass

devbyanoop/kbguard

GitHub ↗ · How this check works

Per-setup public labels: Linux / Luna: Works

Static status badge · SVG · read-only JSON. Embed with ![Coldpass status](https://coldpass.dev/badge/devbyanoop--kbguard.svg).

other

Works

The recorded run passed on 1 setup.

Answers apply to each recorded setup, revision and operation. Earlier observations remain in Run details.

Tested on Linux
PlatformHaikuLuna
Linuxour test failed; no repo verdictyes

Linux / Haiku 5.5: our test failed; no repo verdict · Oct 27, 2026 · revision not recorded
Recorded operation: No working operation verified.

Linux / Luna: yes · Oct 27, 2026 · c840f441f9b1 · codex / codex-cli 0.164.0
Recorded operation: <guest-path> scan --collection demo --config examples/policy_corpus/kbguard.yaml

Does what it says
1 of 1 claims checked out
  • The bundled corpus can be scanned into a health report.: Real input produced the expected result: 17 chunks

    Source: Produces a health score (0–100) and an HTML/JSON report.

    Input: examples/policy_corpus/ seeded demo collection

    Expected: snapshot contains report.html and results.json

    Command: <guest-path> scan --collection demo --config examples/policy_corpus/kbguard.yaml

    Observed: 17 chunks -> .kbguard/snapshots/2026-10-27T14-23-52_demo (report.html, results.json)

MCP
No
Local or hosted
local
Local: runs on your machine
Needs keys or browser
None seen
Maintained
Maintained
actively maintained: last commit 0 days ago; 52 commits and 0 merged PRs in 90 days; 0 open issues, 0 open PRs; latest release 2026-10-27

Last commit Oct 27, 2026

Setup time
3 min 44 s
3 min 44 s to a working result
Issue
none found in recorded check
Examples
1 of 1 ran as expected
  • Seed and scan the bundled policy corpus: command completed successfully

    Source: README.md Quickstart

    Input: examples/policy_corpus/

    Expected: 17 chunks are scanned and a snapshot is written

    Command: <guest-path> scan --collection demo --config examples/policy_corpus/kbguard.yaml

    Observed: Wrote snapshot '2026-10-27T14-23-58_demo': 17 chunks -> .kbguard/snapshots/2026-10-27T14-23-58_demo (report.html, results.json)

Evidence
README behavior checked
Agent interfaces
CLI
CLI

Observed interfaces were exercised by the checker. Documentation alone does not confirm compatibility.

Tested with
Codex / Luna
  • Linux: Codex / Luna · agent codex-cli 0.164.0 · Checked operation passed · Oct 27, 2026 on c840f441f9b1

Each entry describes its recorded operation and source revision.

Safety
No unexpected network or file activity found in these checks

No problems traced to this repository code in these checks; a short run cannot prove safety.

Full event, path and process lists for each observed setup:

Repair history and test corrections
Current diagnosis: test · harness_fix_required

<host-path> api repos/devbyanoop/kbguard/commits/HEAD --jq.sha exited 1: r help, please include the request ID 971C:217B7E:3275F6D:A634222:6AE0A684 and timestamp 2026-10-27 13:26:28 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) (HTTP 403)

Repair record fix-d472419c8318b819aec3 · current status JSON. Original run outcomes remain unchanged.

Failed run: devbyanoop/kbguard · Oct 27, 2026 · Our test failed; no repo verdict.

Run details
Earlier attempts (1)

Luna

Native agent · Checked operation passed

Checked operation <guest-path> scan --collection demo --config examples/policy_corpus/kbguard.yaml

Agent-reported scope: Scan bundled policy corpus

Run details
run
devbyanoop--kbguard-gpt-6-luna-1793110791990671436
date
Oct 27, 2026
time to working
223.8s
product hosting / execution
Local command in the guest
recorded operation scope
product operation
model
gpt-6-luna
agent / version
codex / codex-cli 0.164.0
platform
linux
reported cost
not reported (not assumed free)
Recorded source
https://github.com/devbyanoop/kbguard
Backend
hyperv
Tool transport
mcp-assigned-vm
Requested source pin (not an observed revision)
{"commit": "c840f441f9b12a9d76dcd0ff71f19fafaf30fcba", "url": "https://github.com/devbyanoop/kbguard"}
Test version
readme-38e6b13f3b13804effb95797e3466b1a1334da7a232d897cbc8965867f802605
revision
c840f441f9b12a9d76dcd0ff71f19fafaf30fcba
Whose fault: not assigned · resolved

Safety: No problems traced to this repository code in these checks.

No problems traced to this repository code in these checks.

OSV scanned supported lockfiles; unpinned dependencies and unsupported formats are outside this check.

A short run cannot establish that code is safe.

Connections show IP addresses; proxies can hide the final hostname.

Tracing covers dispatched commands and their children, not the whole OS; guest root can interfere with tracing.

Full safety evidence →

Answers recorded for this run
  • The bundled corpus can be scanned into a health report.: Real input produced the expected result: 17 chunks

    Source: Produces a health score (0–100) and an HTML/JSON report.

    Input: examples/policy_corpus/ seeded demo collection

    Expected: snapshot contains report.html and results.json

    Command: <guest-path> scan --collection demo --config examples/policy_corpus/kbguard.yaml

    Observed: 17 chunks -> .kbguard/snapshots/2026-10-27T14-23-52_demo (report.html, results.json)

Examples

  • Seed and scan the bundled policy corpus: command completed successfully

    Source: README.md Quickstart

    Input: examples/policy_corpus/

    Expected: 17 chunks are scanned and a snapshot is written

    Command: <guest-path> scan --collection demo --config examples/policy_corpus/kbguard.yaml

    Observed: Wrote snapshot '2026-10-27T14-23-58_demo': 17 chunks -> .kbguard/snapshots/2026-10-27T14-23-58_demo (report.html, results.json)

Local or hosted: local

What the agent did

Scan bundled policy corpus

pwd && ls -la && sed -n '1,240p' README.md && python3 --version && id -u
rg --files .coldpass src examples docs | head -80 && cat pyproject.toml | head -100 && sed -n '1,220p' examples/policy_corpus/README.md 2>/dev/null; sed -n '1,220p' docs/getting-started/installation.md; sed -n '1,220p' docs/getting-started/quickstart.md
python3 -m venv .venv && .venv/bin/python -m pip install -e '.[dev,chroma]'
python examples/policy_corpus/seed.py && .venv/bin/kbguard scan --collection demo --config examples/policy_corpus/kbguard.yaml
 .venv/bin/python examples/policy_corpus/seed.py && .venv/bin/kbguard scan --collection demo --config examples/policy_corpus/kbguard.yaml
 .venv/bin/python -m pip install '.[dedup]'
 .venv/bin/kbguard scan --collection demo --config examples/policy_corpus/kbguard.yaml
mkdir -p .coldpass && cat > .coldpass/probe.json <<'EOF'
{"kind":"cli","argv":["<guest-path>","scan","--collection","demo","--config","examples/policy_corpus/kbguard.yaml"],"cwd":"<guest-path>","expected_text":"17 chunks"}
EOF
cat > .coldpass/claims.json <<'EOF'
[{"kind":"claim","claim":"The bundled corpus can be scanned into a health report.","source":"Produces a health score (0–100) and an HTML/JSON report.","input":"examples/policy_corpus/ seeded demo collection","expected":"snapshot contains report.html and results.json","probe_kind":"cli","argv":["<guest-path>","scan","--collection","demo","--config","examples/policy_corpus/kbguard.yaml"],"expected_text":"17 chunks","cwd":"<guest-path>"}]
EOF
cat > .coldpass/examples.json <<'EOF'
[{"kind":"example","claim":"Seed and scan the bundled policy corpus","source":"README.md Quickstart","input":"examples/policy_corpus/","expected":"17 chunks are scanned and a snapshot is written","argv":["<guest-path>","scan","--collection","demo","--config","examples/policy_corpus/kbguard.yaml"],"cwd":"<guest-path>","expected_text":"17 chunks"}]
EOF
cat > .coldpass/cycles.json <<'EOF'
{"detected":false,"reason":"Inspected README product commands and entry points; kbguard performs an on-demand scan and documents no scheduler, loop, webhook, or periodic cycle.","checks":[]}
EOF
cat > .coldpass/report.json <<'EOF'
{"outcome":"working","fault_owner":null,"operation":"Scan bundled policy corpus","operation_scope":"Python 3.12.3 virtual environment; editable install with dev and chroma extras plus dedup extra.","steps":["python3 -m venv .venv",".venv/bin/python -m pip install -e '.[dev,chroma]'",".venv/bin/python examples/policy_corpus/seed.py",".venv/bin/python -m pip install '.[dedup]'",".venv/bin/kbguard scan --collection demo --config examples/policy_corpus/kbguard.yaml"],"deviations":["Initial scan reported that near-duplicate detection requires kbguard[dedup]; installed the documented extra and reran successfully."],"stuck_step":null,"main_blocker":null,"plain_failure":null,"suggested_fix":null}
EOF

<env-var>=<guest-path> python3 -I <guest-path> --validate --replay

No product verdict. Run record.