Works in specific setups
Only older checks are saved; no current product test.
Answers apply to each recorded setup, revision and operation. Earlier observations remain in Run details.
Tested on Linux| Platform | Haiku | Luna |
|---|
| Linux | yes | no |
|---|
Linux / Haiku 5.5: yes · Oct 16, 2026 · 86402dc12e42 · claude-code / 2.1.300 (Claude Code)
Recorded operation: /workspace/.venv/bin/ecfr-mcp · local stdio MCP start + initialize + tools/list
Linux / Luna: no · Oct 17, 2026 · 3031be7a5a50 · codex / codex-cli 0.162.1
Recorded operation: limited checks
- MCP
- yes, local
Yes, runs locally
- Needs keys or browser
- None seen
- Setup time
- 1 min 36 s to install, 2 min 6 s to first use
- Issue
- none found in confirmed setups
Safety: no observations were recorded for the selected revision. Functional results do not establish a safety result.
Run details
Haiku 5.5
Native agent · Checked operation passedChecked operation /workspace/.venv/bin/ecfr-mcp · local stdio MCP start + initialize + tools/list
Agent-reported scope: Start the eCFR MCP server (ecfr-mcp 1.1.10, stdio) from the pinned source, run MCP initialize and tools/list (13 tools), and exercise lookup_far_clause on FAR 52.212-4, which returned the live clause text from ecfr.gov.
MCP server returned: ecfr · version 1.1.10.
MCP tools returned: get_latest_date, get_cfr_content, get_cfr_structure, get_version_history, get_ancestry, search_cfr, list_agencies, get_corrections, lookup_far_clause, compare_versions, list_sections_in_part, find_far_definition, find_recent_changes. Tool listing does not establish authenticated tool-call success.
Run details
- run
- 1102tools-dev--federal-contracting-mcps-claude-haiku-5-5-1792195616179049553
- date
- Oct 16, 2026
- time to working
- 243.8s
- product hosting / execution
- Local stdio MCP server in the guest
- recorded operation scope
- not separately recorded
- model
- claude-haiku-5-5
- agent / version
- claude-code / 2.1.300 (Claude Code)
- platform
- linux
- reported cost
- $0.014959
- Recorded source
- https://github.com/1102tools-dev/federal-contracting-mcps
- Tool transport
- mcp-assigned-vm
- Test version
- readme-0e7099c5be9e966c3552ada47b50e26c120936275ce1ac666ec3559223219013
- revision
- 86402dc12e4206b0fab769f8094a2e64ffb216ad
Whose fault: not assigned · resolved- Evidence unavailable in the public snapshot.
What the agent did
Start the eCFR MCP server (ecfr-mcp 1.1.10, stdio) from the pinned source, run MCP initialize and tools/list (13 tools), and exercise lookup_far_clause on FAR 52.212-4, which returned the live clause text from ecfr.gov.
apt-get install python3.12-venv python3-pip (venv needed; ensurepip was missing)
python3 -m venv /workspace/.venv
servers/ecfr-mcp/readme.md: '## Installation' / '### From source' -> pip install -e . (run inside servers/ecfr-mcp, using /workspace/.venv/bin/python -m pip)
servers/ecfr-mcp/readme.md: '## Configuration' stdio start -> /workspace/.venv/bin/ecfr-mcp, MCP initialize + tools/list (13 tools)
MCP tools/call lookup_far_clause {section_id: '52.212-4'} -> clause text returnedrun JSON · checker evidence · agent report unavailable · transcript excerpt unavailable · error excerpt unavailable
Earlier attempts (1)
Luna
Native agent · Recorded operation failedOperation / attempted scope limited checks
Agent-reported scope: Start ecfr-mcp and list MCP tools
Run details
- run
- 1102tools-dev--federal-contracting-mcps-gpt-6-luna-1792256101167134035
- date
- Oct 17, 2026
- time to working
- not recorded
- product hosting / execution
- Not recorded
- recorded operation scope
- limited checks
- model
- gpt-6-luna
- agent / version
- codex / codex-cli 0.162.1
- platform
- linux
- reported cost
- not reported (not assumed free)
- Recorded source
- https://github.com/1102tools-dev/federal-contracting-mcps
- Tool transport
- mcp-assigned-vm
- Test version
- readme-c590228a982eded6c4169356a442b244e98faa820504519ec488469d2c8caa4d
- revision
- 3031be7a5a5063b3e28ca45e5d4f54529d4c0dc2
Fix: fix-a0953c2547a311a0b53c.
Recorded blocker / warningStep: cd servers/ecfr-mcp && python -m pip install -e .
Actual command error: /bin/bash: line 1: python: command not found; uvx and uv are also unavailable, and python3 has no pip module.
Install / setup / connection checks
[
{
"status": "FAIL",
"details": {
"working": false,
"argv": [
"python",
"-m",
"pip",
"install",
"-e",
"."
],
"kind": "cli",
"blocker": "[Errno 2] No such file or directory: 'python'"
},
"check": "install",
"optional": false
}
]Suggested next step (agent-reported): Provide uv/uvx or Python pip in the VM, then install ecfr-mcp and run it under an MCP client to issue tools/list.
What the agent did
Start ecfr-mcp and list MCP tools
Read root README Local setup
Read servers/ecfr-mcp/readme.md Installation
run JSON · agent report + check · transcript excerpt · error excerpt
No product verdict. Run record.
No product verdict. Run record.
No product verdict. Run record.
No product verdict. Run record.