coldpass

decimal-labs/decimalai-mcp

GitHub ↗ · How this check works

Per-setup public labels: Linux / Haiku: Works

Static status badge · SVG · read-only JSON. Embed with ![Coldpass status](https://coldpass.dev/badge/decimal-labs--decimalai-mcp.svg).

agent-skillsai-agentsclaudecursorllm-evaluationmcp

Works

Only older checks are saved; no current product test.

Answers apply to each recorded setup, revision and operation. Earlier observations remain in Run details.

Tested on Linux
PlatformHaikuLuna
Linuxyes

Linux / Haiku 5.5: yes · Oct 18, 2026 · a033c9f22052 · claude-code / 2.1.300 (Claude Code)
Recorded operation: <host-path> -m decimalai_mcp.server · local stdio MCP start + initialize + tools/list

MCP
yes, local
Yes, runs locally
Needs keys or browser
None seen
Issue
none found in recorded check

Safety: no observations were recorded for the selected revision. Functional results do not establish a safety result.

Run details

Haiku 5.5

Native agent · Checked operation passed

Checked operation <host-path> -m decimalai_mcp.server · local stdio MCP start + initialize + tools/list

Agent-reported scope: Start the stdio MCP server (python -m decimalai_mcp.server) and list its tools via MCP initialize + tools/list; expected search_skills, get_skill, get_leaderboard.

MCP server returned: decimalai · version 0.1.4.

MCP tools returned: search_skills, get_skill, get_leaderboard. Tool listing does not establish authenticated tool-call success.

Run details
run
decimal-labs--decimalai-mcp-claude-haiku-5-5-1792343158331375302
date
Oct 18, 2026
time to working
not recorded
product hosting / execution
Local stdio MCP server in the guest
recorded operation scope
product operation
model
claude-haiku-5-5
agent / version
claude-code / 2.1.300 (Claude Code)
platform
linux
reported cost
$0.003801
Recorded source
https://github.com/decimal-labs/decimalai-mcp
Tool transport
mcp-assigned-vm
Test version
readme-35a4df7562ac6aaecbf68c5247f5297931fc216885efe8863696871d144439bf
revision
a033c9f22052fe1528a7c4e200b62ad6b2dc0d8d
What the agent did

Start the stdio MCP server (python -m decimalai_mcp.server) and list its tools via MCP initialize + tools/list; expected search_skills, get_skill, get_leaderboard.

cd <host-path> && git log -1 --format=%H 2>/dev/null; ls -la; cat README.md 2>/dev/null | head -200
ls -la <host-path> 2>/dev/null; echo "CDP=$CDP_URL"; which node npm python3 pip3 uv 2>&1
cd <host-path> && (python3 -m venv <host-path> 2>&1 || (sudo apt-get update -qq && sudo apt-get install -y -qq python3-venv >/dev/null 2>&1 && python3 -m venv <host-path>)) && <host-path> install -q -e . 2>&1 | tail -20; echo rc=$?; <host-path> -c "import decimalai_mcp, mcp; print('ok', decimalai_mcp.__file__)"
sudo apt-get update -qq >/dev/null 2>&1; sudo apt-get install -y -qq python3.12-venv >/tmp/apt.log 2>&1; echo apt=$?; rm -rf <host-path> && python3 -m venv <host-path> && cd <host-path> && <host-path> install -q -e . ; echo pip=$?; cd /tmp && <host-path> -c "import decimalai_mcp, mcp.server.fastmcp as f; print('ok', decimalai_mcp.__file__)"
cd /tmp && cat > /tmp/list_tools.py <<'EOF'
import asyncio
from mcp import ClientSession, StdioServerParameters
from mcp.client.stdio import stdio_client
async def main():
    params = StdioServerParameters(command="<host-path>", args=["-m", "decimalai_mcp.server"], cwd="/tmp")
    async with stdio_client(params) as (r, w):
        async with ClientSession(r, w) as s:
            await s.initialize()
            tools = await s.list_tools()
            for t in tools.tools: print(t.name)
asyncio.run(main())
EOF
timeout 60 <host-path> -I /tmp/list_tools.py; echo rc=$?
cd <host-path> && mkdir -p .coldpass && cat > .coldpass/probe.json <<'EOF'
{"kind":"mcp","argv":["<host-path>"}
EOF
cat > .coldpass/report.json <<'EOF'
{"outcome":"working","operation":"Start the stdio MCP server (python -m decimalai_mcp.server) and list its tools via MCP initialize + tools/list; expected search_skills, get_skill, get_leaderboard.","operation_scope":"Public read-only registry tools; no DECIMAL_API_KEY needed. Tool calls against api.decimal.ai not exercised (only tools/list).","steps":["Read README.md","python3 -m venv <host-path> (failed: ensurepip missing)","apt-get install python3.12-venv; recreated <host-path> install -q -e . in workspace (succeeded)","Verified import of decimalai_mcp and mcp.server.fastmcp","Started server over stdio and ran tools/list via mcp client (/tmp/list_tools.py)"],"deviations":["python3 -m venv failed because python3-venv was not installed; ran apt-get install python3.12-venv then recreated venv.","Did not run pytest or the CI FastMCP check, per smoke-task instructions."],"stuck_step":null,"main_blocker":null,"suggested_fix":null}
EOF
<env-var>=<host-path> python3 -I <host-path> --validate; echo rc=$?