Haiku 5.5
Native agent · Not testedChecked operation <host-path> mcp serve · local stdio MCP start + initialize + tools/list
Agent-reported scope: Installed the local Orbit CLI (orbit 0.139.0) from the README's install.sh, started its MCP server with `orbit mcp serve` over stdio, and listed its tools (initialize + tools/list). Also indexed a git snapshot of the pinned repo locally and ran `orbit grep` against it, which returned definitions from the source.
MCP server returned: orbit-cli · version 0.139.0.
MCP tools returned: get_graph_schema, index, run_sql. Tool listing does not establish authenticated tool-call success.
Run details
- run
- gitlabhq--orbit-knowledge-graph-claude-haiku-5-5-1792306963989506650
- date
- Oct 18, 2026
- time to working
- not recorded
- product hosting / execution
- Local stdio MCP server in the guest
- recorded operation scope
- product operation
- model
- claude-haiku-5-5
- agent / version
- claude-code / 2.1.300 (Claude Code)
- platform
- linux
- reported cost
- $0.011608
- Recorded source
- https://github.com/gitlabhq/orbit-knowledge-graph
- Tool transport
- mcp-assigned-vm
- Test version
- readme-c26ffe1cce5b90e6f204842e94573d85d9b767775aa350121a892728022647fe
- revision
- 365be79ee154a0bbb8719dd8b43a78bb3f77b7f5
Double-checks failed run: gitlabhq/orbit-knowledge-graph · Oct 17, 2026.
Fix: fix-38adc87002b16945f6d5.
What the agent did
Installed the local Orbit CLI (orbit 0.139.0) from the README's install.sh, started its MCP server with `orbit mcp serve` over stdio, and listed its tools (initialize + tools/list). Also indexed a git snapshot of the pinned repo locally and ran `orbit grep` against it, which returned definitions from the source.
cd <host-path> && ls -la && cat README.md 2>/dev/null | head -200
cat <host-path> 2>/dev/null | head -80; echo; echo CDP=$CDP_URL $<env-var>; which cargo rustc node npm python3; uname -a; cat /etc/os-release | head -2
cd <host-path> && head -60 install.sh; echo ----; sed -n 80,200p <host-path> | grep -n "validate\|kind\|mcp" | head -40; echo ----; ls docs/source/remote/ | head -50; which glab; echo ----; grep -n "" docs/source/remote/access/glab.md | head -80
cd <host-path> && export NODE_USE_ENV_PROXY=1 && bash install.sh 2>&1 | tail -30; echo "rc=$?"; ls -la ~/.local/bin 2>/dev/null; export PATH=$HOME/.local/bin:$PATH; orbit --help 2>&1 | head -60
cd <host-path> && bash install.sh --version v0.51.0 2>&1 | tail -15; export PATH=$HOME/.local/bin:$PATH; which orbit glab; orbit --version 2>&1 | head -3
cd /tmp && for u in https://gitlab.com/api/v4/projects/77960826/packages/generic/orbit-cli/0.147.0/orbit-cli-linux-aarch64.tar.gz https://gitlab.com/api/v4/projects/77960826/packages/generic/orbit-cli/0.147.0/orbit-cli-linux-aarch64-musl.tar.gz https://gitlab.com/api/v4/projects/77960826/packages/generic/orbit-cli/0.147.0/orbit-cli-linux-x86_64.tar.gz https://gitlab.com/api/v4/projects/77960826/packages/generic/orbit-cli/0.147.0/orbit-cli-linux-aarch64-gnu.tar.gz https://gitlab.com/; do echo -n "$u -> "; curl -s -o /dev/null -w "%{http_code}\n" -m 20 -I "$u"; done; echo; env | grep -i proxy; cd <host-path> && grep -n "linux-aarch64\|orbit-cli-linux" install.sh | head; which glab || echo "no glab"
curl -s -m 30 "https://gitlab.com/api/v4/projects/77960826/packages?package_name=orbit-cli&per_page=5" | head -c 1500; echo; curl -s -m 30 "https://gitlab.com/api/v4/projects/77960826/packages/generic/orbit-cli/0.147.0/" | head -c 500; echo; curl -s -m 30 -o /dev/null -w "%{http_code}\n" "https://gitlab.com/api/v4/projects/77960826"
curl -s -m 30 "https://gitlab.com/api/v4/projects/77960826/packages?package_name=orbit-cli&per_page=100&order_by=created_at&sort=desc" | python3 -c "import json,sys; d=json.load(sys.stdin); print([ (p['version'],p['created_at'][:10]) for p in d][:15])"; echo; V=$(curl -s -m 30 "https://gitlab.com/api/v4/projects/77960826/packages?package_name=orbit-cli&per_page=100&order_by=created_at&sort=desc" | python3 -c "import json,sys; print(json.load(sys.stdin)[0]['version'])"); echo latest=$V; curl -s -m 30 "https://gitlab.com/api/v4/projects/77960826/packages/$(curl -s -m 30 "https://gitlab.com/api/v4/projects/77960826/packages?package_name=orbit-cli&per_page=100&order_by=created_at&sort=desc" | python3 -c "import json,sys; print(json.load(sys.stdin)[0]['id'])")/package_files" | python3 -c "import json,sys; [print(f['file_name']) for f in json.load(sys.stdin)]"
cd <host-path> && bash install.sh --version v0.139.0 2>&1 | tail -15; export PATH=$HOME/.local/bin:$PATH; which orbit && orbit --version 2>&1 | head -3; orbit --help 2>&1 | head -70
export PATH=$HOME/.local/bin:$PATH; cd <host-path> && orbit index --help 2>&1 | head -30; echo ----; timeout 900 orbit index <host-path> 2>&1 | tail -25; echo rc=$?
export PATH=$HOME/.local/bin:$PATH; orbit config --help 2>&1 | head -30; echo ----; orbit config list 2>&1 | head -30; orbit --help 2>&1 >/dev/null; grep -rn -i "telemetry\|DO_NOT_TRACK\|opt.out" <host-path> <host-path> 2>/dev/null | head -10
export PATH=$HOME/.local/bin:$PATH; orbit config set telemetry.enabled false 2>&1; orbit config list 2>&1; rm -rf /tmp/orbit-src && mkdir -p /tmp/orbit-src && cp -a <host-path> /tmp/orbit-src/ && cd /tmp/orbit-src && git init -q && git -c user.email=smoke@local -c user.name=smoke add -A >/dev/null 2>&1 && git -c user.email=smoke@local -c user.name=smoke commit -qm "pinned snapshot" && git log --oneline | head -2; cd /tmp && timeout 1200 orbit index /tmp/orbit-src -s 2>&1 | tail -25; echo rc=${PIPESTATUS[0]}
export PATH=$HOME/.local/bin:$PATH; orbit list 2>&1 | head; echo ----; orbit grep --help 2>&1 | head -20; echo ----; orbit grep "index" 2>&1 | head -25; echo ----; grep -rn "orbit mcp" <host-path> | head -10
export PATH=$HOME/.local/bin:$PATH; orbit grep --repo /tmp/orbit-src "index_repo|Indexer|index" --limit 5 2>&1 | head -30; echo ----; printf '%s\n' '{"jsonrpc":"2.0","id":1,"method":"initialize","params":{"protocolVersion":"2024-11-05","capabilities":{},"clientInfo":{"name":"smoke","version":"0"}}}' '{"jsonrpc":"2.0","method":"notifications/initialized"}' '{"jsonrpc":"2.0","id":2,"method":"tools/list"}' | timeout 60 orbit mcp serve 2>/dev/null | head -c 1500; echo; echo rc=$?
cd <host-path> && ls -la .coldpass 2>&1; mkdir -p .coldpass && cat > .coldpass/probe.json <<'EOF'
{"kind":"mcp","argv":["<host-path>"}
EOF
cat > .coldpass/report.json <<'EOF'
{"outcome":"working","operation":"Installed the local Orbit CLI (orbit 0.139.0) from the README's install.sh, started its MCP server with `orbit mcp serve` over stdio, and listed its tools (initialize + tools/list). Also indexed a git snapshot of the pinned repo locally and ran `orbit grep` against it, which returned definitions from the source.","operation_scope":"Covers the local, offline `orbit` CLI and MCP path only. The hosted `glab orbit` commands (query, status, ontology, setup) need a GitLab credential from `glab auth login` and a group with Orbit enabled; glab is not installed and those were not exercised.","steps":["Read README.md: Quickstart uses glab + `glab orbit setup` (needs auth); local path is via install.sh and `orbit`.","bash install.sh (latest resolved to v0.147.0, artifacts 404)","bash install.sh --version v0.139.0 (installed orbit 0.139.0 to ~/.local/bin)","orbit config set telemetry.enabled false","orbit index <host-path> (failed: not a git repository)","cp -a workspace to /tmp/orbit-src; git init; git commit (workspace left unmodified)","orbit index /tmp/orbit-src -s (indexed, rc=0)","orbit list; orbit grep --repo /tmp/orbit-src \"index_repo|Indexer|index\"","orbit mcp serve (initialize + tools/list over stdio, returned get_graph_schema, index, run_sql, ...)"],"deviations":["install.sh with no --version: resolved latest v0.147.0 whose download returned 404 for every artifact. Ran `bash install.sh --version v0.139.0`, the newest version with published artifacts in the project's package registry.","`orbit index <host-path> failed with 'no git repository found'. The workspace is not a git repo and must stay unchanged, so indexed a git-initialized copy at /tmp/orbit-src instead.","glab was not installed (README quickstart requires it plus `glab auth login`). Not installed because it needs credentials that are not available in this guest; hosted glab orbit steps were skipped.","Telemetry: the indexer tried to post to events.gitlab.net (failed, no network effect); set telemetry.enabled=false as the consent-off option."],"stuck_step":null,"main_blocker":null,"suggested_fix":"For the hosted quickstart: install glab 1.120+, run `glab auth login` with a Premium/Ultimate account whose top-level group has Orbit enabled, then `glab orbit setup`. For the installer: publish orbit-cli artifacts for v0.147.0 or fix the latest-release resolver in install.sh."}
EOF
python3 -m json.tool .coldpass/probe.json >/dev/null && python3 -m json.tool .coldpass/report.json >/dev/null && echo json-ok; <env-var>=<host-path> python3 -I <host-path> --validate 2>&1 | tail -20run JSON · checker evidence · agent report + check · transcript excerpt · error excerpt
Earlier attempts (1)
Haiku 5.5
Native agent · Recorded operation failedOperation / attempted scope No working operation verified.
Run details
- run
- gitlabhq--orbit-knowledge-graph-claude-haiku-5-5-1792291237503811408
- date
- Oct 17, 2026
- time to working
- not recorded
- product hosting / execution
- Not recorded
- recorded operation scope
- not separately recorded
- model
- claude-haiku-5-5
- agent / version
- claude-code / 2.1.300 (Claude Code)
- platform
- linux
- reported cost
- $0.023757
- Recorded source
- https://github.com/gitlabhq/orbit-knowledge-graph
- Tool transport
- mcp-assigned-vm
- Test version
- readme-6bd225b7dceaabc00d2c31e87e787795491e8d7d19bfab58de846adc71c82afb
- revision
- 365be79ee154a0bbb8719dd8b43a78bb3f77b7f5
Fix: fix-38adc87002b16945f6d5.
Recorded blocker / warningStep: /bin/bash -c 'o=$(mktemp);e=$(mktemp);/bin/bash -lc "$1" </dev/null >"$o" 2>"$e";c=$?;cat "$o";cat "$e" >&2;rm -f "$o" "$e";exit $c' coldpass 'export CDP_URL=http://<internal-ip>:9226; export <env-var>=http://<internal-ip>:9226; export <env-var>=<host-path>; cd <host-path> && echo ok'
The guest ran out of memory or vanished and stopped answering during the product check.
Suggested next step (agent-reported): Inspect the recorded blocker and correct the README prerequisites or harness error.
run JSON · checker evidence · agent report + check · transcript excerpt · error excerpt