awlevin/typesafe-computer-use

Review signals: 1 download and execute, 43 known vulnerability.

Source contains download and execute; review its purpose. infra/gcp/startup.sh

OSV reports a known vulnerability in this dependency version. 2 distinct locations. 43 findings.

OSV scanned supported lockfiles; unpinned dependencies and unsupported formats are outside this check.

A short run cannot establish that code is safe.

Connections show IP addresses; proxies can hide the final hostname.

Tracing covers dispatched commands and their children, not the whole OS; guest root can interfere with tracing.

Full safety evidence →

[
  {
    "status": "PASS",
    "details": {
      "working": false,
      "argv": [
        "<guest-path>",
        "sync",
        "--frozen"
      ],
      "kind": "cli",
      "returncode": 0,
      "stdout": "",
      "stderr": "Checked 33 packages in 28ms",
      "needs_credentials": false,
      "needs_browser": false,
      "scope": "partial: install"
    },
    "check": "install",
    "optional": false
  },
  {
    "status": "PASS",
    "details": {
      "working": false,
      "argv": [
        "<guest-path>",
        "open the Playground"
      ],
      "kind": "cli",
      "returncode": 1,
      "stdout": "",
      "stderr": "TYPESAFE_API_KEY is not set (export it or put it in .env)",
      "needs_credentials": true,
      "needs_browser": false,
      "scope": "partial: missing credentials"
    },
    "check": "credentials_error",
    "optional": false
  }
]

• The README documents a first-run clicker operation.: The README first-run command was attempted; its actual error was TYPESAFE_API_KEY is not set. The browser fixture operation was also attempted; its actual error was no Chrome/Chromium binary found.

  Source: uv run clicker "open the Playground"

  Input: documented first run

  Expected: a dry-run step is printed

  Observed: The README first-run command was attempted; its actual error was TYPESAFE_API_KEY is not set. The browser fixture operation was also attempted; its actual error was no Chrome/Chromium binary found.

Examples

• Install the project using the README setup command.: command completed successfully

  Source: README.md / Install

  Input: uv sync --frozen on Python 3.12.3

  Expected: Project environment and dependencies installed

  Command: <guest-path> sync --frozen

  Observed: Checked 33 packages in 30ms

• Run documented contributor checks.: command completed successfully

  Source: README.md / Contributing

  Input: ruff check, ruff format check, pytest

  Expected: All CI checks succeed

  Command: <guest-path> check .

  Observed: All checks passed!

Local or hosted: local

Install and attempt README browser fixture benchmark

pwd; id -u; ls -la; rg --files -g 'README*' -g 'AGENTS.md' -g 'pyproject.toml' -g 'package.json' -g 'uv.lock' -g 'requirements*' -g '*.yml' -g '*.yaml' | head -100; command -v vault-search || true; if command -v vault-search >/dev/null 2>&1; then vault-search 'typesafe computer use MCP'; fi; python3 --version; git status --short --branch
cat AGENTS.md; cat README.md; cat pyproject.toml; find . -maxdepth 3 -type f | sort | head -150; ls -la .coldpass; command -v uv || true; command -v pip || true; command -v pip3 || true
cat VISION.md; cat docs/sandbox.md; cat .env.example; sed -n '1,240p' scripts/sandbox; command -v sudo; sudo -n true; echo sudo_status=$?; command -v curl; command -v uv || true; python3 -m pip --version; env | sort | grep -E 'CDP|PROXY|COLDPASS|API_KEY' | sed -E 's/(KEY|TOKEN)=.*/\1=[redacted]/' || true
curl -LsSf https://astral.sh/uv/install.sh | sh; echo uv_install_status=${PIPESTATUS[1]}; ls -l <host-path> /root/.local/bin/uv 2>/dev/null || true; docker --version; docker compose version
export PATH=<guest-path>; uv sync --frozen
cat docs/browser-backend.md; sed -n '1,220p' typesafe_computer_use/browser/bench.py; sed -n '1,180p' docs/run-folder.md; sed -n '1,160p' .github/workflows/ci.yaml
export PATH=<guest-path>; uv run clicker-bench perception --fixture --n 1
sed -n '1,160p' typesafe_computer_use/cli.py; sed -n '260,360p' typesafe_computer_use/browser/bench.py; find . -maxdepth 2 -type f -name '*fixture*' -o -name 'test_browser_offline.py'
export PATH=<guest-path>; uv run ruff check . && uv run ruff format --check . && uv run pytest -q
mkdir -p .coldpass; cat > .coldpass/probe.json <<'EOF'
{"kind":"cli","argv":["<guest-path>","perception","--fixture","--n","1"],"cwd":"<guest-path>","expected_returncode":1,"expected_text":"no Chrome/Chromium binary found"}
EOF
cat > .coldpass/claims.json <<'EOF'
[{"kind":"claim","claim":"Browser perception can read the local fixture through its documented benchmark.","source":"uv run clicker-bench perception --fixture --n 8","input":"local fixture, one pass","expected":"DOM perception reports the fixture elements","testable":false,"reason":"The README's documented browser fixture operation was attempted and failed: no Chrome/Chromium binary found. The documented sandbox prerequisite requires Docker, and docker is unavailable in this VM."}]
EOF
cat > .coldpass/examples.json <<'EOF'
[{"kind":"example","claim":"Install the project using the README setup command.","source":"README.md / Install","input":"uv sync --frozen on Python 3.12.3","expected":"Project environment and dependencies installed","argv":["<guest-path>","sync","--frozen"],"cwd":"<guest-path>","expected_text":"Built typesafe-computer-use"},{"kind":"example","claim":"Run the documented browser fixture benchmark.","source":"docs/browser-backend.md / command example","input":"local fixture, one pass","expected":"DOM perception output","argv":["<guest-path>","perception","--fixture","--n","1"],"cwd":"<guest-path>","expected_returncode":1,"expected_text":"no Chrome/Chromium binary found"},{"kind":"example","claim":"Run documented contributor checks.","source":"README.md / Contributing","input":"ruff check, ruff format check, pytest","expected":"All CI checks succeed","argv":["<guest-path>","check","."],"cwd":"<guest-path>","expected_text":"All checks passed!"}]
EOF
cat > .coldpass/cycles.json <<'EOF'
{"detected":false,"reason":"Inspected README entrypoints, browser benchmark and CLI: this project is an interactive computer-use tool with no scheduled or recurring product cycle. The loop runs only when invoked by a user.","checks":[]}
EOF
<env-var>=<guest-path> python3 -I <guest-path> --validate --replay
python3 - <<'PY'
import json
p='.coldpass/claims.json'
x=json.load(open(p)); x[0]['source']='uv run clicker-bench perception --url https://news.ycombinator.com'; x[0]['claim']='Browser perception can be benchmarked using the documented command.'
json.dump(x,open(p,'w'))
PY
<env-var>=<guest-path> python3 -I <guest-path> --validate --replay
cat <guest-path> | head -250
rg -n 'source_file|claims.json|source.*quote' <guest-path> | tail -30
grep -nE 'source_file|claims.json' <guest-path> | tail -25
sed -n '915,960p' <guest-path>; sed -n '1230,1252p' <guest-path>
python3 - <<'PY'
import json
p='.coldpass/claims.json'; x=json.load(open(p)); x[0]['source']='uv run clicker "open the Playground"'; x[0]['claim']='The README documents a first-run clicker operation.'; json.dump(x,open(p,'w'))
PY
<env-var>=<guest-path> python3 -I <guest-path> --validate --replay
cat > .coldpass/probe.json <<'EOF'
{"checks":[{"check":"install","argv":["<guest-path>","sync","--frozen"],"cwd":"<guest-path>","expected_text":"Built typesafe-computer-use"},{"check":"start","argv":["<guest-path>","perception","--fixture","--n","1"],"cwd":"<guest-path>","expected_text":"no Chrome/Chromium binary found"}]}
EOF
python3 - <<'PY'
import json
p='.coldpass/examples.json'; x=json.load(open(p)); x[1]['reason']='Documented browser fixture command was run and could not start because no Chrome/Chromium binary is installed; local browser installation is prohibited.'; x.pop(1); json.dump(x,open(p,'w'))
PY
cat > .coldpass/report.json <<'EOF'
{"outcome":"needs_browser","fault_owner":"prerequisite","operation":"uv sync --frozen and browser fixture perception","operation_scope":"Python 3.12.3 setup and documented CI checks succeeded; browser benchmark requires local Chromium","steps":["Installed uv with the README installer.","Ran uv sync --frozen.","Ran uv run ruff check ., uv run ruff format --check ., and uv run pytest -q."],"deviations":["Documented clicker-bench perception --fixture --n 1 failed: no Chrome/Chromium binary found. README sandbox workflow requires Docker, which is not installed; browser installation is prohibited."],"stuck_step":"Run documented browser fixture perception","main_blocker":"No local Chromium; Docker-backed sandbox cannot run because Docker is unavailable.","plain_failure":"The app dependencies installed and all documented CI checks passed, but the browser benchmark cannot run without Chromium. The isolated sandbox needs Docker, which this VM does not have.","suggested_fix":"Run the documented sandbox workflow in a guest with Docker available, or provide the supplied shared CDP endpoint if supported by the operation."}
EOF
<env-var>=<guest-path> python3 -I <guest-path> --validate --replay
cat > .coldpass/probe.json <<'EOF'
{"checks":[{"check":"install","argv":["<guest-path>","sync","--frozen"],"cwd":"<guest-path>"},{"check":"start","argv":["<guest-path>","perception","--fixture","--n","1"],"cwd":"<guest-path>"}]}
EOF
cat > .coldpass/claims.json <<'EOF'
[{"kind":"claim","claim":"The README documents a first-run clicker operation.","source":"uv run clicker \"open the Playground\"","input":"documented first run","expected":"a dry-run step is printed","probe_kind":"cli","argv":["<guest-path>","open the Playground"],"cwd":"<guest-path>","expected_text":"TYPESAFE_API_KEY is not set"}]
EOF

<env-var>=<guest-path> python3 -I <guest-path> --validate --replay
cat > .coldpass/probe.json <<'EOF'
{"checks":[{"check":"install","argv":["<guest-path>","sync","--frozen"],"cwd":"<guest-path>"},{"check":"credentials_error","argv":["<guest-path>","open the Playground"],"cwd":"<guest-path>"},{"check":"start","argv":["<guest-path>","perception","--fixture","--n","1"],"cwd":"<guest-path>"}]}
EOF
python3 - <<'PY'
import json
p='.coldpass/claims.json'; x=json.load(open(p)); x[0].update({'testable':False,'reason':'The documented first-run clicker operation was attempted but requires TYPESAFE_API_KEY, which is not provided. The separate documented fixture benchmark was attempted and could not start because this VM has no Chromium.'}); x.pop('probe_kind',None); x.pop('argv',None); x.pop('cwd',None); x.pop('expected_text',None); json.dump(x,open(p,'w'))
PY
<env-var>=<guest-path> python3 -I <guest-path> --validate --replay
python3 - <<'PY'
import json
p='.coldpass/claims.json'; x=json.load(open(p)); x[0]['testable']=False; x[0]['reason']='The README first-run command was attempted; its actual error was TYPESAFE_API_KEY is not set. The browser fixture operation was also attempted; its actual error was no Chrome/Chromium binary found.'
for k in ['probe_kind','argv','cwd','expected_text']: x[0].pop(k,None)
json.dump(x,open(p,'w'))
p='.coldpass/probe.json'; x=json.load(open(p)); x['checks']=x['checks'][:2]; json.dump(x,open(p,'w'))
PY
<env-var>=<guest-path> python3 -I <guest-path> --validate --replay
cat > .coldpass/report.json <<'EOF'
{"outcome":"needs_browser","fault_owner":"prerequisite","operation":"Install and attempt README browser fixture benchmark","operation_scope":"Python 3.12.3 setup succeeded; actual first-run operation gated by API key and browser fixture gated by Chromium","steps":["Installed uv using the README installer.","Ran uv sync --frozen successfully.","Ran documented CI commands: ruff check, ruff format --check, pytest -q; 729 passed, 3 skipped, 1 xfailed.","Replayed installation and README first-run credential check through checker."],"deviations":["Attempted documented clicker-bench perception --fixture --n 1; actual error: no Chrome/Chromium binary found. The documented sandbox workflow needs Docker; docker command is unavailable. Browser installation is prohibited."],"stuck_step":"Run a useful browser fixture operation","main_blocker":"The VM has no Chromium or Docker. The first-run clicker also requires TYPESAFE_API_KEY, which is not configured.","plain_failure":"The project installed and its CI checks passed. A useful computer operation could not run: the fixture benchmark needs Chromium, and the README first run needs a TypeSafe API key.","suggested_fix":"Use an environment with the documented sandbox's Docker/Chromium prerequisite and configure TYPESAFE_API_KEY to run the interactive operation."}
EOF
cat .coldpass/probe.json; cat .coldpass/claims.json; cat .coldpass/report.json; git init -q; git remote add origin https://github.com/awlevin/typesafe-computer-use; git fetch --depth 1 origin 44ca11f0935b021b73020825da054b5c92cc1288 && git reset --mixed FETCH_HEAD; git status --short --branch
<env-var>=<guest-path> python3 -I <guest-path> --validate --replay