thomas123-mck/stealth-scraper-benchmark

Review signals: 1 connection review.

Repository processes attempted these non-loopback connections; proxies can hide the final hostname. 3 distinct locations. 5 attributed processes.

OSV scanned supported lockfiles; unpinned dependencies and unsupported formats are outside this check.

A short run cannot establish that code is safe.

Connections show IP addresses; proxies can hide the final hostname.

Tracing covers dispatched commands and their children, not the whole OS; guest root can interfere with tracing.

Full safety evidence →

• Running stealth-benchmark --recommendations prints the recommended infrastructure providers: Real input produced the expected result: Open-Source Suite: GitHub

  Source: stealth-benchmark --recommendations

  Input: --recommendations

  Expected: Open-Source Suite: GitHub line

  Command: <guest-path> --recommendations

  Observed: …Open-Source Suite: GitHub (https://github.com/thomas123-mck/stealth-scraper-benchmark) ================================================================================

• stealth-benchmark --url benchmarks a single target URL with the direct request tier: Real input produced the expected result: Direct connection reached target

  Source: stealth-benchmark --url "https://target-domain.com/catalog"

  Input: --url https://httpbin.org/ip (baseline target, substituted for the placeholder)

  Expected: Direct request reaches the target

  Command: <guest-path> --url https://httpbin.org/ip

  Observed: …Direct connection reached target - ProxyScrape:[SKIPPED] HTTP None | Latency: 0.0s | Skipped (PROXYSCRAPE_PROXY_URL not configured) - ZenRows: [SKIPPED] HTTP None | Latency: 0.0s | Skipped (ZENROWS_API_KEY not configured) ================================================================================ BENCHMARK COMPLETED ================================================================================ ================================================================================ RECOMMENDED ANTI-BOT & RESIDENTIAL INFRASTRUCTURE =====================================================

Examples

• Option 2 README command: python -m stealth_scraper_benchmark.cli --recommendations runs the CLI from the clone: command completed successfully

  Source: README.md Option 2: Clone from GitHub

  Input: --recommendations

  Expected: Recommendations banner printed

  Command: <guest-path> -m stealth_scraper_benchmark.cli --recommendations

  Observed: ========================== - Tier 2 (Rotating Residential): ProxyScrape (https://proxyscrape.com/?ref=mmm3zgm) - Tier 3 (Headless Unblocker API): ZenRows (https://www.zenrows.com/) - Open-Source Suite: GitHub (https://github.com/thomas123-mck/stealth-scraper-benchmark) ================================================================================ <frozen runpy>:128: RuntimeWarning: 'stealth_scraper_benchmark.cli' found in sys.modules after import of package 'stealth_scraper_benchmark', but prior to execution of 'stealth_scraper_benchmark.cli'; this may result in unpredictable behaviour

• Repo offline unit tests (no README test command; ran from outside repo root because the root shim shadows the package): command completed successfully

  Source: tests/test_benchmark.py

  Input: discover -s tests

  Expected: 23 tests pass

  Command: <guest-path> -m unittest discover -s <guest-path> -p 'test_*.py'

  Observed: ....................... ---------------------------------------------------------------------- Ran 23 tests in 0.070s OK

Local or hosted: local

Install stealth-scraper-benchmark from the pinned clone and run stealth-benchmark --url against a baseline target, plus stealth-benchmark --recommendations

cd <guest-path> && ls -la && cat README.md 2>/dev/null | head -200; python3 --version; echo "CDP_URL=$CDP_URL"
cd <guest-path> && cat stealth_scraper_benchmark.py pyproject.toml; find src tests -type f | head -50; cat .gitignore; ls .coldpass
cd <guest-path> && cat src/stealth_scraper_benchmark/cli.py; echo ----; cat src/stealth_scraper_benchmark/core.py | head -150
cd <guest-path> && sed -n 150,400p src/stealth_scraper_benchmark/core.py; echo ----; cat tests/test_benchmark.py | head -60; cat src/stealth_scraper_benchmark/__init__.py
cd <guest-path> && (python3 -m venv <guest-path> 2>&1 || (sudo -n apt-get -o DPkg::Lock::Timeout=300 install -y python3-venv ><guest-path> 2>&1; python3 -m venv <guest-path>)); <guest-path> -V; <guest-path> -V
cd <guest-path> && <guest-path> install -e . 2>&1 | tail -15; ls <guest-path> | grep stealth
cd /tmp && <guest-path> --url "https://httpbin.org/ip"; echo "EXIT=$?"
cd <guest-path> && grep -n "recommendations\|stealth-benchmark --url\|Run benchmark\|python -m" README.md; ls <guest-path> /inputs 2>&1; cd /tmp && <guest-path> -m stealth_scraper_benchmark.cli --recommendations; echo "EXIT=$?"
cd <guest-path> && git init -q 2>&1; git remote add origin https://github.com/thomas123-mck/stealth-scraper-benchmark 2>&1; timeout 120 git fetch --depth 1 origin bc64de1f5aa4140ce449d34694375e084bb428dc 2>&1 | tail -3; git reset --mixed FETCH_HEAD 2>&1 | tail -2; git rev-parse HEAD; git status --short | head
cd <guest-path> && <guest-path> -m unittest discover -s tests -v 2>&1 | tail -15; echo "EXIT=${PIPESTATUS[0]}"
cd /tmp && <guest-path> -m unittest discover -s <guest-path> -p 'test_*.py' 2>&1 | tail -4; echo "EXIT=${PIPESTATUS[0]}"; ls -a <guest-path> | grep -i "github\|ci" 
cd <guest-path> && grep -rniE "cron|schedule|webhook|--once|--now|while True|loop" --include=*.py --include=*.md --include=*.toml . | grep -v "^./.git/" | head; echo "---"; cat > .coldpass/claims.json <<'EOF'
[
  {"kind":"claim","claim":"Running stealth-benchmark --recommendations prints the recommended infrastructure providers","source":"stealth-benchmark --recommendations","input":"--recommendations","expected":"Open-Source Suite: GitHub line","probe_kind":"cli","argv":["<guest-path>","--recommendations"],"expected_text":"Open-Source Suite: GitHub","cwd":"<guest-path>"},
  {"kind":"claim","claim":"stealth-benchmark --url benchmarks a single target URL with the direct request tier","source":"stealth-benchmark --url \"https://target-domain.com/catalog\"","input":"--url https://httpbin.org/ip (baseline target, substituted for the placeholder)","expected":"Direct request reaches the target","probe_kind":"cli","argv":["<guest-path>","--url","https://httpbin.org/ip"],"expected_text":"Direct connection reached target","cwd":"<guest-path>"}
]
EOF
<guest-path> -I -c 'import json;json.load(open("<guest-path>"));print("claims ok")'
cd <guest-path> && cat > probe.json <<'EOF'
{"kind":"cli","argv":["<guest-path>","--url","https://httpbin.org/ip"],"cwd":"<guest-path>","expected_text":"Direct connection reached target"}
EOF
cat > examples.json <<'EOF'
[
  {"kind":"example","claim":"Option 2 README command: python -m stealth_scraper_benchmark.cli --recommendations runs the CLI from the clone","source":"README.md Option 2: Clone from GitHub","input":"--recommendations","expected":"Recommendations banner printed","argv":["<guest-path>","-m","stealth_scraper_benchmark.cli","--recommendations"],"cwd":"/tmp","env":{},"expected_text":"RECOMMENDED ANTI-BOT & RESIDENTIAL INFRASTRUCTURE"},
  {"kind":"example","claim":"Repo offline unit tests (no README test command; ran from outside repo root because the root shim shadows the package)","source":"tests/test_benchmark.py","input":"discover -s tests","expected":"23 tests pass","argv":["<guest-path>","-m","unittest","discover","-s","<guest-path>","-p","test_*.py"],"cwd":"/tmp","env":{},"expected_text":"Ran 23 tests"}
]
EOF
cat > cycles.json <<'EOF'
{"detected":false,"checks":[],"reason":"Inspected README.md, pyproject.toml, stealth_scraper_benchmark.py, src/stealth_scraper_benchmark/cli.py and core.py. The CLI is a one-shot command with no cron, loop, webhook, scheduler, or --once/--now trigger."}
EOF
for f in probe examples cycles; do <guest-path> -I -c "import json,sys;json.load(open('$f.json'));print('$f ok')"; done
cd <guest-path> && cat > report.json <<'EOF'
{"outcome":"working","fault_owner":null,"operation":"Install stealth-scraper-benchmark from the pinned clone and run stealth-benchmark --url against a baseline target, plus stealth-benchmark --recommendations","operation_scope":"Linux guest, Python 3.12.3 in <guest-path> (README needs >=3.8, no runtime deps). Direct-request tier only. ProxyScrape and ZenRows tiers were skipped because no PROXYSCRAPE_PROXY_URL or ZENROWS_API_KEY was supplied. The WAF-protected targets in DEFAULT_BENCHMARK_TARGETS were not run. CDP endpoint not needed (CLI, no browser).","steps":["python3 -m venv <guest-path>","<guest-path> install -e .  (in <guest-path>, Option 2 clone)","<guest-path> --url https://httpbin.org/ip  -> Direct: [PASS] HTTP 200","<guest-path> --recommendations","python -m stealth_scraper_benchmark.cli --recommendations (from /tmp, Option 2 form)"],"deviations":["Repo offline tests fail when run from the repo root: root shim stealth_scraper_benchmark.py shadows the package and raises ImportError on __version__ (circular import). Ran the same 23 tests from /tmp with discover -s and they pass.","README python -m form prints a RuntimeWarning about sys.modules but exits 0.","README placeholder target-domain.com replaced with httpbin.org/ip baseline.","The published-package pip install (Option 1) was not used; the pinned clone was installed instead.","No Git-pin problems: fetch of bc64de1 succeeded and git status is clean."],"stuck_step":null,"main_blocker":null,"plain_failure":null,"suggested_fix":"Repo: move or rename the root stealth_scraper_benchmark.py shim (or the tests import path) so running unittest from the repo root does not shadow the package. Add a documented test command to the README."}
EOF
<guest-path> -I -c "import json;json.load(open('report.json'));print('report ok')"; cd <guest-path> && <env-var>=<guest-path> python3 -I <guest-path> --validate --replay 2>&1 | tail -60