coldpass

kar2phi/video-lens

GitHub ↗ · How this check works

Static status badge · SVG · read-only JSON. Embed with ![Coldpass status](https://coldpass.dev/badge/kar2phi--video-lens.svg).

agentskillstranscriptionyoutube

Not tested

Only older checks are saved; no current product test.

Answers apply to each recorded setup, revision and operation. Earlier observations remain in Run details.

Needs keys or browser
None seen
Setup time
1 min 10 s
1 min 10 s to a working result

Safety: no observations were recorded for the selected revision. Functional results do not establish a safety result.

Repair history and test corrections
Verified test fix · fix-16e17ddf604709cdfad4

Checker matches cli expected_text against the whole stdout, not the last 12000 chars (video-lens printed it first)

The repo was not at fault. Coldpass changed its own test, so there is no repo patch.

Before: kar2phi/video-lens · Oct 17, 2026 · Recorded operation failed

After the test fix: kar2phi/video-lens · Oct 17, 2026 · Haiku 5.5 · Not tested.

Earlier diagnoses and Coldpass test changes
Run details

Haiku 5.5

Native agent · Not tested

Checked operation bash skills/video-lens/scripts/serve_report.sh /root/Downloads/video-lens/reports/video-lens_sample_output.html /root/Downloads/video-lens/reports · local HTTP start + response check

Agent-reported scope: Rendered the sample video-lens HTML report via the README dev server step (scripts/yt_template_dev.py through render_report.py), then served it with skills/video-lens/scripts/serve_report.sh and fetched it back over HTTP on localhost:8765 (200, byte-identical to the rendered file).

Run details
run
kar2phi--video-lens-claude-haiku-5-5-1792273152342516178
date
Oct 17, 2026
time to working
69.6s
product hosting / execution
Local HTTP server in the guest
recorded operation scope
product operation
model
claude-haiku-5-5
agent / version
claude-code / 2.1.300 (Claude Code)
platform
linux
reported cost
$0.007172
Recorded source
https://github.com/kar2phi/video-lens
Tool transport
mcp-assigned-vm
Test version
readme-603a226f6387cc5b4d7d1b8afdfd388d8b6712b507e3388e7197ef73c9e5d53a
revision
9bb49e172ffb4c3f75bb7621db0179184e50533d
Current diagnosis: unknown · resolved

Checker matches cli expected_text against the whole stdout, not the last 12000 chars (video-lens printed it first)

Repair record fix-16e17ddf604709cdfad4 · current status JSON. Original run outcomes remain unchanged.

Failed run: kar2phi/video-lens · Oct 17, 2026 · Recorded operation failed.

Repair development: kar2phi/video-lens · Oct 17, 2026 · Repair work (development) · not an initial-trial result.

Test-repair rerun: kar2phi/video-lens · Oct 17, 2026 · Not tested.

Double-checks failed run: kar2phi/video-lens · Oct 17, 2026.

Fix: fix-16e17ddf604709cdfad4.

What the agent did

Rendered the sample video-lens HTML report via the README dev server step (scripts/yt_template_dev.py through render_report.py), then served it with skills/video-lens/scripts/serve_report.sh and fetched it back over HTTP on localhost:8765 (200, byte-identical to the rendered file).

cat README.md; read Taskfile.yml, requirements.txt
apt-get install python3-venv (for venv; PEP 668 blocks system pip)
python3 -m venv /opt/vl-venv && /opt/vl-venv/bin/pip install -r requirements.txt
python scripts/yt_template_dev.py (README 'Dev server' step, invoked directly)
bash skills/video-lens/scripts/serve_report.sh <report> <reports dir> (README 'Dev server' serve step, invoked directly)
curl http://localhost:8765/video-lens_sample_output.html -> 200, matches rendered file

run JSON · checker evidence · agent report + check · transcript excerpt · error excerpt

Earlier attempts (1)

Haiku 5.5

Native agent · Recorded operation failed

Operation / attempted scope <host-path> skills/video-lens/scripts/fetch_transcript.py 3Y1G9najGiI en

Agent-reported scope: Fetched the YouTube transcript for video 3Y1G9najGiI (AWS re:Invent 2025 keynote) with skills/video-lens/scripts/fetch_transcript.py, which returned metadata (CHANNEL: AWS Events) and timestamped transcript lines.

Run details
run
kar2phi--video-lens-claude-haiku-5-5-1792269680320130660
date
Oct 17, 2026
time to working
not recorded
product hosting / execution
Local command in the guest
recorded operation scope
Caption fetch only, against live YouTube using the guest's network. Not exercised: report rendering/serving (task dev, serve_report.sh), local Whisper transcription (Apple Silicon only, not available here), Raycast, and the full test/eval suites (intentionally skipped per task).
model
claude-haiku-5-5
agent / version
claude-code / 2.1.300 (Claude Code)
platform
linux
reported cost
$0.007359
Recorded source
https://github.com/kar2phi/video-lens
Tool transport
mcp-assigned-vm
Test version
readme-ae92559f48c79761a7519f779588bb74b351dbdbfe8f4f6cd776a60c8291fdf3
revision
9bb49e172ffb4c3f75bb7621db0179184e50533d
Current diagnosis: unknown · resolved

Checker matches cli expected_text against the whole stdout, not the last 12000 chars (video-lens printed it first)

Repair record fix-16e17ddf604709cdfad4 · current status JSON. Original run outcomes remain unchanged.

Failed run: kar2phi/video-lens · Oct 17, 2026 · Recorded operation failed.

Repair development: kar2phi/video-lens · Oct 17, 2026 · Repair work (development) · not an initial-trial result.

Test-repair rerun: kar2phi/video-lens · Oct 17, 2026 · Not tested.

Fix: fix-16e17ddf604709cdfad4.

Recorded blocker / warning

Step: <host-path> skills/video-lens/scripts/fetch_transcript.py 3Y1G9najGiI en

product invocation failed: {"returncode": 0, "stdout": "[59:52] again, going back a\nlittle bit in the past,\n[59:55] and tell you a story about Jeff Bezos.\n[1:00:00] In the early days of Amazon,\n[1:00:02] as we as executives\nwere required each year\n[1:00:07] to spend two days with customer serv

Suggested next step (agent-reported): Inspect the recorded blocker and correct the README prerequisites or harness error.

What the agent did

Fetched the YouTube transcript for video 3Y1G9najGiI (AWS re:Invent 2025 keynote) with skills/video-lens/scripts/fetch_transcript.py, which returned metadata (CHANNEL: AWS Events) and timestamped transcript lines.

run JSON · checker evidence · agent report + check · transcript excerpt · error excerpt
No product verdict. Run record.
No product verdict. Run record.
Repair work and diagnoses (1)
Haiku 5.5
Native agent · Repair work (development) · not an initial-trial result
Operation / attempted scope <host-path> skills/video-lens/scripts/fetch_transcript.py -- 3Y1G9najGiI en
Agent-reported scope: Fetch the YouTube transcript for video 3Y1G9najGiI in English with skills/video-lens/scripts/fetch_transcript.py (the SKILL.md fetch step), returning title/channel metadata, LANG line, and timestamped transcript lines.
Run details
run
kar2phi--video-lens-claude-haiku-5-5-1792270120892794874
date
Oct 17, 2026
time to working
not recorded
product hosting / execution
Local command in the guest
recorded operation scope
Exercised the transcript fetch path with captions available; no LLM report generation, no browser/CDP, and no local Whisper fallback. Requires network access to YouTube. Prerequisite: python3.12-venv and the requirements.txt packages in <host-path>
model
claude-haiku-5-5
agent / version
claude-code / 2.1.300 (Claude Code)
platform
linux
reported cost
$0.007115
Recorded source
https://github.com/kar2phi/video-lens
Tool transport
mcp-assigned-vm
Test version
readme-c29efe76cba7a182105d69f3605a4bcaf84ebc4f4eef08ea4d2281880d692f57
revision
9bb49e172ffb4c3f75bb7621db0179184e50533d
Current diagnosis: unknown · resolved
Checker matches cli expected_text against the whole stdout, not the last 12000 chars (video-lens printed it first)
Repair record fix-16e17ddf604709cdfad4 · current status JSON. Original run outcomes remain unchanged.
Failed run: kar2phi/video-lens · Oct 17, 2026 · Recorded operation failed.
Repair development: kar2phi/video-lens · Oct 17, 2026 · Repair work (development) · not an initial-trial result.
Test-repair rerun: kar2phi/video-lens · Oct 17, 2026 · Not tested.
Double-checks failed run: kar2phi/video-lens · Oct 17, 2026.
Fix: fix-16e17ddf604709cdfad4.
Recorded blocker / warning
Step: <host-path> skills/video-lens/scripts/fetch_transcript.py -- 3Y1G9najGiI en
product invocation failed: {"returncode": 0, "stdout": "[59:52] again, going back a\nlittle bit in the past,\n[59:55] and tell you a story about Jeff Bezos.\n[1:00:00] In the early days of Amazon,\n[1:00:02] as we as executives\nwere required each year\n[1:00:07] to spend two days with customer serv
Suggested next step (agent-reported): Inspect the recorded blocker and correct the README prerequisites or harness error.
What the agent did
Fetch the YouTube transcript for video 3Y1G9najGiI in English with skills/video-lens/scripts/fetch_transcript.py (the SKILL.md fetch step), returning title/channel metadata, LANG line, and timestamped transcript lines.
cat README.md (Install Option B/C: pip install -r requirements.txt)
apt-get install -y python3.12-venv
python3 -m venv <host-path>
<host-path> install -r requirements.txt (youtube-transcript-api, yt-dlp 2026.08.19, pytest)
<host-path> skills/video-lens/scripts/fetch_transcript.py -- 3Y1G9najGiI en (rc=0, 1830 transcript lines, LANG: en)
run JSON · checker evidence · agent report + check · transcript excerpt · error excerpt