Browse / Agent tools
Coolhand-Labs/coolhand-python
Zero-config LLM cost & quality monitoring for Python apps - automatically log AI API calls and collect user feedback for analysis using Coolhand.
Works.Tested on 2026-10-28. From the README alone, on Linux with Haiku and Linux with Luna.

What we checked
Does it run from the README?Yes. Running in 5:45 on a clean Linux box.The run
Tested Oct 28, 2026, rev d0136ad.
Does it do what the README says?2 of 2 claims held up.Evidence
“Streamed responses are automatically logged to Coolhand”
Expected streams captured with message id and token counts. Got PASS streaming_capture: 5 sync streams captured with token metadata.
“Importing coolhand auto-initializes monitoring”
Expected monitoring reports active. Got Monitoring active: True.
Which setups did we try?Works with Haiku, Luna.Setups
Linux / Haiku: works, Oct 28, rev d0136ad. Linux / Luna: works, Oct 28, rev d0136ad.
Needs keys, a login or a browser?No.Details
None seen
Is it safe to run?Made outbound HTTPS connections: yes (hosts not recorded) by <guest-path>, coolhandWhat we saw
Review signals across current setups: connection review. 16 listed items (named-host connections, static matches, dependency advisories) are below and do not change this verdict. 16 static matches retained as context.
Repository processes attempted these non-loopback connections; proxies can hide the final hostname. 35.241.4.177:443 2 findings. 17 attributed processes.
OSV reports a known vulnerability in this dependency version. 5 distinct locations. 8 findings.
Reviewed as expected for a test run: attempted writes that failed, so nothing was written.
Full event, path and process lists for each observed setup:
A quiet run is not a safety guarantee.
Is it maintained?Slow · 96 commits in 90 days · 97 merged PRs in 90 days · 17 open issues · 2 open PRsActivity
slow: last commit 0 days ago; 96 commits and 97 merged PRs in 90 days; 17 open issues, 2 open PRs; 0 of 19 recent threads got a maintainer reply; latest release 2026-10-27
Can I show this on my README?Copy the badge.Badge
The run
Oct 28 · rev d0136adIndependent test, not endorsed by the project.