Robin Saige we check the tools AI agents call

ChiefLab

io.github.bdentech/chieflab

Open execution contract for agents doing business work. 6 operators, one MIT-licensed spec.

— the operator's own registry description reported

Publisher io.github.bdentech · first seen 2026-08-12 · endpoint https://api.chieflab.io/api/mcp

allow
verdict
stale-rich-solo
cluster
ok_tools
answers
45
tools served

Dependency rating derived

allow
allow — alive & usable · action ● · V n/a
allow — because answers ●, 45 tools legible (band A) ●, no confirmed drift in 2 probes ●; not yet checked: truth (0 runs)

Cluster stale-rich-solo · distinctiveness 0.337 (typical). Every figure is a percentile or class within the 11,094-server censussee the whole spectrum.

Does it answer? Q1 · observed
answersalive_tools
latency159 ms
vs populationtypical
protocolbehind
authopen
Can it be used? Q4 · observed
tools45
vs populationhigh
capabilities1
harnessA
Did it hold when checked? Q3–Q4 · derived
identitysolo
servers on its host1
verifiabilityunassessed
duplicate inventoryno
drift events0
answers trueno primary

🔏 Signed receipt rr_30e8d30cf6af8f60e68b9f08 · ed25519 · key rs-rcpt-2026-08 — this rating is tamper-evident; an agent gets the full signature from check_server and can verify it against the published key.

Q1Does it answer?alive & usable — 2 probes ●evidence ↓
Q2What is it?action ● evidence ↓
Q3Can it be checked?V n/a for this kind ◐evidence ↓
Q4Did it hold?harness A · truth not yet run · no drift ●evidence ↓
Q5What company does it keep?stale-rich-solo · 1 on its host (context, not verdict) ◐evidence ↓

● observed · ◐ derived · ○ reported — the verdict synthesizes Q1–Q4; Q5 is context. Methodology →

History observed

Every probe we made, oldest → newest (2 shown, 2026-08-12 → 2026-08-14). Green answered · amber answered-but-walled · red no useful answer. A gap in our cadence is a gap in coverage, not evidence about the server.

changelog (1 events)
datetypewhat changed
2026-08-12outcomefirst probe: ok_tools

What kind of tools these are derived

Verification only means something relative to a tool's NATURE — an email-sender has no "true answer", a generator has no answer key. Classification evidence: classified from tool names/descriptions/annotations WE OBSERVED. What checking applies to each kind (the full methodology →):

naturetoolsmeaning what checking applies
action41changes the worldno true answer exists; we check the CONTRACT (destructive/read-only/idempotent declarations, error legibility) and never fire real actions
unclassified3not classifiable from its textTier-1 only until its tools describe themselves
generative1creates contentno answer key exists; disclosure + stability checks, never truth verdicts

Tools last seen observed

chieflab_approve_action chieflab_boot chieflab_brain_summary chieflab_check_measurement_due chieflab_connect_provider chieflab_connector_status chieflab_continue_launch_loop chieflab_create_next_move_action chieflab_create_work_request chieflab_execute_approved_action chieflab_force_measurement_due chieflab_get_capability chieflab_get_company_profile chieflab_get_publishing_targets chieflab_get_users_after_build chieflab_help chieflab_inbox chieflab_launch_product chieflab_list_specialists chieflab_mark_action_done chieflab_measure_hacker_news chieflab_measure_reddit chieflab_persistence_health chieflab_post_launch_review chieflab_prepare_next_move chieflab_publish_approved_post chieflab_query_proof_ledger chieflab_record_manual_metrics chieflab_record_manual_publish chieflab_redraft chieflab_regenerate_visual_asset chieflab_request_specialist chieflab_retry_blocked_action chieflab_review_visual_asset chieflab_search_capabilities chieflab_send_approved_email chieflab_set_company_profile chieflab_set_provider_key chieflab_set_publishing_targets chieflab_signup_workspace chieflab_skip_next_move chieflab_status chieflab_suggest_next_move chieflab_use_manual_fallback chieflab_verify_install

Harness readiness observed

Can an agent's harness pick this tool and call it correctly? Graded on the three things an agent reads — name, description, typed parameters. Band A — an agent can pick and call these reliably.

legibility checktools passingok
name is clear & specific45/45
has a description45/45
description is substantive45/45
parameters are typed44/4544/45
parameters are described35/4535/45

45 of 45 tools graded · 45 with a captured input schema. RS-008, Tier-1 — no domain knowledge, applies to any tool. “Alive” is not the same as “usable”.

Truth checks observed

Not in the Tier-2 trade lane, or not yet checked. Tier-2 re-derives a server's answers against published primary sources — see truth checks.

Protocol conformance observed

2025-03-26
protocol version
session model
0.3.0
server version chieflab

Capabilities: tools

Drift observed

No confirmed drift on record. Baseline set 2026-08-14; changes appear here after human review.

raw probe records
probed (UTC) outcomehttpmsprotocol
2026-08-14T19:59:24Zok_tools2001592025-03-26
2026-08-12T05:34:36Zok_tools2001262025-03-26

Watch or embed this verdict

verdict badge

Operators: put the live verdict in your README — it updates with every census, links back here, and is a dated observation, never a warranty:

[![Robin Saige verdict](https://robinsaige.com/badge/io.github.bdentech/chieflab.svg)](https://robinsaige.com/s/io.github.bdentech/chieflab)

Depend on it? Subscribe to its change feed — outcome changes and confirmed drift, no account needed. Building on it? The full dossier as JSON — verdict, rating, truth checks, history — stable enough to gate CI on.

← overview