Robin Saige we check the tools AI agents call

Hive Evaluator

io.github.srotzin/hive-mcp-evaluator

MCP server: NEED + YIELD + CLEAN-MONEY gates with EIP-3009 attestations · Hive Civilization

— the operator's own registry description reported

Publisher io.github.srotzin · first seen 2026-08-12 · endpoint https://hive-mcp-gateway.onrender.com/evaluator/mcp

allow
verdict
gateway
cluster
ok_tools
answers
4
tools served

Dependency rating derived

allow
allow — gateway · action ● · V n/a
allow — because answers ●, 4 tools legible (band A) ●, no confirmed drift in 2 probes ●; not yet checked: truth (0 runs)

Cluster gateway · distinctiveness 0.243 (typical). Every figure is a percentile or class within the 11,094-server censussee the whole spectrum.

Does it answer? Q1 · observed
answersalive_tools
latency258 ms
vs populationtypical
protocolstale
authopen
Can it be used? Q4 · observed
tools4
vs populationmid
capabilities1
harnessA
Did it hold when checked? Q3–Q4 · derived
identityfarm_member
servers on its host19
verifiabilityunassessed
duplicate inventoryno
drift events0
answers trueno primary

🔏 Signed receipt rr_b7221c33e35b434fc59431a8 · ed25519 · key rs-rcpt-2026-08 — this rating is tamper-evident; an agent gets the full signature from check_server and can verify it against the published key.

Q1Does it answer?gateway — 2 probes ●evidence ↓
Q2What is it?action ● evidence ↓
Q3Can it be checked?V n/a for this kind ◐evidence ↓
Q4Did it hold?harness A · truth not yet run · no drift ●evidence ↓
Q5What company does it keep?gateway · 19 on its host (context, not verdict) ◐evidence ↓

● observed · ◐ derived · ○ reported — the verdict synthesizes Q1–Q4; Q5 is context. Methodology →

History observed

Every probe we made, oldest → newest (2 shown, 2026-08-12 → 2026-08-14). Green answered · amber answered-but-walled · red no useful answer. A gap in our cadence is a gap in coverage, not evidence about the server.

changelog (1 events)
datetypewhat changed
2026-08-12outcomefirst probe: ok_tools

What kind of tools these are derived

Verification only means something relative to a tool's NATURE — an email-sender has no "true answer", a generator has no answer key. Classification evidence: classified from tool names/descriptions/annotations WE OBSERVED. What checking applies to each kind (the full methodology →):

naturetoolsmeaning what checking applies
action2changes the worldno true answer exists; we check the CONTRACT (destructive/read-only/idempotent declarations, error legibility) and never fire real actions
retrieval-public1serves public factstruth-checkable against a public source — the V-ladder applies in full
unclassified1not classifiable from its textTier-1 only until its tools describe themselves

Tools last seen observed

evaluator_attest_job evaluator_get_fees evaluator_get_job evaluator_submit_job

Harness readiness observed

Can an agent's harness pick this tool and call it correctly? Graded on the three things an agent reads — name, description, typed parameters. Band A — an agent can pick and call these reliably.

legibility checktools passingok
name is clear & specific4/4
has a description4/4
description is substantive4/4
parameters are typed4/4
parameters are described4/4

4 of 4 tools graded · 4 with a captured input schema. RS-008, Tier-1 — no domain knowledge, applies to any tool. “Alive” is not the same as “usable”.

Truth checks observed

Not in the Tier-2 trade lane, or not yet checked. Tier-2 re-derives a server's answers against published primary sources — see truth checks.

Protocol conformance observed

2024-11-05
protocol version
session model
1.0.0
server version hive-mcp-evaluator

Capabilities: tools

Drift observed

No confirmed drift on record. Baseline set 2026-08-14; changes appear here after human review.

raw probe records
probed (UTC) outcomehttpmsprotocol
2026-08-14T20:00:14Zok_tools2002582024-11-05
2026-08-12T05:35:26Zok_tools2002782024-11-05

Watch or embed this verdict

verdict badge

Operators: put the live verdict in your README — it updates with every census, links back here, and is a dated observation, never a warranty:

[![Robin Saige verdict](https://robinsaige.com/badge/io.github.srotzin/hive-mcp-evaluator.svg)](https://robinsaige.com/s/io.github.srotzin/hive-mcp-evaluator)

Depend on it? Subscribe to its change feed — outcome changes and confirmed drift, no account needed. Building on it? The full dossier as JSON — verdict, rating, truth checks, history — stable enough to gate CI on.

← overview