SigRank — AI Operator Benchmarking
com.signalaf/sigrank
SigRank benchmark MCP: cascade metrics, leaderboard, operator profiles, simulation, diagnostics.
— the operator's own registry description reported
Publisher com.signalaf · first seen 2026-08-28 · endpoint https://signalaf.com/api/mcp
Dependency rating derived
allow — alive & usable · retrieval-public ● · V3 has answer key ◐
Cluster mid-slow-shared · distinctiveness 0.633 (unusual). Every figure is a percentile or class within the 15,472-server census — see the whole spectrum.
🔏 Signed receipt rr_32e4b37d0dcd57cad6ff05c2 · ed25519 · key rs-rcpt-2026-08 — this rating is tamper-evident; an agent gets the full signature from check_server and can verify it against the published key.
● observed · ◐ derived · ○ reported — the verdict synthesizes Q1–Q4; Q5 is context. Methodology →
History observed
Every probe we made, oldest → newest (2 shown, 2026-08-30 → 2026-09-06). Green answered · amber answered-but-walled · red no useful answer. A gap in our cadence is a gap in coverage, not evidence about the server.
changelog (1 events)
| date | type | what changed |
|---|---|---|
| 2026-08-30 | outcome | first probe: ok_tools |
What kind of tools these are derived
Verification only means something relative to a tool's NATURE — an email-sender has no "true answer", a generator has no answer key. Classification evidence: classified from tool names/descriptions/annotations WE OBSERVED. What checking applies to each kind (the full methodology →):
| nature | tools | meaning | what checking applies |
|---|---|---|---|
| retrieval-public | 11 | serves public facts | truth-checkable against a public source — the V-ladder applies in full |
| generative | 4 | creates content | no answer key exists; disclosure + stability checks, never truth verdicts |
| computational | 1 | deterministic transforms | self-checkable by re-computation and known-answer tests |
Tools last seen observed
Harness readiness observed
Can an agent's harness pick this tool and call it correctly? Graded on the three things an agent reads — name, description, typed parameters. Band A — an agent can pick and call these reliably.
| legibility check | tools passing | ok |
|---|---|---|
| name is clear & specific | 16/16 | ✓ |
| has a description | 16/16 | ✓ |
| description is substantive | 16/16 | ✓ |
| parameters are typed | 16/16 | ✓ |
| parameters are described | 11/16 | 11/16 |
16 of 16 tools graded · 16 with a captured input schema. RS-008, Tier-1 — no domain knowledge, applies to any tool. “Alive” is not the same as “usable”.
Truth checks observed
Not yet confirmed — 3 attempt(s) currently unverifiable (rate limits, walls, or unmappable schemas — never counted against the server) · 0 disagreements.
| claim class | key | verdict | primary source |
|---|---|---|---|
| tariff-duty | 0901.21.00 | unverifiable | us-hts |
| tariff-duty | 6109.10.00 | unverifiable | us-hts |
| tariff-duty | unmapped | unverifiable | us-hts |
Protocol conformance observed
Capabilities: prompts resources tools
Drift observed
No confirmed drift on record. Baseline set 2026-09-06; changes appear here after human review.
raw probe records
| probed (UTC) | outcome | http | ms | protocol |
|---|---|---|---|---|
| 2026-09-06T06:12:59Z | ok_tools | 200 | 520 | 2025-06-18 |
| 2026-08-30T06:12:41Z | ok_tools | 200 | 609 | 2025-06-18 |
Watch or embed this verdict
Operators: put the live verdict in your README — it updates with every census, links back here, and is a dated observation, never a warranty:
[](https://robinsaige.com/s/com.signalaf/sigrank)
Depend on it? Subscribe to its change feed — outcome changes and confirmed drift, no account needed. Building on it? The full dossier as JSON — verdict, rating, truth checks, history — stable enough to gate CI on.
Operator of this server? Everything we hold about it is on this page — free, no account, for anyone. Wrong attribution, stale probe, misclassification? Dispute this record →