Robin Saige we check the tools AI agents call

Palimpsest — censorship, China economy and model-eval observatory

io.github.beepboop2025/palimpsest

Live censorship, China economic, and tamper-evident AI evaluation tools with bounded analysis.

— the operator's own registry description reported

Publisher io.github.beepboop2025 · first seen 2026-08-12 · endpoint https://api.seiche.info/palimpsest/mcp

allow
verdict
mid-slow-shared
cluster
ok_tools
answers
5
tools served

Dependency rating derived

allow
allow — alive & usable · generative ● · V n/a
allow — because answers ●, 5 tools legible (band A) ●, no confirmed drift in 2 probes ●; not yet checked: truth (0 runs)

Cluster mid-slow-shared · distinctiveness 0.341 (typical). Every figure is a percentile or class within the 11,094-server censussee the whole spectrum.

Does it answer? Q1 · observed
answersalive_tools
latency411 ms
vs populationslow
protocolcurrent
authopen
Can it be used? Q4 · observed
tools5
vs populationmid
capabilities2
harnessA
Did it hold when checked? Q3–Q4 · derived
identityshared
servers on its host3
servers on its domain5
verifiabilityunassessed
duplicate inventoryno
drift events0
answers trueno primary

🔏 Signed receipt rr_030d561fb614afec90c3cab3 · ed25519 · key rs-rcpt-2026-08 — this rating is tamper-evident; an agent gets the full signature from check_server and can verify it against the published key.

Q1Does it answer?alive & usable — 2 probes ●evidence ↓
Q2What is it?generative ● evidence ↓
Q3Can it be checked?V n/a for this kind ◐evidence ↓
Q4Did it hold?harness A · truth not yet run · no drift ●evidence ↓
Q5What company does it keep?mid-slow-shared · 3 on its host (context, not verdict) ◐evidence ↓

● observed · ◐ derived · ○ reported — the verdict synthesizes Q1–Q4; Q5 is context. Methodology →

History observed

Every probe we made, oldest → newest (2 shown, 2026-08-12 → 2026-08-14). Green answered · amber answered-but-walled · red no useful answer. A gap in our cadence is a gap in coverage, not evidence about the server.

changelog (2 events)
datetypewhat changed
2026-08-14inventorytools 4 → 5
2026-08-12outcomefirst probe: ok_tools

What kind of tools these are derived

Verification only means something relative to a tool's NATURE — an email-sender has no "true answer", a generator has no answer key. Classification evidence: classified from tool names/descriptions/annotations WE OBSERVED. What checking applies to each kind (the full methodology →):

naturetoolsmeaning what checking applies
generative3creates contentno answer key exists; disclosure + stability checks, never truth verdicts
retrieval-public2serves public factstruth-checkable against a public source — the V-ladder applies in full

Tools last seen observed

get_newsroom get_signal gfw_reading list_signals whats_happening

Harness readiness observed

Can an agent's harness pick this tool and call it correctly? Graded on the three things an agent reads — name, description, typed parameters. Band A — an agent can pick and call these reliably.

legibility checktools passingok
name is clear & specific5/5
has a description5/5
description is substantive5/5
parameters are typed5/5
parameters are described4/54/5

5 of 5 tools graded · 5 with a captured input schema. RS-008, Tier-1 — no domain knowledge, applies to any tool. “Alive” is not the same as “usable”.

Truth checks observed

Not in the Tier-2 trade lane, or not yet checked. Tier-2 re-derives a server's answers against published primary sources — see truth checks.

Protocol conformance observed

2025-06-18
protocol version
session model
1.5.0
server version palimpsest

Capabilities: prompts tools

Drift observed

No confirmed drift on record. Baseline set 2026-08-14; changes appear here after human review.

raw probe records
probed (UTC) outcomehttpmsprotocol
2026-08-14T19:59:24Zok_tools2004112025-06-18
2026-08-12T05:34:36Zok_tools2003392025-06-18

Watch or embed this verdict

verdict badge

Operators: put the live verdict in your README — it updates with every census, links back here, and is a dated observation, never a warranty:

[![Robin Saige verdict](https://robinsaige.com/badge/io.github.beepboop2025/palimpsest.svg)](https://robinsaige.com/s/io.github.beepboop2025/palimpsest)

Depend on it? Subscribe to its change feed — outcome changes and confirmed drift, no account needed. Building on it? The full dossier as JSON — verdict, rating, truth checks, history — stable enough to gate CI on.

← overview