Robin Saige we check the tools AI agents call

traced llm proxy

io.github.mikerawsonnz/traced-llm-proxy

Proxy Gemini (Vertex AI) completions wrapped in OpenTelemetry trace spans; returns the answer plus t

— the operator's own registry description reported

Publisher io.github.mikerawsonnz · first seen 2026-08-12 · endpoint https://anthropic-mcp-opentelemetry-api-264025.getvda.ai/mcp

allow
verdict
thin-shared
cluster
ok_tools
answers
2
tools served

Dependency rating derived

allow
allow — alive & usable · orchestration ● · V n/a
allow — because answers ●, 2 tools legible (band A) ●, no confirmed drift in 2 probes ●; not yet checked: truth (0 runs)

Cluster thin-shared · distinctiveness 0.442 (moderate). Every figure is a percentile or class within the 11,094-server censussee the whole spectrum.

Does it answer? Q1 · observed
answersalive_tools
latency64 ms
vs populationtypical
protocolleading
authopen
Can it be used? Q4 · observed
tools2
vs populationlow
capabilities1
harnessA
Did it hold when checked? Q3–Q4 · derived
identityshared
servers on its host1
servers on its domain9
verifiabilityunassessed
duplicate inventoryno
drift events0
answers trueno primary

🔏 Signed receipt rr_b3aa13a06aceb4d6a6f042d4 · ed25519 · key rs-rcpt-2026-08 — this rating is tamper-evident; an agent gets the full signature from check_server and can verify it against the published key.

Q1Does it answer?alive & usable — 2 probes ●evidence ↓
Q2What is it?orchestration ● evidence ↓
Q3Can it be checked?V n/a for this kind ◐evidence ↓
Q4Did it hold?harness A · truth not yet run · no drift ●evidence ↓
Q5What company does it keep?thin-shared · 1 on its host (context, not verdict) ◐evidence ↓

● observed · ◐ derived · ○ reported — the verdict synthesizes Q1–Q4; Q5 is context. Methodology →

History observed

Every probe we made, oldest → newest (2 shown, 2026-08-12 → 2026-08-14). Green answered · amber answered-but-walled · red no useful answer. A gap in our cadence is a gap in coverage, not evidence about the server.

changelog (1 events)
datetypewhat changed
2026-08-12outcomefirst probe: ok_tools

What kind of tools these are derived

Verification only means something relative to a tool's NATURE — an email-sender has no "true answer", a generator has no answer key. Classification evidence: classified from tool names/descriptions/annotations WE OBSERVED. What checking applies to each kind (the full methodology →):

naturetoolsmeaning what checking applies
action1changes the worldno true answer exists; we check the CONTRACT (destructive/read-only/idempotent declarations, error legibility) and never fire real actions
orchestration1routes other toolsidentity + fronted-service disclosure checks (gateway vs costume)

Tools last seen observed

invoke selftest

Harness readiness observed

Can an agent's harness pick this tool and call it correctly? Graded on the three things an agent reads — name, description, typed parameters. Band A — an agent can pick and call these reliably.

legibility checktools passingok
name is clear & specific1/21/2
has a description2/2
description is substantive2/2
parameters are typed2/2
parameters are described2/2

2 of 2 tools graded · 2 with a captured input schema. RS-008, Tier-1 — no domain knowledge, applies to any tool. “Alive” is not the same as “usable”.

Truth checks observed

Not in the Tier-2 trade lane, or not yet checked. Tier-2 re-derives a server's answers against published primary sources — see truth checks.

Protocol conformance observed

2026-07-28
protocol version
session model
0.1.7
server version anthropic-mcp-opentelemetry-api-264025

Capabilities: tools

Drift observed

No confirmed drift on record. Baseline set 2026-08-14; changes appear here after human review.

raw probe records
probed (UTC) outcomehttpmsprotocol
2026-08-14T19:59:51Zok_tools200642026-07-28
2026-08-12T05:35:08Zok_tools200712026-07-28

Watch or embed this verdict

verdict badge

Operators: put the live verdict in your README — it updates with every census, links back here, and is a dated observation, never a warranty:

[![Robin Saige verdict](https://robinsaige.com/badge/io.github.mikerawsonnz/traced-llm-proxy.svg)](https://robinsaige.com/s/io.github.mikerawsonnz/traced-llm-proxy)

Depend on it? Subscribe to its change feed — outcome changes and confirmed drift, no account needed. Building on it? The full dossier as JSON — verdict, rating, truth checks, history — stable enough to gate CI on.

← overview