IA-QA — 130+ QA & Dev Tools for AI Agents
io.github.JcJamet/ia-qa-toolbox
130+ QA & dev tools for AI agents: prompt injection, RAG testing, VLM eval, guardrails. Free.
— the operator's own registry description reported
Publisher io.github.JcJamet · first seen 2026-08-12 · endpoint https://www.ia-qa.com/mcp
Dependency rating derived
allow — alive & usable · retrieval-public ● · V3 has answer key ◐
Cluster rich-solo · distinctiveness 0.468 (moderate). Every figure is a percentile or class within the 11,094-server census — see the whole spectrum.
🔏 Signed receipt rr_1073fdeec167ef262070f33f · ed25519 · key rs-rcpt-2026-08 — this rating is tamper-evident; an agent gets the full signature from check_server and can verify it against the published key.
● observed · ◐ derived · ○ reported — the verdict synthesizes Q1–Q4; Q5 is context. Methodology →
History observed
Every probe we made, oldest → newest (2 shown, 2026-08-12 → 2026-08-14). Green answered · amber answered-but-walled · red no useful answer. A gap in our cadence is a gap in coverage, not evidence about the server.
changelog (1 events)
| date | type | what changed |
|---|---|---|
| 2026-08-12 | outcome | first probe: ok_tools |
What kind of tools these are derived
Verification only means something relative to a tool's NATURE — an email-sender has no "true answer", a generator has no answer key. Classification evidence: classified from tool names/descriptions/annotations WE OBSERVED. What checking applies to each kind (the full methodology →):
| nature | tools | meaning | what checking applies |
|---|---|---|---|
| retrieval-public | 84 | serves public facts | truth-checkable against a public source — the V-ladder applies in full |
| generative | 32 | creates content | no answer key exists; disclosure + stability checks, never truth verdicts |
| computational | 29 | deterministic transforms | self-checkable by re-computation and known-answer tests |
| action | 3 | changes the world | no true answer exists; we check the CONTRACT (destructive/read-only/idempotent declarations, error legibility) and never fire real actions |
| orchestration | 1 | routes other tools | identity + fronted-service disclosure checks (gateway vs costume) |
| unclassified | 1 | not classifiable from its text | Tier-1 only until its tools describe themselves |
Tools last seen observed
Harness readiness observed
Can an agent's harness pick this tool and call it correctly? Graded on the three things an agent reads — name, description, typed parameters. Band A — an agent can pick and call these reliably.
| legibility check | tools passing | ok |
|---|---|---|
| name is clear & specific | 150/150 | ✓ |
| has a description | 150/150 | ✓ |
| description is substantive | 150/150 | ✓ |
| parameters are typed | 148/150 | 148/150 |
| parameters are described | 150/150 | ✓ |
150 of 150 tools graded · 150 with a captured input schema. RS-008, Tier-1 — no domain knowledge, applies to any tool. “Alive” is not the same as “usable”.
Truth checks observed
Not in the Tier-2 trade lane, or not yet checked. Tier-2 re-derives a server's answers against published primary sources — see truth checks.
Protocol conformance observed
Capabilities: tools
Drift observed
No confirmed drift on record. Baseline set 2026-08-14; changes appear here after human review.
raw probe records
| probed (UTC) | outcome | http | ms | protocol |
|---|---|---|---|---|
| 2026-08-14T19:59:04Z | ok_tools | 200 | 323 | 2025-06-18 |
| 2026-08-12T05:34:19Z | ok_tools | 200 | 318 | 2025-06-18 |
Watch or embed this verdict
Operators: put the live verdict in your README — it updates with every census, links back here, and is a dated observation, never a warranty:
[](https://robinsaige.com/s/io.github.JcJamet/ia-qa-toolbox)
Depend on it? Subscribe to its change feed — outcome changes and confirmed drift, no account needed. Building on it? The full dossier as JSON — verdict, rating, truth checks, history — stable enough to gate CI on.