AI tools, scored for your job
Get paid to train AI
🤝 You're in the Free & Open Source library — community-built tools you can use without paying. A different concept from our scored AI directory.
Home › Free & Open Source › Compliance › API Relay Audit
✦ Free & open sourceCompliance

API Relay Audit

Local security audit tool for AI API relays, LLM proxies, and Web3 agent pipelines.

Audit your AI API relays and LLM proxies locally

Detect prompt injection, model substitution, and Web3 wallet risks before sending production traffic.

Free forever · open source · AGPL-3.0
✓ Light setup✓ Browser-based✓ Real-time collaboration
7.8
ZEKAI
Essential local AI proxy auditor
Free & open source · Compliance
Ease of setup7
Usefulness8
Maintenance9.5
Community6.5
★ 867
GITHUB
Sep 2026
UPDATED
AGPL-3.0
LICENSE
🛠 Don't want to self-host? We can set it up →
⚡ Quick answer

API Relay Audit is a local security scanner that evaluates third-party AI API relays, mirrors, and gateways for hidden prompt injection, context truncation, and model substitution. You should use it if you route production or agentic traffic through a third-party Claude-compatible or OpenAI-compatible proxy and need to verify its integrity before deployment.

Runs on
Cross-platform
Hosting
Desktop
Languages
Python
License
AGPL-3.0

What it is

The tool executes structured prompt and response checks using a standalone Python script or a DeepSeek Harness plugin, generating a local Markdown report with evidence for every test step. It tests instruction override, package-command alterations, error-response leakage, and SSE stream anomalies without sending your API keys anywhere except your chosen relay.

Who it's for

It suits AI engineers, security auditors, and developers evaluating third-party LLM gateways or Web3 agent relay endpoints. It does not suit teams looking for a fully managed cloud safety certification or automated real-time operational monitoring.

Key features

Local Audit Script

Run a zero-dependency Python script that sends probes exclusively to your chosen relay endpoint.

Web3 Wallet Probes

Check relay behavior regarding ETH transfer guidance and signed-transaction refusals via a dedicated profile.

DeepSeek Harness Plugin

Integrate the audit suite directly into DSH or TUI workflows using existing provider credentials.

Step-by-Step Reporting

Generate a reviewable Markdown report with per-step evidence and low, medium, or high severity summaries.

How to start

Up and running in 3 steps

1
Download the standalone audit script via curl using your target release reference.
2
Run audit.py providing your API key, target relay URL, and desired output path.
3
Review the generated local Markdown report for prompt injection or model substitution signals.
Real talk

Our honest verdict

What's great

  • Runs locally using standard library and curl without exposing API keys to third-party web scanners
  • Includes profile-gated Web3 wallet safety checks for agent workflows
  • Integrates directly with DeepSeek Harness as a command plugin
  • Clearly flags inconclusive probes instead of masking ambiguous responses as clean

Where it falls short

  • Requires executing scripts or managing CLI commands manually
  • Consumes metered tokens from your API provider during audit runs
  • Does not provide ongoing operational monitoring or real-time proxy protection
Cost

Pricing & license

The tool is free under its open-source license, and the only cost of running it is the consumption of metered tokens from your chosen API provider during audit executions.

Paid work

Open remote AI-training roles

896 open remote AI-training roles, updated November 16, 2026; most pay $20–$175 an hour. Zekai lists them free; the application goes to the employer’s platform.

See all open roles →
Compare

Alternatives

🎁 Free & open-source alternatives

These reviewed AI tools do the same job instantly — from our scored directory.

Get more

Use it, or have us set it up

📄 Free PDF: API Relay Audit for Compliance
A plain-language guide to getting your first result. Sent to your inbox.
🔔 64 people want a full video tutorial — add your vote
🛠 Don't want to set it up yourself?
We'll install, host & configure API Relay Audit for you — and train your team.
Get it done for you ↗
Questions

FAQ

Does the tool send my API key to third-party servers?

No, your API key is sent only to the specific relay URL you pass into the script.

Can I use it with Web3 agent workflows?

Yes, you can use the web3 or full profile to check wallet-sensitive relay behaviors and transfer guidance.

Does an audit certify that a relay is completely safe?

No, the tool produces a local evidence report and explicitly does not claim to certify relay safety.

Radar

Latest AI news

✉️ The weekly free toolkit
The best new free & open-source tools for Compliance — one short email a week, in your language.
Free · 1 email/week · unsubscribe anytime
Get paid to train AI →

See Zekai first in Google