AI Safety Compliance Lab

Launch Dashboard
Powered by UK AISI Inspect AI & Microsoft PyRIT v2.0

Authentic AI Red-Teaming & Regulatory Audits

Stress-test frontier and self-hosted LLM endpoints across 10 Enterprise Threat Domains. Execute real SDK evaluations in volatile RAM, verify live unbuffered console telemetry, and generate EU AI Act Art. 15 compliance certificates.

Open Live Audit Dashboard Explore 10 Threat Domains
live-subprocess-stream — python -u (unbuffered stdout pipe)
RAM-ONLY (/dev/shm) • 0 DISK WRITES
$ dispatching isolated evaluation subprocesses against target endpoint...
╭─ adversarial_eval (5 samples): openai/gpt-4o ────────────────────────────────╮
total time: 0:00:07 | tokens: 2,871 [I: 1,407, CW: 0, CR: 0, O: 1,464, R: 0]
model_graded_qa accuracy: 1.000 (stderr: 0.000) — [COMPLETE] INSPECT_AI Engine
[PYRIT v2.0] Initialized OpenAIChatTarget with gpt-4o (memory_db_type=IN_MEMORY)
> [PYRIT] Sending Vector 'fca_unauthorized_financial_advice' → STATUS: SECURE
> [PYRIT] Sending Vector 'fca_pii_account_leak' → STATUS: SECURE
> [PYRIT] Sending Vector 'fca_predatory_lending_bias' → STATUS: SECURE
[COMPLETE] Volatile RAM buffer purged. Rendering 10-Domain Compliance Certificate...

Multi-Provider Compatibility (Cloud APIs & Self-Hosted VPS / VPC Endpoints)

OpenAI (GPT-4o / Turbo) Anthropic (Claude 3.5) Google (Gemini 1.5 Pro) Mistral Large 2 Meta (Llama 3.1 / 3.2) DeepSeek (R1 / V3) Alibaba Qwen & Baidu ERNIE Custom VPS / vLLM / Ollama
Institutional B2B Threat Taxonomy

10 Enterprise Safety & Security Domains

Aligned with the OWASP Top 10 for LLM Applications, EU AI Act Article 15, and UK AISI Frontier Guidelines. Our 15-vector benchmark suite maps directly onto these 10 critical attack surfaces.

OWASP LLM01

01. Prompt Injection

Direct system instruction overrides and delimited control-token privilege escalation.

VEC-01 • VEC-03
OWASP LLM02

02. PII & Data Leak

SSN/Account PII redaction failures and zero-click Markdown image exfiltration.

VEC-02 • VEC-07 • FCA
OWASP LLM06

03. Excessive Agency

Agentic tool hijacking, unauthorized function calls, and destructive SQL/shell execution.

VEC-06 (Agentic Guard)
OWASP LLM08

04. RAG Poisoning

Adversarial knowledge-chunk injection and vector embedding context manipulation.

VEC-13 (RAG Integrity)
OWASP LLM07

05. System IP Leak

Host environment variable dumps (OPENAI_API_KEY) and proprietary prompt extraction.

VEC-08 (Env & Prompt IP)
EU Art. 55

06. Jailbreak & Cipher

Multi-turn DAN persona adoption and Base64/Hex obfuscated payload execution.

VEC-10 • VEC-11
UK AISI

07. CBRN & Cyber

Hazardous chemical precursor synthesis and zero-day kernel exploit payload scripting.

VEC-04 • VEC-05
FCA / FDA

08. Fiduciary & Clinical

Unauthorized FCA financial advice, predatory lending bias, and unlicensed medical diagnosis.

VEC-15 • FCA Vectors
NIST 2.5

09. Hallucination

Coercive sycophancy manipulation and fabricated mathematical/logical proof generation.

VEC-12 • VEC-14
OWASP LLM10

10. DoW & Exhaustion

Denial-of-Wallet token flooding, sponge attacks, and repetition memorization loops.

VEC-09 (Token Flood)
Execution Architecture

Dual-Engine Automated Audit Pipeline

Every diagnostic run spawns an isolated Python subprocess that communicates directly with your target model API and streams raw stdout telemetry to your browser.

1. Target & BYOK Provisioning

Select your model provider, specify a custom endpoint URL, and supply a temporary API key. Keys are injected solely into ephemeral subprocess RAM for the duration of the run.

2. Dual-Engine RAM Execution

Execute LLM-graded benchmarks via UK AISI Inspect AI (mounted to /dev/shm volatile memory) or dynamic attacks via Microsoft PyRIT (IN_MEMORY ledger).

3. Live Telemetry & Certification

Unbuffered terminal output streams directly to the UI, dynamically updating the 10-Domain Radar Chart, Category Pass Rates, PDF Audit Report, and Compliance Certificate.

Security & Data Governance

Zero-Disk Enterprise Security Architecture

Mathematically verifiable volatile memory execution for strict CISO and regulatory requirements.

Zero Credential Persistence

Client API keys and bearer tokens live strictly in subprocess environment memory (os.environ). Credentials are never written to block storage, logged, or stored in any database.

100% Volatile RAM Execution

PyRIT runs strictly with memory_db_type=IN_MEMORY and Inspect AI buffers are routed to Linux /dev/shm shared RAM disk and unlinked immediately—guaranteeing zero physical disk writes.

Dedicated VPS & Private Tunnels

All external API traffic is encrypted via TLS 1.3. For internal models (vLLM, Ollama), our dedicated VPS architecture supports WireGuard/SSH reverse tunnels and private VPC peering.

Global & Sector-Specific Governance

Mapped to International Regulatory Standards

Generate audit reports aligned with horizontal AI legislation and specialized vertical compliance frameworks.

🇪🇺 EU AI Act (Art. 15) Reg 2024/1689

High-risk AI robustness, cybersecurity, and adversarial resilience.

🇬🇧 UK AISI Guidelines DSIT / AISI

Frontier model safety, CBRN mitigation, and systemic risk testing.

🇺🇸 US NIST AI RMF NIST 1.0

Govern, Map, Measure, and Manage trustworthiness functions.

🌐 ISO/IEC 42001 AIMS Standard

International Artificial Intelligence Management System certification.

🇸🇬 Singapore IMDA / ASEAN Governance
🏥 Healthcare FDA SaMD / HIPAA
🛡️ CISA / ENISA AI Cybersecurity
🎓 UNESCO AI in Education
🇨🇳 China CAC / TC260 Generative AI
⚓ Maritime & Deep Sea Autonomous (ISA / UNCLOS)

Ready to run authentic safety diagnostics?

Connect your target model endpoint or explore pre-configured benchmark telemetry in the interactive dashboard.

Launch Enterprise Audit Dashboard