Skip to content
JournalRunning LLMs in production

Notes from the governed doorway.

Field notes on routing, cost control and AI safety — how teams run large language models in production without losing visibility, spend control or their security team's sign-off.

Latest writing
Secure Workplace AI Chat Deployments Teams Can Govern
8 min read

Secure Workplace AI Chat Deployments Teams Can Govern

Build secure workplace AI chat deployments with request-level controls, data protection, audit traces and spend limits - without rewriting your app code.

Can LLM Budgets Block Requests in Production?
7 min read

Can LLM Budgets Block Requests in Production?

Can LLM budgets block requests? Yes: hard caps can stop spend at the gateway with a 429, giving engineering teams clear, auditable control over model use.

AI Governance Case Study: Control at Every Request
7 min read

AI Governance Case Study: Control at Every Request

This AI governance case study shows how one controlled LLM gateway cuts exposure, spend and audit gaps without changing application logic in production.

LLM Firewall Evaluation Criteria That Matter
7 min read

LLM Firewall Evaluation Criteria That Matter

Use these LLM firewall evaluation criteria to test policy accuracy, data controls, latency, auditability and deployment fit before production rollout.

AI Policy Tools for Production LLM Control
7 min read

AI Policy Tools for Production LLM Control

AI policy tools enforce security, data controls and spend limits at every LLM request, giving teams evidence, flexibility and operational control at scale.

Provider Failover Alternatives for LLM Production
7 min read

Provider Failover Alternatives for LLM Production

Provider failover alternatives for LLM teams: compare retries, multi-region design and governed routing for continuity, control and audit-ready operations

How to Set Project AI Budgets That Actually Hold
7 min read

How to Set Project AI Budgets That Actually Hold

Set project AI budgets that give teams room to build, while enforcing hard caps, clear ownership and traceable spend across every model request daily use.

Scaling Multi-Team AI Without Losing Control
7 min read

Scaling Multi-Team AI Without Losing Control

Scaling multi-team AI needs one governed doorway for routing, spend, security and auditability, without forcing teams to rewrite working applications.

LLM Firewalls for Controlled AI Operations
7 min read

LLM Firewalls for Controlled AI Operations

LLM firewalls protect prompts, sensitive data and model outputs while giving teams request-level controls, audit evidence and predictable AI spend limits.

Can DLP Block Prompts? What It Can Actually Do
7 min read

Can DLP Block Prompts? What It Can Actually Do

Can DLP block prompts before they reach an LLM? Learn where it works, where it fails, and how request-level controls reduce data exposure in production.

EU AI Act Records: What Teams Must Retain
7 min read

EU AI Act Records: What Teams Must Retain

EU AI Act records need more than log retention. See how teams build traceable, proportionate evidence for AI systems in use at scale across teams today.

Enterprise Model Router Review for Production
7 min read

Enterprise Model Router Review for Production

An enterprise model router review for teams assessing routing, governance, spend caps, security controls and audit evidence before production rollout.

What Causes LLM Overspend in Production?
7 min read

What Causes LLM Overspend in Production?

What causes LLM overspend in production? Find the token, routing, retry and governance failures that make AI usage costly and hard to control at scale.

Provider Failover Policies for Production AI
7 min read

Provider Failover Policies for Production AI

Provider failover policies keep applications available without weakening data controls, routing intent, spend discipline or audit evidence under pressure.

8 Best Prompt Security Controls for Production
7 min read

8 Best Prompt Security Controls for Production

Compare the best prompt security controls for production LLM systems, from injection shielding and DLP to moderation, audit trails and spend caps safely.

How to Analyse LLM Request Costs Properly
7 min read

How to Analyse LLM Request Costs Properly

Learn how to analyse LLM request costs by model, route, feature and team, then set controls that reduce spend without weakening production quality safely.

How to Govern LLM Usage Across Teams at Scale
7 min read

How to Govern LLM Usage Across Teams at Scale

Govern LLM usage across teams with request-level controls, DLP redaction, hard spend caps and per-request traces, without changing application code at all.

LLM Gateway Software Review for Production
7 min read

LLM Gateway Software Review for Production

An LLM gateway software review for engineering, security and FinOps teams comparing routing, controls, observability, data handling and deployment needs.

DLP Redaction Rules for Production AI Systems
8 min read

DLP Redaction Rules for Production AI Systems

Set DLP redaction rules that protect sensitive data in LLM requests, preserve useful prompts and create evidence for production governance teams daily.

A Copilot Data Leak Example That Scales Fast
7 min read

A Copilot Data Leak Example That Scales Fast

A copilot data leak example shows how ordinary prompts can expose sensitive records. See the controls that stop disclosure before a model call is made.

Centralised LLM Gateway Comparison for Production
7 min read

Centralised LLM Gateway Comparison for Production

A centralised LLM gateway comparison for teams weighing routing, policy enforcement, observability, spend control and deployment friction in production.

Indirect Injection Defence for Production AI
7 min read

Indirect Injection Defence for Production AI

Indirect injection defence protects production AI when untrusted documents, web pages and tool content enter model context, with enforceable controls.

How to Deploy AI DLP Actions Without Rewrites
7 min read

How to Deploy AI DLP Actions Without Rewrites

Learn how to deploy AI DLP actions at the API gateway, selecting log, warn, redact or block controls without changing application logic in production.

7 OpenRouter Alternatives for Production AI
6 min read

7 OpenRouter Alternatives for Production AI

Assess openrouter alternatives for routing, governance, cost control and EU-ready auditability before moving production LLM traffic between providers.

Model Routing Guide for Production AI Teams
8 min read

Model Routing Guide for Production AI Teams

A practical model routing guide for engineering teams: choose capable models per request, enforce policy, control spend and retain audit-ready traces.

AI Governance Software for Production LLMs
7 min read

AI Governance Software for Production LLMs

AI governance software puts routing, data protection, policy enforcement and cost control at every LLM request, giving teams evidence without rewrites.

LLM Security That Holds Up in Production
7 min read

LLM Security That Holds Up in Production

LLM security in production means enforcing prompt, data, output and spend controls on every request, with evidence teams can review when it most matters.

Enterprise AI Governance Platform for Control
7 min read

Enterprise AI Governance Platform for Control

An enterprise AI governance platform enforces policy, protects data, controls spend and produces the request-level evidence production teams need at scale.

How to Enforce Prompt Policies at the Gateway
8 min read

How to Enforce Prompt Policies at the Gateway

Learn how to enforce prompt policies at the API gateway, protecting sensitive data, stopping injection attempts and preserving audit-ready request traces.

GDPR AI Tools for Production LLM Control
7 min read

GDPR AI Tools for Production LLM Control

GDPR AI tools need to govern each LLM request, not merely document policies. See how routing, redaction and audit trails work in production systems daily.

Can LLMs Process Personal Data Under GDPR?
8 min read

Can LLMs Process Personal Data Under GDPR?

Can LLMs process personal data under GDPR? Learn controls for lawful use, from purpose limitation and DLP to provider governance and audit trails for staff.

Model Risk Management for Production AI Teams
7 min read

Model Risk Management for Production AI Teams

Model risk management gives AI teams request-level control of providers, prompts, data, spend and audit evidence, without rewriting production applications.

Production LLM Security Guide for Real Systems
7 min read

Production LLM Security Guide for Real Systems

A production LLM security guide for teams enforcing prompt, data, output and spend controls across providers without rewriting their applications safely.

European AI Regulation for Production LLMs
7 min read

European AI Regulation for Production LLMs

European AI regulation affects every production LLM request. Build the controls, evidence and operating model needed for EU AI Act and GDPR readiness.

How to Set AI Hard Caps Without Blocking Work
7 min read

How to Set AI Hard Caps Without Blocking Work

Learn how to set AI hard caps that stop uncontrolled LLM spend while preserving essential production work, traceability and provider choice across teams.

LLM Compliance for Production AI Systems
7 min read

LLM Compliance for Production AI Systems

LLM compliance requires controls on every request. See how routing, DLP, moderation and audit trails make production AI accountable at scale with control.

EU AI Act Future Needs Request-Level Control
8 min read

EU AI Act Future Needs Request-Level Control

EU AI Act future planning starts in the request path. Build evidence, enforce data controls and retain model flexibility as AI systems scale across teams.

PII Redaction for Production LLM Systems
7 min read

PII Redaction for Production LLM Systems

PII redaction protects LLM prompts and outputs without slowing delivery. Learn where it belongs, what it catches, and how to enforce it per request safely.

A Regulated AI Deployment Example That Holds Up
7 min read

A Regulated AI Deployment Example That Holds Up

See a regulated AI deployment example for a customer-support copilot: policy checks, PII redaction, model routing, trace evidence and spend caps in use.

How to Route LLMs by Capability in Production
6 min read

How to Route LLMs by Capability in Production

Route LLMs by capability with governed routing rules that protect data, manage spend and select the right model for every production request at scale now.

7 Best LLM Routing Tools: What to Assess
7 min read

7 Best LLM Routing Tools: What to Assess

Compare the best LLM routing tools for production: routing quality, policy enforcement, data controls, spend caps, traceability and deployment effort.

How to Configure OpenAI API Migration Safely
7 min read

How to Configure OpenAI API Migration Safely

Configure OpenAI API migration with a controlled endpoint change, then add routing, DLP, spend caps and traces without rewriting application logic safely.

LLM Routing Savings Example for Production Teams
7 min read

LLM Routing Savings Example for Production Teams

An LLM routing savings example: compare model costs, apply policy controls, and measure verified savings across production request volumes reliably now.

7 Best Tools for AI Budgeting in Production
7 min read

7 Best Tools for AI Budgeting in Production

Compare the best tools for AI budgeting: spend caps, usage visibility, model routing and governance for production LLM teams across providers at scale.

AI Governance Framework for Production Control
8 min read

AI Governance Framework for Production Control

Build an AI governance framework that enforces policy, protects sensitive data, controls spend and produces evidence at every request across providers.

Multi Model Routing Strategy for Production AI
7 min read

Multi Model Routing Strategy for Production AI

Build a multi model routing strategy that balances capability, cost, resilience and request-level governance for production AI workloads at scale safely.

Switch LLM Providers Without Code Changes
7 min read

Switch LLM Providers Without Code Changes

Switch LLM providers without code changes using one OpenAI-compatible endpoint, governed routes, request-level controls and failover for production teams.

LLM Output Moderation API for Production Teams
7 min read

LLM Output Moderation API for Production Teams

An LLM output moderation API applies enforceable checks to every response, helping teams prevent unsafe content, data leakage and policy breaches at scale.

How to Detect Anomalous AI Usage in Production
7 min read

How to Detect Anomalous AI Usage in Production

Learn to detect anomalous AI usage through request traces, budgets and policy signals, without retaining prompts or disrupting production services safely.

LLM Spend Budget Controls for Production Teams
7 min read

LLM Spend Budget Controls for Production Teams

LLM spend budget controls give engineering, FinOps and security teams hard caps, clear ownership and traceable decisions without slowing production AI.

Send LLM Logs to SIEM Without Exposing Prompts
7 min read

Send LLM Logs to SIEM Without Exposing Prompts

Learn how to send LLM logs to SIEM with useful security context, minimal data exposure, consistent correlation and audit-ready evidence across providers.

LLM Audit Trail Requirements for Production
7 min read

LLM Audit Trail Requirements for Production

Meet LLM audit trail requirements using request-level evidence, privacy controls and traces that support governance without default prompt storage at scale.

LLM Data Loss Prevention for Production AI
7 min read

LLM Data Loss Prevention for Production AI

LLM data loss prevention protects prompts and outputs at the gateway, enforcing redaction, blocking and audit evidence without changing application code.

Mask PII Before Sending Requests to LLMs
8 min read

Mask PII Before Sending Requests to LLMs

Learn how to mask PII before sending prompts to LLMs with gateway DLP policies: preset detectors, redaction, blocking and audit-ready request metadata.

How to Prevent Jailbreak Attacks in Chatbots
8 min read

How to Prevent Jailbreak Attacks in Chatbots

Learn how to prevent jailbreak attacks in chatbots with request-level controls, layered testing, output checks and audit-ready evidence logs.

Prompt Injection Protection for LLMs That Holds
7 min read

Prompt Injection Protection for LLMs That Holds

Prompt injection protection for LLMs needs request-level controls, isolation and monitoring. Learn how to stop hostile instructions in production safely.

How to Reduce LLM API Costs in Production
8 min read

How to Reduce LLM API Costs in Production

Learn how to reduce LLM API costs with request-level routing, token controls, budgets and observability, without changing production application logic.

LLM Provider Failover Solution for Production
7 min read

LLM Provider Failover Solution for Production

Build an LLM provider failover solution that protects uptime, preserves policy controls, and keeps production AI requests moving when a provider fails.

AI Gateway: Control Every Production Request
7 min read

AI Gateway: Control Every Production Request

An AI gateway routes each model request by cost and capability, enforcing security, data controls, budgets and observability across production teams daily.

LLM Cost Optimisation Platform for Production
7 min read

LLM Cost Optimisation Platform for Production

An LLM cost optimisation platform controls model spend per request, without sacrificing policy enforcement, security, reliability or observability daily.

OpenAI Compatible API Gateway for Production
8 min read

OpenAI Compatible API Gateway for Production

An OpenAI compatible API gateway centralises model routing, policy enforcement, data protection, budgets and observability without changing business code.