Glossary
What is AI Gateway?
The central control point through which traffic from internal users and applications to AI services passes. It provides access, security policy, logging and routing from a single place.
An AI Gateway is an intermediate layer that sits on the path through which employees and applications reach large language model services. It determines who accesses which model, records requests and responses, enforces usage limits and manages policies centrally.
One of its most important functions is security control. Sensitive data in prompts can be masked or blocked with DLP rules; attack attempts such as prompt injection can also be inspected at the same point. This reduces the need to write separate rules for every tool.
By meaningfully reducing uncontrolled use, the gateway addresses the Shadow AI problem. If an organization uses more than one LLM, consolidating access at a single point also makes oversight and cost monitoring easier.