Control plane for LLM Gateway

The LLM Gateway Control Plane provides a graphical interface that simplifies API management within the LLM Gateway ecosystem. It offers advanced observability and control over API usage, allowing you to monitor, manage, and optimize API calls efficiently.

Providers dashboard

You can view the Providers Dashboard when you log in. It offers you an overview of the API providers your system interacts with. At the top, you can find general statistics, including total API calls, error rate (%), average runtime (ms), and status code distribution.

A table lists each consumed API provider along with key metrics, including provider name, endpoint totals, total API calls, error rate percentages, and average runtime.

Select a API provider row to expand additional details, such as HTTP method, path, last transaction time, status code distribution, and total API calls.

You can filter the data by time ranges (last 5 minutes, 24 hours, and so on) or by consumer tags using the x-lunar-consumer-tag header, allowing fine-grained analysis.

Managing auto-discovered path parameters

Each API Provider row includes a more options menu on the right. Select Manage Path Params to open a configuration page where you can rename the automatically assigned path parameter names (for example, param1, param2) to more meaningful names.

By default, the Control Plane packages path parameters automatically once it detects 50 different parameters, preventing UI overload. Use Manage Path Params to control how these parameters display and organize.

Gateway policies hub

The Gateway policies Hub provides a library of pre-configured policies designed to help you optimize your API consumption. These policies include solutions for rate limiting, error management, and quota enforcement, letting you quickly deploy best practices for managing API traffic.

You can browse, select, and apply these policies to your environment in a few clicks, improving your API performance and efficiency.

The Signal widget, located in the bottom-left navigation menu, provides real-time status feedback on the LLM Gateway components, including active gateways, active interceptors, and traffic routed to LLM Gateway. You can also use this widget to add new instances and generate API keys for seamless integration.

User settings

Select User Settings to manage user profile information and organizational settings. You can:

Edit first and last name
Update organization name
Manage account settings and password
Invite team members to collaborate on the same dashboard

You can also find quick links to LLM Gateway topics and options to request new features or join the LLM Gateway Discord community.