Analytics
Last updated
Was this helpful?
Last updated
Was this helpful?
This feature is available for all plans:-
: 30 days retention
: 365 days retention
: Unlimited
As soon as you integrate Portkey, you can start to view detailed & real-time analytics on cost, latency and accuracy across all your LLM requests.
The analytics dashboard provides an interactive interface to understand your LLM application Here, you can see various graphs and metrics related to requests to different LLMs, costs, latencies, tokens, user activity, feedback, cache hits, errors, and much more.
The metrics in the Analytics section can help you understand the overall efficiency of your application, discover patterns, identify areas of optimization, and much more.
The overview tab is a 70,000ft view of your application's performance. This highlights the cost, tokens used, mean latency, requests and information on your users and top models.
This is a good starting point to then dive deeper.
Portkey captures errors automatically for API and Accuracy errors. The charts give you a quick sense of error rates allowing you to debug further when needed.
The dashboard also shows you the number of requests rescued by Portkey through the various AI gateway strategies.
When you enable cache through the AI gateway, you can view data on the latency improvements and cost savings due to cache.
Portkey allows you to collect feedback on LLM requests through the logs dashboard or via API. You can view analytics on this feedback collected on this dashboard.
Group your request data by metadata parameters to unlock insights on usage. Select the metadata property to use in the dropdown and view the request data grouped by values of that metadata parameter.
This lets you answer questions like:
Which users are we spending the most on?
Which organisations have the highest latency?
The dashboard provides insights into your , , , and also summarizes information by .
The users tab provides an overview of the user information associated with your Portkey requests. This data is derived from the user parameter in OpenAI SDK requests or the special _user key in the Portkey .
