AI Studio provides session logs and observability metrics for agents so you can understand how your agents are performing.

The following observability views are available for individual agents:

You can also view global usage and spend for your organization.

​
Session logs

Session logs are only available to organization admins. Logs are only available for custom no-code agents and are not yet available for Ask Writer or prebuilt agents.

Organization admins can choose to retain logs from agent sessions. When enabled, you can view the logs for an agent for the given retention period.

​
Enable session logging

To enable session logging, log in to AI Studio and navigate to the Admin tab in the left sidebar.

From there, you can enable session logging for your organization.

Once enabled, you can choose the retention period for session logs for each agent. The default is no retention. The possible retention periods are 7 days, 30 days, 90 days, or 180 days.

Whenever someone updates an agent’s session log settings, all organization admins receive an email notification.

​
View session logs

To view session logs, navigate to specific agent from the AI Studio homepage. Select the Observability tab from the top of the page and then select the Session logs view. Click on an individual session to view the logs.

​
Flagged responses

In a chat with a no-code agent, an end user can flag a response as inappropriate or inaccurate. An organization admin can then view the flagged responses within the session logs.

To flag a response in a chat, the user clicks the Flag button in the bottom right corner of the response.

In the session logs for a particular conversation, you can see any flagged responses by clicking the View flagged responses button in the top right corner of the session log.

​
Agent observability

Agent observability provides a detailed view of an agent’s engagement, performance, and usage. Anyone can view these metrics for agents in your organization. Session logs are also available, but only for organization admins if the agent’s session log settings are enabled.

These metrics are only available for deployed agents.

To view metrics for deployed agents, navigate to the specific agent from the AI Studio homepage. Select the Observability tab from the top of the page and then choose the specific metric you want to view.

  • Engagement metrics: Show the top five users for the agent over the specified time period and the total number of user interactions for the agent.
  • Performance metrics: Show the average response time as well as the P90, P95, and P99 response times for the agent over the specified time period. It also shows the response codes broken down by 200, 400, and 500 status codes.
  • Usage metrics: Show the total number of tokens and the total spend for the agent over the specified time period.