Reporting

Learn how to track and analyze GenerativeAgent’s performance.

Monitoring how GenerativeAgent handles customer interactions is critical for ensuring optimal performance and customer satisfaction.

By tracking key metrics around containment and task completion, you can continuously improve GenerativeAgent’s effectiveness and identify areas for optimization.

You can access GenerativeAgent reporting data in two ways:

Reporting Option	Capabilities	Availability
Out-of-the-box dashboards	Get started quickly with pre-built visualizations Track containment, conversation volume, and task completion Review quality flags, Input Safety blocks, and API health	ASAPP Messaging and Standalone GenerativeAgent
Data feeds	Export raw data for custom analysis Combine GenerativeAgent data with your own analytics Build custom reports in your BI tools Track end-to-end customer journeys across channels	ASAPP Messaging and Standalone GenerativeAgent

Out-of-the-box dashboards

The fastest way to start monitoring GenerativeAgent is through pre-built dashboards.

They are available to all GenerativeAgent deployments, including standalone GenerativeAgent. Sign in to CXP and select Dashboards under the Monitor section of the left-hand menu.

These dashboards show you:

• Containment and conversation volume over time
• Containment and rep opportunity by intent, first task, and last task
• Conversations flagged by quality evaluators
• Input Safety blocks, API health, and Knowledge Base health
• And more. ASAPP adds and updates dashboards regularly, so check back to see what is new.

Dashboards

See what each dashboard contains, how to filter the data, and how often it updates.

Data feeds

For deeper analysis, or to integrate GenerativeAgent metrics with your existing analytics infrastructure, you can pipe GenerativeAgent’s data directly into your system using:

• File Exporter APIs for standalone GenerativeAgent.
• Download from S3 if you are using our Messaging Platform.

This approach is recommended when you need to:

• Combine GenerativeAgent metrics with other customer journey data
• Build custom dashboards in your BI tools
• Perform advanced analytics across channels
• Track end-to-end customer interactions

File Exporter

Use File Exporter to export data from a standalone GenerativeAgent. When exporting data via the File Exporter APIs, you need to specify a feed of generativeagent.

The system generates reports hourly.

Here is an example to get a list of files in the generativeagent feed for a given day:

curl --request POST \
  --url https://api.sandbox.asapp.com/fileexporter/v1/static/listfeedfiles \
  --header 'Content-Type: application/json' \
  --header 'asapp-api-id: <api-key>' \
  --header 'asapp-api-secret: <api-key>' \
  --data '{
  "feed": "generativeagent",
  "version": "1",
  "format": "jsonl",
  "date": "2024-06-27",
  "interval": "hr=23"
}'

Refer to the File Exporter documentation for more details on the listing and retrieving files.

Download from S3

Use S3 to download data exported from the Messaging Platform. When exporting data via S3, you will need to specify the FEED_NAME as generativeagent.

Refer to the Download from S3 guide for more details on the file structure and how to access the data.

GenerativeAgent data schema

Data Reference

See all available metrics and their definitions in our data reference guide