First Steps

Metrics

Build product analytics for AI applications using natural language

Metrics let you track patterns in conversations that would be impossible to capture with traditional event-based analytics. Define what you want to measure using plain text — just like policies — and White Circle handles the rest.

Example Use Cases

Customer Support Bot
  • Was the user’s issue resolved?
  • How often do users express frustration?
  • How often do users ask for help?
AI Coding Assistant
  • How often do users ask for bug fixes vs. new features vs. documentation?
  • Are users asking follow-up questions after code generation?
  • What programming languages are most requested?
Educational Tutor
  • Did the student understand the explanation?
  • How often do users ask for simpler explanations?
  • What topics generate the most questions?
Sales Assistant
  • Did the user express purchase intent?
  • What objections come up most frequently?
  • How often do users ask about pricing?

How Metrics Work

Metrics let you define what you want to measure using plain language — just like policies. Unlike Policies, which enforce behavior, Metrics help you analyze and understand it.

Each Metric has two components:

Included Content

Describe what should count toward this Metric.

Excluded Content

Describe what should be excluded, even if it seems similar.

Example: Feature Request Detection

To track how often users request new features:

  • Included: “User asks for a new capability, requests functionality that doesn’t exist, suggests improvements or additions”
  • Excluded: “Bug reports, questions about existing features, general feedback without specific feature requests”

Metrics vs. Policies

While Metrics and Policies use the same definition approach, they serve different purposes:

AspectPoliciesMetrics
PurposeContent moderationProduct analytics
ProcessingReal-timeAsynchronous
API ResponseImmediate flagged resultResults arrive asynchronously
Use CaseBlock or flag contentUnderstand user behavior

Getting Started

Creating a Metric follows the same workflow as Policies:

  1. Open the Metrics Page

    Go to the Metrics page in your White Circle dashboard.

  2. Create a New Metric

    Click Add Metric and give it a descriptive name like “Feature Requests” or “User Satisfaction”.

  3. Define Your Metric

    Write what should be included and excluded using plain language.

  4. Save and Start Tracking

    Once saved, Metrics are computed for matching content sent through your Environment, including Events submitted to /api/event and /api/events.

Viewing Analytics

On the platform, you can view analytics for each Metric, including trends over time and matched content.


Next Steps

Create a Metric

Open the platform and define your first Metric

Check Events

Learn how to send Events with metadata for richer analytics