Widgets
A widget is one chart on a custom dashboard. It queries your traces, observations or scores and draws the result. Widgets live in a project-wide library, so one widget can be added to several dashboards.
Create a widget with Add Widget > Create New Widget on a dashboard. The widget library is the Widgets tab next to Dashboards at /project/<projectId>/widgets, where you can open a widget to edit it, or delete it. A widget that is still on a dashboard must be removed from that dashboard before you delete it.
Build a widget
The widget form has a live preview and these settings.
Data selection
| Setting | Options |
|---|---|
| View | Traces, Observations, Scores Numeric or Scores Categorical. |
| Metrics | What to measure, with an aggregation. Aggregations are count, sum, average, min, max, p50, p75, p90, p95 and p99. |
| Filters | Narrow the data, for example to one trace name, environment, model or tag. |
| Breakdown dimension | Optional grouping, for example by model, trace name, user, tag, environment or prompt name. |
Examples of measures per view:
| View | Measures include |
|---|---|
| Traces | count, latency, total tokens, total cost, observation and score counts |
| Observations | count, latency, time to first token, input, output and total tokens, tokens per second, input, output and total cost |
| Scores Numeric | value, count |
| Scores Categorical | count, broken down by value |
Visualization
| Group | Chart types |
|---|---|
| Time Series | Line Chart, Vertical Bar Chart |
| Total Value | Big Number, Horizontal Bar Chart, Vertical Bar Chart, Histogram, Pie Chart, Pivot Table |
- Histogram takes a number of bins from 1 to 100.
- Pivot Table groups by several dimensions with subtotals and a grand total, and can have a default sort column and order.
- Bar, pie and pivot charts take a breakdown row limit from 0 to 1000.
Give the widget a Name and optional Description, then save it.
Scores on widgets
Scores are a view, not a chart type. To chart a quality score, choose Scores Numeric and, for example, average value over time as a Line Chart, or value as a Histogram for its distribution. Choose Scores Categorical to count labels, for example as a Pie Chart.
Dashboard filters
The date range and filters set on a dashboard apply on top of each widget's own filters. See Custom Dashboards.