Skip to main content
A custom metric you author, graded by an LLM against a prompt. Reference it from a collector by its name.
  • name is the metric’s stable slug (its metricId), exactly what a collector references. displayName is the human name shown in the UI.
  • The prompt is the grading criteria and must reference a transcript source (e.g. {{transcript}}) and {{world_context}}. Inline or file://.
  • name, type, and scope are immutable once created (a change is create-new). Editing the prompt, labels, bounds, or options creates a new version.
  • SCALE metrics add scaleMin / scaleMax (+ optional scaleLabels); CLASSIFICATION metrics add options (+ optional maxSelections); scope: PER_PARTICIPANT requires a participantRole.
System metrics (Roark’s built-in metrics) are managed by Roark, not by you: you never define them in config. To collect one, just reference its slug in a collector’s metrics: list, exactly like a custom metric. The same is true for derived metrics (thresholds, formulas, patterns), which are not yet definable in config.
For the full field reference of every kind, see the Config DSL reference schema.