goldenSet (evalRunner/builtinSuites.ts)

diegosouzapw-OmniRoute · src/lib/evals/evalRunner/builtinSuites.ts · typescript · MIT
ai, AI / Agents

Defines reusable golden-set evaluation suites for LLM testing across multiple models

// Source: https://github.com/ai-integr8tor/diegosouzapw-OmniRoute | License: MIT | Copyright 2026 diegosouzapw
// Provided via justclaw.it.com; keep this notice with the code.
/**
 * Eval Runner — built-in golden-set suites (pure data).
 *
 * Static suite definitions extracted verbatim from evalRunner.ts. This module
 * has zero imports and no runtime state, so importing it produces no side
 * effects — the host (evalRunner.ts) registers these suites at module load.
 *
 * @module lib/evals/evalRunner/builtinSuites
 */

// ─── Built-in Golden Set Suite (≥10 cases, multi-model) ────────────────

export const goldenSet = {
  id: "golden-set",
  name: "OmniRoute Golden Set",
  description: "Baseline evaluation cases for LLM response quality across multiple models",
  cases: [
    {
      id: 

... (truncated -- full source via MCP)

See the full source, get the GitHub permalink, and search for more like it.

Get a free API key