> ## Documentation Index
> Fetch the complete documentation index at: https://www.adaline.ai/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# Prompt evaluators

# PromptEvaluatorsClient

`adaline.prompts.evaluators` manages the evaluators attached to a prompt — LLM-as-a-judge graders, JavaScript checks, text matchers, cost, latency, and response-length guards. Evaluators are always scoped to a prompt; there is no workspace-level evaluators collection.

## Access

```typescript theme={null}
import { Adaline } from '@adaline/client';

const adaline = new Adaline();
const evaluators = adaline.prompts.evaluators; // PromptEvaluatorsClient
```

The class is also exported directly:

```typescript theme={null}
import { PromptEvaluatorsClient } from '@adaline/client';
```

Types from `@adaline/api`:

```typescript theme={null}
import type {
  Evaluator,
  CreateEvaluatorRequest,
  UpdateEvaluatorRequest,
  ListEvaluatorsResponse,
  SortOrder,
} from '@adaline/api';
```

Evaluator types at a glance:

| `type`            | What it measures                      |
| ----------------- | ------------------------------------- |
| `llm-as-a-judge`  | Qualitative grading via an LLM rubric |
| `javascript`      | Arbitrary JS/TS sandboxed check       |
| `text-matcher`    | String contains / regex / equality    |
| `cost`            | Cost threshold per row                |
| `latency`         | Response time threshold               |
| `response-length` | Token / character bounds              |

***

## list()

List evaluators attached to a prompt (paginated).

```typescript theme={null}
list(options: {
  promptId: string;
  limit?: number;
  cursor?: string;
  sort?: SortOrder;
  createdAfter?: number;
  createdBefore?: number;
}): Promise<ListEvaluatorsResponse>
```

### Parameters

| Name            | Type        | Required | Description                               |
| --------------- | ----------- | -------- | ----------------------------------------- |
| `promptId`      | `string`    | Yes      | Prompt whose evaluators should be listed. |
| `limit`         | `number`    | No       | Page size (default 50, max 200).          |
| `cursor`        | `string`    | No       | Cursor from a previous response.          |
| `sort`          | `SortOrder` | No       | `"createdAt:asc"` or `"createdAt:desc"`.  |
| `createdAfter`  | `number`    | No       | Unix milliseconds.                        |
| `createdBefore` | `number`    | No       | Unix milliseconds.                        |

### Returns

`Promise<ListEvaluatorsResponse>` with `{ data: Evaluator[]; pagination: Pagination }`.

### Example

```typescript theme={null}
const { data } = await adaline.prompts.evaluators.list({
  promptId: 'prompt_abc123',
  limit: 50,
});
```

***

## create()

Attach a new evaluator to a prompt.

```typescript theme={null}
create(options: {
  promptId: string;
  evaluator: CreateEvaluatorRequest;
}): Promise<Evaluator>
```

### Parameters

| Name        | Type                                                                   | Required | Description                                                                                    |
| ----------- | ---------------------------------------------------------------------- | -------- | ---------------------------------------------------------------------------------------------- |
| `promptId`  | `string`                                                               | Yes      | Prompt to attach the evaluator to.                                                             |
| `evaluator` | [`CreateEvaluatorRequest`](/docs/reference/api/v2/openapi/create-evaluator) | Yes      | Evaluator definition — `type` (see table above), `title`, and `settings` specific to the type. |

### Returns

`Promise<Evaluator>` — the newly attached evaluator with its server-assigned `id`.

### Example — LLM-as-a-judge

```typescript theme={null}
const evaluator = await adaline.prompts.evaluators.create({
  promptId: 'prompt_abc123',
  evaluator: {
    type: 'llm-as-a-judge',
    title: 'Factuality',
    settings: {
      model: 'gpt-4o',
      rubric: 'Rate 1-5 for factual accuracy against the reference answer.',
      threshold: 4,
    },
  },
});
```

### Example — text matcher

```typescript theme={null}
const evaluator = await adaline.prompts.evaluators.create({
  promptId: 'prompt_abc123',
  evaluator: {
    type: 'text-matcher',
    title: 'Must mention policy link',
    settings: {
      operator: 'contains',
      value: 'https://example.com/policy',
    },
  },
});
```

***

## get()

Fetch a single evaluator by ID.

```typescript theme={null}
get(options: {
  promptId: string;
  evaluatorId: string;
}): Promise<Evaluator>
```

***

## update()

Update an evaluator's title, settings, or threshold.

```typescript theme={null}
update(options: {
  promptId: string;
  evaluatorId: string;
  evaluator: UpdateEvaluatorRequest;
}): Promise<Evaluator>
```

### Example

```typescript theme={null}
await adaline.prompts.evaluators.update({
  promptId: 'prompt_abc123',
  evaluatorId: 'evaluator_abc123',
  evaluator: { settings: { threshold: 3 } },
});
```

***

## delete()

Permanently delete an evaluator. Results from past evaluations that used it are preserved.

```typescript theme={null}
delete(options: {
  promptId: string;
  evaluatorId: string;
}): Promise<void>
```

***

## See Also

* [PromptsClient](/docs/reference/sdk/v2/typescript/classes/prompts) — parent client
* [PromptEvaluationsClient](/docs/reference/sdk/v2/typescript/classes/prompt-evaluations) — run evaluations with these evaluators
* API reference: [List evaluators](/docs/reference/api/v2/openapi/list-evaluators) · [Create](/docs/reference/api/v2/openapi/create-evaluator) · [Update](/docs/reference/api/v2/openapi/update-evaluator) · [Delete](/docs/reference/api/v2/openapi/delete-evaluator)