Interface EvaluatorSpec

What the runner needs to know about an evaluator before running it.

interface EvaluatorSpec {
    evaluatorId: string;
    inputs: { id: string; required: boolean }[];
    name: string;
    producesPassed: boolean;
}

Properties

evaluatorId: string

The saved evaluator id, or the evaluator type when run by type.

inputs: { id: string; required: boolean }[]

Inputs the evaluator reads, required ones first.

name: string

producesPassed: boolean

Whether the evaluator answers pass or fail (against a score only).