EvaluationJob

constructor(evaluator: Evaluator, aspirationalAverage: Long, target: SessionCreationRequest, scorer: Scorer = Scorer(), maxTurns: Int = 20, greetings: List<String> = listOf("Hello", "Hi", "Greetings", "Yo", "Hey"), setups: List<Setup> = emptyList(), tasks: List<Task>, facts: List<String>, assertions: List<Assertion> = emptyList())

Parameters

evaluator

the evaluator

tasks

the tasks to perform

facts

the facts to provide in response to questions

maxTurns

the maximum number of turns in the conversation. Safeguard

assertions

assertions to make after the conversation is done