Evaluation Job
constructor(evaluator: Evaluator, aspirationalAverage: Long, target: SessionCreationRequest, scorer: Scorer = Scorer(), maxTurns: Int = 20, greetings: List<String> = listOf("Hello", "Hi", "Greetings", "Yo", "Hey"), setups: List<Setup> = emptyList(), tasks: List<Task>, facts: List<String>, assertions: List<Assertion> = emptyList())
Parameters
evaluator
the evaluator
tasks
the tasks to perform
facts
the facts to provide in response to questions
max Turns
the maximum number of turns in the conversation. Safeguard
assertions
assertions to make after the conversation is done