Evaluation
data class EvaluationJob(val evaluator: Evaluator, val aspirationalAverage: Long, val target: SessionCreationRequest, val scorer: Scorer = Scorer(), val maxTurns: Int = 20, val greetings: List<String> = listOf("Hello", "Hi", "Greetings", "Yo", "Hey"), val setups: List<Setup> = emptyList(), val tasks: List<Task>, val facts: List<String>, val assertions: List<Assertion> = emptyList())
Configuration for evaluating a conversation
Parameters
evaluator
the evaluator
tasks
the tasks to perform
facts
the facts to provide in response to questions
max
the maximum number of turns in the conversation. Safeguard
assertions
assertions to make after the conversation is done
Constructors
Link copied to clipboard
constructor(evaluator: Evaluator, aspirationalAverage: Long, target: SessionCreationRequest, scorer: Scorer = Scorer(), maxTurns: Int = 20, greetings: List<String> = listOf("Hello", "Hi", "Greetings", "Yo", "Hey"), setups: List<Setup> = emptyList(), tasks: List<Task>, facts: List<String>, assertions: List<Assertion> = emptyList())