langchain.evaluation.comparison.eval_chain.resolve_pairwise_criteria¶

langchain.evaluation.comparison.eval_chain.resolve_pairwise_criteria(criteria: Optional[Union[Mapping[str, str], Criteria, ConstitutionalPrinciple, str, List[Union[Mapping[str, str], Criteria, ConstitutionalPrinciple]]]]) → dict[source]¶

Resolve the criteria for the pairwise evaluator.

Parameters

  • criteria (Union[CRITERIA_TYPE, str, List[CRITERIA_TYPE]], optional) –

  • use. (The criteria to) –

Returns

The resolved criteria.

Return type

dict