OptionaljsonOptional JSONPath selector applied to the selected source before it is passed to the evaluator prompt.
Requirements:
$source=metadataSource field that should populate the prompt variable.
Available sources are input, output, metadata, tool_calls, expected_output, and experiment_item_metadata.
Prompt variable name without braces.
Example: for the prompt Judge {{input}} against {{output}}, use input and output.
Connects one prompt variable to data from an observation or experiment.
Manual mappings are used for
llm_as_judgeevaluators.codeevaluators use a fixed runtime mapping managed by Langfuse.How to build a valid mapping list:
GET /evaluators/{id}.variablesarray.{{or}}.jsonPathis optional. Use it only when the selected source is a JSON object and you want to extract one nested field before inserting it into the evaluator prompt.Invalid, missing, or duplicate mappings return a validation error. Malformed JSONPath expressions are also rejected.
Example
Example
Example