Fixed Response

This is an agent that simply always outputs the given fixed response. Good for debugging purposes or as a baseline, e.g. if always predicting a given class.

Basic Examples

Evaluate on the dialogue safety task, always predicting notok

python examples/eval_model.py  -t dialogue_safety -dt valid -m fixed_response -fr __notok__

FixedResponseAgent Options

FixedResponse Arguments

-fr, --fixed-response

Fixed response the agent always returns

Default: I don't know..