🤖

Chatbot Personality Tester

supportapi-pushdaily cycle

A/B test chatbot system prompt personalities to maximize resolution-without-human rates while maintaining CSAT.

Primary Metric

Resolution Without Human Rate

↑ Higher is better

Experiment Settings

Variants per round: 3

Max rounds: 8

Min sample size: 500

Guard Rails

Experiments auto-pause if these thresholds are breached

Minimum 60% CSAT scoreFloor: 60.0%

Maximum 50% escalation rateFloor: 50.0%