Fine-tuning is available on Vogent’s custom Enterprise plan.
How do I know if Fine-Tuning Will Work for My Agent?
If your agent has a certain bar for accuracy, or if mistakes are costly, then fine-tuning can guard you against hallucinations and other unexpected behavior. The majority of our customers with call volumes above 10,000 calls per month (and many with call volumes below that) run fine-tuned agents. Our fine-tuning process varies by customer, but generally involves the following steps:1
Define the Task and Expected Behavior
We’ll work with you to understand the ideal agent behavior, any issues you’re seeing, and the goals of the fine-tuning.
2
Collect Data
We’ll collect data for the fine-tune, and supplement it with data that we generate using internal models.
Recordings and transcripts from real calls are the most effective data for fine-tuning, but we have workarounds if those aren’t available.
3
Train the Model
We’ll train our in-house language models on the generated data.
4
Evaluate and Iterate
We’ll test the model on past (and live) calls to evaluate its performance. We may need to iterate on the data or training parameters to achieve the desired behavior.