Instant Retrain & Feedback

Introduction

Instant Retrain and Feedback allow you to improve your AI agent using real conversations.

Instead of waiting for manual retraining cycles, Exei lets you correct responses instantly and capture user feedback directly from conversations. These features help your AI learn faster, reduce errors, and improve accuracy over time.

What Feedback Does

Feedback allows users and internal teams to indicate whether an AI response was helpful.

Feedback is collected in the form of:

• Likes

• Dislikes

Feedback helps identify:

• Incorrect or incomplete responses

• Poorly worded answers

• Areas where training needs improvement

Where Feedback Comes From

Feedback can be given:

• During live conversations

• During Playground testing

All feedback is tied to the exact conversation and response where it was provided.

Where to View Feedback

Feedback is visible in:

• Individual conversation views

• Insights (on supported plans)

This allows teams to review feedback in context and take corrective action.

What Instant Retrain Does

Instant Retrain allows admins to immediately correct an AI response and teach the agent how it should respond in the future.

Instead of editing training data separately, you can fix issues directly from real conversations.

Where Instant Retrain Is Available

Instant Retrain can be used from:

• The Playground

• The Conversations module

It is available when reviewing both live and past conversations.

How Instant Retrain Works

When you use Instant Retrain:

1. You select the AI response that needs correction

2. You provide the correct or improved response

3. The correction is saved as Text training

4. The AI learns instantly and updates its behavior

Future conversations benefit from this correction immediately.

When to Use Instant Retrain

Use Instant Retrain when:

• The AI gives an incorrect answer

• The response is missing important details

• The tone or wording needs improvement

• A fallback response occurs due to missing information

Instant Retrain is the fastest way to fix real-world issues.

Instant Retrain and Fallbacks

Fallbacks are strong signals for retraining.

When a fallback occurs:

• Review the conversation

• Identify missing knowledge or rules

• Use Instant Retrain to add the correct response

Over time, this significantly reduces fallback frequency.

Relationship Between Feedback and Retrain

Feedback helps you identify problems.
Instant Retrain helps you fix them.

A common workflow:

1. User or admin dislikes a response

2. Admin reviews the conversation

3. Instant Retrain is used to correct the response

4. AI improves for future conversations

Together, they create a continuous improvement loop.

Visibility Across Channels

Feedback and retraining apply across all channels:

• Website chat

• Website voice

• Shopify storefront

• VoIP (toll-free inbound calls)

• Playground testing

A retrained response improves behavior everywhere.

Best Practices for Instant Retrain & Feedback

• Review disliked responses regularly

• Retrain using clear, accurate answers

• Avoid overly long or complex retrain responses

• Use real user language where possible

• Track improvements using Insights (if available on your plan)

Consistent retraining leads to better AI performance.

Common Mistakes to Avoid

• Ignoring negative feedback

• Retraining without understanding the context

• Adding contradictory retrain responses

• Overusing retrain instead of improving core training sources

Retraining should complement structured training, not replace it entirely.

How to Test Improvements

After retraining:

1. Open Test AI Agent

2. Ask similar questions again

3. Confirm the AI responds correctly

4. Monitor future conversations for consistency

Testing ensures the retrain worked as expected.

What’s Next?

Once you actively use feedback and retraining, the next step is optimization.

Recommended next guides:

• Insights & Analytics

• Test AI Agent (Playground)