Test your Bot Performance
The user can now test their bot performance with the help of sample questions (i.e., golden questions) and view the bot performance report, such as accuracy for individual questions, along with the ZBrain answer and correct answer provided by the user. Users have the option to modify the default settings for testing the bot, including parameters like the model type and context length. Once the test report is generated, users can access a detailed report. They can view context, adjust accuracy as needed, revert to previous versions, and delete any of the versions they've created.
The steps to analyze the bot's performance are as follows -
Go to your Apps detail section, and navigate to Configure your Bot tab.
Under the Default Settings, you can update your bot's default settings, such as the type of model, temperature, score threshold, no. of chunks, context max token & response max token.
Select the Save button to save either the default settings or any other modifications to the configuration.
Click on the Test Bot Performance button to test your bot based on the default settings.
In order to test your bot, you need to add the Golden Questions, based on which accuracy report will be calculated and displayed.
To add the golden questions, go to the Test Questions tab, add your test questions and answers based on your knowledge base, and click on the Save button to save details. Next, click on Test Bot Performance to check the bot performance report.
After clicking on Test Bot Performance, it will redirect you to the Bot Performance tab.
Once the report is generated, you can review it to see the accuracy of each question, the default settings in use, and the current version used for the test.
Here, you are able to view the entire answer using the + icon in each row.
Using the View Context button, you can view the context used to generate the ZBrain answer.
Based on user feedback, you can adjust the accuracy by clicking the Edit button located next to the accuracy column for each test question and answer.
If you want to revert to a specific version, simply click on that version and then click the Revert to this Version button. This action will replace the current version with the one you've chosen.
If you want to delete any particular version, you can delete it using the Delete this Version button.
Last updated
