Getting Started

Finetuning

Finetuning the chatbot

When adding or adjusting instructions, we always recommend testing again. This allows you to check if the chatbot responds as desired. If it does, great! But if not, you need to further refine the instructions and test again until you achieve the desired results. Experiment with different instructions and adjust them based on the results in the Interactive tester. This way, you can optimize the chatbot before activating it.

Where does a wrong answer come from?

If the chatbot gives a wrong answer, it is important to determine why. Perhaps no knowledge has been added to answer the question correctly, so you simply add new instructions. But if you have already added knowledge, you need to adjust it so the chatbot can answer the question correctly next time. In domain knowledge, you can search for words from the question. The same applies to Instructions. If there is nothing there, the knowledge may be in an added URL or document, and you need to adjust something there to get the correct answer.

Watermelon is continuously evolving, and we will soon add a feature where you can see the source of the answer in the Interactive tester.

Traps

A common trap is spending too much time testing. We recommend not endlessly testing but activating the chatbot when you feel about 70-80% of the answers are correct. Then you will see what questions are actually being asked by end-users, and you can adjust the chatbot accordingly.

Another trap is fixating on a wrong answer. It may happen that the chatbot does not immediately provide the desired answer. Don't worry! That doesn't mean you built the chatbot wrong. By adding or adjusting the right instructions, you can ensure that the chatbot provides the correct answer next time.

Tips & tricks

Throughout this guide, you find various tips & tricks for writing instructions. Below is a summary of all these tips & tricks:

1. Be clear and concise: Formulate your instructions in a clear and concise manner so the chatbot can easily understand and follow them.
2. Provide context: Ensure your instructions provide enough context to the chatbot. This helps the chatbot provide the correct answers based on the specific situation. 'Don't tell, but show': Show the chatbot how to handle the fed information.
3. Be specific: Give detailed instructions to the chatbot, especially when it comes to specific tasks or interactions with users.
4. Consider different languages: If your chatbot is multilingual, make sure your instructions are consistent with the user's language. If necessary, set language-specific instructions to ensure the chatbot responds correctly.
5. Test and improve: Experiment with different instructions and regularly test how the chatbot responds. Adjust the instructions based on the feedback and learn from the interactions to improve the performance of the chatbot.
6. Stay up-to-date: Regularly review the instructions and ensure they are up-to-date with the latest information and developments from your company or industry.
7. Be friendly and empathetic: If the chatbot is customer-facing, consider adding instructions that are friendly and empathetic.
8. Use positive language: For example, 'you may' or 'you say A when asked B' instead of 'you may never' or 'you don't answer question B'.
9. Monitor and analyze: Monitor the chatbot's interactions closely and analyze the given answers. Identify patterns, frequently asked questions, and potential areas for improvement. Use these insights to optimize the instructions and the performance of the chatbot.