Automate Chatbots Testing Using Chatbots: What, Why & How

Chatbots are different than traditional softwares, major challenge for any chatbot is to understand the context of the user’s conversation. While it is straightforward to build your own chatbot using DialogFlow, Microsoft Bot Builder, Botpress etc, but at the same time it is relatively challenging to test them.  With the emerging trend of chatbots in almost every domain where they are becoming the primary interface to customers to interact with your business, it is becoming important to roll them quickly with higher quality.

Building a testing strategy for ChatBot is difficult as it requires to focus on - Conversational Flow, NLP, User Experience, Bot Accuracy, Conversation Steps, identifying user intent and more. Non-deterministic user interactions, no barriers on interacting with the system are a couple of challenges when testing the Chatbots.

Having said that, there are still many use cases that can be automated when testing a Chatbot while we can still concentrate on the QA part, than the “bug” part of the application.

Botium (Selenium for Chatbots) together with TestMyBot libraries come to our rescue where Botium will be interacting with your ChatBot to test them and that’s what automation for ChatBot means.

In this session, you will learn about:

• Challenges of Testing Chatbots

• Testing Strategy for ChatBots

• Botium in a nutshell

• Demo using TestMyBot

  • Running a test by creating it

  • Running pre-recorded / scripted conversations