Challenges in testing ChatBots
This is the second article on ChatBot Testing. Here is the first article which introduces the chatbots in general and details out why should we test chatbots. Chatbots are different to other applications in several ways as listed below which makes them challenging to test and measure the quality. Self Learning Systems Chatbots are built using AI and NLP services and keep learning and improving on their own. This makes it highly unpredictable whether a test case has failed due to the defect or if its improvement. One cannot have the traditional style of testing and write test cases with expected output. Remember, the test data used itself can be used by the bot to learn and update its behaviour, the negative testing may have an impact on the bot !! Non-linear input Voice based chatbots use the s...