Shama Ugale

Senior QA at ThoughtWorks

Shama Ugale is currently the seniour QA at Thoughtworks and have worked as a Solution Consultant with focus on designing need based test Automation solutions – Web, Mobile , Webservices, chatbots, NLP, AI and Data, Agile and setting up a DevOps Culture.

He has over 10 years of industry experience and enjoy speaking at conferences, engaging in knowledge sharing across tech communities as well as mentoring.

Testing Conversational AI

Last year was dominated by smart devices and voice based home assistants. These, unlike other applications, use conversational interfaces to interact. They are built using advanced algorithms ranging from pattern and expression matching engines to natural language processing and AI/Machine learning techniques. These systems constantly learn by themselves, thereby improving the interactions with the user, resulting in the challenge of non-deterministic output in the testing world. To such interfaces, natural language is the input and we humans really love having synonyms and alternative expressions like emojis, GIFs and pictures. Testing in this context therefore moves to clouds of probabilities.

In this session Shama will cover the strategy for testing such interfaces; testing the NLP models and sharing experience on how to automate these tests and add it to the CI/CD build pipelines.
Key learnings include:

  • The how, what and why of a conversational interface?
  • How to strategize testing for such interfaces?
  • How to automate the Conversational AI & place it on CI/CD pipelines?
  • How to measure quality for these conversational Interfaces?