One QA and a Smart Camera: How Not to Get Lost in the Clouds

What to do when you are the only E2E QA on a project where hardware, computer vision, machine learning and cloud infrastructure all come together?

In this talk, I will share the story of testing an AI-powered smart camera — a device that uses VLM (Vision Language Models) to describe what is happening in the frame and generate a summary of the day’s events. I will show some funny moments when the model can describe your cat as “a small dog”, explain why, occasionally, you have to be released without any testing. I will also discuss the methods that help to cover the full E2E testing of a complex product alone.

The main insight of the talk is to demonstrate how the role of a “little man” at the end of the production chain turns into a position of a person with a comprehensive view of the product — a person who becomes the link between teams. Join me for a real-life case study, funny examples of VLM errors, and practical tips on testing smart devices!