Indeed is an American worldwide employment-related search engine for job listings. It is available in over 60 countries and 28 languages.
Company's decision making is solely data-driven. Development teams running a large amount of A/B tests for frontend and backend on regular basis.
All team members including QAs monitor results of these tests using internally build and open-sourced SQL-like tool.
QA Engineers at Indeed takes into consideration large amount of possible combinations of environments and different features in A/B tests.
In my talk, I will share how we analyze real user data and use system monitoring tools to improve quality of test cases.