I'll give a talk about methods we use to make autotests stage independent of number of test cases. How we have learned to make there tests as fast as possible.
To do this, we have built a cluster using mesos and marathon. We learned that Docker containerisation in conjunction with selenium grid coped with this task very well. We built automated verification of the results of tests in a pipeline with home brewed CLI-utilities. And have eliminated conflicts and exscessive queue growth of automated tests using Jenkins Cloud plugin for Docker, Job DSL, Serenity Reports and deployment tools such as Ansible.
Despite the fact that this approach has very high entry difficulty and requires strong technical expertise, it allows you to flexibly adjust the infrastructure and dynamically manage computation resources.