Ideas & Feature Requests

Share your ideas on how Test Cloud can better help you deliver higher quality apps faster.

Any vs All Devices Test Runs

Today, all tests run on all specified devices. If there are 100 unique tests and I select 5 device models then 500 tests are executed (5x100). I'll call this mode "All" devices. 

Alternatively, if I want to run all tests once but don't care on which devices within a set that is "Any" devices. If there are 100 unique tests and I select 5 device models then 100 tests are executed. If I run this a second time the mix of what tests run on which devices may be different based on the dynamic device availability at the time the tests are executed.

One motivation for this is to run through all of tests as fast as possible (without limiting/waiting for execution on a particular device model).

[Any vs All could be an attribute of a device set or just a matter of how it is specified.

"Any" device could be expanded to "Any N" where N denotes how many instances of the tests execute. The above example is "Any 1"; "Any 2" can be used to cause each test to execute twice (on any two different devices in the device set). ]

 

 

  • Glenn Wilson
  • Oct 13 2015
Device Manufacturer
Device Model Name
Operating System Version
  • Attach files