Share your ideas on how Test Cloud can better help you deliver higher quality apps faster.
Allow the user to create and manage (save, delete, edit, rename) named device sets and to use them when submitting (both via the command line and the web site) to select devices.
This would really speed things up and make life easier. I need to test to a consistent set of new and older devices.
In conjunction with this request, it'd be great to have the ability to get the device set id of an existing test run.
This should also be available via a public API user users can programmatically update their device sets as new devices with certain characteristics are added.
I do wonder if under the covers, the device sets are shared based on device combination. That would make it difficult to fulfill this request.IE: say I create a device set that contains just an Iphone 6S+ on iOS 9.3, I'll get a device set of 1a2b3c, and then someone else creates the exact same set and gets the same ID.
I do like named device sets, although for us they would get out of date, unless I could live update the set for new runs? Also consider specifying test ranges. For our 'full' iOS test what we really want is a set of ranges that capture the queries:
Tablets, not phones, all iOS9 OSes, 1 GB or more Ram, 1.3 Ghz or higher processor. Maybe have a maximum devices or something to prevent unexpected surprises, but that's really how we want to express it, every device in our target support range.
If you wanted to be extra fancy, you could have a 'minimum coverage' subset, that had at least one instance of every factor, but not all of them.
Thank you for the input, everyone. We've added this feature to our near-term roadmap. In addition to a simplistic approach of manually adding devices to a device set from a list of available devices, we will explore the option of defining a dynamic device set based on provided criteria. These options will be available in the UI as well as via the API and CLI.
Please feel free to post any additional thoughts to this issue.
You won't be notified about changes to this idea.