Set Default Dataset Based Upon an Individual Test Case
The current process allows you to select a 'default' dataset for the overall Data Template. However, if you have multiple test cases that use the same Data Template, this can be very difficult to maintain constantly having to change the drop down of what dataset needs to be used. Additionally, when you create an execution set, you then need to assign the data set to each individual test case you are running.
I think you should be able to choose a default data set for each test case, so it doesn't somehow get changed in between runs. For example, there have been several instances where I have come back to run test cases on my local machine where I would need to change the datasets back to what it needs to be set. Even though, myself or others on my team never messed with this.
Lastly, I believe these defaults should be synced over when adding test cases to an execution set. This can be a very timely process if you need to click down the entire list of test cases to add datasets, and it has a lot of room for error.
See my prototype below:
Hi Zach,
The first issue, where the selected dataset is changing for a test case, should not occur and sounds like a bug. The idea is as you state - the data template may have a default dataset, but you can change that on a test case and it should stay that way. If you are able to replicate this please reach out to the support team so we can try and track down the cause and fix it.
The second idea is a good one, because it makes sense that if you specify a dataset on a test case for local testing, you will want that same dataset on the execution set. One of the advantages of the execution set is that you can run multiple permutations of datasets on a single test case, but we could at least start with the dataset specified on the test case, and then you can add additional datasets as needed. We're working on improving the UX for execution sets now, and will look at how we can do this when we focus on the execution set creation.
Please sign in to leave a comment.