Create test_case_dataset_name for Execution Callbacks

Hello,

Can you create a test case level variable for test case data set names? A lot of our test cases cover additional test cases through the data provided by the data sets in a data template.

I do not see this as a variable on the following link.

Execution Callbacks - Subject7 - Confluence (atlassian.net)

0
4 comments
Avatar
Joseph Hamdan

Hi Zach,

We appreciate users requesting enhancements. We are evaluating your request and will provide updates, hopefully soon.

Regards,
Subject7 Team

0
Comment actions Permalink
Avatar
Jonathan Hotz

Hi Zach,

Could you provide some additional details about how you would like to use this variable? For example, are you trying to collect the information about which datasets were used? Will the dataset(s) used then trigger actions on your side? If a test case uses multiple datasets, will a comma-delimited list be sufficient for what you need?

I'm a little confused when you say "our test cases cover additional test cases", so please provide as much information possible about you needs. However, I understand that if there is sensitive or proprietary information you may not want to share it on this forum, in which case you can also email me directly.

Thank you,

Jonathan

0
Comment actions Permalink
Avatar
Zach Schwantes

Here is example of a few test cases. We are running 3 different data sets within the OCLeaseAccounting Data Template with the values of USA, PRT, and IND business units. In this scenario, it would be nice for us to get this variable of what datasets are used and what data template for reporting purposes. We use these variables to send e-mail reminders along with using the APIs Sub7 has configured to gather the data in a Power BI report which allows us to see at ease what has been run and its status. It would be nice to have the datasets as well so we can see what environment it ran in, under what business unit, and so forth.

In the past when I have mentioned our test cases cover additional test cases, I had meant in this scenario where we have used datasets to help manage these various scenarios. In the example I have shown below, we have 3 test cases for Create Lease, one for each designated Business Unit. On our dashboard, at a glance it would be nice to see Create Lease ran for USABU and passed.

Example of Payload Sent:

{"Execution #": "@execution_id", 

"Execution Name": "@execution_set_name", 

"Execution Pass Rate": "@pass_rate",

"Execution Pass on Retry": "@execution_passed_on_retry",

"Failed": "@execution_failed",

"Total": "@execution_total",}

Example of JSON Parsing for the Received Payload:

{
    "type": "object",
    "properties": {
        "Execution #": {
            "type": "string"
        },
        "Execution Name": {
            "type": "string"
        },
        "Execution Pass Rate": {
            "type": "string"
        },
        "Execution Pass on Retry": {
            "type": "string"
        },
        "Failed": {
            "type": "string"
        },
        "Total": {
            "type": "string"
        }
    }
}

Example of Test Case with Datasets:

 

Please let me know if this answers your questions.

0
Comment actions Permalink
Avatar
Zach Schwantes

Are you trying to collect the information about which datasets were used?

Yes

Will the dataset(s) used then trigger actions on your side?

As of right now no, but maybe in the future.

If a test case uses multiple datasets, will a comma-delimited list be sufficient for what you need?

Yes, as long as the data templates are in a separate column.

0
Comment actions Permalink

Please sign in to leave a comment.