@provartesting/provardx-cli
v1.4.2
Published
A plugin for the Salesforce CLI to orchestrate testing activities and report quality metrics to Provar Manager
Downloads
413
Maintainers
Readme
@provartesting/provardx-cli
What is the ProvarDX CLI?
The Provar DX CLI is a Salesforce CLI plugin for Provar customers who want to automate the execution of tests using Provar Automation, and the reporting of test results and other quality-related metrics to Provar Manager.
Installation, Update, and Uninstall
Install the plugin
$ sf plugins install @provartesting/provardx-cli
Update plugins
$ sf plugins update
Uninstall the plugin
$ sf plugins uninstall @provartesting/provardx-cli
Commands
sf provar config get
sf provar config set
sf provar automation config generate
sf provar automation config load
sf provar automation config validate
sf provar automation config get
sf provar automation config set
sf provar automation setup
sf provar automation project compile
sf provar automation metadata download
sf provar automation test run
sf provar manager connect
sf provar manager display
sf provar manager open
sf provar manager testcase retrieve
sf provar manager test run
sf provar manager test run report
sf provar config get
Retrieve a value from the specified JSON file.
USAGE
$ sf provar config get -f <value> [--json]
FLAGS
-f, --file-path=<value> (required) File path of the JSON file to get the property value from.
GLOBAL FLAGS
--json Format output as json.
DESCRIPTION
Retrieve a value from the specified JSON file.
EXAMPLES
Get the testEnvironment value within the environment property from the config.json file:
$ sf provar config get environment.testEnvironment -f config.json
sf provar config set
Set one or more properties in the specified JSON file.
USAGE
$ sf provar config set [--json]
FLAGS
-f, --file-path=<value> (required) File path of the JSON file to get the property value from.
GLOBAL FLAGS
--json Format output as json.
DESCRIPTION
Set one or more properties in the specified JSON file.
EXAMPLES
Set the environment to “SIT” in the config.json properties file:
$ sf provar config set environment.testEnvironment="SIT" -f config.json
Set the testEnvironment to “SIT” and the webBrowser to “Chrome”, within the environment property.
$ sf provar config set environment.testEnvironment="SIT" environment.webBrowser="Chrome" -f config.json
Set testCases to a list of test case paths in the config.json properties file.
$ sf provar config set testCases='["tests/myTestCase.testcase","tests/testSuite1/myTestCase1.testCase"]' -f config.json
sf provar automation config generate
Generate a boilerplate ProvarDX properties file.
USAGE
$ sf provar automation config generate [--json] [-p <value>]
FLAGS
-p, --properties-file=<value> (required) Path to the properties file that will be generated.
-n, --no-prompt Don't prompt to confirm file should be overwritten.
GLOBAL FLAGS
--json Format output as json.
DESCRIPTION
Generate a boilerplate property file.
EXAMPLES
Generate a basic properties file named provardx-properties.json:
$ sf provar automation config generate -p provardx-properties.json
sf provar automation config load
Validate and load a ProvarDX properties file for later use.
USAGE
$ sf provar automation config load -p <value> [--json]
FLAGS
-p, --properties-file=<value> (required) Path of the properties file to be loaded.
GLOBAL FLAGS
--json Format output as json.
DESCRIPTION
Validate and load a ProvarDX properties file for later use.
EXAMPLES
Validate that the myproperties.json file is valid.
$ sf provar automation config load -p myproperties.json
sf provar automation config validate
Check if the loaded properties file has all the required properties set.
USAGE
$ sf provar automation config validate [--json]
GLOBAL FLAGS
--json Format output as json.
DESCRIPTION
Check if the loaded properties file has all the required properties set.
EXAMPLES
Check if the loaded properties file has all the required properties set:
$ sf provar automation config validate
sf provar automation config get
Retrieve a value from the loaded properties file.
USAGE
$ sf provar automation config get [--json]
GLOBAL FLAGS
--json Format output as json.
DESCRIPTION
Retrieve a value from the loaded properties file.
EXAMPLES
Get the testEnvironment property value from the provardx-properties.json properties file:
$ sf provar automation config get environment.testEnvironment
sf provar automation config set
Set one or more properties in the loaded properties file.
USAGE
$ sf provar automation config set [--json]
GLOBAL FLAGS
--json Format output as json.
DESCRIPTION
Set one or more properties in the loaded properties file.
EXAMPLES
Set the environment to "SIT” in the provardx-properties.json properties file:
$ sf provar automation config set environment.testEnvironment="SIT"
Set the testEnvironment to "SIT” and the webBrowser to "Chrome”, within the environment property:
$ sf provar automation config set environment.testEnvironment="SIT" environment.webBrowser="Chrome"
Set testCases to a list of test case paths in the provardx-properties.json properties file:
$ sf provar automation config set testCases='["tests/myTestCase.testcase","tests/testSuite1/myTestCase1.testCase"]'
sf provar automation setup
Download and install Provar Automation.
USAGE
$ sf provar automation setup [--json] [-v <value>]
FLAGS
-v, --version=<value> Provar Automation build version number.
GLOBAL FLAGS
--json Format output as json.
DESCRIPTION
Download and install Provar Automation.
EXAMPLES
Install version Provar Automation version 2.12.1:
$ sf provar automation setup --version 2.12.1
sf provar automation project compile
Compile PageObject and PageControl Java source files into object code.
USAGE
$ sf provar automation project compile [--json]
GLOBAL FLAGS
--json Format output as json.
DESCRIPTION
Compile PageObject and PageControl Java source files into object code.
EXAMPLES
Compile the project using the configuration set in the properties file:
$ sf provar automation project compile
sf provar automation metadata download
Download any required metadata for a specified Provar Salesforce connection.
USAGE
$ sf provar automation metadata download -c <value> [--json]
FLAGS
-c, --connections=<value> (required) Comma-separated list of names of Provar Salesforce connections to use, as defined in the project.
GLOBAL FLAGS
--json Format output as json.
DESCRIPTION
Download any required metadata for a specified Provar Salesforce connection.
EXAMPLES
Refresh metadata for the MySalesforceConnection connection and store it in folder set in the properties file:
$ sf provar automation metadata download -c MySalesforceConnection
sf provar automation test run
Run the tests as specified in the loaded properties file.
USAGE
$ sf provar automation test run [--json]
GLOBAL FLAGS
--json Format output as json.
DESCRIPTION
Run the tests as specified in the loaded properties file.
EXAMPLES
Run the tests as specified in the loaded properties file:
$ sf provar automation test run
sf provar manager connect
Load the alias or username to be used in subsequent commands to connect to Provar Manager.
USAGE
$ sf provar manager connect -o <value> [--json]
FLAGS
-o, --target-org=<value> (required) Username or alias set in the SF CLI which corresponds to the Provar Manager org.
GLOBAL FLAGS
--json Format output as json.
DESCRIPTION
Load the alias or username to be used in subsequent commands to connect to Provar Manager.
EXAMPLES
Connect to the Provar Manager org that has been previously authorised using the SF CLI, and stored with the alias "ProvarManager":
$ sf provar manager connect -o ProvarManager
sf provar manager display
Display information about the connected Provar Manager org.
USAGE
$ sf provar manager display [--json]
GLOBAL FLAGS
--json Format output as json.
DESCRIPTION
Display information about the connected Provar Manager org.
EXAMPLES
Display information about the connected Provar Manager org:
$ sf provar manager display
sf provar manager open
Open Provar Manager in a browser.
USAGE
$ sf provar manager open [--json]
GLOBAL FLAGS
--json Format output as json.
DESCRIPTION
Open Provar Manager in a browser.
EXAMPLES
Open Provar Manager in a browser:
$ sf provar manager open
sf provar manager testcase retrieve
Retrieve test cases related to the provided user stories (issues) or metadata components, for a given test project.
USAGE
$ sf provar manager testcase retrieve -p <value> -t Apex|ProvarAutomation [--json] [--flags-dir <value>] [-m <value>] [-f <value>] [-i <value>] [-o <value>] [-n <value>] [-l <value>]
FLAGS
-f, --metadata-file=<value> Path to a text file that contains the list of metadata components in source format.
-i, --issues=<value> A comma-separated list of issue IDs, keys, or external IDs.
-l, --test-plan=<value> Test Plan Name. Use if you want to retrieve test instance file paths.
-m, --metadata-components=<value> Semicolon-separated list of metadata components, grouped and prefixed by their metadata type.
-n, --ignore-metadata=<value> Semicolon-separated list of metadata types to ignore from METADATA-COMPONENTS or METADATA-FILE.
-o, --output=<value> Output to a specific file instead of stdout.
-p, --test-project=<value> (required) Test Project key to filter by.
-t, --test-automation-tool=<option> (required) Test Automation tool used to automate the tests.
<options: Apex|ProvarAutomation>
DESCRIPTION
Retrieve test cases related to the provided user stories (issues) or metadata components, for a given test project.
EXAMPLES
Retrieve Apex unit test class ids from the test project "Salesforce Project" with key "SFP" that cover the "NewLeadFormController" and "ExistingLeadFormController" Apex classes:
$ sf provar manager testcase retrieve -p SFP -t Apex -m "ApexClass:NewLeadFormController,ExistingLeadFormController"
Retrieve Provar Automation test case paths from the test project with key "PAT" related to the user story with key "TM-766", in JSON format:
$ sf provar manager testcase retrieve -p PAT -t ProvarAutomation -i "TM-766" --json
Retrieve Provar Automation test case paths from the test project with key "PAT" related to the metadata listed in the file "changes.txt", ignoring changes to custom objects, output to "testcases.txt":
$ sf provar manager testcase retrieve -p PAT -t ProvarAutomation -f changes.txt -n CustomObject -o testcases.txt
Example of a list of metadata changes:
base/main/default/layouts/Release__c-Release Layout.layout-meta.xml
base/main/default/objects/Sprint__c/fields/Sprint_Goal__c.field-meta.xml
sf provar manager test run
Run tests via Provar Manager.
USAGE
$ sf provar manager test run -f <value> [--json] [-y] [-w <value>] [-p <value>] [-o <value>] [-r <value>]
FLAGS
-f, --configuration-file=<value> (required) Path to the configuration file.
-o, --output=<value> Output to a specific file instead of stdout.
-p, --polling-interval=<value> [default: 60] Sets the polling interval in seconds. Default is 60 seconds.
-r, --result-format=<value> [default: human] Format of the test results.
-w, --wait=<value> Sets the polling timeout in minutes.
-y, --synchronous Runs command synchronously; if not specified, the command is run asynchronously.
GLOBAL FLAGS
--json Format output as json.
DESCRIPTION
Run tests via Provar Manager.
EXAMPLES
Run tests as per the config/run-grid-test.json configuration file, wait 10 minutes, poll every 30 seconds, and store the results as JSON in the results.json file:
$ sf provar manager test run -f config/run-grid-tests.json -w 10 -p 30 -r json -o results.json
Run tests as per the config/run-grid-test.json configuration file, wait 20 minutes, and store the results as JUnit in the junit-results.xml file:
$ sf provar manager test run -f config/run-grid-tests.json -w 20 -r junit -o junit-results.xml
sf provar manager test run report
Check or poll for the status of a test run operation.
USAGE
$ sf provar manager test run report -i <value> [--json] [-r <value>] [-o <value>]
FLAGS
-i, --test-run=<value> (required) Test run ID.
-o, --output=<value> Output to a specific file instead of stdout.
-r, --result-format=<value> [default: human] Format of the test results.
GLOBAL FLAGS
--json Format output as json.
DESCRIPTION
Check or poll for the status of a test run operation.
EXAMPLES
Retrieve results for test run 45f70417-df21-4917-a667-abc2ee46dc63 and store the results as JSON in the results.json file
$ sf provar manager test run report -i 45f70417-df21-4917-a667-abc2ee46dc63 -r json -o results.json
Retrieve results for test run 45f70417-df21-4917-a667-abc2ee46dc63 and store the results as JUnit in the junit-results.xml file:
$ sf provar manager test run report -i 45f70417-df21-4917-a667-abc2ee46dc63 -r junit -o junit-results.xml