Getting Started - OpenFin

Testable allows you to load test your OpenFin application by simulating virtual users launching and using your application.

Because the OpenFin runtime is Chromium, we can use Selenium to run our tests. This guide follows a basic example of running a sample OpenFin application with Webdriver.io on Testable. All source code can be found at openfin-wdio-testable-example (which is adapted from openfin-wdio-testable-example for Testable).

Start by signing up and creating a new test case using the New Test Case button on the dashboard.

Enter the test case name (e.g. OpenFin Demo) and press Next.

Scenario

Select Selenium as the scenario type.

Selenium Scenario

Let's use the following settings:

  1. Bindings: Webdriver.io.
  2. Source: Version Control.
  3. Repository: Add New... use Name = openfin-wdio-testable-example, Url = https://github.com/testable/openfin-wdio-testable-example.git.
  4. Branch: master for Webdriver.io v5, wdio-v4 for Webdriver.io v4.
  5. Webdriver.io Conf File: wdio.conf.js
  6. Runtime Requirements: Windows. OpenFin is built to run on Windows. Testable's test runner is available for Windows. You can also run OpenFin on Linux and our demo repository supports that as well.

General Settings

Check out openfin-wdio-testable-example for more details on the couple of minor adjustments to get your test running on Testable.

The sample test spec even captures a couple of screenshots which will be available as part of the test results.

Next, click on the Configuration tab or press the Next button at the bottom to move to the next step of configuring your test.

Configuration

Now that we have the scenario for our test, we need to configure our load parameters including:

  1. Concurrent Users Per Location: Number of users that will execute in parallel in each region selected. Each user will execute the scenario (i.e. launch OpenFin and perform the test steps).
  2. Test Length: Select Iterations to have each client execute the scenario a set number of times regardless of how long it takes. Choose Duration if you want each client to continue executing the scenario for a set amount of time (in minutes).
  3. Location(s): Choose the location in which to run your test and the test runner source that indicates which test runners to use in that location to run the load test. For OpenFin tests, you will need to select either AWS On Demand - Testable Account or your own AWS account.
  4. Test Runners: For OpenFin Windows tests, only 1 virtual user can run on each EC2 instance. This means you must select Manual under Test Runners, and then set Concurrent Users Per EC2 Instance = 1.

And that's it! Press Start Test and watch the results start to flow in. See the new configuration guide for full details of all configuration options.

For the sake of this example, let's use the following parameters:

Test Configuration

View Results

Once the test starts executing, Testable will distribute the work out to the EC2 instances that Testable spins up.

Test Results

In each region, the Testable runners runs the OpenFin test with 5 virtual users across 5 EC2 instances, each running the test 3 times with a 10 second pause between test iterations.

The results will include screenshots, assertions, traces, performance metrics, logging, breakdown by URL, analysis, comparison against previous test runs, and more.

That's it! Go ahead and try these same steps with your own scripts and feel free to contact us with any questions.