Integrate Test Observability with Test Management

BrowserStack Test Observability currently supports all the below testing frameworks and it is agnostic to the type of tests i.e it will work with functional UI, Unit, and also Integration tests.

Test Observability works for tests that you might be running on browsers/devices hosted locally or on CI or even on any other cloud platform. You need not be an existing BrowserStack Automate / App Automate user to be able to use Test Observability although it works seamlessly if you happen to be an Automate or App Automate user as well.

By integrating your automated test suites for TestNG-Java, WebdriverIO-NodeJS, and Mocha-JavaScript with Test Observability using the BrowserStack SDK, you can gain deeper insights into the performance and quality of your tests.

Get started with Test Observability

You can use BrowserStack Test Observability both when you’re using BrowserStack’s devices and browsers to run your functional end-to-end tests and also if you’re running tests locally on your laptop/CI system or even when you’re using some other cloud provider.

Pre-requisites

You have an account with BrowserStack (even free trial works) and can get the username and access key from Settings.

If you can find username and access key in your account summary section or if you do not have an account yet, sign up for a Free Trial.

Step 1: Go to project repository

Check out your codebase from your repository (example Git).
You can also refer to this example project.

Step 2: Verify your pom.xml entries

Since, you’re an existing browserstack-java-sdk user, you must already have the following entry in your pom.xml file of your project. Please verify that the following exists:

<dependency>
  <groupId>com.browserstack</groupId>
  <artifactId>browserstack-java-sdk</artifactId>
  <version>LATEST</version>
</dependency>

Step 3: Install the latest SDK version

mvn install
# gradle build

Step 4: Verify your browserStack.yml config file

Go To browserstack.yml and make the following changes:

userName: <your browserstack_username goes here>
accessKey: <your browserstack_password goes here>
buildName: <Your static build/job name of CI goes here>
projectName: <Your static project name goes here>
testObservability: true

Step 5: Run your test suite with Test Observability (Local Test)

mvn test -P sample-test

Create and export report via Jenkins

Pre-requisite

1. Jenkins must be installed (this is applicable for other CI/CD tools like Travis CI, Circle CI, GitHub Actions, Bamboo CI).
2. A jenkins pipline for CI/CD process exists.

Step 1: Modify changes in “Jenkinsfile”

1. Go to code base.
2. Open root folder and verify if Jenkinsfile exists.
3. If not create one (for references refer to this link).

Step 2: Push the codebase into Github

Step 3: Go to Jenkins CI/CD tool

Step 4: Go to Project pipeline and click on Build Now

Step 5: Wait for build to complete successfully

Step 6: View test run report in Test Management

1. Select project to which test report was exported
2. Click Test Runs menu link
3. Open the Test Run generated from automation test exectution
4. You will find all the test cases with their respective results here
5. Click on the Test Observability icon in front of Test Run
6. This shall take you to Test Observability platform

Select a test framework to get started

Nodejs

WebdriverIO

Integrate E2E WebdriverIO tests running locally or in any cloud service

Java

TestNG

Integrate unit or E2E TestNG tests running locally or in any cloud service

Javascript

mocha

Integrate unit or E2E mocha tests running locally or in any cloud service