Skip to content

Latest commit

 

History

History

ui-tests

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
data
data
 
 
tests
tests
 
 
README.md
README.md
 
 
package-lock.json
package-lock.json
 
 
package.json
package.json
 
 
playwright.config.js
playwright.config.js
 
 

README.md

Integration Testing

This folder contains the integration tests of the extension.

They are defined using Playwright test runner.

The Playwright configuration is defined in playwright.config.js.

The Nbdime server configuration to use for the integration test is defined in jupyter_server_test_config.py.

The default configuration will produce video for failing tests and an HTML report.

There is a new experimental UI mode that you may fall in love with; see that video.

Run the tests

All commands are assumed to be executed from the root directory

To run the tests, you need to:

  1. Compile the extension:
npm install
npm run build

Check the extension is installed in JupyterLab.

  1. Install test dependencies (needed only once):
cd ./ui-tests
npm install
npx playwright install
cd ..
  1. Execute the Playwright tests:
cd ./ui-tests
npx playwright test

Test results will be shown in the terminal. In case of any test failures, the test report will be opened in your browser at the end of the tests execution; see Playwright documentation for configuring that behavior.

Update the tests snapshots

All commands are assumed to be executed from the root directory

If you are comparing snapshots to validate your tests, you may need to update the reference snapshots stored in the repository. To do that, you need to:

  1. Compile the extension:
npm install
npm run build

Check the extension is installed in JupyterLab.

  1. Install test dependencies (needed only once):
cd ./ui-tests
npm install
npx playwright install
cd ..
  1. Execute the Playwright command:
cd ./ui-tests
npx playwright test -u

Some discrepancy may occurs between the snapshots generated on your computer and the one generated on the CI. To ease updating the snapshots on a PR, you can type please update playwright snapshots to trigger the update by a bot on the CI. Once the bot has computed new snapshots, it will commit them to the PR branch.

Create tests

All commands are assumed to be executed from the root directory

To create tests, the easiest way is to use the code generator tool of playwright:

  1. Compile the extension:
npm install
npm run build

Check the extension is installed in JupyterLab.

  1. Install test dependencies (needed only once):
cd ./ui-tests
npm install
npx playwright install
cd ..
  1. Start the server:
cd ./ui-tests
npm start
  1. Execute the Playwright code generator in another terminal:
cd ./ui-tests
npm playwright codegen localhost:8888

Debug tests

All commands are assumed to be executed from the root directory

To debug tests, a good way is to use the inspector tool of playwright:

  1. Compile the extension:
npm install
npm run build

Check the extension is installed in JupyterLab.

  1. Install test dependencies (needed only once):
cd ./ui-tests
npm install
npx playwright install
cd ..
  1. Execute the Playwright tests in debug mode:
cd ./ui-tests
npx playwright test --debug

Upgrade Playwright and the browsers

To update the web browser versions, you must update the package @playwright/test:

cd ./ui-tests
npm up "@playwright/test"
npx playwright install