From c09b7aa2ea35870c459b0aa667035d43a5e1fa9b Mon Sep 17 00:00:00 2001 From: Mike Han Date: Tue, 27 Feb 2024 15:27:37 -0700 Subject: [PATCH 1/6] Add note about the windows + webkit limitation --- docs/web-apps/automated-testing/playwright.md | 8 ++++++++ 1 file changed, 8 insertions(+) diff --git a/docs/web-apps/automated-testing/playwright.md b/docs/web-apps/automated-testing/playwright.md index 9c59a9cf9c..19ce6495b4 100644 --- a/docs/web-apps/automated-testing/playwright.md +++ b/docs/web-apps/automated-testing/playwright.md @@ -188,3 +188,11 @@ browserType.launch: Chromium distribution 'chrome' is not found at C:\Users\sauc ``` This is because playwright's project specific settings override the global configuration that Sauce Labs provides during runtime. In this case, the location of the browser binary. Make sure that `launchOptions` are not set when running on a Sauce VM. + +### Webkit + Windows + +There is a [known issue](https://github.com/microsoft/playwright/issues/24512) in Playwright that prevents some sites from loading in Webkit on Windows with the error `SSL peer certificate or SSH remote key was not OK`. We recommend running your Playwright + Webkit tests on our Mac VMs. + +:::note +Tests running through Sauce Tunnels are unaffected. +::: From e508378f802847e3fb5baf0c722516ea17a1e7e9 Mon Sep 17 00:00:00 2001 From: Mike Han Date: Tue, 27 Feb 2024 15:50:59 -0700 Subject: [PATCH 2/6] We support cucumber now! --- docs/web-apps/automated-testing/playwright.md | 4 ---- 1 file changed, 4 deletions(-) diff --git a/docs/web-apps/automated-testing/playwright.md b/docs/web-apps/automated-testing/playwright.md index 19ce6495b4..59b6a61c5d 100644 --- a/docs/web-apps/automated-testing/playwright.md +++ b/docs/web-apps/automated-testing/playwright.md @@ -171,10 +171,6 @@ Local websites can still be loaded. Webkit is not working on macOS 11 since Playwright 1.29.0 -### Playwright + Cucumber - -Based on current Playwright test runner implementation, there is no way to run Playwright test runner with Cucumber. - ### Playwright HTML Reporter + Trace Viewer Because of a limitation in how assets are stored on our platform, configuring your tests to use the built-in [HTML reporter](https://playwright.dev/docs/test-reporters#html-reporter) and Playwright's [Trace Viewer](https://playwright.dev/docs/trace-viewer-intro) feature will not work as expected. From cd08917180e199645b22f31c2057e308d8996204 Mon Sep 17 00:00:00 2001 From: Mike Han Date: Wed, 28 Feb 2024 09:37:30 -0700 Subject: [PATCH 3/6] more specific workaround --- docs/web-apps/automated-testing/playwright.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/web-apps/automated-testing/playwright.md b/docs/web-apps/automated-testing/playwright.md index 59b6a61c5d..c89f749d18 100644 --- a/docs/web-apps/automated-testing/playwright.md +++ b/docs/web-apps/automated-testing/playwright.md @@ -187,7 +187,7 @@ This is because playwright's project specific settings override the global confi ### Webkit + Windows -There is a [known issue](https://github.com/microsoft/playwright/issues/24512) in Playwright that prevents some sites from loading in Webkit on Windows with the error `SSL peer certificate or SSH remote key was not OK`. We recommend running your Playwright + Webkit tests on our Mac VMs. +There is a [known issue](https://github.com/microsoft/playwright/issues/24512) in Playwright that prevents some sites from loading in Webkit on Windows with the error `SSL peer certificate or SSH remote key was not OK`. We recommend running your Playwright + Webkit tests on our Mac VMs by setting the [platformName](https://docs.saucelabs.com/web-apps/automated-testing/playwright/yaml/#platformname) to either `macOS 13` or `macOS 12`. :::note Tests running through Sauce Tunnels are unaffected. From d061917f917d288757b064a86894d62c120f30bc Mon Sep 17 00:00:00 2001 From: Mike Han Date: Wed, 28 Feb 2024 10:24:32 -0700 Subject: [PATCH 4/6] Add limitations for playwright+cucumber --- .../cucumberjs-playwright/limitations.md | 28 +++++++++++++++++++ 1 file changed, 28 insertions(+) create mode 100644 docs/web-apps/automated-testing/cucumberjs-playwright/limitations.md diff --git a/docs/web-apps/automated-testing/cucumberjs-playwright/limitations.md b/docs/web-apps/automated-testing/cucumberjs-playwright/limitations.md new file mode 100644 index 0000000000..577b6e6b72 --- /dev/null +++ b/docs/web-apps/automated-testing/cucumberjs-playwright/limitations.md @@ -0,0 +1,28 @@ +--- +id: limitations +title: Limitations for Cucumber.js with Playwright +sidebar_label: Limitations +--- + +import Tabs from '@theme/Tabs'; +import TabItem from '@theme/TabItem'; +import useBaseUrl from '@docusaurus/useBaseUrl'; + +## Limitations + +### Special Characters in Test Names + +We recommend that you avoid the use of special characters when naming your tests. If your test name contains any special characters, your test may not run or its artifacts may not be visible in our platform. + +### Playwright 1.31.1 + Webkit + Sauce-Connect + +When using Sauce-Connect, Webkit browser is unable to load any website that is hosted on the Internet. +Local websites can still be loaded. + +### macOS 11 + Playwright 1.29+ + Webkit + +Webkit is not working on macOS 11 since Playwright 1.29.0 + +### Webkit + Windows + +There is a [known issue](https://github.com/microsoft/playwright/issues/24512) in Playwright that prevents some sites from loading in Webkit on Windows with the error `SSL peer certificate or SSH remote key was not OK`. We recommend running your Playwright + Webkit tests on our Mac VMs by setting the [platformName](https://docs.saucelabs.com/web-apps/automated-testing/playwright/yaml/#platformname) to either `macOS 13` or `macOS 12`. From 6d7f0197629a5b544f25753855dae2524797a141 Mon Sep 17 00:00:00 2001 From: Mike Han Date: Wed, 28 Feb 2024 10:44:07 -0700 Subject: [PATCH 5/6] Add to sidebar --- sidebars.js | 1 + 1 file changed, 1 insertion(+) diff --git a/sidebars.js b/sidebars.js index c7d2b3ed4f..de13af4a53 100644 --- a/sidebars.js +++ b/sidebars.js @@ -1519,6 +1519,7 @@ module.exports = { 'web-apps/automated-testing/cucumberjs-playwright/quickstart', 'web-apps/automated-testing/cucumberjs-playwright/yaml', 'web-apps/automated-testing/cucumberjs-playwright/advanced', + 'web-apps/automated-testing/cucumberjs-playwright/limitations', ], }, { From 652773e606e8f18f3fed13859fe88f7ec78a28df Mon Sep 17 00:00:00 2001 From: Mike Han Date: Wed, 28 Feb 2024 10:59:07 -0700 Subject: [PATCH 6/6] redundant title --- .../automated-testing/cucumberjs-playwright/limitations.md | 2 -- 1 file changed, 2 deletions(-) diff --git a/docs/web-apps/automated-testing/cucumberjs-playwright/limitations.md b/docs/web-apps/automated-testing/cucumberjs-playwright/limitations.md index 577b6e6b72..defdb693f1 100644 --- a/docs/web-apps/automated-testing/cucumberjs-playwright/limitations.md +++ b/docs/web-apps/automated-testing/cucumberjs-playwright/limitations.md @@ -8,8 +8,6 @@ import Tabs from '@theme/Tabs'; import TabItem from '@theme/TabItem'; import useBaseUrl from '@docusaurus/useBaseUrl'; -## Limitations - ### Special Characters in Test Names We recommend that you avoid the use of special characters when naming your tests. If your test name contains any special characters, your test may not run or its artifacts may not be visible in our platform.