Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Managing side-effects of e2e tests #64

Open
Nachasic opened this issue Jun 1, 2021 · 0 comments
Open

Managing side-effects of e2e tests #64

Nachasic opened this issue Jun 1, 2021 · 0 comments
Labels
bug Something isn't working enhancement New feature or request

Comments

@Nachasic
Copy link
Contributor

Nachasic commented Jun 1, 2021

E2E tests perform a lot of operations with the backend: creating, updating and deleting spaces, updating user profiles as well.

When same tests are ran against staging multiple times simultaneously (e.g. in parallel jobs) this creates data races. When testing anything resolved by name, like spaces, these data races can be mitigated by incorporating RNG for names. However, when it comes to testing invitations such strategy wouldn't work.

Scheduling test jobs to run them sequentially doesn't seem feasible, so sandboxing the environment comes to mind as the most sensible solution.

Alternatively, this problem could be solved by allowing the creation of users - each test suite would create it's own set of users, using a naming convention and RNG for emails, effectively limiting the scope of test operations to a set of short-lived user accounts.

@Nachasic Nachasic added bug Something isn't working enhancement New feature or request labels Jun 1, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant