Scope down e2e tests


Mar 10, 2023

ACCEPTED

Nuraghe team

#e2e #tests

Context

Typically, e2e tests consist in simulating user interactions and making sure all the components of the system under test behave as expected. This involves reducing the number of mocks to the minimum (e.g. - only expensive third party APIs).

In the case of PCUI, this would involve a lot of infrastructure being moved (e.g. creating a cluster) and it would add many dependencies to every test (ParallelCluster, the underlying AWS infrastructure, CloudFormation and so on). It would make the tests very costly, with little to no actual improvement in the confidence that PCUI is working as expected.

Last but not least, PC provides a powerful dry-run feature that allows PCUI to quickly verify most of its features.

Decision

In PCUI, e2e tests will avoid involving costly tests such as an actual cluster creation

Consequences

  • Cheaper, much quicker tests
  • More or less the same level of confidence in the stability of PCUI