The Substra project is under active development as a closed-source solution. There are ongoing strategic discussions regarding the possibility of open-sourcing newer versions, but no conclusion has been reached yet.
substra-tests
Substra end-to-end (e2e) tests
Prerequisites
This project requires python 3.6+.
Install tests dependencies:
pip3 install --no-cache-dir "git+https://github.com/SubstraFoundation/substra.git@master"
pip3 install -r requirements.txt
The tests suite requires a Substra network up and running to test the remote backend. The network can be started with skaffold (Kubernetes) or manually with helm charts.
The substra project is needed for running the tests. It can be found here
You will need to install it thanks to the pip
binary.
Run the tests
The tests can run both on the remote backend and the local backend. To run the complete test suite on both backends:
make test
Run the tests on the remote backend
The network configuration is described in a yaml file.
A default configuration file is available:
values.yaml
(default): for networks started with KubernetesTo run the tests using the default values.yaml
file:
make test-remote
To run the tests using the provided local-values.yaml
(or a custom config file):
SUBSTRA_TESTS_CONFIG_FILEPATH=local-values.yaml make test-remote
Since tests can take a long time to run, some of them are marked as slow. You can run the "fast" ones with:
make test-minimal
Note that test_compute_plan
from test_execution_compute_plan.py
is not marked as slow even though it takes several seconds to complete. This is because it covers a very basic use case of the platform and is needed to ensure basic features aren't broken.
Run the tests on the local backend
The network configuration is described in a yaml file: local-backend-values.yaml
and cannot be changed.
To run the tests using on the local backend:
make test-local
Some tests are skipped in this mode as they need the remote backend to run.
Test design guidelines
When adding or modifying tests, please follow these guidelines:
values.yaml
)Download Details:
Author: Substra
Official Github: https://github.com/Substra/substra-tests
License: Apache-2.0 license