You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
mitogen/.ci
Alex Willmer 9dce5fe056 tests: Correct DISTRO vs DISTROS usage in CI configurations
The environment variable DISTRO is used to set the target Docker image
used when running the Mitogen unit tests. DISTROS is used for the
Ansible integration tests. VER sets the version of Ansible that is
installed on the controller.

When MODE=Mitogen
- there is no need to set VER, because nothing that installs Ansible
- it does not make sense to set DISTROS.
4 years ago
..
soak .ci: import soak scripts. 6 years ago
README.md .ci: add verbiage for run_batches() too. 6 years ago
ansible_install.py remove ansible from github tag install setup in test config files 4 years ago
ansible_tests.py localhost_ansible tests now pass, adding -vvv to ansible_tests to get more debug info there 4 years ago
azure-pipelines-steps.yml clean up azure python version used 4 years ago
azure-pipelines.yml tests: Correct DISTRO vs DISTROS usage in CI configurations 4 years ago
ci_lib.py tests: Correct DISTRO vs DISTROS usage in CI configurations 4 years ago
debops_common_install.py install all required debops extras for ansible 4 years ago
debops_common_tests.py netaddr needs to be on the Ansible controller, not in target nodes 4 years ago
localhost_ansible_install.py remove ansible from github tag install setup in test config files 4 years ago
localhost_ansible_tests.py don't run sshpass install through run 4 years ago
mitogen_install.py adding interpreter_discovery tests to ci 5 years ago
mitogen_py24_install.py Merge devel/290 @ 79b979ec8544ef5d8620c64068d4a42fabf50415 5 years ago
mitogen_py24_tests.py issue #477: add mitogen_py24 CI test type. 6 years ago
mitogen_tests.py issue #482: ci: add stray process checks to all jobs 5 years ago
prep_azure.py missed a format call var 4 years ago
spawn_reverse_shell.py issue #587: import spawn_reverse_shell.py script. 6 years ago
travis.sh add workaround for TravisCI 4MB log limit job termination 4 years ago

README.md

.ci

This directory contains scripts for Travis CI and (more or less) Azure Pipelines, but they will also happily run on any Debian-like machine.

The scripts are usually split into _install and _test steps. The _install step will damage your machine, the _test step will just run the tests the way CI runs them.

There is a common library, ci_lib.py, which just centralized a bunch of random macros and also environment parsing.

Some of the scripts allow you to pass extra flags through to the component under test, e.g. ../../.ci/ansible_tests.py -vvv will run with verbose.

Hack these scripts until your heart is content. There is no pride to be found here, just necessity.

ci_lib.run_batches()

There are some weird looking functions to extract more paralellism from the build. The above function takes lists of strings, arranging for the strings in each list to run in order, but for the lists to run in parallel. That's great for doing setup.py install while pulling a Docker container, for example.

Environment Variables

  • VER: Ansible version the _install script should install. Default changes over time.
  • TARGET_COUNT: number of targets for debops_ run. Defaults to 2.
  • DISTRO: the mitogen_ tests need a target Docker container distro. This name comes from the Docker Hub mitogen user, i.e. mitogen/$DISTRO-test
  • DISTROS: the ansible_ tests can run against multiple targets simultaneously, which speeds things up. This is a space-separated list of DISTRO names, but additionally, supports:
    • debian-py3: when generating Ansible inventory file, set ansible_python_interpreter to python3, i.e. run a test where the target interpreter is Python 3.
    • debian*16: generate 16 Docker containers running Debian. Also works with -py3.