You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
mitogen/.ci
Alex Willmer 27b4b77bba CI: Upgrade Github jobs from Ubuntu 20.04 to 22.04 & 24.04
Python 2.7 (distro package) and 3.6 (pyenv managed) jobs run on Ubuntu 22.04.
More recent Pythons (distro or Github provided) run on 24.04.

fixes #1256

Ansible tasks that run locally (e.g. `connection: local`, `delegate_to:
localhost`) must now specify their `ansible_python_interpreter`, typically as
`{{ ansible_playbook_python }}`; otherwise the system Python on the controller
(e.g. `/usr/bin/python`) is likely to be used and this is often outside the
version range supported by the Ansible verison under test. If this occurs then
the symptom is often a failure to import a builtin from
`ansible.module_utils.six.moves`, e.g.

```
fatal: [target-centos6-1]: FAILED! => changed=true
  cmd:
  - ansible
  - -m
  - shell
  - -c
  - local
  - -a
  - whoami
  - -i
  - /tmp/mitogen_ci_ansibled3llejls/hosts
  - test-targets
  delta: '0:00:02.076385'
  end: '2025-04-17 17:27:02.561500'
  msg: non-zero return code
  rc: 8
  start: '2025-04-17 17:27:00.485115'
  stderr: |-
  stderr_lines: <omitted>
  stdout: |-
    An exception occurred during task execution. To see the full traceback,
    use -vvv. The error was:     from ansible.module_utils.six.moves import
    map, reduce, shlex_quote
```
7 months ago
..
soak .ci: import soak scripts. 7 years ago
README.md ci: Reduce number of Jobs by parameterizing Mitogen Docker SSH tests 1 year ago
ansible_tests.py CI: Consolidate directory path constants 10 months ago
ci_lib.py CI: Upgrade Github jobs from Ubuntu 20.04 to 22.04 & 24.04 7 months ago
debops_common_install.py ci: Extract container registry location into variables 1 year ago
debops_common_tests.py CI: Don't share temporary directory between test groupings 10 months ago
localhost_ansible_tests.py CI: Consolidate directory path constants 10 months ago
mitogen_py24_install.py ci: Move container registry authentication to an Azure Devops step 1 year ago
mitogen_py24_tests.py ci: Reduce number of Jobs by parameterizing Mitogen Docker SSH tests 1 year ago
mitogen_tests.py ci: Reduce number of Jobs by parameterizing Mitogen Docker SSH tests 1 year ago

README.md

.ci

This directory contains scripts for Continuous Integration platforms. Currently GitHub Actions, but ideally they will also run on any Debian-like machine.

The scripts are usually split into _install and _test steps. The _install step will damage your machine, the _test step will just run the tests the way CI runs them.

There is a common library, ci_lib.py, which just centralized a bunch of random macros and also environment parsing.

Some of the scripts allow you to pass extra flags through to the component under test, e.g. ../../.ci/ansible_tests.py -vvv will run with verbose.

Hack these scripts until your heart is content. There is no pride to be found here, just necessity.

ci_lib.run_batches()

There are some weird looking functions to extract more paralellism from the build. The above function takes lists of strings, arranging for the strings in each list to run in order, but for the lists to run in parallel. That's great for doing setup.py install while pulling a Docker container, for example.

Environment Variables

  • MITOGEN_TEST_DISTRO_SPECS: a space delimited list of distro specs to run the tests against. (e.g. centos6 ubuntu2004-py3*4). Each spec determines the Linux distribution, target Python interepreter & number of instances. Only distributions with a pre-built Linux container image can be used.

    • debian-py3: when generating Ansible inventory file, set ansible_python_interpreter to python3, i.e. run a test where the target interpreter is Python 3.
    • debian*16: generate 16 Docker containers running Debian. Also works with -py3.
  • MITOGEN_TEST_IMAGE_TEMPLATE: specifies the Linux container image name, and hence the container registry used for test targets.