ansible/shippable.yml

language: python

env:
  matrix:
    - T=none

matrix:
  exclude:
    - env: T=none
  include:
    - env: T=sanity/1
    - env: T=sanity/2
    - env: T=sanity/3
    - env: T=sanity/4

    - env: T=units/2.6
    - env: T=units/2.7
    - env: T=units/3.5
    - env: T=units/3.6
    - env: T=units/3.7

    - env: T=windows/2008/1
    - env: T=windows/2008-R2/1
    - env: T=windows/2012/1
    - env: T=windows/2012-R2/1
    - env: T=windows/2016/1

    - env: T=windows/2008/2
    - env: T=windows/2008-R2/2
    - env: T=windows/2012/2
    - env: T=windows/2012-R2/2
    - env: T=windows/2016/2

    - env: T=windows/2008/3
    - env: T=windows/2008-R2/3
    - env: T=windows/2012/3
    - env: T=windows/2012-R2/3
    - env: T=windows/2016/3

    - env: T=windows/2008/4
    - env: T=windows/2008-R2/4
    - env: T=windows/2012/4
    - env: T=windows/2012-R2/4
    - env: T=windows/2016/4

    - env: T=network

    - env: T=osx/10.11/1
    - env: T=rhel/7.6/1
    - env: T=freebsd/11.1/1
    - env: T=linux/centos6/1
    - env: T=linux/centos7/1
    - env: T=linux/fedora28/1
    - env: T=linux/fedora29/1
    - env: T=linux/opensuse42.3/1
    - env: T=linux/ubuntu1404/1
    - env: T=linux/ubuntu1604/1
    - env: T=linux/ubuntu1604py3/1

    - env: T=osx/10.11/2
    - env: T=rhel/7.6/2
    - env: T=freebsd/11.1/2
    - env: T=linux/centos6/2
    - env: T=linux/centos7/2
    - env: T=linux/fedora28/2
    - env: T=linux/fedora29/2
    - env: T=linux/opensuse42.3/2
    - env: T=linux/ubuntu1404/2
    - env: T=linux/ubuntu1604/2
    - env: T=linux/ubuntu1604py3/2

    - env: T=osx/10.11/3
    - env: T=rhel/7.6/3
    - env: T=freebsd/11.1/3
    - env: T=linux/centos6/3
    - env: T=linux/centos7/3
    - env: T=linux/fedora28/3
    - env: T=linux/fedora29/3
    - env: T=linux/opensuse42.3/3
    - env: T=linux/ubuntu1404/3
    - env: T=linux/ubuntu1604/3
    - env: T=linux/ubuntu1604py3/3

    - env: T=aws/2.7/1
    - env: T=aws/3.6/1

    - env: T=aws/2.7/2
    - env: T=aws/3.6/2

    - env: T=azure/2.7/1
    - env: T=azure/3.6/1

    - env: T=azure/2.7/2
    - env: T=azure/3.6/2

    - env: T=azure/2.7/3
    - env: T=azure/3.6/3

    - env: T=azure/2.7/4
    - env: T=azure/3.6/4

    - env: T=vcenter/2.7/1
    - env: T=vcenter/3.6/1

    - env: T=cs/2.7/1
    - env: T=cs/3.6/1
branches:
  except:
    - "*-patch-*"
    - "revert-*-*"

build:
  ci:
    - test/utils/shippable/timing.sh test/utils/shippable/shippable.sh $T

integrations:
  notifications:
    - integrationName: email
      type: email
      on_success: never
      on_failure: never
      on_start: never
      on_pull_request: never
    - integrationName: irc
      type: irc
      recipients:
      - "chat.freenode.net#ansible-notices"
      on_success: change
      on_failure: always
      on_start: never
      on_pull_request: always
    - integrationName: slack
      type: slack
      recipients:
      - "#shippable"
      on_success: change
      on_failure: always
      on_start: never
      on_pull_request: never
Add support for shippable.com CI tests. This will allow offloading sanity tests from Travis to Shippable. 9 years ago			`language: python`

Add full support for Shippable CI. 9 years ago			`env:`
			`matrix:`
Run OS X and FreeBSD CI tests using groups. (#31254) * Run OS X and FreeBSD CI tests using groups. * Improve readability of Shippable jobs. 7 years ago			`- T=none`
Add support for shippable.com CI tests. This will allow offloading sanity tests from Travis to Shippable. 9 years ago
			`matrix:`
Run slowest tests first to minimize run time. 9 years ago			`exclude:`
Run OS X and FreeBSD CI tests using groups. (#31254) * Run OS X and FreeBSD CI tests using groups. * Improve readability of Shippable jobs. 7 years ago			`- env: T=none`
Add support for shippable.com CI tests. This will allow offloading sanity tests from Travis to Shippable. 9 years ago			`include:`
Convert ansible-test compile into a sanity test. 7 years ago			`- env: T=sanity/1`
			`- env: T=sanity/2`
Split sanity tests into 3 groups. (cherry picked from commit 5461bfbf315d1ac24a50df8e643821b1062849bb) 6 years ago			`- env: T=sanity/3`
Use 4 nodes for sanity tests in CI. (cherry picked from commit 6a51b5ed26762ddd2b7b19a14306fa151260b138) 6 years ago			`- env: T=sanity/4`
Run OS X and FreeBSD CI tests using groups. (#31254) * Run OS X and FreeBSD CI tests using groups. * Improve readability of Shippable jobs. 7 years ago
			`- env: T=units/2.6`
			`- env: T=units/2.7`
			`- env: T=units/3.5`
			`- env: T=units/3.6`
Add Python 3.7 to CI unit test matrix. (#34680) * Add Python 3.7 to CI unit test matrix. * Fix `os.errno` reference to be `errno`. * Update test_aci unit test for Python 3.7. 7 years ago			`- env: T=units/3.7`
Run OS X and FreeBSD CI tests using groups. (#31254) * Run OS X and FreeBSD CI tests using groups. * Improve readability of Shippable jobs. 7 years ago
Sync stable-2.5 test infrastructure with devel. (#39544) Sync stable-2.5 test infrastructure with devel: - shippable.yml - test/runner/ - test/sanity/ - test/utils/ - docs/docsite/rst/dev_guide/testing/sanity/ - test/integration/targets/*/aliases 7 years ago			`- env: T=windows/2008/1`
			`- env: T=windows/2008-R2/1`
			`- env: T=windows/2012/1`
			`- env: T=windows/2012-R2/1`
			`- env: T=windows/2016/1`

			`- env: T=windows/2008/2`
			`- env: T=windows/2008-R2/2`
			`- env: T=windows/2012/2`
			`- env: T=windows/2012-R2/2`
			`- env: T=windows/2016/2`

			`- env: T=windows/2008/3`
			`- env: T=windows/2008-R2/3`
			`- env: T=windows/2012/3`
			`- env: T=windows/2012-R2/3`
			`- env: T=windows/2016/3`
Run OS X and FreeBSD CI tests using groups. (#31254) * Run OS X and FreeBSD CI tests using groups. * Improve readability of Shippable jobs. 7 years ago
Update Shippable integration test groups. (#43118) * Update Shippable integration test groups. * Update integration test group aliases. * Rebalance AWS and Azure tests with extra group. * Rebalance Windows tests with another group. (cherry picked from commit 4e489d1be86a2e8eafce935d91ba4fe096c1b15e) 6 years ago			`- env: T=windows/2008/4`
			`- env: T=windows/2008-R2/4`
			`- env: T=windows/2012/4`
			`- env: T=windows/2012-R2/4`
			`- env: T=windows/2016/4`

Run OS X and FreeBSD CI tests using groups. (#31254) * Run OS X and FreeBSD CI tests using groups. * Improve readability of Shippable jobs. 7 years ago			`- env: T=network`

Run OS X tests in 3 groups in CI. 7 years ago			`- env: T=osx/10.11/1`
[stable-2.5] Backport test infra updates and test fixes. (#49204) * Switch tests from RHEL 7.5 to 7.6. (cherry picked from commit 6745ee7cc86c50f79b24fb701d1e4680320a576b) * Remove CI platform: freebsd/10.4 (cherry picked from commit e6ffc4f89a27853e2ce983bc51a982b5a138d1bd) * Add `--raw` option to ansible-test shell command. It is currently supported only with the `--remote` option. This makes it easier to troubleshoot new instances which are not yet supported by the setup scripts used by ansible-test. (cherry picked from commit 0826a008039c45f4fcf2d428c9267decdaeb7de2) * Support skip of platforms by version in tests. (#48826) * Support skip of platforms by version in tests. Previously a remote platform could be skipped completely using the alias: `skip/{platform}` such as `skip/rhel` Now a specific platform version can be skipped using the alias: `skip/{platform}{version}` such as `skip/rhel7.6` This feature is available for platforms specified with the `--remote` option. * Add skip by version to the docs. (cherry picked from commit 8066acc90c13595039812bd8f9eb1fcaaca1a890) * Fix ansible-test skip warning message. (cherry picked from commit 3b705efc93fdf6553c05d139dfb49fe6a5aa6483) * Fix lookup_passwordstore test skipping. (#49178) * Fix lookup_passwordstore test skipping. Skip all of RHEL instead of specific versions. Skip all of CentOS < 7 instead of specific versions. This makes the test more robust when testing newer versions. Tests could be executed on RHEL if EPEL was installed during the test. (cherry picked from commit 704dae2cda5ef3a7303b37de7bb0004f0a2ba581) 6 years ago			`- env: T=rhel/7.6/1`
go back to FreeBSD 11.1 for tests due to 11.2 stability issues (#45872) (#45873) (cherry picked from commit a7d372c3bada00d89b918d241ab41a62e3352872) 6 years ago			`- env: T=freebsd/11.1/1`
Run OS X and FreeBSD CI tests using groups. (#31254) * Run OS X and FreeBSD CI tests using groups. * Improve readability of Shippable jobs. 7 years ago			`- env: T=linux/centos6/1`
			`- env: T=linux/centos7/1`
ansible-test: change Fedora 24, 25 to 28, 29 (#49586) - 2.5 (#49587) * ansible-test: change Fedora 24 to 28 (#49586) (cherry picked from commit 5392caee1445d9663c3f3416aa57b6bcb9fdc630) * fix openssl_certificate tests * ansible-test - swap Fedora 25 for 29 (#49634) (cherry picked from commit 6a09db51311f0557a783ca80c3c1b8e260998a60) * test make sure everything passes * Fix rpm_key test on Fedora 27. (cherry picked from commit 39aa50022a16bc455469bd9e1d5c493f3663ecca) * skip yum tests on Fedora hosts 6 years ago			`- env: T=linux/fedora28/1`
			`- env: T=linux/fedora29/1`
Run OS X and FreeBSD CI tests using groups. (#31254) * Run OS X and FreeBSD CI tests using groups. * Improve readability of Shippable jobs. 7 years ago			`- env: T=linux/opensuse42.3/1`
			`- env: T=linux/ubuntu1404/1`
			`- env: T=linux/ubuntu1604/1`
			`- env: T=linux/ubuntu1604py3/1`

Run OS X tests in 3 groups in CI. 7 years ago			`- env: T=osx/10.11/2`
[stable-2.5] Backport test infra updates and test fixes. (#49204) * Switch tests from RHEL 7.5 to 7.6. (cherry picked from commit 6745ee7cc86c50f79b24fb701d1e4680320a576b) * Remove CI platform: freebsd/10.4 (cherry picked from commit e6ffc4f89a27853e2ce983bc51a982b5a138d1bd) * Add `--raw` option to ansible-test shell command. It is currently supported only with the `--remote` option. This makes it easier to troubleshoot new instances which are not yet supported by the setup scripts used by ansible-test. (cherry picked from commit 0826a008039c45f4fcf2d428c9267decdaeb7de2) * Support skip of platforms by version in tests. (#48826) * Support skip of platforms by version in tests. Previously a remote platform could be skipped completely using the alias: `skip/{platform}` such as `skip/rhel` Now a specific platform version can be skipped using the alias: `skip/{platform}{version}` such as `skip/rhel7.6` This feature is available for platforms specified with the `--remote` option. * Add skip by version to the docs. (cherry picked from commit 8066acc90c13595039812bd8f9eb1fcaaca1a890) * Fix ansible-test skip warning message. (cherry picked from commit 3b705efc93fdf6553c05d139dfb49fe6a5aa6483) * Fix lookup_passwordstore test skipping. (#49178) * Fix lookup_passwordstore test skipping. Skip all of RHEL instead of specific versions. Skip all of CentOS < 7 instead of specific versions. This makes the test more robust when testing newer versions. Tests could be executed on RHEL if EPEL was installed during the test. (cherry picked from commit 704dae2cda5ef3a7303b37de7bb0004f0a2ba581) 6 years ago			`- env: T=rhel/7.6/2`
go back to FreeBSD 11.1 for tests due to 11.2 stability issues (#45872) (#45873) (cherry picked from commit a7d372c3bada00d89b918d241ab41a62e3352872) 6 years ago			`- env: T=freebsd/11.1/2`
Run OS X and FreeBSD CI tests using groups. (#31254) * Run OS X and FreeBSD CI tests using groups. * Improve readability of Shippable jobs. 7 years ago			`- env: T=linux/centos6/2`
			`- env: T=linux/centos7/2`
ansible-test: change Fedora 24, 25 to 28, 29 (#49586) - 2.5 (#49587) * ansible-test: change Fedora 24 to 28 (#49586) (cherry picked from commit 5392caee1445d9663c3f3416aa57b6bcb9fdc630) * fix openssl_certificate tests * ansible-test - swap Fedora 25 for 29 (#49634) (cherry picked from commit 6a09db51311f0557a783ca80c3c1b8e260998a60) * test make sure everything passes * Fix rpm_key test on Fedora 27. (cherry picked from commit 39aa50022a16bc455469bd9e1d5c493f3663ecca) * skip yum tests on Fedora hosts 6 years ago			`- env: T=linux/fedora28/2`
			`- env: T=linux/fedora29/2`
Run OS X and FreeBSD CI tests using groups. (#31254) * Run OS X and FreeBSD CI tests using groups. * Improve readability of Shippable jobs. 7 years ago			`- env: T=linux/opensuse42.3/2`
			`- env: T=linux/ubuntu1404/2`
			`- env: T=linux/ubuntu1604/2`
			`- env: T=linux/ubuntu1604py3/2`

Run OS X tests in 3 groups in CI. 7 years ago			`- env: T=osx/10.11/3`
[stable-2.5] Backport test infra updates and test fixes. (#49204) * Switch tests from RHEL 7.5 to 7.6. (cherry picked from commit 6745ee7cc86c50f79b24fb701d1e4680320a576b) * Remove CI platform: freebsd/10.4 (cherry picked from commit e6ffc4f89a27853e2ce983bc51a982b5a138d1bd) * Add `--raw` option to ansible-test shell command. It is currently supported only with the `--remote` option. This makes it easier to troubleshoot new instances which are not yet supported by the setup scripts used by ansible-test. (cherry picked from commit 0826a008039c45f4fcf2d428c9267decdaeb7de2) * Support skip of platforms by version in tests. (#48826) * Support skip of platforms by version in tests. Previously a remote platform could be skipped completely using the alias: `skip/{platform}` such as `skip/rhel` Now a specific platform version can be skipped using the alias: `skip/{platform}{version}` such as `skip/rhel7.6` This feature is available for platforms specified with the `--remote` option. * Add skip by version to the docs. (cherry picked from commit 8066acc90c13595039812bd8f9eb1fcaaca1a890) * Fix ansible-test skip warning message. (cherry picked from commit 3b705efc93fdf6553c05d139dfb49fe6a5aa6483) * Fix lookup_passwordstore test skipping. (#49178) * Fix lookup_passwordstore test skipping. Skip all of RHEL instead of specific versions. Skip all of CentOS < 7 instead of specific versions. This makes the test more robust when testing newer versions. Tests could be executed on RHEL if EPEL was installed during the test. (cherry picked from commit 704dae2cda5ef3a7303b37de7bb0004f0a2ba581) 6 years ago			`- env: T=rhel/7.6/3`
go back to FreeBSD 11.1 for tests due to 11.2 stability issues (#45872) (#45873) (cherry picked from commit a7d372c3bada00d89b918d241ab41a62e3352872) 6 years ago			`- env: T=freebsd/11.1/3`
Run OS X and FreeBSD CI tests using groups. (#31254) * Run OS X and FreeBSD CI tests using groups. * Improve readability of Shippable jobs. 7 years ago			`- env: T=linux/centos6/3`
			`- env: T=linux/centos7/3`
ansible-test: change Fedora 24, 25 to 28, 29 (#49586) - 2.5 (#49587) * ansible-test: change Fedora 24 to 28 (#49586) (cherry picked from commit 5392caee1445d9663c3f3416aa57b6bcb9fdc630) * fix openssl_certificate tests * ansible-test - swap Fedora 25 for 29 (#49634) (cherry picked from commit 6a09db51311f0557a783ca80c3c1b8e260998a60) * test make sure everything passes * Fix rpm_key test on Fedora 27. (cherry picked from commit 39aa50022a16bc455469bd9e1d5c493f3663ecca) * skip yum tests on Fedora hosts 6 years ago			`- env: T=linux/fedora28/3`
			`- env: T=linux/fedora29/3`
Run OS X and FreeBSD CI tests using groups. (#31254) * Run OS X and FreeBSD CI tests using groups. * Improve readability of Shippable jobs. 7 years ago			`- env: T=linux/opensuse42.3/3`
			`- env: T=linux/ubuntu1404/3`
			`- env: T=linux/ubuntu1604/3`
			`- env: T=linux/ubuntu1604py3/3`

Update Shippable integration test groups. (#43118) * Update Shippable integration test groups. * Update integration test group aliases. * Rebalance AWS and Azure tests with extra group. * Rebalance Windows tests with another group. (cherry picked from commit 4e489d1be86a2e8eafce935d91ba4fe096c1b15e) 6 years ago			`- env: T=aws/2.7/1`
			`- env: T=aws/3.6/1`

			`- env: T=aws/2.7/2`
			`- env: T=aws/3.6/2`

			`- env: T=azure/2.7/1`
			`- env: T=azure/3.6/1`

			`- env: T=azure/2.7/2`
			`- env: T=azure/3.6/2`

			`- env: T=azure/2.7/3`
			`- env: T=azure/3.6/3`

			`- env: T=azure/2.7/4`
			`- env: T=azure/3.6/4`
Run OS X and FreeBSD CI tests using groups. (#31254) * Run OS X and FreeBSD CI tests using groups. * Improve readability of Shippable jobs. 7 years ago
Update Shippable integration test groups. (#43118) * Update Shippable integration test groups. * Update integration test group aliases. * Rebalance AWS and Azure tests with extra group. * Rebalance Windows tests with another group. (cherry picked from commit 4e489d1be86a2e8eafce935d91ba4fe096c1b15e) 6 years ago			`- env: T=vcenter/2.7/1`
			`- env: T=vcenter/3.6/1`
Skip CI for default GitHub patch/revert branches. The default naming convention for patch branches created in the GitHub UI when editing files is: {username}-patch-{number} The default naming convention for revert branches created in the GitHub UI when reverting a PR is: revert-{pr_number}-{pr_branch_name} This exclusion will prevent Shippable from running on these branches until a PR is created. 7 years ago
Update Shippable integration test groups. (#43118) * Update Shippable integration test groups. * Update integration test group aliases. * Rebalance AWS and Azure tests with extra group. * Rebalance Windows tests with another group. (cherry picked from commit 4e489d1be86a2e8eafce935d91ba4fe096c1b15e) 6 years ago			`- env: T=cs/2.7/1`
			`- env: T=cs/3.6/1`
Skip CI for default GitHub patch/revert branches. The default naming convention for patch branches created in the GitHub UI when editing files is: {username}-patch-{number} The default naming convention for revert branches created in the GitHub UI when reverting a PR is: revert-{pr_number}-{pr_branch_name} This exclusion will prevent Shippable from running on these branches until a PR is created. 7 years ago			`branches:`
			`except:`
			`- "-patch-"`
			`- "revert--"`

Add support for shippable.com CI tests. This will allow offloading sanity tests from Travis to Shippable. 9 years ago			`build:`
			`ci:`
Run OS X and FreeBSD CI tests using groups. (#31254) * Run OS X and FreeBSD CI tests using groups. * Improve readability of Shippable jobs. 7 years ago			`- test/utils/shippable/timing.sh test/utils/shippable/shippable.sh $T`
Add support for shippable.com CI tests. This will allow offloading sanity tests from Travis to Shippable. 9 years ago
			`integrations:`
			`notifications:`
			`- integrationName: email`
			`type: email`
Revert "Enable Shippable email notifications. (#16429)" This reverts commit 5fdcc2f2b0d4012daad80409c77142e645468cd6. 9 years ago			`on_success: never`
			`on_failure: never`
Add support for shippable.com CI tests. This will allow offloading sanity tests from Travis to Shippable. 9 years ago			`on_start: never`
			`on_pull_request: never`
Add IRC notifications to shippable.yml. 9 years ago			`- integrationName: irc`
			`type: irc`
			`recipients:`
			`- "chat.freenode.net#ansible-notices"`
			`on_success: change`
			`on_failure: always`
			`on_start: never`
			`on_pull_request: always`
Add Slack notifications for Shippable. (#16428) 9 years ago			`- integrationName: slack`
			`type: slack`
			`recipients:`
			`- "#shippable"`
			`on_success: change`
			`on_failure: always`
			`on_start: never`
			`on_pull_request: never`