Commit Graph

157 Commits (cf217178c7845dd372ec9272c40af4eb0bb55c9a)

Author SHA1 Message Date
Matt Clay df1144ced7 Temporarily remove AIX from test matrix.
AIX provisioning is failing.
5 years ago
Yanis Guenane 4fd2dce7f3
Testing: Add support for AIX platform (#65802) 5 years ago
Matt Clay 479845a05c
Expand Shippable test matrix. (#66912)
* Add 2 CI groups for AWS.
* Add 1 CI group for vmware.
* Add 1 CI group for CS.
* Add 1 CI group for posix.
5 years ago
haiyuan_zhang bc37ea96d5 Vmss scale in policy (#66512)
* azure_rm_virtualmachinescaleset: add scale_in_policy and terminate_event_notification

* azure_rm_virtualmachinescalesetinstance: add vmss instance protection policy support
5 years ago
Jordan Borean 6f04f87a13
Deprecate Windows 2008, and 2008 R2 (#66257)
* Deprecate Windows 2008, and 2008 R2

* Remove shippable nodes

* Update windows_faq.rst

Be less specific about 2008/R2 timeframes

* Update setup.ps1

tweak warning text

Co-authored-by: Matt Davis <nitzmahone@users.noreply.github.com>
5 years ago
Sam Doran 2a7623dd5c
Add CentOS 8 to the test matrix (#63649) 5 years ago
Sam Doran 0e5a83a1cc
Add Fedora 31 to the test matrix (#64848)
* Add Fedora 31 to the test matrix

* Remove Fedora 29 from the test matrix
5 years ago
Matt Clay 75646037dc Switch from RHEL 8.0 & 8.1b to 8.1 in CI. 5 years ago
Matt Clay 811127d64d Add RHEL 8.1b to the Shippable test matrix. 5 years ago
Matt Clay e4e5005640
Fix ansible-test coverage path handling. (#61528)
* Fix ansible-test coverage path handling.
* Split CI unit tests into two groups.
5 years ago
Sam Doran e5b24a68cc Add additional group for sanity tests
Put validate-modules in its own group
5 years ago
Jordan Borean 81cb6f366a
Added group 7 to Windows groups - ci_complete (#60240) 5 years ago
Sam Doran b9dafdbade
Move integration tests to using RHEL 8.0 GA (#57772) 5 years ago
Sam Doran c1a23cd763 Add two new Azure groups to prevent timeouts
ci_complete
5 years ago
Sam Doran 7b9d991f78
Add Fedora 30 to test matrix (#57713)
Remove Fedora 28 from test matrix
5 years ago
Sam Doran 84075fe351 Change RHEL8 image name to match changes in ansible-test (#57807)
* Change RHEL8 image name to match changes in ansible-test

Continue to use the beta version of RHEL 8 until we fix tests that are breaking with the GA version.

* Skip ufw integration test on RHEL 8 Beta
6 years ago
Matt Clay 85ae8f5258 Add Hetzner Cloud to CI integration tests. 6 years ago
Matt Clay 9e30300034 Add 6th Windows CI group. 6 years ago
Matt Clay c8f2becb7a Reduce testing of Ubuntu versions.
Removing:

- Ubuntu 14.04 with Python 2.7
- Ubuntu 16.04 with Python 3.5

Keeping:

- Ubuntu 16.04 with Python 2.7
- Ubuntu 18.04 with Python 3.6
6 years ago
Matt Clay 906427caba
Add shippable/posix/group4/ for CI. (#53816) 6 years ago
Matt Clay 9ed9cfb40c Split Windows tests into 5 groups. 6 years ago
Jordan Borean 3635c59b23
OpenSUSE - Add OpenSUSE 15 test containers (#52793)
* OpenSUSE - Add OpenSUSE 15 test containers ci_complete

* Reset matrix back to normal

* Set container version instead of latest

* Remove old Docker completion file
6 years ago
Matt Clay 6a82827ddd Add Python 3.8 to ansible-test and CI. 6 years ago
Matt Clay 9bb1c59686
Add FreeBSD 12.0 to CI. (#52195) 6 years ago
Jordan Borean 0334c20630
Add Windows Server 2019 to Shippable matrix (#51685)
* Test out Server 2019 - ci_complete

* run tests and continue on error - ci_complete

* Add the full matrix back in
6 years ago
Jordan Borean 828df4b336
ansible-test: add Ubuntu 18.04 container (#50790)
* ansible-test: Add Ubuntu 18.04 to Shippable CI nodes

* re-add ubuntu1604/3 to matrix

* forgot to add environment for git kill gpg-agent
6 years ago
Jordan Borean 6a09db5131
ansible-test - swap Fedora 25 for 29 (#49634) 6 years ago
Jordan Borean 5392caee14
ansible-test: change Fedora 24 to 28 (#49586) 6 years ago
Matt Clay a41c0405a7
Add CI platform: rhel/8.0 (#48835) 6 years ago
Matt Clay e6ffc4f89a Remove CI platform: freebsd/10.4 6 years ago
Matt Clay 6745ee7cc8 Switch tests from RHEL 7.5 to 7.6. 6 years ago
Matt Clay 6a51b5ed26 Use 4 nodes for sanity tests in CI. 6 years ago
Matt Clay 2761fe8272 Revert "Use 4 nodes for sanity tests in CI."
This reverts commit b887333029.
6 years ago
Matt Clay b887333029 Use 4 nodes for sanity tests in CI. 6 years ago
Matt Clay 40c9301b27
Use default Shippable container. (#46703) 6 years ago
Jordan Borean a7d372c3ba
go back to FreeBSD 11.1 for tests due to 11.2 stability issues (#45872) 6 years ago
Matt Clay c50d6f1944 Update RHEL and FreeBSD versions used for tests:
- RHEL 7.4 -> 7.5
- FreeBSD 11.1 -> 11.2
6 years ago
Matt Clay debc1e229e Split Azure tests into 8 groups. 6 years ago
Matt Clay 5461bfbf31 Split sanity tests into 3 groups. 6 years ago
Matt Clay 4e489d1be8
Update Shippable integration test groups. (#43118)
* Update Shippable integration test groups.
* Update integration test group aliases.
* Rebalance AWS and Azure tests with extra group.
* Rebalance Windows tests with another group.
6 years ago
Matt Clay 1d0fd49a33 Rebalance cloud tests into 5 groups. 7 years ago
Matt Clay 1d419c737d Run each Windows version independently in CI. 7 years ago
Matt Clay abbc1ed4e6 Remove EOL openSUSE Leap 42.2 from CI. 7 years ago
Matt Clay 7abdab6c9e Convert ansible-test compile into a sanity test. 7 years ago
Matt Clay 6969d492d8 Split Windows tests into 4 groups. 7 years ago
Matt Clay 30093dc4ed
Add Python 3.7 to CI unit test matrix. (#34680)
* Add Python 3.7 to CI unit test matrix.
* Fix `os.errno` reference to be `errno`.
* Update test_aci unit test for Python 3.7.
7 years ago
Matt Clay 6f77a32b13 Run RHEL tests on Azure in 3 groups. 7 years ago
Matt Clay 6988d32da2 Update FreeBSD versions used in CI. 7 years ago
Matt Clay 2ece86fba1 Split up cloud tests to avoid 1 hour CI limit. 7 years ago
Matt Clay cf1337ca9a Update ansible-test sanity command. (#31958)
* Use correct pip version in ansible-test.
* Add git fallback for validate-modules.
* Run sanity tests in a docker container.
* Use correct python version for sanity tests.
* Pin docker completion images and add default.
* Split pylint execution into multiple contexts.
* Only test .py files in use-argspec-type-path test.
* Accept identical python interpeter name or binary.
* Switch cloud tests to default container.
* Remove unused extras from pip install.
* Filter out empty pip commands.
* Don't force running of pip list.
* Support delegation for windows and network tests.
* Fix ansible-test python version usage.
* Fix ansible-test python version skipping.
* Use absolute path for log in ansible-test.
* Run vyos_command test on python 3.
* Fix windows/network instance persistence.
* Add `test/cache` dir to classification.
* Enable more python versions for network tests.
* Fix cs_router test.
7 years ago
Matt Clay b44c38930b Run OS X tests in 3 groups in CI. 7 years ago
Matt Clay 795d19bc78 Revert "Temporarily disable OS X in CI."
This reverts commit b26ae1809c.
7 years ago
Matt Clay b26ae1809c Temporarily disable OS X in CI. 7 years ago
Matt Clay 5a91ed0a3b Switch CI for OS X back to a single job. (#31265)
* Update Shippable scripts for group/non-group use.
* Switch CI for OS X back to a single job.
7 years ago
Matt Clay 72237b63e7 Run OS X and FreeBSD CI tests using groups. (#31254)
* Run OS X and FreeBSD CI tests using groups.
* Improve readability of Shippable jobs.
7 years ago
Matt Clay c00ad0868e Update Windows CI groups from 2 to 3. 7 years ago
Matt Clay 67c7bd8745 Revert "Temporarily disable failing opensuse test jobs."
This reverts commit 31d2eb0828.
7 years ago
Matt Clay 31d2eb0828 Temporarily disable failing opensuse test jobs. 7 years ago
Matt Clay 52eb5032ba Remove unnecessary pre_ci section. 7 years ago
Matt Clay 8f4c8844c4 Divide Windows integration tests into 2 groups. (#29029)
* Divide Windows integration tests into 2 groups.
* Support `none` for `--changed-all-target`.
* Run 2 separate Windows groups on Shippable.
* Only run smoketest and minimal for the group1 job.
7 years ago
Matt Clay 55fb18b85c Split cloud tests into two CI groups. 7 years ago
Ganesh Nalawade 8a6e1531b7 Fix config timeout issue for network modules (#28261)
* Fix config timeout issue for network modules

* Re-enable network test

* Remove unwanted persistent connection timer

* Minor changes in description
7 years ago
Matt Clay d2065cfc0d Temporarily disable network tests. 7 years ago
Matt Clay a8b7f2a7e2 Skip CI for default GitHub patch/revert branches.
The default naming convention for patch branches created in
the GitHub UI when editing files is: {username}-patch-{number}

The default naming convention for revert branches created in
the GitHub UI when reverting a PR is: revert-{pr_number}-{pr_branch_name}

This exclusion will prevent Shippable from running on these
branches until a PR is created.
7 years ago
Matt Clay af9b0ba47b Replace opensuse42.1 with opensuse42.3 in CI. 7 years ago
Matt Clay 9965435b56 Switch back to FreeBSD 11.0 for CI stability. 7 years ago
Matt Clay c2f1dff997 Update remote OS versions tested in CI. 7 years ago
Matt Clay 7931e11437 Use subset of Windows tests for "all" tests. (#26830) 7 years ago
Matt Clay 4a013d6d69 Add RHEL 7.3 to ansible-test and CI. (#26550)
* Add support for RHEL to ansible-test.
* Enable RHEL 7.3 on Shippable.
7 years ago
Matt Clay c4a2deda9d Restore disabled opensuse integration tests. 8 years ago
John R Barker e9e2d67035 Run vyos_command Network tests in Shippable (#24514)
* Run VyOS Network tests in Shippable

* net_command no longer exists

* network/ci

* Disable other network tests

* pep8 fix

* Fix PEP 8 issue.
8 years ago
Matt Clay e56c418d9d Temporarily disable opensuse on Shippable.
The tests are timing out on most CI runs now.
8 years ago
Matt Clay 17e07a27b2 Enable cloud tests for use with ansible-test. 8 years ago
Matt Clay 0587d59266 Use Shippable image: drydock/u16pytall:master (#23997)
* Use Shippable image: drydock/u16pytall:master
* Do not install python 3.6 on Shippable.
8 years ago
Matt Clay 9810429f5b Remove Ubuntu 12.04 from Shippable CI.
Ubuntu 12.04 will be end-of-life before stable-2.4 is released.
8 years ago
Matt Clay 2804d2e848 Split up unit tests on Shippable. (#21931)
* Add more verbose output to coverage combine.
* Run unit tests on CI separately by version.
8 years ago
John R Barker 54e6c9472e Disable Network integration tests (#21273)
This will disable the integration tests for all network platforms &
modules, though the unit tests will still run.

This is needed while a large refactor of the networking code is done.
8 years ago
Matt Clay 4e19adb919 Restore FreeBSD 11.0 tests for CI. 8 years ago
Matt Clay 085865cee8 Temporarily remove FreeBSD 11.0 from CI. 8 years ago
Matt Clay 25caa67d41 Disable pull of updated Shippable docker image.
This should improve reliability of our jobs on Shippable.

The Shippable AMIs should already have the latest docker image,
per Shippable support, so pull doesn't provide any benefit for us.
8 years ago
Matt Clay 82bf37fc53 Add docker image output to Shippable pre_ci. 8 years ago
Matt Clay f534573dcf Enable first network tests on Shippable. (#20208) 8 years ago
Matt Clay a1d30c853c Enable FreeBSD 11.0 for CI. 8 years ago
Robin Roth 9f2d22425b Run tests on opensuse42.2
* add to shippable
* add to completion/readme
* Fixes #18645
8 years ago
Matt Clay 68346b128f Update Fedora tests to use releases 24 and 25. 8 years ago
Matt Clay 6bbd92e422 Initial ansible-test implementation. (#18556) 8 years ago
Toshio Kuratomi c5b4369ae7 Add PRIVILEGED to freebsd because testing of mount keys off of that. (#17803) 8 years ago
Toshio Kuratomi 4452ee86bd Turn mount test back on (#17797)
* Turn mount test back on

* Mount tests need PRIVILEGED so turn that back on

Revert "Revert "Set PRIVILEGED=true for non_destructive tests. (#17733)" (#17738)"

This reverts commit dc0fb1c212.

* Add a needs_privileged tag so that we can skip mount tests on centos6

Some containers timeout on shippable tests when run with privileged.
Unfortunately, some tests require that in order to run.  Tagging those
allows us to skip those tests on the platforms that timeout when we get
ready to run the integration test in shippable.

* Centos6 times out with PRIVILEGED set so remove that (will disable the mount tests on centos6)

* Remove false start
8 years ago
Matt Clay dc0fb1c212 Revert "Set PRIVILEGED=true for non_destructive tests. (#17733)" (#17738)
This reverts commit 1384270ccd.
8 years ago
Matt Clay 1384270ccd Set PRIVILEGED=true for non_destructive tests. (#17733)
This should allow test_mount tests to run on Shippable.
8 years ago
Matt Clay c81fe70fbf Enable more integration tests for python 3. (#17473)
* Enable more integration tests for python 3.
* Split out python 3 integration tests.

Now that we're running more integration tests on python 3, the
tests are taking long enough that they warrant splitting out in
the same way the python 2 tests are split.
8 years ago
Toshio Kuratomi b8a8027b7d We've decided that python-3.5 is the minimum python version (#17270) 8 years ago
Matt Clay 106b12b369 Enable Python 3 CI for Ubuntu 16.04 on Shippable. (#17210) 8 years ago
Matt Clay a695e18615 Add support for OS X CI on Shippable. (#17160) 8 years ago
Matt Clay e2602e9be0 Add FreeBSD to Shippable CI. (#16883) 8 years ago
Matt Clay 380ed053e8 Add Windows integration tests to Shippable. (#16803)
Enable Windows integration tests on Shippable.
8 years ago
Matt Clay e04d552bc6 Run shippable tests in unprivileged containers. (#16481)
* Run shippable tests in unprivileged containers.
9 years ago
Matt Clay 91883fb6b9 Revert "Enable Shippable email notifications. (#16429)"
This reverts commit 5fdcc2f2b0.
9 years ago
Matt Clay 5fdcc2f2b0 Enable Shippable email notifications. (#16429) 9 years ago
Matt Clay ca3aba72fc Add Slack notifications for Shippable. (#16428) 9 years ago