353 Commits (725bb4d1739c75a023b4987f79f1739b1a854b95)

Author	SHA1	Message	Date
Matt Clay	771768966f	Flush output from timing script.	6 years ago
Matt Clay	a96a51b0c6	List quay.io images during Shippable run.	6 years ago
Matt Clay	78bd020429	Remove obsolete `test/utils/docker/` directory.	6 years ago
Matt Clay	5461bfbf31	Split sanity tests into 3 groups.	6 years ago
Matt Clay	31a5b874a1	Use runtime instead of datetime for test output.	6 years ago
Matt Clay	4e489d1be8	Update Shippable integration test groups. (#43118) ... * Update Shippable integration test groups. * Update integration test group aliases. * Rebalance AWS and Azure tests with extra group. * Rebalance Windows tests with another group.	6 years ago
Matt Clay	528de5b82f	Remove unwanted containers at CI job start.	6 years ago
Matt Clay	a7d7df1450	Make docs-build sanity test disabled by default.	7 years ago
Matt Clay	ee02d0c120	Remove obsolete test containers. ... - opensuse42.1 - EOL - opensuse42.2 - EOL - ubuntu1204 - EOL - cloudstack-simulator - Migrated to https://github.com/ansible/cloudstack-test-container	7 years ago
Matt Clay	26312b6557	Remove migrated httptester files. ... The httptester has been migrated to: https://github.com/ansible/http-test-container	7 years ago
Matt Clay	27def6c5dc	Remove vcenter-simulator container files. ... The simulator has moved to its own repository: https://github.com/ansible/vcenter-test-container	7 years ago
Matt Clay	8a223009ca	Improve handling of integration test aliases. (#38698) ... * Include change classification data in metadata. * Add support for disabled tests. * Add support for unstable tests. * Add support for unsupported tests. * Overhaul integration aliases sanity test. * Update Shippable scripts to handle unstable tests. * Mark unstable Azure tests. * Mark unstable Windows tests. * Mark disabled tests.	7 years ago
Martin Krizek	cb5e594c13	Fix building from ubuntu1404 Dockerfile	7 years ago
Matt Martz	7c311ad615	Update httptester for httpbin==0.6.2	7 years ago
Matt Clay	11ad559010	Terminate Tower instances after CI ends. (#37265) ... * Remove obsolete Tower support from manage_ci. * Add missing remote settings to cloud tests.	7 years ago
Matt Clay	1d419c737d	Run each Windows version independently in CI.	7 years ago
Matt Martz	e3b6b40d88	Match recent Dockerfile change in httptester playbook file, to extend ca cert lifetime (#35734)	7 years ago
Matt Clay	df3265a811	Extend httptester CA cert lifetime.	7 years ago
John R Barker	9728857e01	Remove network-test-runner (#35556) ... Not been used for a while, replaced by DCI	7 years ago
Matt Clay	7abdab6c9e	Convert ansible-test compile into a sanity test.	7 years ago
Matt Clay	eae23d2dbd	Skip coverage on routine CI runs.	7 years ago
Matt Clay	20824b8f3d	Simplify Windows versions in ansible-test.	7 years ago
Matt Clay	d8673ed72a	Preserve `test/results/data/` in Shippable jobs.	7 years ago
Matt Davis	fbce62795d	enable Windows Server 2016 in CI (#34127) ... * enable Windows Server 2016 in CI * avoid use of Write-Host in config script	7 years ago
Matt Clay	82b5a6a0c9	Fix ansible-test network-integration command. (#34661) ... * Fix ansible-test network platform init filter. * Fix ansible-test network inventory generation. * Remove ios/csr1000v from CI. * Run network tests on Python 2.7 and 3.6.	7 years ago
Matt Clay	d5eef2f8a9	Use `dnf upgrade` in Fedora Dockerfiles.	7 years ago
Matt Clay	61d155b315	Update Fedora Dockerfiles for Python 3 testing.	7 years ago
Matt Clay	b7bf98cd3a	Add fedora27py3 Dockerfile.	7 years ago
Matt Martz	a0ad7ffedf	Update httptester.yml to match Dockerfile (#34508)	7 years ago
Matt Clay	fba178d852	Fix httptester Dockerfile so it builds again.	7 years ago
Matt Clay	1b5c4b72bd	Add Azure provider support to ansible-test and CI. ... ci_complete	7 years ago
Matt Clay	887f227994	Use vyos/1.1.8 in CI.	7 years ago
Matt Clay	2ef438c962	Improve zypper refresh/clean for opensuse images.	7 years ago
Matt Clay	6472723ba8	Add missing ansible-test --remote-terminate support. (#32918) ... * Expand ansible-test --remote-terminate support: - windows-integration - network-integration These commands previously accepted the option, but did not support it. * Terminate windows and network instances when done.	7 years ago
John R Barker	ff7c349f11	Provide details via DCI Env (#32770)	7 years ago
John R Barker	897b31f249	Use same TEST seperater as Shippable (#32758)	7 years ago
John R Barker	4443da2d79	Remove debug (#32736) ... * Make script executable * Tidy up comments	7 years ago
John R Barker	4464635787	Specify branch details, add verbose, disable colour (#32731)	7 years ago
John R Barker	6ce3972f21	Script to generate DCI Coverage (#32550)	7 years ago
Matt Clay	cf1337ca9a	Update ansible-test sanity command. (#31958) ... * Use correct pip version in ansible-test. * Add git fallback for validate-modules. * Run sanity tests in a docker container. * Use correct python version for sanity tests. * Pin docker completion images and add default. * Split pylint execution into multiple contexts. * Only test .py files in use-argspec-type-path test. * Accept identical python interpeter name or binary. * Switch cloud tests to default container. * Remove unused extras from pip install. * Filter out empty pip commands. * Don't force running of pip list. * Support delegation for windows and network tests. * Fix ansible-test python version usage. * Fix ansible-test python version skipping. * Use absolute path for log in ansible-test. * Run vyos_command test on python 3. * Fix windows/network instance persistence. * Add `test/cache` dir to classification. * Enable more python versions for network tests. * Fix cs_router test.	7 years ago
James Tanner	cc287daa3b	Enable tracing and log collection in the vcsim container	7 years ago
Matt Clay	03e18aa52e	Remove cryptography install from CI other test.	7 years ago
Matt Clay	5a91ed0a3b	Switch CI for OS X back to a single job. (#31265) ... * Update Shippable scripts for group/non-group use. * Switch CI for OS X back to a single job.	7 years ago
Matt Clay	72237b63e7	Run OS X and FreeBSD CI tests using groups. (#31254) ... * Run OS X and FreeBSD CI tests using groups. * Improve readability of Shippable jobs.	7 years ago
jctanner	6b6a145027	Add an option to spawn vcsim in esx mode (#31155)	7 years ago
Matt Clay	765718bed2	Run all Windows tests if change detection disabled (#30320) ... * Run all Windows tests if change detection disabled * Run all Windows versions if change detection disabled	7 years ago
Matt Clay	8f4c8844c4	Divide Windows integration tests into 2 groups. (#29029) ... * Divide Windows integration tests into 2 groups. * Support `none` for `--changed-all-target`. * Run 2 separate Windows groups on Shippable. * Only run smoketest and minimal for the group1 job.	7 years ago
Matt Clay	55fb18b85c	Split cloud tests into two CI groups.	7 years ago
Matt Clay	e513ec10da	Add safety check for Shippable "Rebuild with SSH" (#28857) ... * Add safety check for Shippable "Rebuild with SSH". * Run shippable.py for the `other` test.	7 years ago
Matt Clay	1a98962e19	Switch default cloud tests to smoketest.	7 years ago
3onyc	554496c404	[passwordstore] Use builtin _random_password function instead of pwgen (#25843) ... * [password] _random_password -> random_password and moved to util/encrypt.py * [passwordstore] Use built-in random_password instead of pwgen utility * [passwordstore] Add integration tests	7 years ago
Matt Clay	e1cfcdbbc6	Add opensuse42.3 docker image.	7 years ago
Matt Clay	c59e32469f	Add Fedora Python 3 Docker images and fix tests. (#27794) ... * Add new Fedora docker images with Python 3. * Use consistent env var for lookup test. * Fix testing of virtualenv with Python 3. * Fix docker_secret tests on Fedora 26. * Add Python 3 support to Fedora postgresql test. * Add Python 3 support to Fedora mysql tests. * Fix uri test server for Python 3 on Fedora. * Fix iso_extract test for Python 3 on Fedora. * Add Python 3 support for Fedora to openssl tests. * Fix dnf group test for Python 3 on Fedora. * Use force with user deletion in become test.	7 years ago
Matt Clay	2cafb934eb	Update vcenter-simulator base to fedora:26 image. ... This is required because govmomi now requires go 1.8+ to be installed.	7 years ago
Matt Clay	e0e5b4cf64	Optimize running of CI cloud integration tests.	7 years ago
Matt Clay	7931e11437	Use subset of Windows tests for "all" tests. (#26830)	7 years ago
Matt Clay	0b784c65b1	Add sanity import test to ansible-test. (#26730) ... * Add sanity import test to ansible-test. * Run sanity import test on all python versions.	7 years ago
Matt Clay	4a013d6d69	Add RHEL 7.3 to ansible-test and CI. (#26550) ... * Add support for RHEL to ansible-test. * Enable RHEL 7.3 on Shippable.	7 years ago
Matt Clay	7ab4a889ad	Update tox.ini to use ansible-test.	7 years ago
Abhijeet Kasurde	bc4ff8aed9	Modify flask_control for vmware_host test suites (#26175) ... Fix adds additional helper methods to get information about host system from vcsim Signed-off-by: Abhijeet Kasurde <akasurde@redhat.com>	7 years ago
Alexander Braverman	038e090bc1	Add sshpass to Dockerfile for Ansbile integration tests	7 years ago
Toshio Kuratomi	e238ae999b	Cyptography pr 20566 rebase (#25560) ... Make pyca/cryptography the preferred backend for cryptographic needs (mainly vault) falling back to pycrypto pyca/cryptography is already implicitly a dependency in many cases through paramiko (2.0+) as well as the new openssl_publickey module, which requires pyOpenSSL 16.0+. Additionally, pyca/cryptography is an optional dep for better performance with vault already. This commit leverages cryptography's padding, constant time comparisons, and CBC/CTR modes to reduce the amount of code ansible needs to maintain. * Handle wrong password given for VaultAES format * Do not display deprecation warning for cryptography on python-2.6 * Namespace all of the pycrypto imports and always import them Makes unittests better and the code less likely to get stupid mistakes (like using HMAC from cryptogrpahy when the one from pycrypto is needed) * Add back in atfork since we need pycrypto to reinitialize its RNG just in case we're being used with old paramiko * contrib/inventory/gce: Remove spurious require on pycrypto (cherry picked from commit 9e16b9db275263b3ea8d1b124966fdebfc9ab271) * Add cryptography to ec2_win_password module requirements * Fix python3 bug which would pass text strings to a function which requires byte strings. * Attempt to add pycrypto version to setup deps * Change hacking README for dual pycrypto/cryptography * update dependencies for various CI scripts * additional CI dockerfile/script updates * add paramiko to the windows and sanity requirement set This is needed because ansible lists it as a requirement. Previously the missing dep wasn't enforced, but cryptography imports pkg_resources so you can't ignore a requirement any more * Add integration test cases for old vault and for wrong passwords * helper script for manual testing of pycrypto/cryptography * Skip the pycrypto tests so that users without it installed can still run the unittests * Run unittests for vault with both cryptography and pycrypto backend	7 years ago
Abhijeet Kasurde	e7e091d154	Update Flask controller for latest testsuites (#26125) ... Fix adds GPL Licence and few improvements to accommodate new testsuites. Signed-off-by: Abhijeet Kasurde <akasurde@redhat.com>	7 years ago
Matt Clay	4530eea7f8	Docker image updates for integration tests. (#26054) ... * Sort packages to install. * Add python-argparse to centos6 docker image. * Add gcc and python dev lib to docker images. * Add python cryptography to docker images. * Add coverage using pip instead of OS packages. * Update old pip versions in docker images. * Exclude */pyshared/* from coverage reporting.	8 years ago
jctanner	33c61d1cdf	Vcsim container (#25236) ... * Add container files for vcenter simulator * Add controller file to spin up the container during tests	8 years ago
Toshio Kuratomi	3f9d1ab024	Add deps for cryptography to the Docker images (#25580)	8 years ago
Dag Wieers	4307733e6e	Revert the accidental addition of python-lxml (#25432) ... I inadvertedly added python-lxml to the cloudstack-simulator Dockerfile. This PR reverts this specific change. This relates to PR #25324	8 years ago
John R Barker	a6c078c7fb	Add tzdata back (#25433) ... It appears that the base Docker images have removed tzdata. We use tzdata in the debconf tests, so add it back.	8 years ago
Dag Wieers	966b5fd1a0	Add python-lxml to docker images (#25324)	8 years ago
René Moser	d96195131f	cloudstack: test: improve startup time, fix network dependency on run (#24876)	8 years ago
Matt Clay	5babe2daea	Increase python version coverage for tests. (#24762) ... * Improve ansible-test inventory handling. * Fix python 3 re-raise of exception from thread. * Fix python 3 encoding for windows-integration. * Run network tests on multiple python versions. * Run windows tests on multiple python versions. * Support Shippable delegation using --tox. * Skip vyos_command on python 3 tests until fixed. * Add python 3 filtering to local and tox. * Fix tests to support back to back runs. * Temporarily test networking with python 2.7 only. Running the tests back to back causes intermittent test failures which need to be addressed before we can test multiple versions in a single test run.	8 years ago
Matt Clay	036ba7eeec	Clean up Shippable tools and update job handling. ... - Tools are now in a tools subdirectory. - Removed obsolete ansible-core-ci tool. - Added run.py for starting new CI runs. - Improved handling of run IDs and URLs. - General code cleanup and docs updates. - Nightly CI runs use complete coverage.	8 years ago
Matt Clay	6e160650e9	Fix run filter on Shippable downloader.	8 years ago
Matt Clay	4daa16f9ce	Add --all and --stub coverage options. ... ci_coverage ci_complete	8 years ago
Matt Clay	6a2a7a2392	Enable codecov.io and add coverage grouping.	8 years ago
Matt Clay	fdcad0f44d	Improve on-demand coverage for Shippable.	8 years ago
Matt Clay	5cb5228cde	Implement on-demand coverage on Shippable. (#24535)	8 years ago
Matt Clay	af5db3e4a9	Revert "Add support for on-demand coverage on Shippable." ... This reverts commit 7b3f0b8870.	8 years ago
Matt Clay	7b3f0b8870	Add support for on-demand coverage on Shippable. ... Triggered by setting the COVERAGE environment var to a non-empty value. Alternatively the string `ci_coverage` can be added to a commit message.	8 years ago
Matt Clay	fb9efd3c7e	Add `--remote-terminate` option to ansible-test. ... Set `--remote-terminate success` for osx tests.	8 years ago
René Moser	aaf4f04574	automated integration tests for cloudstack (#20552)	8 years ago
Matt Clay	17e07a27b2	Enable cloud tests for use with ansible-test.	8 years ago
John R Barker	ecbf8e933a	Docs how to test (2nd) (#24094) ... * Big testing doc refactor * Combine all the testing documentation in to one place to make it easier to find * Convert everything to RST * Create testing_network guide * Create testing landing page * For each section detail "how to run" and "how to extend testing" * More examples * Lots more detail	8 years ago
Matt Clay	0587d59266	Use Shippable image: drydock/u16pytall:master (#23997) ... * Use Shippable image: drydock/u16pytall:master * Do not install python 3.6 on Shippable.	8 years ago
Matt Clay	e7bb508ad6	Fix var precedence check to support python 3. (#23552) ... * Fix var precedence check to support python 3. * Run CI sanity tests using python 3.5. * Disable pylint non-iterator-returned test to pass on python 3.5.	8 years ago
Matt Clay	eec01e2137	Set IO encoding for ansible-test on Shippable.	8 years ago
Matt Clay	9e1bf1c6f2	Update fedora24 Dockerfile to resolve dnf issue.	8 years ago
Matt Clay	dfe8eca3d2	Update Shippable downloader to support new API. ... - Download run/jobs by URL (old or new). - Download run metadata. - Download job metadata. - Format downloaded JSON. - Handle and save coverage/testresults download errors.	8 years ago
Matt Clay	12f6beaebd	Remove python2.4 package install from other test.	8 years ago
Matt Clay	869449e288	Add test verification to ansible-test. (#22636) ... * Add unified git diff parser. * Add metadata and diff handling. * Add test confidence/verification to bot output.	8 years ago
Matt Clay	89559f78de	Add `--failure-ok` option to `ansible-test`. (#22623)	8 years ago
Matt Clay	a64665ae91	Fix error handling in CI other script.	8 years ago
Matt Clay	3ab344e8bd	Use lint/junit output for compile test. (#22395) ... * Refactor sanity classes for use in all tests. * Use lint/junit output for compile test. * Add missing options for compile test. * Fix early bailout on requirements install.	8 years ago
Matt Clay	9acf551674	Run all `other` tests on Shippable before failing.	8 years ago
Matt Clay	8f463fcdd2	Create bot friendly sanity output. (#22381)	8 years ago
Matt Clay	72c96b3ac3	Fix encoding issue in shippable downloader.	8 years ago
Matt Clay	d66ce40ecb	Overhaul `ansible-test sanity` implementation. (#22177) ... - Tests are run to completion instead of stopping on first failure. - Test results are now parsed instead of passing through to the console. - Test results can be saved in junit xml format. - Test results will show up on the Shippable "Tests" result tab. - Added an experimental --lint option for easier integration with other tools. - Code smell tests are now usable with the --list-tests, --test and --skip-test options. - Code split out from executor.py into sanity.py. - Rename download-logs to download.py and add support for test and coverage results. - Miscellaneous improvements.	8 years ago
Matt Clay	ae2d2860f5	Reduce CI output processing code coverage.	8 years ago
Matt Clay	2804d2e848	Split up unit tests on Shippable. (#21931) ... * Add more verbose output to coverage combine. * Run unit tests on CI separately by version.	8 years ago
Matt Clay	b2bd75a408	Restore 2008-SP2 and 2008-R2_SP1 CI testing.	8 years ago