33 Commits (f3720c90e06f0a0f0abc3b5407dc944253ac2e43)

Author	SHA1	Message	Date
Matt Clay	79685a4a2d	Use Python 3.7 to run ansible-test coverage in CI. (#57555) ... Generating XML for coverage reports on Python 3.7 uses far less memory than on Python 2.7. This change should avoid the MemoryError we've been seeing in the nightly coverage runs.	5 years ago
Matt Clay	8fa294a33a	Fix ansible-test coverage stub memory usage. (#53652) ... Split coverage stub files into multiple parts based on the number of lines in files included in each stub. This will keep memory usage down to avoid hanging on Shippable.	6 years ago
Matt Clay	887ab35656	Add support for ansible-test --coverage-check. (#53573)	6 years ago
Matt Clay	9546761407	Fix coverage stub generation in CI.	6 years ago
Matt Clay	a8d829d9c3	Add timeout support to ansible-test. (#53302) ... * Add timeout support to ansible-test. * Fix ansible-test tar filename filter bug. * Update timeouts used on Shippable. * Kill subprocesses when parent process terminates. * Require explicit use of env --show option.	6 years ago
Matt Clay	b2f354ce29	Ignore errors during container cleanup in CI.	6 years ago
Matt Clay	a1fec259c1	Reduce console noise at start of CI session. (#52387) ... * Reduce console noise at start of CI session. * Use allowed shebang.	6 years ago
John R Barker	721a28202e	Revert Debug: Size of coverage file #50380 (#50945)	6 years ago
John R Barker	e6ced9c73f	Debug: Size of coverage file (#50380)	6 years ago
John R Barker	7ec82cdfc9	Revert TEMP HACK: Upload all to codecov (#50279) ... Codecov.io have made some improvements to results processing. Upload all the coverage data to see is codecov can process this. Reverts https://github.com/ansible/ansible/pull/47515	6 years ago
Matt Clay	01833b6fb1	Add `env` command to ansible-test and run in CI. (#50176) ... * Add `env` command to ansible-test and run in CI. * Avoid unnecessary docker pull.	6 years ago
John R Barker	fb2e838a42	TEMP HACK: Avoid overloading codecov.io (#47515) ... Without this patch we are overloading codecov.io by uploading 90+ tests. As a workaround limit uploading to only "Group 1" Will be removed/updated based on codecov.io's support team	6 years ago
Matt Clay	ac492476e5	Bug fixes and cleanup for ansible-test. (#45991) ... * Remove unused imports. * Clean up ConfigParser usage in ansible-test. * Fix bare except statements in ansible-test. * Miscellaneous cleanup from PyCharm inspections. * Enable pylint no-self-use for ansible-test. * Remove obsolete pylint ignores for Python 3.7. * Fix shellcheck issuers under newer shellcheck. * Use newer path for ansible-test. * Fix issues in code-smell tests.	6 years ago
Matt Clay	a96a51b0c6	List quay.io images during Shippable run.	6 years ago
Matt Clay	528de5b82f	Remove unwanted containers at CI job start.	6 years ago
Matt Clay	8a223009ca	Improve handling of integration test aliases. (#38698) ... * Include change classification data in metadata. * Add support for disabled tests. * Add support for unstable tests. * Add support for unsupported tests. * Overhaul integration aliases sanity test. * Update Shippable scripts to handle unstable tests. * Mark unstable Azure tests. * Mark unstable Windows tests. * Mark disabled tests.	7 years ago
Matt Clay	d8673ed72a	Preserve `test/results/data/` in Shippable jobs.	7 years ago
Matt Clay	72237b63e7	Run OS X and FreeBSD CI tests using groups. (#31254) ... * Run OS X and FreeBSD CI tests using groups. * Improve readability of Shippable jobs.	7 years ago
Matt Clay	036ba7eeec	Clean up Shippable tools and update job handling. ... - Tools are now in a tools subdirectory. - Removed obsolete ansible-core-ci tool. - Added run.py for starting new CI runs. - Improved handling of run IDs and URLs. - General code cleanup and docs updates. - Nightly CI runs use complete coverage.	7 years ago
Matt Clay	4daa16f9ce	Add --all and --stub coverage options. ... ci_coverage ci_complete	7 years ago
Matt Clay	6a2a7a2392	Enable codecov.io and add coverage grouping.	7 years ago
Matt Clay	fdcad0f44d	Improve on-demand coverage for Shippable.	7 years ago
Matt Clay	5cb5228cde	Implement on-demand coverage on Shippable. (#24535)	7 years ago
Matt Clay	af5db3e4a9	Revert "Add support for on-demand coverage on Shippable." ... This reverts commit 7b3f0b8870.	7 years ago
Matt Clay	7b3f0b8870	Add support for on-demand coverage on Shippable. ... Triggered by setting the COVERAGE environment var to a non-empty value. Alternatively the string `ci_coverage` can be added to a commit message.	7 years ago
Matt Clay	eec01e2137	Set IO encoding for ansible-test on Shippable.	8 years ago
Matt Clay	8f463fcdd2	Create bot friendly sanity output. (#22381)	8 years ago
Matt Clay	d66ce40ecb	Overhaul `ansible-test sanity` implementation. (#22177) ... - Tests are run to completion instead of stopping on first failure. - Test results are now parsed instead of passing through to the console. - Test results can be saved in junit xml format. - Test results will show up on the Shippable "Tests" result tab. - Added an experimental --lint option for easier integration with other tools. - Code smell tests are now usable with the --list-tests, --test and --skip-test options. - Code split out from executor.py into sanity.py. - Rename download-logs to download.py and add support for test and coverage results. - Miscellaneous improvements.	8 years ago
Matt Clay	ae2d2860f5	Reduce CI output processing code coverage.	8 years ago
Matt Clay	2804d2e848	Split up unit tests on Shippable. (#21931) ... * Add more verbose output to coverage combine. * Run unit tests on CI separately by version.	8 years ago
Matt Clay	422857166b	Remove legacy test alias migration script. (#19629) ... * Require code-smell tests to be files. * Add sanity check for integration test aliases. * Remove migration script for test aliases.	8 years ago
Matt Clay	f9c4158ff8	Remove core/extras dirs from old PRs during CI.	8 years ago
Matt Clay	6bbd92e422	Initial ansible-test implementation. (#18556)	8 years ago