289 Commits (26d9de6f3e08c9df1f7e8f8a78eac13666252f02)

Author	SHA1	Message	Date
jctanner	33c61d1cdf	Vcsim container (#25236) ... * Add container files for vcenter simulator * Add controller file to spin up the container during tests	8 years ago
Toshio Kuratomi	3f9d1ab024	Add deps for cryptography to the Docker images (#25580)	8 years ago
Dag Wieers	4307733e6e	Revert the accidental addition of python-lxml (#25432) ... I inadvertedly added python-lxml to the cloudstack-simulator Dockerfile. This PR reverts this specific change. This relates to PR #25324	8 years ago
John R Barker	a6c078c7fb	Add tzdata back (#25433) ... It appears that the base Docker images have removed tzdata. We use tzdata in the debconf tests, so add it back.	8 years ago
Dag Wieers	966b5fd1a0	Add python-lxml to docker images (#25324)	8 years ago
René Moser	d96195131f	cloudstack: test: improve startup time, fix network dependency on run (#24876)	8 years ago
Matt Clay	5babe2daea	Increase python version coverage for tests. (#24762) ... * Improve ansible-test inventory handling. * Fix python 3 re-raise of exception from thread. * Fix python 3 encoding for windows-integration. * Run network tests on multiple python versions. * Run windows tests on multiple python versions. * Support Shippable delegation using --tox. * Skip vyos_command on python 3 tests until fixed. * Add python 3 filtering to local and tox. * Fix tests to support back to back runs. * Temporarily test networking with python 2.7 only. Running the tests back to back causes intermittent test failures which need to be addressed before we can test multiple versions in a single test run.	8 years ago
Matt Clay	036ba7eeec	Clean up Shippable tools and update job handling. ... - Tools are now in a tools subdirectory. - Removed obsolete ansible-core-ci tool. - Added run.py for starting new CI runs. - Improved handling of run IDs and URLs. - General code cleanup and docs updates. - Nightly CI runs use complete coverage.	8 years ago
Matt Clay	6e160650e9	Fix run filter on Shippable downloader.	8 years ago
Matt Clay	4daa16f9ce	Add --all and --stub coverage options. ... ci_coverage ci_complete	8 years ago
Matt Clay	6a2a7a2392	Enable codecov.io and add coverage grouping.	8 years ago
Matt Clay	fdcad0f44d	Improve on-demand coverage for Shippable.	8 years ago
Matt Clay	5cb5228cde	Implement on-demand coverage on Shippable. (#24535)	8 years ago
Matt Clay	af5db3e4a9	Revert "Add support for on-demand coverage on Shippable." ... This reverts commit 7b3f0b8870.	8 years ago
Matt Clay	7b3f0b8870	Add support for on-demand coverage on Shippable. ... Triggered by setting the COVERAGE environment var to a non-empty value. Alternatively the string `ci_coverage` can be added to a commit message.	8 years ago
Matt Clay	fb9efd3c7e	Add `--remote-terminate` option to ansible-test. ... Set `--remote-terminate success` for osx tests.	8 years ago
René Moser	aaf4f04574	automated integration tests for cloudstack (#20552)	8 years ago
Matt Clay	17e07a27b2	Enable cloud tests for use with ansible-test.	8 years ago
John R Barker	ecbf8e933a	Docs how to test (2nd) (#24094) ... * Big testing doc refactor * Combine all the testing documentation in to one place to make it easier to find * Convert everything to RST * Create testing_network guide * Create testing landing page * For each section detail "how to run" and "how to extend testing" * More examples * Lots more detail	8 years ago
Matt Clay	0587d59266	Use Shippable image: drydock/u16pytall:master (#23997) ... * Use Shippable image: drydock/u16pytall:master * Do not install python 3.6 on Shippable.	8 years ago
Matt Clay	e7bb508ad6	Fix var precedence check to support python 3. (#23552) ... * Fix var precedence check to support python 3. * Run CI sanity tests using python 3.5. * Disable pylint non-iterator-returned test to pass on python 3.5.	8 years ago
Matt Clay	eec01e2137	Set IO encoding for ansible-test on Shippable.	8 years ago
Matt Clay	9e1bf1c6f2	Update fedora24 Dockerfile to resolve dnf issue.	8 years ago
Matt Clay	dfe8eca3d2	Update Shippable downloader to support new API. ... - Download run/jobs by URL (old or new). - Download run metadata. - Download job metadata. - Format downloaded JSON. - Handle and save coverage/testresults download errors.	8 years ago
Matt Clay	12f6beaebd	Remove python2.4 package install from other test.	8 years ago
Matt Clay	869449e288	Add test verification to ansible-test. (#22636) ... * Add unified git diff parser. * Add metadata and diff handling. * Add test confidence/verification to bot output.	8 years ago
Matt Clay	89559f78de	Add `--failure-ok` option to `ansible-test`. (#22623)	8 years ago
Matt Clay	a64665ae91	Fix error handling in CI other script.	8 years ago
Matt Clay	3ab344e8bd	Use lint/junit output for compile test. (#22395) ... * Refactor sanity classes for use in all tests. * Use lint/junit output for compile test. * Add missing options for compile test. * Fix early bailout on requirements install.	8 years ago
Matt Clay	9acf551674	Run all `other` tests on Shippable before failing.	8 years ago
Matt Clay	8f463fcdd2	Create bot friendly sanity output. (#22381)	8 years ago
Matt Clay	72c96b3ac3	Fix encoding issue in shippable downloader.	8 years ago
Matt Clay	d66ce40ecb	Overhaul `ansible-test sanity` implementation. (#22177) ... - Tests are run to completion instead of stopping on first failure. - Test results are now parsed instead of passing through to the console. - Test results can be saved in junit xml format. - Test results will show up on the Shippable "Tests" result tab. - Added an experimental --lint option for easier integration with other tools. - Code smell tests are now usable with the --list-tests, --test and --skip-test options. - Code split out from executor.py into sanity.py. - Rename download-logs to download.py and add support for test and coverage results. - Miscellaneous improvements.	8 years ago
Matt Clay	ae2d2860f5	Reduce CI output processing code coverage.	8 years ago
Matt Clay	2804d2e848	Split up unit tests on Shippable. (#21931) ... * Add more verbose output to coverage combine. * Run unit tests on CI separately by version.	8 years ago
Matt Clay	b2bd75a408	Restore 2008-SP2 and 2008-R2_SP1 CI testing.	8 years ago
Matt Davis	8527013fbe	Complete rewrite of Windows exec wrapper (#21510) ... * supports pipelining for faster execution * supports become (runas), creates interactive subsession under WinRM batch logon * supports usage of arbitrary module_utils files * modular exec wrapper payload supports easier extension * integrates async wrapper behavior for pipelined/become'd async * module_utils are loaded as true Powershell modules, no more runtime modifications to module code	8 years ago
Matt Clay	f16ee2841b	Add retries to Shippable CI scripts. (#21108) ... * Add retry.py for auto-retry in CI scripts. * Add retries to other and units CI scripts.	8 years ago
Matt Clay	f42fa8879b	Temporarily remove Windows Server 2016 from CI.	8 years ago
Matt Clay	7ed67746cf	Enable Windows 2016 on Shippable. ... Also launch Windows instances on us-east-2 and all others on us-east-1.	8 years ago
Matt Clay	3c51ce56fd	Enable more network support in ansible-test. (#20372) ... * Only start platform instances with tests selected. * Enable ios on Shippable. * Show inventory in explain mode. * Fix indentation of generated network inventory. * Update classification of network module_utils.	8 years ago
Matt Clay	34bca6fb55	Use distro packaged jinja2 instead of pip version.	8 years ago
Matt Clay	203e375449	Fix python 3.6 install.	8 years ago
Matt Clay	f534573dcf	Enable first network tests on Shippable. (#20208)	8 years ago
Matt Clay	cd3fdca540	Switch tests to pytest and ansible-test. ... - Replace nose usage with pytest. - Remove legacy Shippable integration.sh. - Update Makefile to use pytest and ansible-test. - Convert most yield unit tests to pytest parametrize.	8 years ago
Matt Clay	f340b8d14f	Add test support for python 3.6.	8 years ago
Matt Martz	9048cf2758	Changes to the httptester docker image to support new client cert functionality in tests (#19912) ... * Fix Dockerfile * Add changes to docker image to support new client cert functionality * Update repo:tag for docker	8 years ago
Robin Roth	61897fa4b7	Add Dockerfile for opensuse 42.2 (#19805)	8 years ago
Matt Clay	68346b128f	Update Fedora tests to use releases 24 and 25.	8 years ago
Matt Clay	165e7c4e61	Add Dockerfile for fedora24 and fedora25.	8 years ago
Matt Clay	422857166b	Remove legacy test alias migration script. (#19629) ... * Require code-smell tests to be files. * Add sanity check for integration test aliases. * Remove migration script for test aliases.	8 years ago
Matt Clay	f789a20f29	Update log download url.	8 years ago
Toshio Kuratomi	c6b42028c4	Fixes for uri under python3 and local (non-httptester) testing	8 years ago
Matt Clay	dab2bf7e13	Skip test_uri on python 3.	8 years ago
Lumír 'Frenzy' Balhar	84544ee8fd	Fix AST nodes for Python 3 and enable dependent test_uri (#18597) ... * Enable tests on python 3 for uri * Added one more node type to SAFE_NODES into safe_eval module. ast.USub represents unary operators. This is necessary for parsing some unusual but still valid JSON files during testing with Python 3.	8 years ago
Matt Clay	f9c4158ff8	Remove core/extras dirs from old PRs during CI.	8 years ago
Matt Clay	580401c02b	Remove legacy test code.	8 years ago
Matt Clay	4da7a7ce0e	Update coverage exclusions. (#18675) ... * Update coverage exclusions. * Fix logic error in Windows change detection.	8 years ago
Matt Clay	6bbd92e422	Initial ansible-test implementation. (#18556)	8 years ago
John R Barker	2b6d5f9f95	Update network-test-runner.sh (#18672)	8 years ago
John R Barker	366b7c7691	Network test runner - Phase 1 (#18524) ... * Initial commit of network-test-runner * remove gist link * Correctly source hackenv and improve logging * Remove debug * Log location	8 years ago
Matt Martz	b79bf14607	Add playbook and packer file for building httptester (#18107)	8 years ago
Adrien Vergé	527d8307c1	Lint YAML files under test/ ... This commit extends YAML linting by enabling standard rules from the `yamllint` tool [1]. Since syntax errors and key duplicates are already checked since 4d48711, this change only adds detection for cosmetic problems. It also narrows checks to the test/ dir only. The main goal is to prevent future problems to enter the code base without being noticed. While it would be a huge effort to be PEP8 compliant, it is relatively easy to have correct YAML style *now* and prevent future errors by enabling linting. Note: for those (like me) caring about code attribution: use `git blame -w` to ignore whitespace-only changes. Note: I disabled some linting checks (such as indentation), they can be enforced in the future if needed. Similarly, current checks can also be disabled. See the `.yamllint` file. [1]: https://yamllint.readthedocs.io/	8 years ago
Adrien Vergé	0e834fc9e4	Fix cosmetic problems in YAML source ... This change corrects problems reported by the `yamllint` linter. Since key duplication problems were removed in 4d48711, this commit mainly fixes trailing spaces and extra empty lines at beginning/end of files.	8 years ago
Matt Clay	c955688772	Move ansible ad-hoc tests to integration targets.	8 years ago
Matt Clay	912d6ed8cc	Clean up code-smell sanity scripts. (#18407) ... - Replace find ';' with '+' for faster execution. - Replace grep -R with -r to avoid recursive warnings. - Exclude .git and .tox directories from recursive grep. - Improve messaging on failed sanity checks. - Add no-basestring check to Shippable.	8 years ago
Matt Clay	8c270ac75f	Add empty-init code-smell script. (#18406) ... Also removed boilerplate from otherwise empty __init__.py files which should not contain any code (checked by empty-init script).	8 years ago
Matt Clay	ecb7f13119	Update log url for Shippable download-logs script. ... Also improved error handling.	8 years ago
Matt Clay	469c4a106b	Fix and create code-smell test for line endings.	8 years ago
Matt Clay	0d46805979	Clean up shebangs for various files. ... - Remove shebangs from: - ini files - unit tests - module_utils - plugins - module_docs_fragments - non-executable Makefiles - Change non-modules from '/usr/bin/python' to '/usr/bin/env python'. - Change '/bin/env' to '/usr/bin/env'. Also removed main functions from unit tests (since they no longer have a shebang) and fixed a python 3 compatibility issue with update_bundled.py so it does not need to specify a python 2 shebang. A script was added to check for unexpected shebangs in files. This script is run during CI on Shippable.	8 years ago
Matt Clay	71819c0a60	Test reorganization and cleanup. (#18270) ... - Correct directory name in test/README.md - Move code-smell tests to test/sanity/code-smell - Update code-smell.sh to use new script paths - Add test/integration/target-prefixes.win for ansible-test - Move module unit tests to match module directory layout	8 years ago
Toshio Kuratomi	2ac12432ef	Enable the git test on py3	8 years ago
Michael Scherer	2804e64ed5	Enable filters test for python 3	8 years ago
Toshio Kuratomi	67ac375188	pip tests now pass on python3. Enable them.	8 years ago
Michael Scherer	578da9a615	Enable test for lookups on python 3 ... Since passlib algo sometime takes a bytes, and sometime not, depending on a internal variable, we have to convert bnased on it, or it fail with "TypeError: salt must be bytes, not str" (or unicode instead of bytes) However, that's not great to use internal structure for that.	8 years ago
Michael Scherer	e93a8814a3	Let authorized_keys be tested on python 3	8 years ago
Toshio Kuratomi	60acfd1e87	Fix ansible-pull on python3 ... On python3, we can't write bytes directly to sys.stdout.	8 years ago
Toshio Kuratomi	fd14048d46	Thanks to mscherer, these tests are now passing	8 years ago
Toshio Kuratomi	91c1fdec3d	unarchive tests now pass on python3	8 years ago
John R Barker	0ef3ff6a9d	Install dependencies for validate-modules (#18028) ... Currently (pre-repomerge) we aren't running sanity.sh from ansible/ansible, after the merge we will. Therefore I've added the requirements here, rather than in ansible-modules-*/test/utils/shippable	8 years ago
Matt Clay	656b82417e	Fix role path for generate-tests.	8 years ago
Matt Clay	80a5c70ad7	Split integration tests out from Makefile. (#17976)	8 years ago
Toshio Kuratomi	5bc3cb278c	Remove unicode escape (#17866) ... * Remove unicode-escape which is not present on python3 Alternative fix for #17305 * Enable the assemble test on python3 * Fix other problems with assemble on python3	8 years ago
Matt Clay	21857e8618	Disable privileged mode on Shippable. (#17844)	8 years ago
Toshio Kuratomi	4452ee86bd	Turn mount test back on (#17797) ... * Turn mount test back on * Mount tests need PRIVILEGED so turn that back on Revert "Revert "Set PRIVILEGED=true for non_destructive tests. (#17733)" (#17738)" This reverts commit dc0fb1c212. * Add a needs_privileged tag so that we can skip mount tests on centos6 Some containers timeout on shippable tests when run with privileged. Unfortunately, some tests require that in order to run. Tagging those allows us to skip those tests on the platforms that timeout when we get ready to run the integration test in shippable. * Centos6 times out with PRIVILEGED set so remove that (will disable the mount tests on centos6) * Remove false start	8 years ago
Matt Clay	a265d2d77d	Run test_template tests on OS X. (#17791)	8 years ago
Matt Clay	0dc3db9e75	Enable unarchive tests for OS X and FreeBSD. (#17789)	8 years ago
Matt Clay	d05df5fc61	Disable expect continue in ansible-core-ci. (#17737) ... This will allow use of larger SSH keys.	8 years ago
Matt Clay	2e0bec293c	Improve error handling for ansible-core-ci. (#17734)	8 years ago
Matt Clay	cf4d436e07	Remove run_tests.sh and update docs. (#17719) ... Removed the obsolete test/utils/run_tests.sh script in favor of using the newer test/utils/shippable/integration.sh instead.	8 years ago
Matt Clay	50b0d011fe	Update integration.sh to copy source by default. (#17717) ... Also add more documentation to the script.	8 years ago
Matt Clay	40ffd8269d	Add shellcheck to code-smell checks. (#17715)	8 years ago
Adrian Likins	e11f7d2339	add a defaults for integration.sh (#17709) ... * add a default test image (ansible/ansible:centos7) * add a default test target (all)	8 years ago
Matt Clay	ada2432165	Add keep on failure option to integration.sh. (#17711)	8 years ago
Matt Clay	7b3cbafbe9	Add python 3 awareness to apt module tests. (#17574) ... Also remove unnecessary dependency from ubuntu1604py3 Dockerfile.	8 years ago
Matt Clay	bcb49fecb5	Add tool for downloading Shippable logs.	8 years ago
Allen Sanabria	b510abce17	CloudRetry/AWSRetry backoff decorator with unit tests (#17039) ... * Added aws_retry decorator function with unit tests * Restructured the code to be used with a base class. This base class CloudRetry can be reused by any other cloud provider. This decorator should be used in situations, where you need to implement a backoff algorithm and want to retry based on the status code from the exception. * updated documentation * fixed tabs * added botocore and boto3 to requirements.txt * removed cloud.py from py24 tests, as it depends on boto3 * fix relative imports * updated test to be 2.6 compat * updated method name from retry to backoff * readded lxd * Updated default backoff from 2 seconds to 1.1s. This will be about a total of 48 seconds in 10 tries. This is configurable.	8 years ago
Matt Clay	c81fe70fbf	Enable more integration tests for python 3. (#17473) ... * Enable more integration tests for python 3. * Split out python 3 integration tests. Now that we're running more integration tests on python 3, the tests are taking long enough that they warrant splitting out in the same way the python 2 tests are split.	8 years ago
Matt Clay	a1947401ba	Enable more tests that pass on python 3. (#17471) ... * Enable more tests that pass on python 3. * Disable test_apt_repository for python 3.	8 years ago
Matt Clay	eb26616b09	Add python3-apt to ubuntu1604py3 Dockerfile.	8 years ago