475 Commits (64084d593e94e97144c6735d80d4d488fa5ae173)

Author	SHA1	Message	Date
Matt Clay	1b5c4b72bd	Add Azure provider support to ansible-test and CI. ... ci_complete	7 years ago
Matt Clay	58286ef93b	Limit pytest < 3.3.0 for python 2.6.	7 years ago
Matt Clay	73132d3906	Update FreeBSD completion for ansible-test.	7 years ago
Nathaniel Case	8679d2e396	Port integration tests to network_cli (#33583) ... * network_cli needs network_os * Work around for Python 3.x < 3.6	7 years ago
Ganesh Nalawade	95044d69c7	Fix unit test failure for netconf connection plugin (#33547)	7 years ago
ZhijunZhao	8506b7bfdc	Fix azure_rm_acs due to Azure breaking API change (#33221) ... * Fix azure_rm_acs due to Azure breaking API change * resolve code review feedbacks * resolve test failures * better name * ignore case for vm size * reformat code * resolve code review feedbacks	7 years ago
Matt Clay	b865ddedac	Change the default ansible-test docker image.	7 years ago
Matt Clay	1ee511f82c	Use an abspath for network inventory ssh key path.	7 years ago
Matt Clay	3a6fad38fa	Update vyos completion in network.txt.	7 years ago
Matt Clay	6f4731ef11	Force all tests to run on docker image updates.	7 years ago
Matt Clay	07bb7684b0	Add PS dependency analysis to ansible-test.	7 years ago
Matt Clay	f9cd50411f	Enable Python 3.7 in ansible-test.	7 years ago
Matt Clay	5f5e150771	Limit paramiko to < 2.4.0 for python 2.6.	7 years ago
Matt Clay	677aca1cc7	Add Python 3.7-dev to the default docker image.	7 years ago
Matt Clay	781219bcfd	Fix and re-enable zypper* integration tests in CI.	7 years ago
Matt Clay	ef21038dd5	Fix ansible-test race calling get_coverage_path.	7 years ago
Matt Clay	6472723ba8	Add missing ansible-test --remote-terminate support. (#32918) ... * Expand ansible-test --remote-terminate support: - windows-integration - network-integration These commands previously accepted the option, but did not support it. * Terminate windows and network instances when done.	7 years ago
Matt Clay	cf1337ca9a	Update ansible-test sanity command. (#31958) ... * Use correct pip version in ansible-test. * Add git fallback for validate-modules. * Run sanity tests in a docker container. * Use correct python version for sanity tests. * Pin docker completion images and add default. * Split pylint execution into multiple contexts. * Only test .py files in use-argspec-type-path test. * Accept identical python interpeter name or binary. * Switch cloud tests to default container. * Remove unused extras from pip install. * Filter out empty pip commands. * Don't force running of pip list. * Support delegation for windows and network tests. * Fix ansible-test python version usage. * Fix ansible-test python version skipping. * Use absolute path for log in ansible-test. * Run vyos_command test on python 3. * Fix windows/network instance persistence. * Add `test/cache` dir to classification. * Enable more python versions for network tests. * Fix cs_router test.	7 years ago
Matt Clay	5663d11b94	Add missing packages to default docker image.	7 years ago
Matt Clay	36b13e3e3d	Fix ansible-test default image. (#31966) ... * Add openssh-client to default docker container. * Include Azure requirements in default container. To do so, handling of pip requirements was updated to install each set of requirements separately and then run a verification pass to make sure there are no conflicts between requirements. * Add missing --docker-no-pull option. * Add documentation for the azure-requirements test.	7 years ago
Matt Clay	f76afab6e5	Add new default Docker container for ansible-test. (#31944) ... * Add new default Docker container for ansible-test. * Update ansible-test change classification. * Update list of disabled pylint rules. * Fix pylint issues with ansible-test.	7 years ago
jctanner	6bf0cc36a7	Bump the vcsim container version (#31861)	7 years ago
Matt Clay	6c3339402a	Improve python 2/3 ABC fallback for pylint. (#31848) ... * Improve python 2/3 ABC fallback for pylint. * Allow longer method names in ansible-test.	7 years ago
James Tanner	e5eedfe4b8	Allow the user to declare an env var to set the vcsim container image	7 years ago
Matt Clay	05ec376197	Multiple Parallels host support for ansible-test. (#31552)	7 years ago
Jordan Borean	665d838fc2	added optional environment passthrough for MacOS 10.13 compatibility (#31500)	7 years ago
Matt Clay	a333f2e5b0	Fix ansible-test config management.	7 years ago
Matt Clay	c055795e02	Pin docker simulator versions.	7 years ago
Matt Clay	ab89b1b219	Add region to ansible-test AWS cloud config. (#30733) ... * Add region to ansible-test AWS cloud config. * Fix .gitignore for ansible-test cloud config.	7 years ago
Matt Clay	397918435b	Fix docker error handling for cs/vcenter tests.	7 years ago
Matt Clay	0ce9e84f38	Fix import test handling of multi-line messages.	7 years ago
Matt Clay	781fd7099a	Reorganize integration tests: ... - Move legacy tests into a separate directory. - Reduce common dependencies between targets.	7 years ago
Matt Clay	1a602096f5	Improve ansible-test HttpClient error handling. (#30301) ... - Automatic retries on DNS lookup failures. - Handle API errors in shippable.py.	7 years ago
Matt Clay	79bc49e150	Fix ansible-test unicode and sanity tests. (#29743) ... * Show warning when using pylint on Python 2.6. * Add pylint disable entries for Python 2. * Fix unicode handling in ansible-test. * Add missing documentation.	7 years ago
Matt Clay	50ae33d3c1	Fix wheel dependency on python 2.6. (#29388) ... * Fix wheel dependency on python 2.6. * Limit wheel version for tox on python 2.6.	7 years ago
Matt Clay	f88750d665	Expand disabled pylint rules. (#29162) ... * Expand disabled pylint rules. * Fix pylint and unicode issues in ansible-test.	7 years ago
Matt Clay	a1453a7917	Improve handling of first CI run for new branch. (#29070)	7 years ago
Matt Clay	8f4c8844c4	Divide Windows integration tests into 2 groups. (#29029) ... * Divide Windows integration tests into 2 groups. * Support `none` for `--changed-all-target`. * Run 2 separate Windows groups on Shippable. * Only run smoketest and minimal for the group1 job.	7 years ago
Matt Clay	e513ec10da	Add safety check for Shippable "Rebuild with SSH" (#28857) ... * Add safety check for Shippable "Rebuild with SSH". * Run shippable.py for the `other` test.	7 years ago
Matt Clay	79dcb3a3fa	Add help links to bot messages. (#28903)	7 years ago
Matt Clay	bda0f6e241	Fix ansible-test handling of integration dir.	7 years ago
Matt Clay	f71d861563	Collect data from integration test runs. (#28650)	7 years ago
Matt Clay	5ea8a5e34b	Add support for setup targets to ansible-test. (#28544) ... * Add support for setup targets to ansible-test. * Code cleanup.	7 years ago
Matt Clay	688823014f	Convert sanity tests to plugins. (#28425) ... * Move sanity into directory. * Omit abstract classes from returned subclass list. * Split sanity tests out into plugins. * Fix abstract class handling for Python 3.	7 years ago
Matt Clay	a31f4c178a	Fix pep8/pylint tests when deleting files. (#28410) ... * Fix pep8/pylint tests when deleting files. * Improve static analysis in PyCharm. * Use success instead of skipped for explain.	7 years ago
Matt Clay	8e0b5800b7	Miscellaneous ansible-test fixes. (#28355) ... * Include .github in test targets. Fix BOTMETA.yml. * Include bin in compile tests. * Exclude links from test targets. * Include bin in pep8 and pylint tests. * Fix pep8 and pylint issues in bin dir.	7 years ago
Matt Clay	66fa46fdda	Update ansible-test change classification. (#28345)	7 years ago
Ricardo Carrillo Cruz	746b433c29	Remove 'net' hardcoding on ansible-test executor (#28334) ... We need to run network-integration against platform agnostic modules, which they all are named as net_* . There is a hardcoding in executor where if prefix is 'net' the hosts is set to all, removing these lines to have desired behaviour.	7 years ago
Matt Clay	0ff5815a4f	Fix ansible-test target completion on Python 3.	7 years ago
Brian Coca	f921369445	Ansible Config part2 (#27448) ... * Ansible Config part2 - made dump_me nicer, added note this is not prod - moved internal key removal function to vars - carry tracebacks in errors we can now show tracebacks for plugins on vvv - show inventory plugin tracebacks on vvv - minor fixes to cg groups plugin - draft config from plugin docs - made search path warning 'saner' (top level dirs only) - correctly display config entries and others - removed unneeded code - commented out some conn plugin specific from base.yml - also deprecated sudo/su - updated ssh conn docs - shared get option method for connection plugins - note about needing eval for defaults - tailored yaml ext - updated strategy entry - for connection pliugins, options load on plugin load - allow for long types in definitions - better display in ansible-doc - cleaned up/updated source docs and base.yml - added many descriptions - deprecated include toggles as include is - draft backwards compat get_config - fixes to ansible-config, added --only-changed - some code reoorg - small license headers - show default in doc type - pushed module utils details to 5vs - work w/o config file - PEPE ATE! - moved loader to it's own file - fixed rhn_register test - fixed boto requirement in make tests - I ate Pepe - fixed dynamic eval of defaults - better doc code skip ipaddr filter tests when missing netaddr removed devnull string from config better becoem resolution * killed extra space with extreeme prejudice cause its an affront against all that is holy that 2 spaces touch each other! shippable timing out on some images, but merging as it passes most	7 years ago
Matt Clay	caf8bbf3bd	Add Azure support to ansible-test. (#28092) ... * Initial Azure cloud testing support. * Add missing Azure requirements. * Fix test handling of setup and requirements. * Update Azure cloud plugin. * Add setup_azure role for integration tests. * Update minimal Azure integration test sample.	7 years ago
Matt Clay	5b6321e45d	Update ansible-test handling of setup.py changes.	7 years ago
Sloane Hertel	1de91a9aa0	[cloud] Convert `s3` module to use boto3 (#21529) ... * replace boto with boto3 for the s3 module make s3 pep8 and remove from legacy files fix s3 unit tests * fix indentation * s3 module - if we can't create an MD5 sum return None and always upload file * remove Location.DEFAULT which isn't used in boto3 and tidy up the docs * pep8 * s3: remove default: null, empty aliases, and required: false from documentation fix incorrectly documented defaults * Porting s3 to boto3. Simplify some logic and remove unused imports * Fix s3 module variables * Fix a typo in s3 module and remove from pep8 legacy files * s3: add pagination for listing objects. Fix logic and use head_object instead of get_object for efficiency. Fix typo in unit test. * Fix pagination to maintain backwards compatibility. Fix incorrect conditional. Remove redundant variable assignment. Fix s3 list_object pagination to return all pages * Use the revised List Objects API as recommended. * Wrap call to paginated_list in a try/except Also remembered to allow marker/prefix/max_keys to modify what keys are listed * Simplify argument	7 years ago
Matt Clay	869e90e12a	Don't fail coverage reporting due to parse errors.	7 years ago
Matt Clay	6c4bf53518	Restore f5 unit test requirements. (#27992)	7 years ago
Matt Clay	a40cb5a47f	Miscellaneous ansible-test updates. (#27937) ... * Add keep alives to ansible-test ssh delegation. * Improve ansible-test JSON parsing error messages. * Increase ansible-test delegation sleep and retry. * Update ansible-test to recognize .psm1 files.	7 years ago
Matt Clay	5cb3acaed1	Add missing unit test requirement.	7 years ago
Matt Clay	2d2377bccc	Remove f5 test requirements to fix CI.	7 years ago
Matt Clay	f7bfa96caf	Use 0 instead of None for line and offset.	7 years ago
Matt Clay	af9b0ba47b	Replace opensuse42.1 with opensuse42.3 in CI.	7 years ago
Matt Clay	c59e32469f	Add Fedora Python 3 Docker images and fix tests. (#27794) ... * Add new Fedora docker images with Python 3. * Use consistent env var for lookup test. * Fix testing of virtualenv with Python 3. * Fix docker_secret tests on Fedora 26. * Add Python 3 support to Fedora postgresql test. * Add Python 3 support to Fedora mysql tests. * Fix uri test server for Python 3 on Fedora. * Fix iso_extract test for Python 3 on Fedora. * Add Python 3 support for Fedora to openssl tests. * Fix dnf group test for Python 3 on Fedora. * Use force with user deletion in become test.	7 years ago
Dag Wieers	941738a686	ansible-test: Fix environments with LD_LIBRARY_PATH	7 years ago
Matt Clay	9965435b56	Switch back to FreeBSD 11.0 for CI stability.	7 years ago
Matt Clay	66c35f60d2	Update ansible-test completions to match CI.	7 years ago
Toshio Kuratomi	21564cdb98	Add some features to the pylint sanity check ... * Enable specific tests (this lets us disable a group and then enable a particular test inside of it) * Comment out tests in the enable and disable files	7 years ago
Matt Clay	f6d7fc548e	Fix ansible-test type hints.	7 years ago
Matt Clay	e241e15899	Add support for `non_local` alias in ansible-test.	7 years ago
Matt Clay	87d434ed68	Fix ansible-test handling of git output.	7 years ago
Matt Clay	51bd07204b	Revert "Revert "Allow ini plugin to load file using other encoding than utf8." (#27407)" ... This reverts commit 520696fb39.	7 years ago
Toshio Kuratomi	520696fb39	Revert "Allow ini plugin to load file using other encoding than utf8." (#27407) ... * Revert "Update conventions in azure modules" This reverts commit 30a688d8d3. * Revert "Allow specific __future__ imports in modules" This reverts commit 3a2670e0fd. * Revert "Fix wildcard import in galaxy/token.py" This reverts commit 6456891053. * Revert "Fix one name in module error due to rewritten VariableManager" This reverts commit 87a192fe66. * Revert "Disable pylint check for names existing in modules for test data" This reverts commit 6ac683ca19. * Revert "Allow ini plugin to load file using other encoding than utf8." This reverts commit 6a57ad34c0.	7 years ago
Yannig Perré	6a57ad34c0	Allow ini plugin to load file using other encoding than utf8. ... - New option for ini plugins: encoding - Add a new option encoding to _get_file_contents - Use replace option in test/runner/lib/util.py when calling decode on stdout/err output when diff have non-utf8 sequences	7 years ago
John R Barker	72bfb051c3	Allow ansible.cfg overrides (#27372) ... If a cfg file exists for this this command then use it. This allows versioned test configuration to override the built in Ansible constants.	7 years ago
Toshio Kuratomi	9f7b0dfc30	Remove automatic use of system six ... * Enable the pylint no-name-in-module check. Checks that identifiers in imports actually exist. When we do this, we also have to ignore _MovedItems used in our bundled six. This means pylint won't check for bad imports below ansible.module_utils.six.moves but that's something that pylint punts on with a system copy of six so this is still an improvement. * Remove automatic use of system six. The exec in the six code which tried to use a system library if available destroyed pylint's ability to check for imports of identifiers which did not exist (the no-name-in-module check). That test is important enough that we should sacrifice the bundling detection in favour of the test. Distributions that want to unbundle six can replace the bundled six in ansible/module_utils/six/__init__.py to unbundle. however, be aware that six is tricky to unbundle. They may want to base their efforts off the code we were using: 2fff690caa/lib/ansible/module_utils/six/__init__.py * Update tests for new location of bundled six Several code-smell tests whitelist the bundled six library. Update the path to the library so that they work. * Also check for basestring in modules as the enabled pylint tests will also point out basestring usage for us.	7 years ago
Toshio Kuratomi	ff22528b07	Consolidate boolean/mk_boolean conversion functions into a single location ... Consolidate the module_utils, constants, and config functions that convert values into booleans into a single function in module_utils. Port code to use the module_utils.validate.convert_bool.boolean function isntead of mk_boolean.	7 years ago
Dag Wieers	e970237a2f	New module: access Cisco ACI (network/aci/aci_rest) (#26029) ... * aci_rest: New module to access Cisco ACI This PR includes: - Relicense as GPLv3+ - Check-mode support - Cosmetic changes to documentation - Examples in YAML format - Removal of incorrect requirements (for this module) - Do not log passwords - Implement native fetch_url instead of requests - Use standard hostname, username and password parameters - Add alias src for parameter config_file - Add mutual exclusive content option for inline data (and show some inline examples) - Add timeout parameter - Add validate_certs parameter - Handling ACI result output (identical for JSON as XML input) - Parse/expose ACI error output to user * Lower case method, add use_ssl, Use python dicts This commit includes: - Use lowercase method names - Add `use_ssl` parameter (not the `protocol` parameter) - Use a python dict for the request data (not a JSON string) - Documentation improvements * Ensure one of 'content' or 'src' is provided * Fix issue with totalCount being a string in JSON This fixes the problem with JSON output where totalCount is a string and not an integer. This fixes jedelman8/aci-ansible#7 * Improve code documentation * Improve error handling and module response * Small typo * Improve documentation and examples * Keep protocol parameter, but deprecate it * Extrude aci functions from module_utils * aci_rest: Add unit tests	7 years ago
Matt Clay	27033915cc	Add --list-targets and speed up --explain. (#26838) ... * Add ansible-test --list-targets option. * Speed up ansible-test integration --explain.	7 years ago
Matt Clay	e63f69464f	Add ansible-test options and docs. (#26823) ... * All integration commands support --continue-on-error * The network-integration command supports --inventory * Add landing page for compile test docs. * Add bot documentation links.	7 years ago
Matt Clay	7931e11437	Use subset of Windows tests for "all" tests. (#26830)	7 years ago
Matt Clay	76158db10c	Improve sanity import test messaging. (#26782)	7 years ago
Matt Clay	789218c215	Initial ansible-test sanity docs. (#26775) ... * Rename no-iterkeys test for consistency. * Require docs for all ansible-test sanity tests. * Initial ansible-test sanity docs. * Fix capitalization of Python. * Fix sanity code smell test false positives. * Fix another code-smell false positive.	7 years ago
Matt Clay	e1b9af9082	Add retries to remote test package installs.	7 years ago
Pilou	4b3d6dfa8a	Use pycodestyle instead of pep8 (#25947)	7 years ago
Matt Clay	fad469efca	Ignore platform_agnostic.yaml in ansible-test.	7 years ago
Matt Clay	0b784c65b1	Add sanity import test to ansible-test. (#26730) ... * Add sanity import test to ansible-test. * Run sanity import test on all python versions.	7 years ago
Matt Clay	20d49af475	Add ANSIBLE_TEST_CI env var to integration tests.	7 years ago
Ganesh Nalawade	e14e37ee1e	Fix junos unit test failures (#26676) ... * Use lxml api's in unit test to parse xml * Remove unwanted import in unit test * Add ncclient dependency in unit test requirement	7 years ago
Matt Clay	ab5dd24430	Handle pip/python errors in ansible-test better.	7 years ago
David Newswanger	64f0eb50ff	remove vyos/1.0.5 from test/runner/completion/network.txt	7 years ago
Matt Clay	82558baaf6	Add role dependencies to change classification.	7 years ago
Matt Clay	a66bd8f7c3	Don't update RHEL instances before running tests.	7 years ago
Matt Clay	2146bb57ce	Simplify FreeBSD setup for tests.	7 years ago
Matt Clay	4a013d6d69	Add RHEL 7.3 to ansible-test and CI. (#26550) ... * Add support for RHEL to ansible-test. * Enable RHEL 7.3 on Shippable.	7 years ago
Andrea Tartaglia	0d48732e7e	Integration tests requirements (#26545) ... * Removed pexpect and jmespath requirement, install it in task directly * Removed passlib dependency	7 years ago
David Newswanger	294c0f91c0	added option to ansible-test to run test playbooks using the debug strategy (#26499)	7 years ago
Matt Clay	a94156227d	Improve error handling for cs tests.	8 years ago
Matt Clay	45e377566c	Refactor ansible-test config classes. (#26505) ... * Move Config classes from executor.py to config.py. * Move Environment and Test config to config.py. * Move Coverage/CoverageReport Config to config.py. * Clean up type hints.	8 years ago
Matt Clay	bd8ea89b1b	Improve handling of network test changes.	8 years ago
Matt Clay	c26a556929	Add check for known_hosts changing during tests. (#26470) ... * Add check for known_hosts changing during tests. * Don't use known hosts file for delegate_to test.	8 years ago
Matt Clay	fba76444e0	Add `ansible-test coverage report --show-missing`.	8 years ago
Matt Clay	69ab6fa803	Remove legacy pycrypto test requirement.	8 years ago
Adrien Vergé	4ee1d0dd35	Revert "Limit yamllint version on python 2.6." (55aec8e) ... Thanks to the report by Matt Clay at [1], yamllint now supports Python 2.6. Tests were enabled on Travis for 2.6 to make sure there will be no regressions in the future. [1]: https://github.com/adrienverge/yamllint/issues/55	8 years ago
David Newswanger	0a6dcf4169	changed ansible-test so that it replaces . with - instead of . with _ so that the hostname is valid	8 years ago
Matt Clay	cd3a795e65	Permissions fix for remote coverage downloads.	8 years ago
Matt Clay	554423cf04	Expose docker socket to test containers.	8 years ago
Matt Clay	7ab4a889ad	Update tox.ini to use ansible-test.	8 years ago
René Moser	77d0542985	test, integration: add diff support (#26296)	8 years ago
Pierre-Louis Bonicoli	d08ff86169	ansible-test: pass --[skip-]tags to ansible-playbook ... Thanks to Olaf Klischat for the idea.	8 years ago
Matt Clay	55aec8ebc9	Limit yamllint version on python 2.6.	8 years ago
Toshio Kuratomi	e238ae999b	Cyptography pr 20566 rebase (#25560) ... Make pyca/cryptography the preferred backend for cryptographic needs (mainly vault) falling back to pycrypto pyca/cryptography is already implicitly a dependency in many cases through paramiko (2.0+) as well as the new openssl_publickey module, which requires pyOpenSSL 16.0+. Additionally, pyca/cryptography is an optional dep for better performance with vault already. This commit leverages cryptography's padding, constant time comparisons, and CBC/CTR modes to reduce the amount of code ansible needs to maintain. * Handle wrong password given for VaultAES format * Do not display deprecation warning for cryptography on python-2.6 * Namespace all of the pycrypto imports and always import them Makes unittests better and the code less likely to get stupid mistakes (like using HMAC from cryptogrpahy when the one from pycrypto is needed) * Add back in atfork since we need pycrypto to reinitialize its RNG just in case we're being used with old paramiko * contrib/inventory/gce: Remove spurious require on pycrypto (cherry picked from commit 9e16b9db275263b3ea8d1b124966fdebfc9ab271) * Add cryptography to ec2_win_password module requirements * Fix python3 bug which would pass text strings to a function which requires byte strings. * Attempt to add pycrypto version to setup deps * Change hacking README for dual pycrypto/cryptography * update dependencies for various CI scripts * additional CI dockerfile/script updates * add paramiko to the windows and sanity requirement set This is needed because ansible lists it as a requirement. Previously the missing dep wasn't enforced, but cryptography imports pkg_resources so you can't ignore a requirement any more * Add integration test cases for old vault and for wrong passwords * helper script for manual testing of pycrypto/cryptography * Skip the pycrypto tests so that users without it installed can still run the unittests * Run unittests for vault with both cryptography and pycrypto backend	8 years ago
Matt Clay	e56ea435f0	Skip dependency check for deleted files. (#26112)	8 years ago
David Newswanger	b2d88f8b73	updated ansible-test integration to skip any files in test/integration/targets/ that aren't directories. ... Fixes #26007	8 years ago
jctanner	996dcb989c	Add the cloud provider script for the vcenter simulator container (#25964)	8 years ago
Matt Clay	9d8aa43c67	Temporary work-around for setuptools 36.0.0 bug. (#25243) ... * Temporary work-around for setuptools 36.0.0 bug. * Use older setuptools for pip integration test. * Limit isort version to avoid new test failures.	8 years ago
kkjang	daada2000c	Fix expect for python 3 (#24912) ... * Fix expect for python 3 - Change generator next to python 3 compatible - Added tests for expect * Add pexpect to integration.txt - add pexpect library to requirements for integration tests * Use ansible_python_interpreter in integration tests for expect * Use double-quotes for expect integration tests * Cast user input to string for expect integration tests * Cast user input to string earlier in expect integration tests * Use ansible.module_utils.six.moves input for expect integration tests * Fix yamllint errors in the expect test * Use cat to trigger timeout for expect integration tests * Use realpath filter in expect integration tests	8 years ago
Ricardo Carrillo Cruz	b12beca3ed	Refactos nxos_ip_interface module (#24885)	8 years ago
Tim Rupp	c1397626fc	Adds the bigip_user module to Ansible (#24753) ... The patch adds the bigip_user module to Ansible to support managing users on an F5 BIG-IP. Unit tests are provided. Integration tests can be found here * https://github.com/F5Networks/f5-ansible/blob/devel/test/integration/bigip_user.yaml * https://github.com/F5Networks/f5-ansible/tree/devel/test/integration/targets/bigip_user/tasks	8 years ago
Matt Clay	53180ebb57	Fix Shippable BASE_BRANCH lookup on merges.	8 years ago
Matt Clay	5babe2daea	Increase python version coverage for tests. (#24762) ... * Improve ansible-test inventory handling. * Fix python 3 re-raise of exception from thread. * Fix python 3 encoding for windows-integration. * Run network tests on multiple python versions. * Run windows tests on multiple python versions. * Support Shippable delegation using --tox. * Skip vyos_command on python 3 tests until fixed. * Add python 3 filtering to local and tox. * Fix tests to support back to back runs. * Temporarily test networking with python 2.7 only. Running the tests back to back causes intermittent test failures which need to be addressed before we can test multiple versions in a single test run.	8 years ago
Matt Clay	9178e176b5	Limit sphinx version on python 2.6. (#24678) ... * Limit sphinx version on python 2.6. * Fix issues identified by rstcheck.	8 years ago
Matt Clay	4daa16f9ce	Add --all and --stub coverage options. ... ci_coverage ci_complete	8 years ago
Matt Clay	6a2a7a2392	Enable codecov.io and add coverage grouping.	8 years ago
Matt Clay	fdcad0f44d	Improve on-demand coverage for Shippable.	8 years ago
John R Barker	e9e2d67035	Run vyos_command Network tests in Shippable (#24514) ... * Run VyOS Network tests in Shippable * net_command no longer exists * network/ci * Disable other network tests * pep8 fix * Fix PEP 8 issue.	8 years ago
Matt Clay	dfd19a812f	Miscellaneous bug fixes for ansible-test. ... - Overhauled coverage injector to fix issues with non-local tests. - Updated integration tests to work with the new coverage injector. - Fix concurrency issue by using random temp files for delegation. - Fix handling of coverage files from root user. - Fix handling of coverage files without arcs. - Make sure temp copy of injector is world readable and executable.	8 years ago
Matt Clay	fb9efd3c7e	Add `--remote-terminate` option to ansible-test. ... Set `--remote-terminate success` for osx tests.	8 years ago
Matt Clay	b8cb3f519b	Detect and fix environment tampering in tests.	8 years ago
Matt Clay	e6934e42be	Update ansible-test change handling and CS plugin. (#24395) ... * Use CloudStack simulator from Ansible repo. * Recognize cloud specific ansible-test changes. * Hide ansible-test cs notice in explain mode.	8 years ago
Matt Clay	0573b8bcd2	Fix ansible-test cloud integration bugs.	8 years ago
Matt Clay	ac72fd9d2c	Add missing return statements.	8 years ago
Matt Clay	201242f302	Fix call to wrong method in ansible-test.	8 years ago
Matt Clay	1582e9bf7d	Fix handling of Shippable env vars.	8 years ago
Matt Clay	a07d42e16d	Add support for cloud tests to ansible-test. (#24315) ... * Split out ansible-test docker functions. * Add cloud support to ansible-test.	8 years ago
Matt Clay	6522d703a1	Fix ansible-test pylint and pep8 issues. (#24245) ... * Fix pylint useless-super-delegation issues. * Fix miscellaneous pylint issues. * Fix PEP 8 issues. * Fix warnings reported by PyCharm.	8 years ago
Matt Clay	d662f6f0db	Fix bugs in ansible-test units command. (#24044) ... * Handle old versions of coverage. * Handle old versions of setuptools. * Detect python version for docker/remote units. * Add sanity override for test constraints.	8 years ago
Matt Clay	cb1f57d4e5	Add rstcheck to ansible-test and correct issues. (#23550) ... * Add rstcheck to ansible-test. * Fix rst code-block languages and syntax errors. * Fix rst inline literals. * Update python 2 code block to pass tests on py 3.	8 years ago
Matt Clay	4ee96b20a3	Temporarily cap pylint version < 1.7.0 in tests.	8 years ago
Toshio Kuratomi	4e8e366739	Ryanpineo fix ipaddr netmask with 32 cidr (#23506) ... * Fix bug in ipaddr netmask filter when cidr is 32 * Add requirement on netaddr to the units.txt file	8 years ago
Matt Clay	92ad9a19b6	Fix ansible-test empty diff handling on Shippable.	8 years ago
Matt Clay	0cf1e8e061	Fix ansible-test handling of import/syntax errors.	8 years ago
Matt Clay	1daa69d685	Initial pylint support for ansible-test sanity.	8 years ago
Ryan Brown	2196fa0e95	[cloud][tests] fixtures for placebo to test AWS modules using boto3 (#21253) ... * [cloud][tests] Create fixtures for using placebo to test boto3-using modules * Use pytest's importorskip instead of manually skipping on missing deps * Fix imports in cloudformation module * Delete unused code * Add maybe_sleep fixtures to speed up recorded test runs * Build basic placebo-CFN tests * Commit placebo recordings of basic stack operations * Add placebo to test-requires * Allow unit tests to run regardless of environment by setting a default region * Use explicit relative import for Python 3 compat * Use __name__ attribute that works on Python 2 and 3	8 years ago
Matt Clay	4fdeade389	Overhaul ansible-test import analysis. (#22888) ... - Add support for module_utils packages for better organization. - Add support for "virtual" module_utils packages such as `six`.	8 years ago
Matt Clay	042e387f27	Fix metadata handling for shell command. (#22801)	8 years ago
Matt Clay	991bf0a1c3	Fix ansible-test base branch handling on merge. (#22759)	8 years ago
Matt Clay	47887a2edd	Fix ansible-test base branch usage on Shippable.	8 years ago
Matt Clay	f7c83ccdc0	Fix ansible-test PR diff handling. ... Permits use of PRs on branches other than devel.	8 years ago
Matt Clay	3a22467b38	Remove python 2.4 compile test.	8 years ago
Matt Clay	869449e288	Add test verification to ansible-test. (#22636) ... * Add unified git diff parser. * Add metadata and diff handling. * Add test confidence/verification to bot output.	8 years ago
Matt Clay	5e9a2b8528	Verify SHA in Shippable change detection.	8 years ago
Matt Clay	89559f78de	Add `--failure-ok` option to `ansible-test`. (#22623)	8 years ago
Matt Clay	771b14acb2	Sort test messages for deterministic output. (#22581)	8 years ago
Matt Clay	cfd313bced	Disable ansible color output on sanity tests.	8 years ago
Matt Clay	3ab344e8bd	Use lint/junit output for compile test. (#22395) ... * Refactor sanity classes for use in all tests. * Use lint/junit output for compile test. * Add missing options for compile test. * Fix early bailout on requirements install.	8 years ago
Matt Clay	fbf55886ba	Use lint friendly output for python syntax checks. (#22390)	8 years ago
Matt Clay	8f463fcdd2	Create bot friendly sanity output. (#22381)	8 years ago
Matt Clay	3e4be156d7	Pre-compile regexes to speed up target processing. ... Without this, changing a large number of files results in target processing taking a very long time due to repeatedly compiling the same patterns in a loop over many targets.	8 years ago
Matt Clay	d66ce40ecb	Overhaul `ansible-test sanity` implementation. (#22177) ... - Tests are run to completion instead of stopping on first failure. - Test results are now parsed instead of passing through to the console. - Test results can be saved in junit xml format. - Test results will show up on the Shippable "Tests" result tab. - Added an experimental --lint option for easier integration with other tools. - Code smell tests are now usable with the --list-tests, --test and --skip-test options. - Code split out from executor.py into sanity.py. - Rename download-logs to download.py and add support for test and coverage results. - Miscellaneous improvements.	8 years ago
Matt Clay	28b882e737	Support ansible commands in sanity tests. (#22172)	8 years ago
Matt Clay	4f3dade266	Add retries for ansible-test docker run.	8 years ago
Matt Clay	45cec93e99	Disable newer shellcheck tests which don't pass.	8 years ago
Matt Clay	a7bb04800d	Add boto to units requirements for s3 test.	8 years ago
Matt Clay	fcac261eef	Run unit tests in isolation w/ coverage support.	8 years ago
Matt Clay	c87ebb6215	Deduplicate arcs when combining coverage data. (#22022)	8 years ago
Matt Clay	2797cff773	Run destructive win tests when creating instances.	8 years ago
Matt Clay	2804d2e848	Split up unit tests on Shippable. (#21931) ... * Add more verbose output to coverage combine. * Run unit tests on CI separately by version.	8 years ago
Matt Clay	bc8186543a	Pass base branch to module validator on delegate.	8 years ago
Matt Martz	9b1bd2eb7e	Re-enable module comparisons in validate-modules (#21582) ... * Re-enable module comparisons, specifically for new module detection and for finding new options/arguments * Only do new module checks in shippable, local will display warning	8 years ago
Matt Clay	1ce2ea0b6c	Fix ansible-test handling of deleted test targets.	8 years ago
Matt Clay	2192c1eb02	Fix ansible-test selection of inventory file.	8 years ago
John R Barker	5e28d3a15c	network_cli shouldn't be specified anymore (#21458)	8 years ago
Matt Clay	d54bc09fae	Consider module_utils deps when running tests. (#21382) ... * Skip pep8 analysis when --explain is used. * Fix return type annotations. * Match line length requirement of PEP 8 config. * Consider module_utils deps when running tests.	8 years ago
Peter Sprygada	7f1c43e597	updates ios modules to support persistent socket (#21258) ... * updates all ios modules to support persistent socket * adds ios action plugin to connect to device * adds exec_command() to ios shared module * fixes ios_config and ios_template local action * update all unit test cases * adds base test module for ios module testing	8 years ago
Matt Clay	4189592701	Revert "Enable process isolation for unit tests." ... This reverts commit 91526cd9f2. Removing this feature primarily because it interferes with collecting proper code coverage results. I may restore the feature later if that can be resolved.	8 years ago
Matt Clay	91526cd9f2	Enable process isolation for unit tests.	8 years ago
Matt Clay	f16ee2841b	Add retries to Shippable CI scripts. (#21108) ... * Add retry.py for auto-retry in CI scripts. * Add retries to other and units CI scripts.	8 years ago
Matt Clay	bce5fc7d96	Use us-east-2 for Windows CI on Shippable.	8 years ago
Matt Clay	309a37de86	Add `--debug` option to `ansible-test`.	8 years ago
Toshio Kuratomi	1609afbd12	Unittests for some of module_common.py (#20812) ... * Unittests for some of module_common.py * Port test_run_command to use pytest-mock The use of addCleanup(patch.stopall) from the unittest idiom was conflicting with the pytest-mock idiom of closing all patches automatically. Switching to pytest-mock ensures that the patches are closed and removing the stopall stops the conflict.	8 years ago
Matt Clay	6ef1a6aeb6	Add `pep8` to `ansible-test`. (#20745) ... The rule sets and legacy file list are a first draft. It is likely that they will need to be revised.	8 years ago
Dag Wieers	3a0a74dc18	Make test/runner less verbose when spawning instances ... As discussed on IRC	8 years ago
Matt Clay	5503b89831	Run fewer tests for winrm config script changes.	8 years ago
Matt Clay	76d563af79	Temporarily switch Windows tests to us-east-1. ... Will switch back to us-east-2 after AWS limit increase is done.	8 years ago
Matt Clay	fa7f84217b	Add startup checks to ansible-test.	8 years ago
Matt Clay	61e6e7868c	Improve jinja2 test coverage. (#20533) ... * Run `template` test on latest jinja2 version. * Update jinja2 install for groupby_filter. * Clean test output dir for each test.	8 years ago
Matt Clay	7ed67746cf	Enable Windows 2016 on Shippable. ... Also launch Windows instances on us-east-2 and all others on us-east-1.	8 years ago
Matt Clay	4ba9f63afe	Use multiple AWS regions in ansible-test. (#20429) ... * Move ansible-test EnvironmentConfig to util. * Use multiple AWS regions in ansible-test.	8 years ago
Matt Clay	4673a9c9c2	Generate ssh key once for network tests.	8 years ago
Matt Clay	4c97bad28e	Update ansible-test network change classification.	8 years ago
Matt Clay	89898ed734	Update coverage constraints for ansible-test.	8 years ago
Matt Clay	3c51ce56fd	Enable more network support in ansible-test. (#20372) ... * Only start platform instances with tests selected. * Enable ios on Shippable. * Show inventory in explain mode. * Fix indentation of generated network inventory. * Update classification of network module_utils.	8 years ago
Matt Clay	dbb89549ff	Improve ansible-test error handling and timeouts. (#20328) ... * Eliminate warning/retry on old instance check. * Increase instance start timeout for windows.	8 years ago
Matt Clay	55b9a11468	Require coverage < 4.3.2 to avoid bugs.	8 years ago
Matt Clay	b5d5888b6e	Add support for ios to ansible-test.	8 years ago
Matt Clay	e2bd71ac02	Clean up inventory generation in ansible-test. (#20313)	8 years ago
Matt Clay	a59ce3a7f9	Add retry on failure to get instance.	8 years ago
Matt Clay	f3130898bb	Retry instance start on error.	8 years ago
Matt Clay	f534573dcf	Enable first network tests on Shippable. (#20208)	8 years ago
Matt Clay	d8733a5455	Complete initial network-integration support.	8 years ago
Matt Clay	300181cfd3	Send current winrm config to ansible-core-ci.	8 years ago
Matt Clay	f340b8d14f	Add test support for python 3.6.	8 years ago
Matt Clay	cc3d131f50	Fix group_by test to work with jinja2 >= 2.9.	8 years ago
Matt Clay	7ba47bfd2d	Correct test constraints and add sanity check.	8 years ago
Matt Clay	07c68571b6	Require jinja2 < 2.9 until tests pass on 2.9.	8 years ago
Matt Clay	3ec7243918	Run all win tests for winrm config script changes.	8 years ago
Brian Coca	57f8b791d6	consolidated docs ... point to new doc locations removed non existing dirs	8 years ago
Matt Clay	b7780ca530	Pass DOCKER_* env vars to docker in ansible-test.	8 years ago
Robin Roth	9f2d22425b	Run tests on opensuse42.2 ... * add to shippable * add to completion/readme * Fixes #18645	8 years ago
Matt Clay	68346b128f	Update Fedora tests to use releases 24 and 25.	8 years ago
Matt Clay	dac226de4a	Improve ansible-test completion and messaging. (#19627) ... * Simplify type annotation of args.docker_util. * Improve error messaging for ansible-doc test. * Add completion for docker, remote and windows.	8 years ago
Matt Clay	422857166b	Remove legacy test alias migration script. (#19629) ... * Require code-smell tests to be files. * Add sanity check for integration test aliases. * Remove migration script for test aliases.	8 years ago
Matt Clay	9b5c782a0b	Use `docker pull` by default in ansible-test.	8 years ago
Matt Clay	f28b5a0ed8	Add --tox-sitepackages option to ansible-test.	8 years ago
Matt Clay	45772b961f	Add private fork CI support to ansible-test.	8 years ago
Matt Clay	1c9a58a885	Run all tests when no last successful commit. ... (cherry picked from commit 2e56035fddfd04eb084bd977fc1ee2f35c2f5283)	8 years ago
Matt Clay	5628e260f2	Relocate module unit tests. (#18812) ... * Relocate module unit tests. * Fix classification of unit test changes.	8 years ago
Matt Clay	573078fc6b	Fix unit test directory path target.	8 years ago
Matt Clay	47083f145a	Don't error if pytest skips all unit tests.	8 years ago
Matt Clay	8e951b9f98	Remove legacy `test/samples` directory.	8 years ago
Matt Clay	7d3e2b2121	Verify path before assigning to sanity test.	8 years ago
Matt Clay	14a2757116	Correct change classification for network plugins.	8 years ago
Matt Clay	d2af88ba8a	Do not replace existing test skip lists.	8 years ago
Adrian Likins	47a7cb733a	use log attribute %(process)d instead of os.getpid (#18691)	8 years ago
Adrian Likins	ba56c87566	Add SSH_AUTH_SOCK to default env ... So ssh-agent works when using locally.	8 years ago
Matt Clay	bee58fe890	Fix compile skip path handling for targeted tests.	8 years ago
Matt Clay	6bbd92e422	Initial ansible-test implementation. (#18556)	8 years ago