ansible

Commit Graph

Author	SHA1	Message	Date
Matt Clay	4276f9c352	[stable-2.12] Relocate the AZP entry point scripts (#80114 ) Scripts previously under `test/utils/shippable/` are now under `.azure-pipelines/commands/` instead.. (cherry picked from commit `f47bc03599`) Co-authored-by: Matt Clay <matt@mystile.com>	3 years ago
Matt Clay	2154de5eb5	[stable-2.12] Fix MANIFEST.in includes (#80147 ) (#80150 ) * [stable-2.12] Fix MANIFEST.in includes (#80147). (cherry picked from commit `7c62cdeecd`) * Include additional packaging files	3 years ago
Matt Clay	c37870a735	[stable-2.12] ansible-test - Improve container management. (#79611 ) * ansible-test: Set max number of open files in containers to 10240 (#75498) (cherry picked from commit `e50ad6f118`) * ansible-test - Add RHEL 9 support. (#76217) * Move RHEL pip package install into function. * Add RHEL 9 support to bootstrap script. * ansible-test - Add RHEL 9 support. * Add install and uninstall instructions for RHEL9 to paramiko tests * Skip incidental_inventory_docker_swarm on RHEL 9. * Update dnf tests for rhel9 * Fix prepare_http_tests on RHEL 9. * fix RHEL9 Python discovery tests to match distro map * Skip subversion test on RHEL 9.0b. Co-authored-by: Matt Martz <matt@sivel.net> Co-authored-by: Matt Davis <mrd@redhat.com> (cherry picked from commit `730194e2b6`) * fix support containers under podman (#76292) * `podman inspect` falls back to a same-named image if the named container is not present; since eg `http-test-container` is both the name of the image and container, it wasn't working properly under podman in many instances. Switching to `docker\|podman container inspect` limits the query to containers only for both podman and docker, allowing the support container detection/creation to work properly. (cherry picked from commit `abac141122`) * ansible-test - Code cleanup. (#76540) * Add missing typing imports. * Remove unnecessary non-capturing group. * Whitespace. * Add type hints. * Ignore PyCharm false positives. * Remove Python 2.x plugin loading logic. * Remove Python 2.x exception handling. * Remove Python 2.x display logic. * Add changelog. (cherry picked from commit `4e70156d7e`) * ansible-test - Fix type hints. (cherry picked from commit `d2daa67b00`) * ansible-test - Fix plugin loading. This fixes a traceback when loading plugins that use dataclasses. (cherry picked from commit `7e814dd4db`) * ansible-test - Remove AIX provisioning support. (#76747) * ansible-test - Remove AIX provisioning support. * Remove `skip/aix` integration test aliases. * Remove build for AIX binary module. (cherry picked from commit `3a891827b7`) * ansible-test: fix typo in validate-modules (#76765) The correct error strategy for the to_text method is surrogate_or_strict Signed-off-by: Dimitri Savineau <dsavinea@redhat.com> (cherry picked from commit `a0f6747f07`) * ansible-test - Improve help for unsupported cwd. (#76866) * ansible-test - Improve help for unsupported cwd. * The `--help` option is now available when an unsupported cwd is in use. * The `--help` output now shows the same instructions about cwd as would be shown in error messages if the cwd is unsupported. * Add `--version` support to show the ansible-core version. * The explanation about cwd usage has been improved to explain more clearly what is required. Resolves https://github.com/ansible/ansible/issues/64523 Resolves https://github.com/ansible/ansible/issues/67551 (cherry picked from commit `de5f60e374`) * ansible-test - Validate collection ns and name. Resolves https://github.com/ansible/ansible/issues/62079 (cherry picked from commit `26b43f425f`) * ansible-test - Add default for Windows remotes. (cherry picked from commit `18ed2c64e5`) * ansible-test - Clean up future boilerplate. (#76874) * ansible-test - Clarify need for empty __init__.py * ansible-test - Update code-smell boilerplate. * Update code-smell boilerplate for core. * Update future boilerplate test for ansible-test. All ansible-test code (except for targets) and core-specific sanity tests now use the same boilerplate. The test also checks for unwanted `__future__` and `metaclass` boilerplate. * Relocate target tools to the correct directory. Several tools used on target Python versions were incorrectly placed in the controller directory. (cherry picked from commit `d19b506ce8`) * ansible-test - Remove obsolete display of MAXFD. Use of ``subprocess.MAXFD`` only worked on Python 2.x, which is no longer supported. (cherry picked from commit `dc6b0d4857`) * ansible-test - Code cleanup and refactoring. (#77169) * Remove unnecessary PyCharm ignores. * Ignore intentional undefined attribute usage. * Add missing type hints. Fix existing type hints. * Fix docstrings and comments. * Use function to register completion handler. * Pass strings to display functions. * Fix CompositeAction handling of dest argument. * Use consistent types in expressions/assignments. * Use custom function to keep linters happy. * Add missing raise for custom exception. * Clean up key/value type handling in cloud plugins. * Use dataclass instead of dict for results. * Add custom type_guard function to check lists. * Ignore return type that can't be checked (yet). * Avoid changing types on local variables. (cherry picked from commit `a06fa496d3`) * ansible-test - Simplify type hints. (cherry picked from commit `af2b1361ff`) * Support podman-remote in ansible-test (#75753) (cherry picked from commit `7cb581ed2c`) * docker_util: Handle error in JSON parsing (#77298) While getting hostname from container, podman command fails to return JSON so wrap exception and return hostname as 'None' Signed-off-by: Abhijeet Kasurde <akasurde@redhat.com> (cherry picked from commit `1100289a45`) * ansible-test - Remove RHEL 9.0b support. Support can be restored once RHEL 9 has been released. (cherry picked from commit `55f90ba31f`) * ansible-test - Don't fail if network cannot be disconnected (#77472) * Don't fail if network cannot be disconnected * add clog frag (cherry picked from commit `66c5844978`) * ansible-test - Backport `InternalError` NOTE: This is a partial backport, including only one new class. (cherry picked from commit `b960641759`) * ansible-test - Fix subprocess management. (#77641) * Run code-smell sanity tests in UTF-8 Mode. * Update subprocess use in sanity test programs. * Use raw_command instead of run_command with always=True set. * Add more capture=True usage. * Don't expose stdin to subprocesses. * Capture more output. Warn on retry. * Add more captures. * Capture coverage cli output. * Capture windows and network host checks. * Be explicit about interactive usage. * Use a shell for non-captured, non-interactive subprocesses. * Add integration test to assert no TTY. * Add unit test to assert no TTY. * Require blocking stdin/stdout/stderr. * Use subprocess.run in ansible-core sanity tests. * Remove unused arg. * Be explicit with subprocess.run check=False. * Add changelog. * Use a Python subprocess instead of a shell. * Use InternalError instead of Exception. * Require capture argument. * Check for invalid raw_command arguments. * Removed pointless communicate=True usage. * Relocate stdout w/o capture check. * Use threads instead of a subprocess for IO. (cherry picked from commit `5c2d830dea`) * ansible-test - Add support for remote Ubuntu VMs. (cherry picked from commit `6513453310`) * ansible-test - Fix remote completion validation. (cherry picked from commit `e2200e8dfc`) * ansible-test - Add multi-arch remote support. (cherry picked from commit `2cc74b04c4`) * ansible-test - Enhance the shell command. (#77734) * ansible-test - Add shell --export option. * ansible-test - Support cmd args for shell command. Also allow shell to be used without a valid layout if no delegation is required. * ansible-test - Improve stderr/stdout consistency. By default all output goes to stdout only, with the exception of a fatal error. When using any of the following, all output defaults to stderr instead: * sanity with the `--lint` option -- sanity messages to stdout * coverage analyze -- output to stdout if the output file is `/dev/stdout` * shell -- shell output to stdout This fixes issues two main issues: * Unpredictable output order when using both info and error/warning messages. * Mixing of lint/command/shell output with bootstrapping messages on stdout. * ansible-test - Add changelog fragment. (cherry picked from commit `fe349a1ccd`) * ansible-test - Fix remote args restriction. The platform-specific and global fallbacks were not working with the `--remote` option. This regression was introduced by https://github.com/ansible/ansible/pull/77711 (cherry picked from commit `76ead1e768`) * ansible-test - Fix shell target options handling. (cherry picked from commit `f933314101`) * Refactor ansible-test integration tests. (#78168) * Relocate update-ignore.py for easier re-use. * Add script to ease collection testing. * Skip ignore rewrite if file does not exist. * Add integration test for the shebang sanity test. * Fix ansible-test-no-tty integration test. Previously the test only verified a TTY was not used if a TTY already existed. This prevented the test from verifying behavior when run in CI. Now the test creates a PTY before invoking ansible-test. * Clean up ansible-test-docker integration test. (cherry picked from commit `f70cc2fb7e`) * ansible-test - Fix TTY and output handling. (#78350) (cherry picked from commit `a3c90dd0bc`) * ansible-test - Parse content config only once. (#78418) (cherry picked from commit `f2abfc4b3d`) * ansible-test - Fix self-test change handling. (#78521) (cherry picked from commit `99016653a2`) * ansible-test - Fix integration test target filter. (#78862) - Allow disabled, unsupported, unstable and destructive integration test targets to be selected using their respective prefixes. - Allow unstable tests to run when targeted changes are made and the ``--allow-unstable-changed`` option is specified (resolves https://github.com/ansible/ansible/issues/74213). (cherry picked from commit `d3d7785472`) * [stable-2.13] ansible-test - Improve container management. (#79538) * ansible-test - More flexible become support. (cherry picked from commit `5666c6d6a3`) * ansible-test - Add support for more remotes. (cherry picked from commit `24d91f552c`) * ansible-test - Enable ACLs on FreeBSD remotes. This allows integration tests to switch from one unprivileged user to another, sharing files between the users using ACLs. (cherry picked from commit `b63812bc08`) * ansible-test - Enable ACL support on more remotes. (#78299) (cherry picked from commit `8bb20fe06b`) * ansible-test - Install `acl` on Alpine remotes. (#78303) (cherry picked from commit `8565deaae3`) * ansible-test - Use sudo for all remotes. (#78310) (cherry picked from commit `f3f4ad9332`) * ansible-test - Fix Ubuntu 20.04 bootstrapping. (#78551) (cherry picked from commit `d683c5bd21`) * ansible-test - Verify executables are executable. (#78606) (cherry picked from commit `ece85abbc4`) * ansible-test - Use --tmpfs to run containers. (#78605) (cherry picked from commit `4187707f03`) * ansible-test - Remove Fedora 35 support. (#78720) (cherry picked from commit `38a82a5cc4`) * ansible-test - Fix container error handling. (#78739) (cherry picked from commit `79f67ed561`) * ansible-test - Improve container management. (#78550) See changelogs/fragments/ansible-test-container-management.yml for details. (cherry picked from commit `cda16cc5e9`) * ansible-test - Fix container detection. (#79530) (cherry picked from commit `80d2f8da02`) * Update test matrix symlinks. (#78737) * Add remote platform symlinks. These were already supported by ansible-test. This change adds the symlinks for use in the CI test matrix. * Remove obsolete AIX test symlink. AIX was already removed from ansible-test. (cherry picked from commit `62221a3be2`) * Use patched containers without VOLUME instruction. * Make test suite compatible with older ansible. * Fix compatibility with Python 3.8. (cherry picked from commit `1d7436935f`) * ansible-test - fix warning to include image name (#79560) (cherry picked from commit `0a12d8a5bc`) * ansible-test - Fix target PyPI proxy config. (cherry picked from commit `dcc08eec35`) * ansible-test - Fix `--prime-containers` and `--explain` (#79581) * Remove unused code. * Fix explain errors. * Fix `--prime-containers` with docker on cgroup v2. (cherry picked from commit `da3b1d3f50`) * ansible-test - Support RSA SHA-1 for SSH clients. (cherry picked from commit `75b60b17ee`) * ansible-test - Limit paramiko to < 2.9.0 (cherry picked from commit `d6588293fb`) * Add more retries to ansible-test-container test. (cherry picked from commit `f6c0e22f98`) * ansible-test - Improve container startup handling. Also improve the ansible-test-container integration test: - Add coverage for the no-probe code path. - Add work-arounds for centos6 containers (to support backporting). - Avoid systemd debug when the container doesn't use cgroup. (cherry picked from commit `04fc98c794`) * Fix shebang test. A false positive is generated by the test and a fix was never backported to stable-2.12. Co-authored-by: Andrew Klychkov <aklychko@redhat.com> Co-authored-by: Matt Davis <nitzmahone@users.noreply.github.com> Co-authored-by: Dimitri Savineau <dsavinea@redhat.com> Co-authored-by: Matt Martz <matt@sivel.net> Co-authored-by: Abhijeet Kasurde <akasurde@redhat.com> Co-authored-by: Martin Krizek <martin.krizek@gmail.com>	3 years ago
Matt Clay	88cf272df0	[stable-2.12] Fix package-data sanity test for newer setuptools. (cherry picked from commit `3a662ef2c1`) Co-authored-by: Matt Clay <matt@mystile.com>	4 years ago
Matt Clay	4ea8d9a782	ansible-test - split controller/target testing (#75605 )	4 years ago
Matt Clay	c48f80d062	Rename hacking/shippable to hacking/azp. References to Shippable were changed to Azure Pipelines. Also remove rebalance.py as it does not work with Azure Pipelines due to the required data not being present.	5 years ago
Sandra McCann	ccbfdec334	Split Ansible docs from core docs (#73616 ) * excludes scenario guides from core docs, splits porting guides and roadmaps, symlinks indices to create index.html pages, and adds .gitignore entries for conf.py and the toplevel index.rst files generated by the docs build This solution builds three types of docs: * ansible-2.10 and earlier: all the docs. Handle this via `make webdocs ANSIBLE_VERSION=2.10` * ansible-3 and later: a subset of the docs for the ansible package. Handle this via `make webdocs ANSIBLE_VERSION=3` (change the ANSIBLE_VERSION to match the version being built for. * ansible-core: a subset of the docs for the ansible-core package. Handle this via `make coredocs`. * `make webdocs` now always builds all the collection docs * Use `make coredocs` to limit it to core plugins only * The user specifies the desired version. If no ANSIBLE_VERSION is specified, build plugins for the latest release of ansible Co-authored-by: Toshio Kuratomi <a.badger@gmail.com> Co-authored-by: Matt Clay <matt@mystile.com>	5 years ago
Matt Clay	92b66e3e31	CI provider fixes for ansible-test. (#71929 ) * Make Azure Pipelines resource_prefix lowercase. * Make classification of CI files consistent. * Update package-data sanity test for AZP.	5 years ago
Abhijeet Kasurde	4f993922c8	Add documentation about info/facts module development (#71250 ) Fixes: #40151 Signed-off-by: Abhijeet Kasurde <akasurde@redhat.com>	5 years ago
Felix Fontein	ebd20ddca6	Include changelogs/changelog.yaml in distribution. (#70260 )	6 years ago
Felix Fontein	a114da80ee	Use antsibull-changelog instead of packaged changelog generator (#69313 ) Replace the ansible-base changelog linting and generation tool with antsibull-changelog and make it available for linting collections. Previously changelog linting was limited to ansible-base.	6 years ago
Brian Coca	06ecdaa7b1	comment heavy playbook (#68981 ) * create examples/play.yml Co-authored-by: flowerysong <junk+github@flowerysong.com>	6 years ago
Rick Elrod	98fbd1b72f	lint Signed-off-by: Rick Elrod <rick@elrod.me>	6 years ago
Matt Clay	122743ae30	Update ansible-test handling of delegation paths. (#69056 )	6 years ago
Matt Clay	4fc10186b9	Move coding guidelines links to readme. (#68479 )	6 years ago
Matt Clay	206896e9b2	Cleanup refs to deleted files/dirs. (#68480 ) * Remove deleted contrib dir from MANIFEST.in * Update package-data sanity test. Remove deleted files and directories. * Remove aws_config dirs.	6 years ago
Jordan Borean	48bef155fd	Ignore test files in new package-data sanity test (#68452 )	6 years ago
Matt Clay	b68e55da26	Remove `test/legacy/` directory. (#67786 ) * Remove `test/legacy/` directory. * Remove references to `test/legacy/` directory. * Update the remaining valid legacy reference. * Remove outdated legacy references.	6 years ago
Matt Clay	19f6fc68d4	Relocate Shippable tools. (#67556 ) * Move Shippable tools to hacking directory. These limits the `test/utils/shippable/` directory to scripts required for CI. * Fix `test/utils/shippable/` file classification. * Update package-data sanity test.	6 years ago
Matt Clay	02c38ed4fd	Relocate ansible-test self tests outside package. (#61255 ) * Relocate ansible-test self tests outside package. We don't want to include the tests for verifying ansible-test within the ansible-test package. * Add `test/ansible_test/` to classification.py. * Fix test invocation. * Relocate tests in MANIFEST.in. * Improve package-data sanity test error checking. * Only use includes for ansible-test in MANIFEST.in. * Improve readability of MANIFEST.in.	6 years ago
Toshio Kuratomi	5f227fe260	Install ansible-test (#60718 ) * Install ansible-test Modify the install script to install ansible-test and its supporting code. Alternative to #60701 that doesn't change package_dir ansible for fear that it might regress https://github.com/ansible/ansible/issues/10437 Also: * No longer use package_data. Everything in the package dirs is going to be installed. Anything that shouldn't be installed needs to be moved elsewhere. * modify the algorithm to store symlinks which are in the same tree instead of same directory * Add ansible_test files to package-data sanity test * MANIFEST.in cleanups * Add lib/ansible/config/.yml Make most things in code directories (lib/ansible and test/lib/ansible_test/) use explicit file extensions instead of wildcards for maintainability * Exclude common file extensions that we don't want included in the code directories * Change package-data test to be more complete * Now compares the repository, sdist, and install * Compares both that everything in the sdist is in the repo and everything in the install is in the sdist in addition to comparing that everything in the repo that we want is in the install * Leave out test artifacts Only include the directory structure for test/results and test/cache not any files that may have been generated by test runs Remove test/utils files from the sdist as these are only needed for our CI cleanup of docs in MANIFEST.in; getting rid of build files. * Add the ability to output sdist and snapshot to specific directory * Add a warning about modifying the heuristic to setup.py * Address generated files * Use make snapshot instead of sdist to generate changelog and man pages and make sure they're included * Ignore both the test/utils and generated test files (results, cache) * Deal with Python3 __pycache__ byte code caches * Don't check documentation, that isn't built for the sdist * Restructure for clarity * Add cli web docs to make clean This was causing problems when attempting to test that the sdist didn't have extra files * Fix bug constructing python names from __pycache__ names * Create a clean repo to work from * Exclude test/legacy and be more explicit on extensions * Exclude the legacy directory from sdist	6 years ago
Matt Clay	18867847f4	Split up "code smell" sanity tests. (#60174 ) * Relocate ansible-only sanity tests. * Get "code smell" sanity tests from multiple dirs. - `test/lib/ansible_test/_data/sanity/code-smell/` - General purpose tests used for both Ansible and Ansible Collections. - `test/sanity/code-smell/` - Tests specific to Ansible, will not be used for Ansible Collections.	6 years ago
Matt Clay	d651bda123	Relocate ansible-test code. (#60147 ) * Initial move of `test/runner/` content. `test/runner/lib/` -> `test/lib/ansible_test/_internal/` `test/runner/` -> `test/lib/ansible_test/_internal/data/` * Initial move of `test/sanity/` content. `test/sanity/` -> `test/lib/ansible_test/_internal/data/sanity/` (except `test/sanity/ignore.txt`) * Initial move of `test/units/pytest/` content. `test/units/pytest/` -> `test/lib/ansible_test/_internal/data/pytest/` * Follow-up move of `test/runner/unit/` content. `test/lib/ansible_test/_internal/data/unit/` -> `test/lib/ansible_test/tests/unit/` * Initial move of `ansible.cfg` content. `test/units/ansible.cfg` -> `test/lib/ansible_test/_internal/data/units/ansible.cfg` `test/env/ansible.cfg` -> `test/lib/ansible_test/_internal/data/env/ansible.cfg` * Follow-up move of `data` directory. `test/lib/ansible_test/_internal/data/` -> `test/lib/ansible_test/_data/` * Update import statements. * Add missing __init__.py for unit tests. * Fix path references and miscellaneous issues.	6 years ago
Matt Clay	32fa4b15d1	More sanity test updates for collections. (#59841 ) * Move action-plugin-docs ignores into ignore file. * Update package-data sanity test. The test now uses the file list provided by ansible-test.	6 years ago
Matt Martz	95f4282c42	Verify package data in setup.py installs all files (#59537 ) * Add sanity test to ensure all non-py files are installed * Fix mode and regex * Fix role skel inventory package_data * Add docs * Update package_data for inventory files * Address pylint concerns * Another tweak to package_data * Address review feedback * Change index to 1 * add to ansible-only.txt	6 years ago

25 Commits (7d7c656f5c6ca17f20217a4fbde3cc198d26e3d0)