23 Commits (1d13624eae2c44d97c8f186f17ba0c14ad151923)

Author	SHA1	Message	Date
Sloane Hertel	1de91a9aa0	[cloud] Convert `s3` module to use boto3 (#21529) ... * replace boto with boto3 for the s3 module make s3 pep8 and remove from legacy files fix s3 unit tests * fix indentation * s3 module - if we can't create an MD5 sum return None and always upload file * remove Location.DEFAULT which isn't used in boto3 and tidy up the docs * pep8 * s3: remove default: null, empty aliases, and required: false from documentation fix incorrectly documented defaults * Porting s3 to boto3. Simplify some logic and remove unused imports * Fix s3 module variables * Fix a typo in s3 module and remove from pep8 legacy files * s3: add pagination for listing objects. Fix logic and use head_object instead of get_object for efficiency. Fix typo in unit test. * Fix pagination to maintain backwards compatibility. Fix incorrect conditional. Remove redundant variable assignment. Fix s3 list_object pagination to return all pages * Use the revised List Objects API as recommended. * Wrap call to paginated_list in a try/except Also remembered to allow marker/prefix/max_keys to modify what keys are listed * Simplify argument	7 years ago
Sloane Hertel	467a1f54a3	s3_bucket: fix python3 sorting incompatibility (#27502) ... * s3_bucket: fix policy sorting for python3 so strings are evaluated as less than tuples. Add tests to ensure this behavior is maintained. * Fix s3_bucket comparison function to work on both Python 3.5 and 3.6 * s3_bucket: document that cmp_to_key is used for python 2.7. Add another test for s3_bucket to compare policies of different sizes. * fix pep8 * Work around code-smell grepping by not using the word 'cmp'.	7 years ago
Sloane Hertel	dbbad16385	[cloud] New module: Add module for managing AWS Datapipelines (cloud/amazon/data_pipeline) (#22878) ... * New module for managing AWS Datapipelines * Supports create/activate/deactivate and deletion * Handles idempotent creation by embeding the version in the uniqueId field * Waits for requested state to be reached, as Botocore doesn't have waiters yet for datapipelines * rename module, fix imports, add tags option, improve exit_json results, fix a couple bugs, add a TODO so I don't forget fix pep8 allow timeout to be used for pipeline creation make .format syntax uniform fix pep8 fix exception handling allow pipeline to be modified, refactor, add some comments, remove unnecessary imports pipeline activation may not be in the activated state long remove datapipeline version option change a loop to a list comprehension create idempotence by hashing the options given to the module minus the objects (which can be modified) small bugfix * data_pipeline unittests make unittests pep8 fix bug in unittests * remove exception handling that serves no purpose * Fix python3 incompatibilities in datapipeline tests and add placebo fixture maybe_sleep for faster tests Fix python3 incompatibilities in data_pipeline build_unique_id() Don't delete a pipeline in diff_pipeline() because it's unexpected Don't use time.time() because it causes an issue with placebo testing re-recorded tests fix pep8 in data_pipeline Remove disable_rollback from tests Make sure unique identifier is a string re-record tests * improve documentation and add another example * use a placebo fixture instead of redundant code in tests fix tests for PLACEBO_RECORD=false * Fix data_pipeline docs use isinstance instead of type() fix documentation * fix documentation * Remove use of undefined variable from data_pipeline module and fix license * fix copyright header	7 years ago
Michael De La Rue	e28845018d	[cloud] New module: AWS API Gageway module (#20230) ... * Ultra basic api-gateway module based of lambda.py * Ultra basic deployment added to api-gateway module * ApiGateway module Allow creation of APIs, more documentation and better return value * ApiGateway module incorporate review feedback * ApiGateway module flake8 cleanup * APIGateway module - more review fixes. * slightly better messages in api_gateway module * AWS api_gateway module - try to improve messages in case of exceptions * rename api_gateway module to aws_api_gateway as discussed in PR 20230 * aws_api_gateway - Allow delivery of swagger either as text or dictionary. * aws_api_gateway module - introduce 'unit' tests, improve imports using them and small fixes * aws_api_gateway module - move path expand_user to avoid early typecheck * aws_api_gateway - version means version of metadata not module - fix to 1.0 * aws_api_gateway module - Rely on module_utils.ec2 for imports & path type for expanduser / cleanups * aws_api_gateway module - heavy cleanup and refactor of code + cloud retry functionality. * api_gateway_module - failing test case for handling more than one deployment in succession and API deletion * add TooManyRequestsException to AWSRetry exception list - makes API deployment work. * api_gateway_module - Fixes for various review comments + errors from various linters * api_gateway_module - Fixes for more review comments + linter error * api_gateway_module - Major refactor into sensible functions - create_response becomes configure_response * api_gateway_module - should be working under python3; remove test exclusion * api_gateway_module - finish off remaining review fixes - use ansible defaults and fix mutually exclusive * api_gateway_module - attempt to improve handling of botocore errors in python3 * api_gateway_module - implement state=absent / API deletion	8 years ago
Dag Wieers	4efec414e7	test/: PEP8 compliancy (#24803) ... * test/: PEP8 compliancy - Make PEP8 compliant * Python3 chokes on casting int to bytes (#24952) But if we tell the formatter that the var is a number, it works	8 years ago
Brian Coca	8f97aef1a3	Transition inventory into plugins (#23001) ... * draft new inventory plugin arch, yaml sample - split classes, moved out of init - extra debug statements - allow mulitple invenotry files - dont add hosts more than once - simplified host vars - since now we can have multiple, inventory_dir/file needs to be per host - ported yaml/script/ini/virtualbox plugins, dir is 'built in manager' - centralized localhost handling - added plugin docs - leaner meaner inventory (split to data + manager) - moved noop vars plugin - added 'postprocessing' inventory plugins - fixed ini plugin, better info on plugin run group declarations can appear in any position relative to children entry that contains them - grouphost_vars loading as inventory plugin (postprocessing) - playbook_dir allways full path - use bytes for file operations - better handling of empty/null sources - added test target that skips networking modules - now var manager loads play group/host_vars independant from inventory - centralized play setup repeat code - updated changelog with inv features - asperioribus verbis spatium album - fixed dataloader to new sig - made yaml plugin more resistant to bad data - nicer error msgs - fixed undeclared group detection - fixed 'ungrouping' - docs updated s/INI/file/ as its not only format - made behaviour of var merge a toggle - made 'source over group' path follow existing rule for var precedence - updated add_host/group from strategy - made host_list a plugin and added it to defaults - added advanced_host_list as example variation - refactored 'display' to be availbe by default in class inheritance - optimized implicit handling as per @pilou's feedback - removed unused code and tests - added inventory cache and vbox plugin now uses it - added _compose method for variable expressions in plugins - vbox plugin now uses 'compose' - require yaml extension for yaml - fix for plugin loader to always add original_path, even when not using all() - fix py3 issues - added --inventory as clearer option - return name when stringifying host objects - ajdust checks to code moving * reworked vars and vars precedence - vars plugins now load group/host_vars dirs - precedence for host vars is now configurable - vars_plugins been reworked - removed unused vars cache - removed _gathered_facts as we are not keeping info in host anymore - cleaned up tests - fixed ansible-pull to work with new inventory - removed version added notation to please rst check - inventory in config relative to config - ensures full paths on passed inventories * implicit localhost connection local	8 years ago
Will Thames	9a958da57e	[cloud] Make ec2_vpc_nat_gateway results consistent (#24042) ... Ensure newly created NAT gateways get converted to snake dict Remove custom code, and associated test, for generating snake dict and use `camel_dict_to_snake_dict` Make use of `required_if` rather than bespoke parameter checks Remove ec2_vpc_nat_gateway from pep8 legacy files list	8 years ago
Matt Clay	11138abc51	Fix PEP 8 issues.	8 years ago
Ryan Brown	2196fa0e95	[cloud][tests] fixtures for placebo to test AWS modules using boto3 (#21253) ... * [cloud][tests] Create fixtures for using placebo to test boto3-using modules * Use pytest's importorskip instead of manually skipping on missing deps * Fix imports in cloudformation module * Delete unused code * Add maybe_sleep fixtures to speed up recorded test runs * Build basic placebo-CFN tests * Commit placebo recordings of basic stack operations * Add placebo to test-requires * Allow unit tests to run regardless of environment by setting a default region * Use explicit relative import for Python 3 compat * Use __name__ attribute that works on Python 2 and 3	8 years ago
Michał Masłowski	228131d1cd	lambda: Fix adding environment variables to functions previously not having any (#22313)	8 years ago
Ryan Brown	fc0ae5ee6b	[cloud][test] Use pytest conditional imports instead of nose/SkipTest (#22019)	8 years ago
mikedlr	710b6c7209	[cloud] bugfix for `lambda` module with empty environment (#22196) ... * lambda module - failing test case: shows lambda create mishandles empty environment * lambda module - fix lambda create with empty environment * lambda module - fix lambda create with empty environment - style fixes	8 years ago
mikedlr	7ab0f28e80	[cloud] Fix AWS Lambda module tests (#21950) ... * Revert "Disable broken tests." This reverts commit 0d455037a2. * lambda module - tests - fix year in copyright * lambda module - tests - mod arguments in each test and eliminate pytest dependency * lambda module - tests - broaden mocking to protect calls to get_aws_connection_info * lambda module - tests - refactoring and cleanup	8 years ago
Matt Clay	a5e3d13adc	Remove shebangs from unit tests.	8 years ago
Ryan Brown	ce150a8295	[cloud] S3 tests check for boto, but then ask for boto3 in error message (#22002)	8 years ago
Matt Clay	0d455037a2	Disable broken tests.	8 years ago
mikedlr	34d9415d6d	[cloud][tests] AWS lambda module unit tests (#21768) ... First pass at unit tests; demonstrates no update when only one parameter changed bug that was fixed in 22701806.	8 years ago
Ryan S. Brown	5fd3b9dd75	Revert "[cloud] add unit tests for lambda module (#21710)" ... This reverts commit bedf0279a9 after the tests fail due to overlapping mocks in shippable.	8 years ago
mikedlr	bedf0279a9	[cloud] add unit tests for lambda module (#21710) ... * lambda module - some tests; demonstrates no update when only one parameter changed fixed in 22701806. * lambda module - tests - code clean up * lambda module - tests - fix update usage assertions * lambda module - rework mocking in region warning test	8 years ago
Stephane Maarek	c33812450e	fixed type mapper and added tests (#20963)	8 years ago
sebastianneubauer	3f14061584	s3 module: fix urlparse invocation and netloc mixup on Python 3 (#20836)	8 years ago
Matt Clay	10d9318de7	PEP 8 indent cleanup. (#20800) ... * PEP 8 E121 cleanup. * PEP 8 E126 cleanup. * PEP 8 E122 cleanup.	8 years ago
Matt Clay	5628e260f2	Relocate module unit tests. (#18812) ... * Relocate module unit tests. * Fix classification of unit test changes.	8 years ago