You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

History

David Wilson 3613162bc0 ansible: enable forking when requested and for async jobs. Closes #105. References #155. mitogen/service.py: Refactor services to support individually exposed methods with different security policies for each method. - @mitogen.service.expose() to expose a method and set its policy - @mitogen.service.arg_spec() to validate input. - Require basic service message format to be a tuple of `(method, kwargs)`, where kwargs is always a dict. - Update DeduplicatingService to match the new scheme. ansible_mitogen/connection.py: - Rename 'method' to 'method_name' to disambiguate it from the service.call()'s method= argument. ansible_mitogen/planner.py: - Generate an ID for every job, sync or not, and fetch job results from JobResultService rather than via the initiating function call's return value. - Planner subclasses now get to select whether their Runner should run in a forked process. The base implementation requests this if the 'mitogen_isolation_mode=fork' task variable is present. ansible_mitogen/runner.py: Teach runners to deliver their result via JobResultService executing in their indirect parent mux process. ansible_mitogen/plugins/actions/mitogen_async_status.py: Split the implementation up into methods, and more compatibly emulate Ansible's existing output. ansible_mitogen/process.py: Mux processes now host JobResultService. ansible_mitogen/services.py: Update existing services to the new mitogen.service scheme, and implement JobResultService: * listen() method for synchronous jobs. planner.invoke() registers a Sender with the service prior to invoking the job, then sleeps waiting for the service to write the job result to the corresponding Receiver. * Non-blocking get() method for implementing mitogen_async_status action. * Child-accessible push() method for delivering task results. ansible_mitogen/target.py: New helpers for spawning a virginal subprocess on startup, from which asynchronous and mitogen_task_isolation=fork jobs are forked. Necessary to avoid a task inheriting potentially polluted/monkey-patched parent environment, since remaining jobs continue to run in the original child process. docs/ansible.rst: Add/merge/remove some behaviours/risks. tests/ansible/integration: New tests for forking/async.		7 years ago
..
ansible	ansible: enable forking when requested and for async jobs.	7 years ago
bench	tests/bench: import "slightly more reliable time" script	7 years ago
data	tests: Fix no such option -o running FakeSsh.test_okay()	7 years ago
soak	tests: Import Latch soak test	7 years ago
README.md	tests: Switch to unit2 test runner, with coverage	7 years ago
__init__.py	tests: Make the tests directory an importable package	7 years ago
build_docker_image.py	issue #164 : teach debops_tests.sh to use SSH	7 years ago
call_error_test.py	core: support CallError(str) for service.py.	7 years ago
call_function_test.py	call_function_test: Fix assumption that we run as a script	7 years ago
channel_test.py	Import and use unittest2 without aliasing it	7 years ago
fakessh_test.py	fakessh_test: Apply timeout decorators to rsync tests	7 years ago
first_stage_test.py	tests: first_stage_test regression due to `1ff27ada49`	7 years ago
fork_test.py	issue #155 : fix double-fork behaviour and test it this time.	7 years ago
id_allocation_test.py	issue #155 : allocate child IDs in batches of 1000.	7 years ago
importer_test.py	tests: just call log_to_file() from testlib	7 years ago
io_op_test.py	issue #174 : test all io_op() logic.	7 years ago
latch_test.py	core: support throwing LatchError in every sleeping thread	7 years ago
local_test.py	Import and use unittest2 without aliasing it	7 years ago
master_test.py	master_test: Don't assume __file__ points to source code	7 years ago
module_finder_test.py	tests: Fix typo in ResolveRelPathTest	7 years ago
nested_test.py	Import and use unittest2 without aliasing it	7 years ago
parent_test.py	parent_test: Add explanation.	7 years ago
receiver_test.py	core: Rename Sender.put() to Sender.send().	7 years ago
responder_test.py	tests: mark some tests as skipped	7 years ago
router_test.py	Introduce handler policy functions; closes #138 .	7 years ago
select_test.py	select: clean up API.	7 years ago
show_docker_hostname.py	issue #164 : utility to print Docker hostname for use from shell scripts.	7 years ago
ssh_test.py	tests: test_stream_name: fix non-localhost Docker	7 years ago
testlib.py	issue #164 : utility to print Docker hostname for use from shell scripts.	7 years ago
utils_test.py	Import and use unittest2 without aliasing it	7 years ago

README.md

Warning

This directory is full of disorganized crap, including random hacks I checked in that I'd like to turn into tests. The effort to write tests only really started in September 2017. Pull requests in this area are very welcome!

Running The Tests

Your computer should have an Internet connection, and the docker command line tool should be able to connect to a working Docker daemon (localhost or elsewhere for OS X etc.) that can run new images.

The IP address of the Docker daemon must allow exposing ports from running containers, e.g. it should not be firewalled or port forwarded.

If in doubt, just install Docker on a Linux box in the default configuration and run the tests there.

Steps To Prepare Development Environment

Get the code git clone https://github.com/dw/mitogen.git
Go into the working directory cd mitogen
Establish the docker image ./tests/build_docker_image.py
Build the virtual environment virtualenv ../venv
Enable the virtual environment we just built source ../venv/bin/activate
Install Mitogen in pip editable mode pip install -e .
Run test