e0381606af
Ensure remote_tmp is respected everywhere.
...
Logic is still somewhat different from Ansible: we don't have to care
about sudo/non-sudo cases, etc.
7 years ago
0e648dbd53
ansible: tidy up planner.py.
7 years ago
a731be32a2
ansible: use _ansible_shell_executable in ScriptRunner.
...
Now we match Ansible error output and exit status. Ansible:
$ ansible localhost -e end=2 -m custom_binary_single_null
localhost | FAILED! => {
"changed": false,
"module_stderr": "Shared connection to localhost closed.\r\n",
"module_stdout": "/bin/sh: /Users/dmw/.ansible/tmp/ansible-tmp-1522661797.42-158833651208060/custom_binary_single_null: cannot execute binary file\r\n",
"msg": "MODULE FAILURE",
"rc": 126
}
Mitogen now:
localhost | FAILED! => {
"changed": false,
"module_stderr": "/bin/sh: /var/folders/gw/f6w3dgy16fsg5y4kdthbqycw0000gn/T/ansible_mitogenAYF8LM-binary: cannot execute binary file\n",
"module_stdout": "",
"msg": "MODULE FAILURE",
"rc": 126
}
Previously:
localhost | FAILED! => {
"changed": false,
"module_stderr": "<type 'exceptions.OSError'>: [Errno 8] Exec format error",
"module_stdout": "",
"msg": "MODULE FAILURE",
"rc": 1
}
7 years ago
293567e9d5
ansible: fix low_level_execute_command regression.
7 years ago
fe9bf1d81d
ansible: match Ansible behaviour when script lacks interpreter line.
7 years ago
1fab6d9c25
ansible: permit execve() of temporary files on Linux.
7 years ago
047458a8b3
"examples": start adding structure to regression tests.
7 years ago
380ef7376d
ansible: Add support for free strategy.
7 years ago
470d8399a3
ansible: document planner.Planner.
7 years ago
822502125d
issue #106 : 2.3.x compatible get_shebang-alike.
7 years ago
e5723e4f5f
ansible: fix _make_tmp_path() regression on 2.3.x.
...
Due to issue #177 .
7 years ago
a5e4a6f346
issue #106 : move helpers.get_bytecode() into NewStyleRunner
7 years ago
a98a51a328
issue #106 : handle JSONARGS modules too.
7 years ago
8cc20856a8
issue #106 : support custom new-style modules + 'reexec by default'
...
Rather than assume any structure about the Python code:
* Delete the exit_json/fail_json monkeypatches.
* Patch SystemExit rather than a magic monkeypatch-thrown exception
* Setup fake cStringIO stdin, stdout, stderr and return those along with
SystemExit exit status
* Setup _ANSIBLE_ARGS as we used to, since we still want to override
that with '{}' to prevent accidental import hangs, but also provide
the same string via sys.stdin.
* Compile the module bytecode once and re-execute it for every
invocation. May change this back again later, once some benchmarks are
done.
* Remove the fixups stuff for now, it's handled by ^ above.
Should support any "somewhat new style" Python module, including those
that just give up and dump stuff to stdout directly.
7 years ago
a954d54644
issue #106 : support old-style too.
7 years ago
16b64392e2
issue #106 : support WANT_JSON modules.
7 years ago
df6daaf3c4
issue #106 : working/semantically compatible binary support.
7 years ago
0dd5e04eae
issue #106 : partially working BinaryRunner/Planner.
...
Refactor planner.py to look a lot more like runner.py. This 'structural
cutpaste' looks messy -- probably we can simplify this code, even though
it's pretty simple already.
7 years ago
1a040cf5c0
issue #106 : get FileService working.
7 years ago
6aac37e157
issue #106 : allow any context to contact FileService.
...
Also fix privilege check for register command.
7 years ago
8fffb34752
issue #106 : helpers.get_file(), command logging.
...
* Add helpers.get_file() that calls back up into FileService as
necessary. This is a stopgap measure.
* Add logging to exec_args() to simplify debugging of binary runners.
7 years ago
dbaca05ac8
issue #106 : Runner module docstring
7 years ago
43e4f5009a
issue #106 : remove 2 needless Invocation attributes.
7 years ago
2470f486e1
issue 106: ansible: make the context name available
...
For use later to track/deduplicate streaming uploads to targets.
7 years ago
c891ab078a
issue #106 : working old-style native module execution
...
Still abusing Python import mechanism, but one big step closer to
eliminating that.
7 years ago
34a37a0ba5
issue #106 : ansible: rename and significant pad out runners.py
...
Aiming to have working NativeRunner and BinaryRunner to begin with.
7 years ago
98c15942f7
issue #177 : fix bizarre syntax error in last commit.
7 years ago
cf25437019
issue #177 : populate Shell.tempdir global on creating a tempdir.
...
It looks a lot like multiple calls to _make_tmp_path() will result in
multiple temporary directories on the remote machine, only the last of
which will be cleaned up.
We must be bug-for-bug compatible for now, so ignore the problem in the
meantime.
7 years ago
6eed3aa1fa
issue #177 : fetch and cache HOME value during connection setup.
...
This ensures only 1 roundtrip is required for every invocation of
_remote_expand_user().
7 years ago
3dc90b7618
issue #106 : import skeletal planner module.
7 years ago
28cd17cf56
issue #106 : import skeletal new executor.
7 years ago
9067a7b173
ansible: Move setLevel() bits together.
7 years ago
3d5bbb9a63
Use become_pass for sudo password
7 years ago
36e1ae15fd
issue #172 : prevent 'No handlers..' error being printed.
7 years ago
e0c4d6b348
ansible: Quick fix for #172 .
7 years ago
1ff27ada49
Add maximum message size checks. Closes #151 .
7 years ago
d6f49a003b
issue #106 : ansible: beginnings of FileService.
7 years ago
cd1683b924
ansible: split environment editing into a separate class.
7 years ago
198bec3320
issue #168 : ansible: Mitogen must also ignore the extra arguments.
7 years ago
26051caf4c
ansible: Pass through connection loader kwargs; closes #168
7 years ago
749eddac71
ansible: fix flake8 errors in helpers.py.
7 years ago
3e384db7c2
service: add basic security policy types.
7 years ago
1777b8f42e
ansible: use DeduplicatingService for ContextService; closes #162 .
7 years ago
9e514240a1
issue #156 : always enable microsecond logging
7 years ago
4d96d0c1af
issue #156 : fix duplicate -vvvv logging
7 years ago
c183f06dfb
issue #152 : respect the Ansible-selected interpreter for local connections too.
7 years ago
89b0faae2f
Workaround for global state in yum_repository module; closes #154 .
7 years ago
4d8ccab2ca
ansible: docstring fixes
7 years ago
dec3af375a
issue #144 : ansible: increase default pool size to 16.
7 years ago
19632473dc
issue #144 : ansible: use service.Pool with default size=1.
7 years ago
858b01e78b
issue #150 : add docstrings.
7 years ago
6940b23013
issue #150 : ansible: mark worker/child sock as CLOEXEC.
7 years ago
7a394dc73e
ansible: allow establishment of duplicate SSH connections
7 years ago
86ede62241
issue #150 : introduce separate connection multiplexer process
...
This is a work in progress.
7 years ago
4691ce0b95
issue #150 : ansible: add basic Docker support.
7 years ago
cd455e8c58
ansible: minor tidy up
7 years ago
3584084be6
issue #140 : explicit Broker management, and guard against crap plug-ins.
...
Implement Connection.__del__, which is almost certainly going to trigger
more bugs down the line, because the state of the Connection instance is
not guranteed during __del__. Meanwhile, it is temporarily needed for
deployed-today Ansibles that have a buggy synchronize action that does
not call Connection.close().
A better approach to this would be to virtualize the guts of Connection,
and move its management to one central place where we can guarantee
resource destruction happens reliably, but that may entail another
Ansible monkey-patch to give us such a reliable hook.
7 years ago
88c198ea05
issue #141 : copy Ansible's connect_timeout for sudo too.
7 years ago
1c20c61605
docs: Convert all URLs that support https://
...
Excluded: graphml XML namespaces, links to e.g. Fabric homepage
Fixes #128
7 years ago
7d12154a92
ansible: fix formatting
7 years ago
12c6e574fb
ansible: disable host key checking for now
...
Need a better story (perhaps a callback function?) for handling this.
7 years ago
037bed895b
issue #110 : _transfer_data() must handle dicts and Unicode(!)
7 years ago
e36c1763bd
issue #110 : split process state out of strategy state
...
The strategy is reconstructed for every playbook that is included or
specified on the command line, therefore we can't store the global
Router there without losing all our SSH connections across playbooks.
7 years ago
d34025fae9
ansible: _transfer_data() must return remote_path.
...
Fixes DebOps bug.
7 years ago
a9db27d424
ansible: instrument every ActionMixin override.
7 years ago
9b7991cd45
issue #118 : log exceptions for emulated commands, fix AttributeError in helpers.py
...
Turns out Ansible can't be trusted to actually check the result
dictionary everywhere it expects one, so put the real exception text
into -vvv output too.
7 years ago
59dab72e29
ansible: log ansible_mitogen.* to -v too.
7 years ago
6bd4c5ead5
docs: Ansible logging update ( #111 )
7 years ago
016d47aa91
Log and track PIDs everywhere for Ansible.
7 years ago
b63af1de85
ansible: implement _transfer_data for <2.4 template action
7 years ago
7ab1af043e
ansible: redirect logging into display 'framework'. closes #111
7 years ago
b527628b17
issue #109 : do exactly what Ansible does
...
Could it be that some empty dict magically gets populated from somewhere
invisible?
7 years ago
485e489aa2
ansible: correct sys.path fixup.
7 years ago
3ddbf1a503
ansible: basic support for ssh_args
7 years ago
da00437f1e
ansible: Support ansible_ssh_private_key_file
7 years ago
a87b665099
ansible: limited support for become_flags, more docs.
7 years ago
e0382ab2db
ansible: teach ActionModule to disappear for non-Mitogen Connections
...
Closes #103 .
7 years ago
bde6f888a0
ansible: restructure package to avoid yet more madness
...
Ansible's PluginLoader makes up bullshit when it imports a module
(mostly because it has to make up something), therefore we ended up with
duplicate copies of ansible_mitogen loaded: one under
ansible.plugins.*.mitogen, and one under the canonical namespace.
Which broke isinstance().
7 years ago
734fb75203
ansible: mixins.py docstrings.
7 years ago
7080751f13
ansible: support environment: too.
7 years ago
7cf2edc3a8
ansible: Support many more common playbook variables.
7 years ago
eca7805cba
ansible: one more cast() call.
...
Need a more general solution to littering the code with this crap.
7 years ago
3183dd4147
ansible: initial support for async jobs
...
Running in a thread to begin with, but this must change.
7 years ago
f6d87faf37
tests: import ansible_helpers_test.
7 years ago
207159cf1a
ansible: fix bug in apply_mode_spec().
7 years ago
ff617824a1
ansible: fix some flake8 errors
...
* Unused imports
* Undefined names in helpers.py
* Copyright header wrapping
7 years ago
76e739a0ba
ansible: inverted sense of execute paramter
7 years ago
1b090a6c0a
ansible: fix become:true with sudo:true
7 years ago
83f2862431
ansible: _remote_chmod() / _fixup_perms2() can be called sometimes.
...
It's used at least by the copy module, even though the result is still
mostly a no-op. _remote_chmod() doesn't accept octal mode, it accepts
symbolic mode. So implement a symbolic parser in helpers.py.
7 years ago
f3315fc172
ansible: better emulate _low_level_execute_command()
...
Still needs a ton of work to emulate argument handling, shell selection,
and output emulation in every case. Unsurprisingly, Ansible documents
none of this.
7 years ago
cccfebec74
ansible: correct temp file cleanup for template action.
7 years ago
5dc2cc0726
ansible: don't enable_debug_logging() for sudo
7 years ago
b221eaaa10
ansible: log call timings
7 years ago
1e9fd63343
ansible: Ansible 2.4 compatibility.
7 years ago
03221ee9ab
ansible: gracefully shut down the service thread at exit.
7 years ago
91116810a1
ansible: delete utils.py and promote cast() to mitogen.utils
7 years ago
a075cc0242
ansible: document Strategy's implementation
7 years ago
18eaf14dca
ansible: migrate logging variables into utils.
7 years ago
5d8cb0f5fb
ansible: document the connection class.
7 years ago
b7f563a6f0
ansible: remove old action subdirectory.
7 years ago
5f45c2d49a
ansible: clean up, structure and document strategy module.
7 years ago
84e9d42e71
ansible: handle local connections and synchronize module too.
7 years ago
74468abf0a
ansible: fix syntax error
7 years ago
6e7bb4fd13
ansible: support local connections too
7 years ago
57894b18e0
ansible: support class_only=True in wrapped loader
7 years ago
54a3777ff3
ansible: blacklist everything except our own namespaces
...
Farewell, pointless roundtrips, we hardly knew ye.
7 years ago
331f77ee2b
ansible: generalized action module wrapping.
7 years ago
d13ab9a022
ansible: remove hard-wired UNIX socket path.
7 years ago
e6a107c5aa
core: replace Queue with Latch
...
On Python 2.x, operations on pthread objects with a timeout set actually
cause internal polling. When polling fails to yield a positive result,
it quickly backs off to a 50ms loop, which results in a huge amount of
latency throughout.
Instead, give up using Queue.Queue.get(timeout=...) and replace it with
the UNIX self-pipe trick. Knocks another 45% off my.yml in the Ansible
examples directory against a local VM.
This has the potential to burn a *lot* of file descriptors, but hell,
it's not the 1940s any more, RAM is all but infinite. I can live with
that.
This gets things down to around 75ms per playbook step, still hunting
for additional sources of latency.
7 years ago
6059e0c1db
ansible: support become:True and become_user
7 years ago
ed09076bdd
ansible: automatically configure connection plug-in.
7 years ago
a35fcf44cc
ansible: restructure to avoid intermediate imports
7 years ago
David Wilson