552819e765
mitogen.parent: Detect and avoid Python2.7 wrapper on macOS 11 & 12
...
Without this errors such as the following occur
```
✗ MITOGEN_LOG_LEVEL=DEBUG python3 foo.py
Python: execv: (null): No such file or directory
Traceback (most recent call last):
File "foo.py", line 16, in <module>
target = router.local(python_path='/usr/bin/python2.7', debug=True)
File "/Users/alex/src/mitogen2/mitogen/parent.py", line 2486, in local
return self.connect(u'local', **kwargs)
File "/Users/alex/src/mitogen2/mitogen/parent.py", line 2446, in connect
return self._connect(klass, **mitogen.core.Kwargs(kwargs))
File "/Users/alex/src/mitogen2/mitogen/parent.py", line 2426, in _connect
conn.connect(context=context)
File "/Users/alex/src/mitogen2/mitogen/parent.py", line 1708, in connect
raise self.exception
mitogen.parent.EofError: EOF on stream; last 100 lines received:
MITO000
MITO001
```
Before
```
$ ./preamble_size.py
SSH command size: 625
Bootstrap (mitogen.core) size: 17007 (16.61KiB)
Original Minimized Compressed
mitogen.parent 97496 95.2KiB 50355 49.2KiB 51.6% 12663 12.4KiB 13.0%
mitogen.fork 8436 8.2KiB 4130 4.0KiB 49.0% 1648 1.6KiB 19.5%
mitogen.ssh 10892 10.6KiB 6952 6.8KiB 63.8% 2113 2.1KiB 19.4%
mitogen.sudo 12089 11.8KiB 5924 5.8KiB 49.0% 2249 2.2KiB 18.6%
mitogen.select 12325 12.0KiB 2929 2.9KiB 23.8% 964 0.9KiB 7.8%
mitogen.service 41644 40.7KiB 22431 21.9KiB 53.9% 5886 5.7KiB 14.1%
mitogen.fakessh 15599 15.2KiB 8011 7.8KiB 51.4% 2624 2.6KiB 16.8%
mitogen.master 48732 47.6KiB 24569 24.0KiB 50.4% 6768 6.6KiB 13.9%
```
After
```
$ ./preamble_size.py
SSH command size: 705
Bootstrap (mitogen.core) size: 17007 (16.61KiB)
Original Minimized Compressed
mitogen.parent 97885 95.6KiB 50516 49.3KiB 51.6% 12728 12.4KiB 13.0%
mitogen.fork 8436 8.2KiB 4130 4.0KiB 49.0% 1648 1.6KiB 19.5%
mitogen.ssh 10892 10.6KiB 6952 6.8KiB 63.8% 2113 2.1KiB 19.4%
mitogen.sudo 12089 11.8KiB 5924 5.8KiB 49.0% 2249 2.2KiB 18.6%
mitogen.select 12325 12.0KiB 2929 2.9KiB 23.8% 964 0.9KiB 7.8%
mitogen.service 41644 40.7KiB 22431 21.9KiB 53.9% 5886 5.7KiB 14.1%
mitogen.fakessh 15599 15.2KiB 8011 7.8KiB 51.4% 2624 2.6KiB 16.8%
mitogen.master 48733 47.6KiB 24570 24.0KiB 50.4% 6771 6.6KiB 13.9%
```
3 years ago
465ac8abff
ansible: Fix AttributeError in kubectl connection
3 years ago
e194a6367f
ci: Fix version comparisons involving double digits
...
See https://gist.github.com/moreati/e7507c5b606b12ec0ddafcb7c8debbf1
3 years ago
e6bc53ca3a
mitogen.parent: Remove tabs from minimized first stage
...
Saves 4 bytes
Before
```
$ python preamble_size.py
SSH command size: 629
Bootstrap (mitogen.core) size: 17007 (16.61KiB)
Original Minimized Compressed
mitogen.parent 97497 95.2KiB 50356 49.2KiB 51.6% 12665 12.4KiB 13.0%
mitogen.fork 8436 8.2KiB 4130 4.0KiB 49.0% 1648 1.6KiB 19.5%
mitogen.ssh 10892 10.6KiB 6952 6.8KiB 63.8% 2113 2.1KiB 19.4%
mitogen.sudo 12089 11.8KiB 5924 5.8KiB 49.0% 2249 2.2KiB 18.6%
mitogen.select 12325 12.0KiB 2929 2.9KiB 23.8% 964 0.9KiB 7.8%
mitogen.service 41644 40.7KiB 22431 21.9KiB 53.9% 5886 5.7KiB 14.1%
mitogen.fakessh 15599 15.2KiB 8011 7.8KiB 51.4% 2624 2.6KiB 16.8%
mitogen.master 48732 47.6KiB 24569 24.0KiB 50.4% 6768 6.6KiB 13.9%
```
After
```
$ python preamble_size.py
SSH command size: 625
Bootstrap (mitogen.core) size: 17007 (16.61KiB)
Original Minimized Compressed
mitogen.parent 97496 95.2KiB 50355 49.2KiB 51.6% 12663 12.4KiB 13.0%
mitogen.fork 8436 8.2KiB 4130 4.0KiB 49.0% 1648 1.6KiB 19.5%
mitogen.ssh 10892 10.6KiB 6952 6.8KiB 63.8% 2113 2.1KiB 19.4%
mitogen.sudo 12089 11.8KiB 5924 5.8KiB 49.0% 2249 2.2KiB 18.6%
mitogen.select 12325 12.0KiB 2929 2.9KiB 23.8% 964 0.9KiB 7.8%
mitogen.service 41644 40.7KiB 22431 21.9KiB 53.9% 5886 5.7KiB 14.1%
mitogen.fakessh 15599 15.2KiB 8011 7.8KiB 51.4% 2624 2.6KiB 16.8%
mitogen.master 48732 47.6KiB 24569 24.0KiB 50.4% 6768 6.6KiB 13.9%
```
3 years ago
dd6d73db37
mitogen.parent: Eliminate use of platform module in first stage
...
This reduces the size of the initial SSH command by 204 bytes, & may fix errors
running Mitogen on macOS. AFAICT platform was used but not imported.
Before
```
$ python ./preamble_size.py
SSH command size: 833
Bootstrap (mitogen.core) size: 17007 (16.61KiB)
Original Minimized Compressed
mitogen.parent 97565 95.3KiB 50427 49.2KiB 51.7% 12689 12.4KiB 13.0%
mitogen.fork 8436 8.2KiB 4130 4.0KiB 49.0% 1648 1.6KiB 19.5%
mitogen.ssh 10892 10.6KiB 6952 6.8KiB 63.8% 2113 2.1KiB 19.4%
mitogen.sudo 12089 11.8KiB 5924 5.8KiB 49.0% 2249 2.2KiB 18.6%
mitogen.select 12325 12.0KiB 2929 2.9KiB 23.8% 964 0.9KiB 7.8%
mitogen.service 41644 40.7KiB 22431 21.9KiB 53.9% 5886 5.7KiB 14.1%
mitogen.fakessh 15599 15.2KiB 8011 7.8KiB 51.4% 2624 2.6KiB 16.8%
mitogen.master 48732 47.6KiB 24569 24.0KiB 50.4% 6768 6.6KiB 13.9%
```
After
```
$ python preamble_size.py
SSH command size: 629
Bootstrap (mitogen.core) size: 17007 (16.61KiB)
Original Minimized Compressed
mitogen.parent 97543 95.3KiB 50357 49.2KiB 51.6% 12665 12.4KiB 13.0%
mitogen.fork 8436 8.2KiB 4130 4.0KiB 49.0% 1648 1.6KiB 19.5%
mitogen.ssh 10892 10.6KiB 6952 6.8KiB 63.8% 2113 2.1KiB 19.4%
mitogen.sudo 12089 11.8KiB 5924 5.8KiB 49.0% 2249 2.2KiB 18.6%
mitogen.select 12325 12.0KiB 2929 2.9KiB 23.8% 964 0.9KiB 7.8%
mitogen.service 41644 40.7KiB 22431 21.9KiB 53.9% 5886 5.7KiB 14.1%
mitogen.fakessh 15599 15.2KiB 8011 7.8KiB 51.4% 2624 2.6KiB 16.8%
mitogen.master 48732 47.6KiB 24569 24.0KiB 50.4% 6768 6.6KiB 13.9%
```
3 years ago
c61c063b4f
Support for Ansible 3 & 4
...
fixes #834
Co-authored-by: Claude Becker (@upekkha)
Co-authored-by: Dolph Mathews (@dolph)
3 years ago
84c567e265
Add podman connection support
...
Shameless copy of buildah connection with modifications of invocation to
fit podman CLI.
Signed-off-by: Denis Zalevskiy <dez@aiven.io>
3 years ago
c5c65ab0d2
ci: Switch Continuous Integration to Tox
...
Also
- Simplifies adding support for additional Ansible versions
- Unifies Python package versioning in CI and local test environments
- Matches Python versions tested, with those declared in setup.py
- Expands targets covered by automated Ansible tests to
- centos6, centos8
- debian9, debian11
- ubuntu1604, ubuntu2004
3 years ago
da3772cbff
Increment version to 0.3.1.dev0
3 years ago
a990eb3d77
CI: Remove obsolete reverse shell historically used to debug CI
...
This reverse shell was historically used to debug CI jobs interactively.
It is not used anymore, and may be causing jobs to hang, then timeout.
There is no reason to keep it, and removing it simplifies CI jobs.
Additionally it has been reported as flagged by security scanners, so
removing it makes Mitogen easier to package/adopt.
fixes #847
3 years ago
bdbc9fe827
changelog entry for #827
3 years ago
234dde5fc1
check Ansible version before loaders are loaded
4 years ago
bce3bab3e8
Add the msvcrt moduleto the default module deny list
...
Commit https://github.com/python/cpython/commit/880d42a3b247 (first
released in Python 3.8a0) moved an import of msvcrt from an if <win32>
block, into a try/except block. So now the import is tried even on Linux
or MacOS.
https://docs.python.org/3/library/msvcrt.html is a Windows specific
builtin.
4 years ago
1e72ebaf8b
tests: Update test coverage to Python 3.9
...
The Travis Linux distribution must be upgraded because the Trusty
(Ubuntu 14.04) image does not have Python 3.9. Xenial (Ubuntu 16.04) is
the earliest version that offers Python 3.9.
I have not chosen a later release, in order to aid restoration of Python
2.4 - 2.6 tests.
4 years ago
f489478127
code cleanup + adds 0.2.10 + 0.3.0 changelog
4 years ago
79b4c0f815
tests: Fix AttributeError in callback plugins used by test suite
...
CALLBACK_VERSION et al are documented as required in
https://docs.ansible.com/ansible/2.10/dev_guide/developing_plugins.html#callback-plugins .
The need for document_fragment is noted in
cfa8075537/lib/ansible/plugins/callback/default.py (L28-L32)Fixes #758
This addresses the following error, seen while running
`ansible_tests.py`.
```
TASK [Gathering Facts gather_timeout=10, gather_subset=['all']]
****************
task path:
/home/alex/src/mitogen/tests/ansible/regression/issue_109__target_has_old_ansible_installed.yml:4
[WARNING]: Failure using method (v2_runner_on_start) in callback plugin
(<ansible.plugins.callback.nice_stdout.CallbackModule object at
0x7f76b3dad090>): 'show_per_host_start'
Callback Exception:
File
"/home/alex/src/mitogen/.tox/py27-ansible2.10/lib/python2.7/site-packages/ansible/executor/task_queue_manager.py",
line 372, in send_callback
method(*new_args, **kwargs)
File
"/home/alex/src/mitogen/.tox/py27-ansible2.10/lib/python2.7/site-packages/ansible/plugins/callback/default.py",
line 240, in v2_runner_on_start
if self.get_option('show_per_host_start'):
File
"/home/alex/src/mitogen/.tox/py27-ansible2.10/lib/python2.7/site-packages/ansible/plugins/callback/__init__.py",
line 91, in get_option
return self._plugin_options[k]
Callback Exception:
File
"/home/alex/src/mitogen/.tox/py27-ansible2.10/lib/python2.7/site-packages/ansible/executor/task_queue_manager.py",
line 372, in send_callback
method(*new_args, **kwargs)
File
"/home/alex/src/mitogen/.tox/py27-ansible2.10/lib/python2.7/site-packages/ansible/plugins/callback/default.py",
line 240, in v2_runner_on_start
if self.get_option('show_per_host_start'):
File
"/home/alex/src/mitogen/.tox/py27-ansible2.10/lib/python2.7/site-packages/ansible/plugins/callback/__init__.py",
line 91, in get_option
return self._plugin_options[k]
[task 339882] 00:00:08.172036 D ansible_mitogen.affinity: CPU mask for
WorkerProcess: 0x000004
Callback Exception:
File
"/home/alex/src/mitogen/.tox/py27-ansible2.10/lib/python2.7/site-packages/ansible/executor/task_queue_manager.py",
line 372, in send_callback
method(*new_args, **kwargs)
File
"/home/alex/src/mitogen/.tox/py27-ansible2.10/lib/python2.7/site-packages/ansible/plugins/callback/default.py",
line 240, in v2_runner_on_start
if self.get_option('show_per_host_start'):
File
"/home/alex/src/mitogen/.tox/py27-ansible2.10/lib/python2.7/site-packages/ansible/plugins/callback/__init__.py",
line 91, in get_option
return self._plugin_options[k]
```
4 years ago
b0ce29dcfd
ssh: Match newer ssh host key prompt that accepts the fingerprint
...
This fixes an ERROR in test_accept_enforce_host_keys() while running the
test suite.
Fixes #756
4 years ago
d6329f3446
Merge devel/290 @ 79b979ec8544ef5d8620c64068d4a42fabf50415
5 years ago
e3c514d906
issue #633 : update Changelog.
5 years ago
ed33236c71
docs: , -> :
5 years ago
9b79986859
docs: use new manpage alias in one more place
5 years ago
7a391022ef
docs: update Changelog for 0.2.8.
5 years ago
4bd0a234ce
docs: lots more changelog concision
5 years ago
8a11dea075
docs: changelog concision
5 years ago
efe91092dc
docs: more changelog tweaks
5 years ago
80bc5c7d8b
docs: changelog fixes/tweaks
5 years ago
a56930e913
issue #590 : update Changelog.
5 years ago
4caca80962
issue #627 : reduce the default pool size in a child to 2.
...
Ansible has no blocking services running, or really any service that
would have an outsized benefit from multiple IO waiters. Probably we
only need 1, but let's start with 2 just in case.
5 years ago
26a9fed396
docs: some more hyperlink joy
5 years ago
d75c9cffc3
docs: add domainrefs plugin to make link aliases everywhere \o/
...
PATENT PENDING
5 years ago
6b180a4091
docs: link IS_DEAD in changelog
5 years ago
01a1914a1f
docs: tweaks to better explain changelog race
5 years ago
bcca47df3c
issue #533 : update routing to account for DEL_ROUTE propagation race
5 years ago
207f57537a
issue #615 : update Changelog.
5 years ago
3c8c11b360
issue #615 : update Changelog.
5 years ago
db8f0db5e7
docs: lots more changelog
5 years ago
341c453eaa
issue #595 : add buildah to docs and changelog.
5 years ago
49796e0c39
docs: update changelog
5 years ago
8dfb3966df
issue #558 , #582 : preserve remote tmpdir if caller did not supply one
...
The undocumented 'tmp' parameter controls whether _execute_module()
would delete anything on 2.3, so mimic that. This means
_execute_remove_stat() calls will not blow away the temp directory,
which broke the unarchive plugin.
5 years ago
1d41adb346
docs: tweaks
5 years ago
9cb187c2c4
formatting error
5 years ago
c89f6cbab6
issue #598 : update Changelog.
5 years ago
240dc84d94
issue #605 : update Changelog.
5 years ago
93e8d5dfcc
docs: fix Sphinx warnings, add LogHandler, more docstrings
5 years ago
1d943388b7
docs: tidy up some Changelog text
5 years ago
c464bb5346
issue #615 : update Changelog.
5 years ago
e352b9e5fd
docs: update Changelog.
5 years ago
6fa69955c4
issue #586 : update Changelog.
5 years ago
f0138072f1
docs: update Changelog.
5 years ago
5ae6f92177
issue #612 : update Changelog.
5 years ago
41d180495a
issue #547 : update Changelog.
5 years ago
50b2d590fd
docs: update Changelog.
5 years ago
dd1fed0a5f
docs: update changelog
5 years ago
e8b1bf5909
issue #410 : automatically work around SELinux braindamage.
5 years ago
0d636af532
docs: add changelog thanks
5 years ago
be330194d5
docs: udpate Changelog.
5 years ago
b7cdd39044
docs: tweak Changelog wording
5 years ago
7629ff9e6d
issue #602 : update Changelog
5 years ago
cf2b8f1c24
docs: update Changelog.
5 years ago
e87e41e69e
docs: finished Changelog locking note
5 years ago
9bb3dac450
docs: break out install_app.py and fix API use.
5 years ago
d0aee1ef3c
issue #549 : docs: update Changelog
5 years ago
7accc092de
docs: changelog tweaks
5 years ago
9e1faa7927
docs: changelog concision / additions
5 years ago
c0357d394f
add 363 to changelog
5 years ago
8f25114d1a
docs: update Changelog
5 years ago
de65790a74
docs: note fd usage has halved
5 years ago
ded00d25c9
docs: more stream-refactor work
5 years ago
4cd32cbcba
docs: update Changelog for stream-refactor.
5 years ago
d35bca3f15
docs: Add lineinfile bug to changelog.
5 years ago
77564fdfe2
issue #170 : update Changelog; closes #170 .
5 years ago
1a32a79fa6
issue #578 : update Changelog.
6 years ago
2d083d19df
issue #589 : remove outdated/incomplete examples
6 years ago
3620fce071
issue #593 : expose configurables for SSH keepalive and increase the default
6 years ago
0b7fd3f290
issue #591 : ansible: restore CWD prior to AnsibleModule initialization.
6 years ago
8f940e2ccb
issue #590 : teach importer to handle self-replacing modules
6 years ago
2c15c1d4a5
issue #587 : docs: update Changelog.
6 years ago
38b3415838
docs: update Changelog for release.
6 years ago
0b110305c9
issue #587 : update Changelog
6 years ago
f30a4c05c8
issue #581 : expose mitogen_mask_remote_name variable.
6 years ago
ee62c57c9d
issue #576 : fix Kwargs minor version check.
...
Unicode kwargs were introduced in Python 2.6.5, not 2.6.0.
6 years ago
65deb3feac
issue #575 : fix exception text rendering
6 years ago
34fb9da1be
issue #570 : add firewalld to always-fork list for now.
6 years ago
c6f4dc356b
docs: update Changelog; closes #557 .
6 years ago
13643b7268
docs: update Changelog for release.
6 years ago
2bd0bbd4df
issue #555 : ansible: workaround ancient reload(sys) hack.
...
This is the most minimal change for what might be relatively minimal
edge case. Alternative is replacing reload(), but let's not do that yet.
Closes #555
6 years ago
7743e57ff3
issue #554 : track and remove multiple make_tmp_path() calls.
6 years ago
d1ba077f0e
docs: update Changelog.
6 years ago
ffae035584
docs: drastically simplify install/changelog.
6 years ago
2226c23c91
issue #550 : update Changelog.
6 years ago
0b177f1491
docs: update Changelog.
6 years ago
79af8ef680
docs: update Changelog; closes #548 .
6 years ago
5dc0bd6f8d
os_fork: clean up docs
6 years ago
ebbf5ab62c
issue #535 : update Changelog.
6 years ago
c119ae8f66
issue #535 : docs: update Changelog
6 years ago
28aa8b3b27
issue #535 : docs: update Changelog.
6 years ago
7d0480e8bd
core: increase cookie field lengths to 64-bit; closes #545 .
6 years ago
14e6c6e49e
docs: update Changelog.
6 years ago
d865fb797d
docs: change 'unreleased' Changelog format and add a hint.
6 years ago
2cde51ea63
docs: update Changelog; closes #542 .
6 years ago
45f915f392
docs: update Changelog; closes #537 .
6 years ago
e010667230
Bump version for release.
6 years ago
6d7bd7e3b9
docs: update Changelog.
6 years ago
cf8ecf19b7
docs: update Changelog; closes #532 .
6 years ago
1b4eb06f72
docs: more concise Changelog.
6 years ago
b317b66317
issue #541 : changelog typos.
6 years ago
0f30808234
ansible: quiesce boto logger; closes #541 .
6 years ago
c39ee9b7fe
docs: update Changelog.
6 years ago
968b826800
docs: update Changelog; closes #539 .
6 years ago
1c955a9876
ansible: capture stderr stream of async tasks. Closes #540 .
6 years ago
4be4b085e3
docs: update Changelog.
6 years ago
d45797b370
docs: duplicate word
6 years ago
24c48c165d
docs: update Changelog.
6 years ago
8ae6ca1d5b
tests/ansible: Spec.become_method() test & mitogen_via= fix.
...
ansible_become_method hostvar was not taken into account.
6 years ago
4d33598fa0
setup.py: include LICENSE; closes #538 .
6 years ago
d1cadf8ac8
tests/ansible: Spec.password() test, document interactive pw limitation.
6 years ago
1292b55fec
docs: add 'Fixes' heading
6 years ago
676f756153
docs: more margin tweaks for changelog
6 years ago
90401833fa
docs: update Changelog; closes #511 , closes #536 .
6 years ago
f514dbeba9
docs: update Changelog release date.
6 years ago
b12539f99b
docs: update Changelog; closes #481
6 years ago
32161f3df5
docs: update thanks
6 years ago
7b046c9fba
docs: fix changelog syntax/order/"20KB"
6 years ago
e167f6373c
docs: update Changelog.
6 years ago
2153e195c3
docs: changelog tidyups.
6 years ago
4531338b12
ansible: document and make affinity stuff portable to non-Linux
...
Portable as in does nothing for the time at least for now.
6 years ago
f06152db97
docs: update Changelog.
6 years ago
7b129e8576
ansible: use Poller for WorkerProcess; closes #491 .
6 years ago
8f6e6b3940
docs: update Changelog.
6 years ago
90573b1963
docs: update Changelog.
6 years ago
2b1035b500
Merge branch 'master' into cover-us
6 years ago
2fa84e096f
Aggregate code coverage data across tox all runs
...
Fixes #529
6 years ago
8a2dcbf674
docs: update Changelog; closes #527 .
6 years ago
0d725f9cd8
Fix DeprecationWarning in mitogen.utils.run_with_router()
...
```
14:20:32.186270 W py.warnings:
/home/alex/src/mitogen/mitogen/utils.py:152: DeprecationWarning: invalid
escape sequence \*
"""
```
6 years ago
e7d70b109b
Generate coverage report even if some tests fail
...
`set -o errexit` was exiting run_tests prematurely if any test failed,
so the coverage report was not always generated.
6 years ago
77e7cadd22
issue #429 : update Changelog.
6 years ago
cd1e5e0138
issue #429 : update Changelog.
6 years ago
60e9596e7d
docs: update Changelog; closes #499 .
6 years ago
3158c4ae9d
docs: update Changelog; closes #493 .
6 years ago
bf676aacfe
docs: update Changelog; closes #479 .
6 years ago
ac4e61e19e
docs: update Changelog; closes #477 .
6 years ago
bb9bb593e4
docs: update Changelog.
6 years ago
63da372de5
docs: update Changelog.
6 years ago
5c5269e147
docs: Changelog typo.
6 years ago
fb815ebec6
issue #434 : add to Changelog.
6 years ago
0edeec118c
issue #401 : add to Changelog.
6 years ago
6856ee9021
issue #359 : add to Changelog.
6 years ago
8f1cff7d08
issue #396 : add to Changelog.
6 years ago
efdfd4a353
docs: add thanks entry
6 years ago
97d2f2e1db
issue #436 : add to Changelog.
6 years ago
Alex Willmer