0b0ae5c971
issue #477 : backport various test modules to Python 2.4.
6 years ago
462a8567e5
issue #477 : add all() polyfill to custom_python_detect_environmnet
6 years ago
e9706a4a09
issue #477 : _update_linecache() must append newlines.
6 years ago
19b708e141
issue #415 , #477 : Poller must handle POLLHUP too.
...
Linux will fire poll() with simply the POLLHUP bit set even though it
was not requested, resulting in an infinite loop.
6 years ago
97a96f5dd8
issue #477 : rename and add tests for polyfill functions.
6 years ago
dc01f9e47e
issue #477 : Ansible 2.3 module output format difference.
...
Don't test for keys it doesn't set.
6 years ago
b6062afe24
issue #477 : Ansible 2.3 cannot use when: on an include.
...
So just use our magic action module to reset the connection instead.
6 years ago
c1a4597e32
issue #477 : tests: use Ansible 2.3-compatible include rather than import
...
This will break with Ansible 2.8. Probably going to end up with a regex
hack for CI.
6 years ago
83aff538b3
issue #477 : testlib: Py2.4 did not have BaseException.
6 years ago
be8562ce09
issue #477 : Ansible 2.3 had stricter arg spec format.
6 years ago
0ee8ee78b8
issue #477 : Py2.4 cannot tolerate unicode kwargs.
6 years ago
4388e794ce
issue #477 : Py2.4: enumerate() may return stopped threads.
6 years ago
07401d767a
issue #477 : Python 2.4 type(exc) returns old-style instance.
6 years ago
2ead451277
issue #477 : Python 2.4 lacked str.partition.
6 years ago
2ec19f2374
issue #477 : Python 2.4 lacked Thread.name.
6 years ago
2f016b5c7b
issue #477 : Python 2.4 lacked context managers.
6 years ago
66b64cae2c
issue #477 : older Ansibles had no vars plugin base class.
6 years ago
d6945443b7
tests: add exact test for issue 251; closes #251 .
6 years ago
23866084d7
issue #412 : promote "mitogen_get_stack" to the main extension.
...
This is to make it easier for users to diagnose their own problems.
6 years ago
2ad05f1238
issue #251 , #412 , #434 : fix connection configuration brainwrong
...
This refactors connection.py to pull the two huge dict-building
functions out into new transport_transport_config.PlayContextSpec and
MitogenViaSpec classes, leaving a lot more room to breath in both files
to figure out exactly how connection configuration should work.
The changes made in 1f21a303d58832
6 years ago
8414ff21ca
issue #434 : tests: set a default remote_user in ansible.cfg.
6 years ago
1b8748a8d9
tests: use assert_equal in more places.
6 years ago
d72567b15b
tests: make assert_equal work on newer Ansibles.
6 years ago
8891b48080
tests: convert stack_construction.yml to assert_equal.
6 years ago
4256d2aa4b
tests: make fork_histogram optional
6 years ago
17eff064b0
tests: use assert_equal in delegate_to_template.yml.
6 years ago
91c9aff9ff
tests: import assert_equal action.
6 years ago
630c058a89
tests: rename 'delegation/' to 'connection_delegation/'
6 years ago
f5d9af80ef
tests: some more utility function tests + flake8.
6 years ago
0ba8cc7b61
tests: clean up / deduplicate Ansible inventory.
6 years ago
1555f23215
tests: add some more helper function tests.
6 years ago
9d9add3339
issue #414 : reenable test.
6 years ago
fcc403cc2f
core: make Receiver.to_sender() use Router.myself().
6 years ago
4bdf60326c
issue #424 : ansible: make put_file() raise AnsibleFileNotFound
6 years ago
06415bb720
issue #310 : fix test failures, teach old import method new tricks
...
- don't try anything unless something really lives in sys.modules by
that name
- non-ASCII files are possible
- the unimportable thing might be an extension module, we don't want
that
6 years ago
6af1a64cce
master: handle crazy non-modules in sys.modules again; closes #310 .
6 years ago
7c33979e25
issue #415 : add IPC latency bench.
6 years ago
a8c056c27b
issue #436 : decode debug log lines on Python 3.
6 years ago
8380baf41b
issue #461 : Ansible 2.3 placeholder modules for action plug-ins.
6 years ago
822978520f
issue #446 : update Receiver.__iter__ to match
...
iter() previously relied on the fake dead message being enqueued.
6 years ago
386d869d5f
tests: fix responder_test after removing unused imports
6 years ago
6592598999
tests: stray socket file left during unix_test.
6 years ago
cce1dbf3b1
tests: quieten a bunch of spam printed during run
6 years ago
b0e7c1a315
tests: fix /etc/environment test on vanilla
...
Use "meta: reset_connection" to ensure /etc/environment is reloaded.
Looks like this entire feature can be ripped out!
6 years ago
26fdbf70e0
tests: good_load_module_size check can't be exact
...
Since message contains pathnames that vary across machines
6 years ago
ae03d5f4f1
issue #446 : basic tests for Receiver._on_receive().
6 years ago
bcd9827c3b
core: Latch.empty() improvements
...
- throw LatchError if the latch is closed.
- wrap with the lock to avoid unexpected weirdness.
6 years ago
388649df97
core: Receiver.close() now wakes all threads; closes #446 .
6 years ago
f2f41809ae
issue #459 : initial get_stats() implementation
6 years ago
1d97493fcd
tests: fallout from #447 .
6 years ago
de719fa249
core: throw error on duplicate add_handler(); closes #447 .
6 years ago
dc92e529bc
service: unregister receiver at shutdown; closes #445 .
6 years ago
85e965118d
Merge remote-tracking branch 'origin/issue462'
...
* origin/issue462:
issue #462 : docs: update Changelog.
parent: cope with broken /dev/pts on Linux; closes #462 .
6 years ago
9da6e6a9a8
tests: don't call Router.shutdown() twice.
...
Due to 497234e7#456 .
6 years ago
b2b7e7b06b
tests: file_service_test fixes
...
Due to 6713b90acc
6 years ago
a8921bb6ff
tests: fix scaling in fork_histogram
6 years ago
6936b93b43
tests: import fork_histogram.py.
6 years ago
5a96d13fd8
issue #426 : fix all.yml sorting, one more delegate_to
6 years ago
bd82fa1986
issue #426 : fix low_level_execute_command.yml breakage.
6 years ago
a6e6bc4c71
issue #426 : to_text filter.
6 years ago
9d87f03ab4
issue #426 : disable Ansible smart transport.
6 years ago
49d37bfa2d
issue #426 : remove LANG and LC_ALL during tests.
6 years ago
a6e6fd14be
issue #426 : more 2->3 test fixes.
6 years ago
67f710fd9b
issue #426 : use delegate_to in fixup_perms2 and copy.yml
6 years ago
a4c7a98dd9
parent: cope with broken /dev/pts on Linux; closes #462 .
6 years ago
3179951f5c
issue #454 : fix AttributeError and atexit.yml test.
6 years ago
1eb08fb5c5
core: docstring tidyups
6 years ago
497234e782
issue #456 : core: raise error during defer() if Broker shutdown
6 years ago
f20e0bbac1
service: Allow registering path prefixes with FileService.
...
e.g. service.register_prefix('/') disables all security checks.
6 years ago
6fafc0a631
select: Python 2.x required __nonzero__ for bool(Select)
6 years ago
300cb41e2e
core: detect stream corruption. Closes #438 .
6 years ago
3876590aa1
parent: add descriptive errors for unsupported call() types.
...
Closes #439 .
6 years ago
22de7f0e72
issue #436 : fix string parsing of mitogen_ssh_debug_level
...
It can be a string when specified on the command line.
6 years ago
44d6ca771a
issue #426 : fix local/delegate_to issue
6 years ago
934d8ac139
issue #426 : fix 2->3 issue in plain_old_module.
6 years ago
3206d59c87
issue #426 : teach DockerMixin to allow selecting interpreter
6 years ago
f1661abe4e
tests: make IterReadTest a little more robust
6 years ago
bef4b0c962
tests: fix copy.yml title
6 years ago
2a6dbb038f
Pythonize, split out and parallelize all jobs.
6 years ago
b60a6d0f3b
Split dev_requirements.txt up according to test mode.
6 years ago
fccf424140
tests: Pythonize print_env.sh.
6 years ago
8f1f3de123
tests: Pythonize env_wrapper.sh, clean up local_test
6 years ago
a717c5406c
tests: split etc_environment test in two
...
Turns out nobody supports ~/.pam_environment any more. Keep the
behaviour around for the time being.
6 years ago
4b61e5af02
tests: run FD and thread checks on every test case.
...
Trying to hunt down weirdness on Azure.
6 years ago
374fd72dbb
tests: disable mtime test on vanilla
6 years ago
79ca67aadd
tests: disable connection tests for non-Mitogen
6 years ago
8972dbb7b9
tests: more Ansible fixes.
6 years ago
acf0b04876
tests: run some playbooks against only one target.
6 years ago
ee2d10375d
tests: don't run reset_connection tests on <2.5.6.
6 years ago
fcdfd5f107
tests: fix disconnect_cleanup.yml target count assumption
6 years ago
1bb239189b
tests: another attempt at working paths.
6 years ago
5f815ec6c4
tests: try to fix PATH problem on Travis.
6 years ago
f5f72b958f
tests: avoid -u command line parameter conflict
6 years ago
0c3e48468b
tests: run disconnect_during_module.yml in subprocess
...
Avoid entire run failing with unreachable
6 years ago
35092c5d35
tests: Unicode/bytes fixes for integration/connection/exec_command.yml
6 years ago
4d443e654b
tests: replace another shell script.
6 years ago
9ad022107e
issue #414 : disable test until rest of CI is healthy
6 years ago
b29c8eaf2a
tests: allow passing -vvv to build_docker_images.
6 years ago
f87553b165
tests: must set ansible_become_pass in synchronize.yml.
6 years ago
816da64df5
tests: show task args in image_prep
6 years ago
174b685d16
tests: CentOS 6 lacks %wheel in sudo by default.
6 years ago
574fc27a9c
issue #414 : import test / reproduction.
6 years ago
c286f4f107
Add tests/ansible/requirements.txt to Tox.
6 years ago
cd6486b0e9
tests: fix more DisconnectTest raciness.
6 years ago
e180d310b5
tests: fix fork_test compat on 3.x.
6 years ago
3f46c9569c
tests: 3.x syntax compat for tests/data/stubs/
6 years ago
27a4001f4f
tests: handle NameError when faulthandler is not installed.
6 years ago
5482b4d528
tests: poller_test 3.x fix.
6 years ago
3836c6a220
tests/bench: run roundtrip.py a ton more to reduce variance
6 years ago
d1b7c232bf
tests: image_prep needs sudo
6 years ago
cf97932fad
core: dead messages have optional body, use it everywhere; closes #387 .
6 years ago
802de6a8d5
issue #406 : clean up DiagLogStream handling and connect() failure.
...
When Stream.connect() fails, have it just use on_disconnect(). Now there
is a single disconnect cleanup path.
Remove cutpasted DiagLogStream setup/destruction, and move it into the
base class (temporarily), and only manage the lifetime of its underlying
FD via Side.close(). This cures another EBADF failure.
6 years ago
e01c8f2891
issue #406 : 3.x syntax fixes.
6 years ago
003526ef7b
issue #406 : fix thread leaks in unix_test too.
6 years ago
eae1bdba4e
tests: make minify_test print something useful on failure
6 years ago
802efa6ea6
issue #406 : ensure broker_test waits for broker exit.
6 years ago
175fc377d2
tests: remove hard-wired SSL paths from fork_test.
6 years ago
3da4b1a420
tests: verify only main/watcher threads exist at teardown
6 years ago
b0dd628f07
issue #406 : parent_test fixes, NameError in log_fd_calls().
6 years ago
6ff1e001da
issue #406 : log socketpair calls too.
6 years ago
70c550f50c
issue #406 : close stdout pipes in parent_test
6 years ago
9b3cb55a8b
issue #4096 : import log_fd_calls() helper.
6 years ago
8a0b343760
issue #406 : test for FD leak after every TestCase
6 years ago
e9a6e4c3d2
issue #406 : add test.
6 years ago
5eff8ea4fb
tests: make result_shell_echo_hi compare less of the timedelta; closes #361
...
Assuming less than one second is too much to ask from Travis.
6 years ago
5be9a55bf4
core: allow Context to be pickled by non-Mitogen pickler.
6 years ago
c148c869e6
issue #76 , #370 : add disconnect cleanup test
6 years ago
aeec2b5054
tests: pad out minify_test to verify all internal modules
6 years ago
f2d288bb1e
tests: ensure minify() result can be compiled for all of core.
6 years ago
fd326f5ad7
tests: stub tests for doas/mitogen_doas
6 years ago
cbd4129cb9
tests: fix paramiko_unblemished.yml
6 years ago
e8fc9e490f
tests: update osa_delegate_to_self to match connection parameters
6 years ago
6c71c5bfef
issue #369 : disable reset_connection on Ansible<2.5.6
...
https://github.com/ansible/ansible/issues/27520
6 years ago
8ed72e7e7b
issue #369 : avoid Ansible 2.5 bug (cond_reset_warn missing method)
6 years ago
ab4ccc6b92
issue #369 : don't mass-kill all SSH clients in reconnection.yml
...
It breaks my new development environment :)
6 years ago
fcdf4a0f35
Import missing stub-sudo.py.
6 years ago
a6dd8bb2d0
issue #409 : stub test for mitogen_sudo method.
6 years ago
fadb9181bc
issue #410 : support sudo --user and SELinux options, add stub test.
6 years ago
144685a327
issue #409 : more lxc/lxd stub tests, let tests run on vanilla.
6 years ago
0e8f451190
issue #409 : add stub LXC test, refactor playbooks.
6 years ago
e832ddec13
issue #409 : mark sudo test noninteractive
6 years ago
a77f07659e
issue #409 : make setns test to work anywhere sudo works.
6 years ago
f2294c1678
issue #409 : add new stub_connections/ test type.
6 years ago
429832b8f7
issue #409 : add kubectl stub and constructor test.
6 years ago
c51b67b863
issue #409 : add test stubs to the PATH in run_ansible_playbook.py
6 years ago
51658fdd66
issue #409 : name-prefix stubs so they can be added to PATH
...
Allows us to reference them from playbooks easily.
6 years ago
5b916fc556
issue #409 : Pythonize run_ansible_playbook.sh
...
And add git_basedir extra variable.
6 years ago
48e8f1f7aa
tests: Pythonize write_all_consumer.py
6 years ago
f53e7dd637
tests: Pythonize another shell script.
6 years ago
332d128651
tests: get rid of some more shell
6 years ago
71f9e84ab3
Add EOF error hints for LXC/LXD; closes #373 .
6 years ago
d5a8293c91
issue #333 : closure & data distinctness tests.
6 years ago
73cda2994f
issue #333 : add versioning, initial batch of poller tests
...
Now poller is start enough to know a start_receive() during an iteration
does not cause events yielded by that iteration to associate with the
wrong descriptor.
These changes are tangentially related to the associated ticket, but
event versioning is still the underlying issue.
6 years ago
96f000c5ea
ansible: tilde-expand SSH key before passing to SSH; closes #334 .
6 years ago
9aa76cf9ce
tests: better Docker test key comment.
6 years ago
1cbff1011e
core: send dead message if max message size exceeded; closes #405
6 years ago
1eae594e32
ssh: fix check_host_keys="accept" and test; closes #411
...
Add real accept/enforce tests.
6 years ago
16ca111ebd
ssh: better OpenSSH 7.5+ permission denied handling
...
The user@host prefix in new-style OpenSSH messages unfortunately takes
the host part from ~/.ssh/config and friends. There is no way to know
which hostname will appear in this string without parsing the OpenSSH
config, nor which username will appear.
Instead just regex it.
Add SSH stub modes to print the new/old errors and add some simple
tests.
This extends the work done in b9112a9cbb
6 years ago
519faa3b3b
issue #369 : add Connection.reset() test.
6 years ago
89852db163
issue #370 : add 'disconnect resets connection' test
6 years ago
c510e58f9b
issue #352 : add test for disconnect message.
6 years ago
53d882dcbd
tests: activate faulthandler if available
6 years ago
9ec360c26d
core: split out & extend Broker.sync_call()
6 years ago
592d6fc8d3
tests: fix CaptureStreamHandler on 2.6.
6 years ago
3429e57825
tests: fix target_test 3.x compat.
6 years ago
3585ee74f7
tests: split out ansible_tests requirements
...
Also remove hard-coded Ansible version, the tests don't need it, nor
does local testing most of the time
6 years ago
b70c57a2cb
tests: fix wstatus_to_str() test on 3.x
...
Now they use enums.
6 years ago
c1c7e5171d
tests: fix fork FD sharing in unix_test.
6 years ago
0cf6019bac
tests: rename one more stubs/ssh.py reference.
6 years ago
778892eaaa
issue #76 : call_function_test fix.
6 years ago
a7d635dff8
tests: import ara_env helper script.
6 years ago
4e3830d75e
tests: add basic unix_test.py.
6 years ago
918f709420
tests: import a bunch more random unchecked in pieces.
6 years ago
0d70fc1324
tests: import z hostfile
6 years ago
36e5ca4115
tests: import missing main_with_no_exec_guard.py.
6 years ago
3943634fa6
tests: import bench/large_messages.py.
6 years ago
73055150f3
tests: move stub tools, into subdir, import docker_test.
6 years ago
7647c95f34
issue #76 : add one more test for indirect siblings
6 years ago
431051f69b
issue #76 : parent: broadcast DEL_ROUTE to interested parties
...
Now rather than simply propagate DEL_ROUTE upwards towards the parent,
we broadcast it downward to any stream that ever sent a message toward
any of the routes that have just become disconnected.
6 years ago
babe3eec31
issue #76 : record egress context IDs
...
Used in a subsequent change to broadcast DEL_ROUTE to potentially
interested children.
6 years ago
fd5066d671
tests: teach various tests to cleanup /tmp when they're done.
6 years ago
7fd9fb0014
issue #397 : fix another case where stray tmpdirs can be left behind.
...
Newer Ansibles use atexit.register() to invoke cleanup, so we need to
run those registrations after each run.
6 years ago
1b17aa1d1a
ansible: fix temp cleanup regression and add test; closes #397 .
6 years ago
e45e5d3e06
tests: Document Python versions in build_docker_images.py
6 years ago
3aa5c4c53d
issue #373 : parse the child process wait status
...
Don't log the raw waitpid() result, convert it to a useful string first.
6 years ago
9d070541d9
ansible: try to create tempdir if missing.
...
Closes #358 .
6 years ago
6dd1001d7a
tests: move kubectl into new subdir
...
Fixes tab completion with tests/ dir :)
CC @yannig
6 years ago
130e42a932
tests: prevent compare_output_test running on import.
6 years ago
4c81eba599
Merge commit 'refs/pull/377/head' of github.com:dw/mitogen into dmw
...
(Pull #377 )
Changes:
- additional_parameters -> extra_args
- Merge with kubectl changes from dmw branch
- Update docs
- Remove unused username class member
- Avoid mutable kubectl_args class member
- Use six.iteritems
6 years ago
4146648759
master: log error an refuse __main__ import if no guard detected.
...
Closes #366 .
6 years ago
6dddef0c45
Make image_prep work on Ubuntu.
6 years ago
2eb3ea78d6
tests: remove a bunch of stray debug
6 years ago
21a7aac220
tests: import custom binaries for tests
...
Same for async tests.
6 years ago
dfb4930fce
tests: import custom binaries for tests
...
It means Linux<->OS X runs work fine without manual hackery.
6 years ago
564113874b
tests: explicitly define localhost in common-hosts
6 years ago
5521945bd2
ansible: temporary files take 5.
6 years ago
f6b74992e1
tests: fix apparently erroneous localhost delegation.
...
The stack delegates to localhost, which has ansible_python_interpreter
set.
6 years ago
e85760477b
tests: fix connection/_put_file.yml
...
Was statting wrong destination path, and comparing floats that don't
roundtrip serialization reliably.
6 years ago
638e473ff1
tests: hacksmash synchronize test to work
...
Avoid password typing idiocy.
6 years ago
17548d1e49
[Enhancement] handle kubectl vars from Ansible connector.
...
This change allows the kubectl connector to support the same options as
Ansible's original connector.
The playbook sample comes with an example of a pod containing two containers
and checking that moving from one container to another, the version of Python
changes as expected.
6 years ago
1a5dadf732
Merge pull request #383 from moreati/pytz-2018.05
...
Update pytz to 2018.05 (needed by babel 2.6.0)
6 years ago
03be0afeeb
tests: Add tests of mitogen.utils.cast()
6 years ago
9fbcb67665
Update pytz to 2018.05 (needed by babel 2.6.0)
...
On Ubuntu 18.04 (others not tested) installing the dev requirements
fails with the following error
babel 2.6.0 has requirement pytz>=0a, but you'll have pytz 2012d which
is incompatible.
Despite the comment in dev_requirements.txt pytz-2012d is not the most
recent version to support Python 2.6. In fact the latest release of pytz
supports Python 2.6.
6 years ago
4356fdf027
Merge pull request #376 from Yannig/kubectl
...
Kubernetes connection support for mitogen.
6 years ago
6828926a36
Kubernetes connection support for mitogen.
6 years ago
d1c84552ec
Use `lxc exec --mode=noninteractive` which is more widely compatible
...
Closes #371
6 years ago
638b196a45
ansible: fix put_file() for large temporary files.
...
Reverts 49736b3a
6 years ago
001b63074c
tests: fix another typo.
6 years ago
d5524178bf
tests: fix bonehead syntax error.
6 years ago
65f03e03f5
tests: remote_tmp test fixes.
6 years ago
5eb41751f5
tests: import missing connection_passthrough
6 years ago
90f89f95fb
ansible: fix exec_command() regression.
6 years ago
7cd4d0828d
tests: data/fakessh.py 3.x fixes.
6 years ago
24a44499ca
tests: verify Connection.put_file() for small/large files.
6 years ago
4d3873c784
core: call chains v3: abstract it into a new CallChain class.
6 years ago
705d77a9be
ansible: remove a bunch more aliasing from connection.py.
6 years ago
66142e7d75
ansible: fork isolated tasks from correct parent.
...
Closes #355 .
6 years ago
a3957d6aaf
parent: add Context.forget_chain().
6 years ago
42b1b3d286
core: support mitogen_chain dispatcher option.
6 years ago
e5d421e5f4
Update k3 inventory.
6 years ago
426cffd9f5
tests: set no_target_syslog
6 years ago
7d62a53264
issue #337 : ssh: disabling PTYs round 2: make it automatic.
6 years ago
5004207705
issue #337 : ssh: support disabling PTY allocation
...
`.ssh(batch_mode=True)`
6 years ago
c4c6ae88a4
parent: raise a descriptive error when openpty fails.
6 years ago
acf7fe56ee
tests: a few more inventory helpers.
6 years ago
b0ffc4e209
Copy random test setup changes out of linear2 branch.
6 years ago
e52684c186
tests: enable display_args_to_stdout
6 years ago
0a2ae4d597
tests: tidy up issue_140.yml
6 years ago
72fa129f8a
tests: fix clash when localhost is test-target
6 years ago
5bac246676
tests: make nice_stdout print failing task line number
6 years ago
9792b8b54f
ansible: use template-expanded delegate_to hostname in one more location.
6 years ago
3b012e5bce
tests: allow plugging in pprint/pprintpp via env.
6 years ago
3453d4d7d0
Python 3 support for classmethod call targets
...
There were two problems with detection and handling of class methods as call targets in Python 3:
* Methods no longer define `im_self` -- this is now only `__self__`
* The `types` module no longer defines a `ClassType`
The universally-compatible (v2.6+) solution was to switch to using the `inspect` module -- whose interface has been stable -- and to checking the method attribute `__self__`.
(It doesn't hurt that `inspect` checks are more brief and we now no longer need the `types` module here.)
6 years ago
90c2ed03d0
ansible: fix synchronize module
...
Broken by recent connection delegation fixes.
6 years ago
8e9b5ad576
tests: import template benchmark script.
6 years ago
084c0ac065
ansible: avoid roundtrip in copy action due to fixup_perms2().
...
On top of existing temporary files work, this reduces the number of
roundtrips required for "copy" and "template" actions from 6 to 3.
6 years ago
4098d45dac
tests: disable delegation tests on vanilla.
6 years ago
50e285f7ba
tests: update for identities_only change.
6 years ago
a4ed27fa63
tests: add playbook step to ensure key file perms.
6 years ago
ac9b84d237
issue #321 : 2.4+ compatibility fixes, disable test on Vanilla.
6 years ago
f24f02ba06
issue #321 : take remote_tmp and system_tmpdirs into account.
...
Can't simply ignore these settings as some users may have weird noexec
filesystems.
6 years ago
a2686b1a2c
issue #321 : simplify temp directory handling.
6 years ago
06e2e846c5
parent: don't generate illegal default remote names.
...
getpass.getuser() output may contain slashes, which must be avoided as
they break virtualenv when present in argv[0].
Closes #344 .
6 years ago
3d588323ff
issue #340 : use expanded delegate_to hostname, not template.
...
PlayContext.delegate_to is the unexpanded template, Ansible doesn't keep
a copy of it around anywhere convenient. We either need to re-expand it
or take the expanded version that was stored on the Task, which is what
is done here.
6 years ago
154dc2e119
tests: fix integration/runner/missing_module.yml on Travis.
6 years ago
3113bf6228
tests: fix debops tests (py-apt broken if /var/lbi/apt missing)
6 years ago
a6995a5288
issue #338 : refactor env handling into class and fix tests.
6 years ago
06ae59702c
tests: rationalize matrix and rewrite ansible_tests
...
Now all distros run in parallel.
6 years ago
da391f0542
tests: fix host limit.
6 years ago
ce058eb8bd
Add 'clean' target to makefile.
6 years ago
8eb288856c
issue #338 : run /etc/environment test with become:true.
6 years ago
ad365dad56
issue #340 : one more test, update Changelog.
6 years ago
916e46621b
issue #340 : add connection delegation tests.
6 years ago
aed8fb531b
tests: unused imports
6 years ago
d39efd9f54
tests: add new users for conndel tests.
6 years ago
e48e32cd0c
tests: image_prep fixes.
6 years ago
e1306bb03d
tests: build Docker images in parallel
6 years ago
df112be704
tests: teach controller.yml to configure git too
6 years ago
49c804937d
tests: import 2 more simple benchmarks.
6 years ago
b521f215fd
ansible: handle >2.6 magic exceptions + sys.excepthook damage
...
Closes #332 .
6 years ago
a192935daf
tests: merge build_docker_images.py with osx_setup.yml
...
Hooray!
6 years ago
6f524d3ff8
issue #339 : minimal tests for lxc/lxd modules.
6 years ago
2c2fc73b0a
tests: whups, s/ansible_hostname/ansible_host/
6 years ago
6c4b01642c
ansible: don't crash when adhoc tries to run a missing module.
...
ansible-playbook prints a separate error during parsing stage, adhoc
performs no such check.
6 years ago
b964e647d2
tests: split inventory up slightly.
...
This makes it easier to run connection delegation tests against either
the local machine or a container.
6 years ago
1473f49505
ansible: emulate /etc/environment reloading behaviour of vanilla.
...
This change is relatively incomplete -- ideally we could snapshot
os.environ and /etc/environment at startup and respect key deletions
too, but that's a lot more work. Wait for a bug report instead.
Closes #338 .
6 years ago
a05835c46e
tests: more stable roundtrip.py.
6 years ago
3e0de9790c
issue #324 : fix Python 3 fallout for custom module_utils.
...
Also enable at last one of its tests.
6 years ago
1008cda93b
tests: add missing debops installs tep
6 years ago
b44b823c4a
ansible: make _remote_expand_user() pay attention to sudoable=..
6 years ago
a8e4dcc98d
issue #301 : correct remote_tmp evaluation context.
...
Vanilla Ansible expands remote_tmp variables in the context of the login
account, not any become_user account.
6 years ago
9410903f20
issue #301 : add related test.
6 years ago
b6d6468c92
issue #301 : support expandvars() for remote_tmp only.
...
Vanilla Ansible support expandvars-like expansions widely in a variety
of places. Prefer to whitelist those we need, rather than sprinkling
hellish semantics everywhere.
6 years ago
1a74938ee0
issue #291 : missing env_wrapper.sh test script.
6 years ago
e39c602fd3
issue #291 : support UNIX hashbang syntax for ansible_*_interpreter.
...
Closes #291 .
6 years ago
f977be2868
issue #291 : permit supplying a full Python argv.
6 years ago
15d68b3c32
issue #309 : fix environment cleanup regression.
...
Closes #309 .
6 years ago
830a133ad6
issue #307 : require partial line when matching interactive prompt.
...
This is a best-effort attempt to avoid SSHd banner spam from breaking
our password entry loop.
Closes #307 .
6 years ago
8ce51ec96c
issue #307 : add SSH login banner to Docker containers
6 years ago
0b1f92b59f
issue #297 : test fixes to match fixed CWD.
6 years ago
d8e0c9e12c
issue #297 : local commands must execute with WorkerProcess environment.
6 years ago
012745efea
issue #297 : local actions must execute with fixed directory.
...
Local actions must execute in the the parent directory of the playbook
that defines the action.
6 years ago
26ba3e4d83
issue #294 : stronger integration test
...
Run the tests in a brand new ansible-playbook invocation, and try both
linear->mitogen->linear and mitogen->linear->mitogen.
6 years ago
5b03e06457
issue #294 : ansible: fix mixed vanilla/Mitogen runs.
...
Don't bother trying to understand what damage PluginLoader has done to
ansible.plugins.* namespace, just ask it for the base class instead.
6 years ago
5668267f47
tests: import debug_ansible_playbook.sh.
6 years ago
e1402b2214
tests: import various bench/ scripts.
6 years ago
8a2e8964a9
tests: import gce.yml
6 years ago
079dc95aef
tests: use nice_stdout in gcloud/ too
6 years ago
b21d51be47
ansible: fix test for 3.x.
6 years ago
04e138e060
core: fix serialization of empty bytes() on 3.x.
6 years ago
b4f4b66679
tests: make cpu_load.py more random.
6 years ago
46ec0ffcaf
tests: log original traceback in assertRaises().
6 years ago
3e48f95439
tests: import cpu_load.py.
6 years ago
7ff9d573b6
tests: remove stray enable_debug()
6 years ago
4ff47d6a93
parent: more 2/3x format fixes
6 years ago
90f2f823db
tests: remove stray hard-coded interpreter.
6 years ago
6b4e047017
tests: 3.x parent_test fixes.
6 years ago
6cbf34d5fe
tests: another smattering of 3.x type/API fixes.
6 years ago
7697861011
tests: skip one test that triggers bug in ancient vendered six.py
6 years ago
c141dd10ec
master: fix resolve_relpath()
...
looks like this was just as broken on 2.x, and suddenly we're
finding a bunch more legit Django deps. It seems anywhere
absolute_import appeared in 2.x, we skipped some imports.
6 years ago
b0404bef40
tests: fix get_module_via_* encoding issues
6 years ago
9903692811
master: update scan_code_imports to cope with wordcode
...
Constant-sized opcodes were introduced as an optimization in Python 3.6.
See https://bugs.python.org/issue26647
6 years ago
826c477061
tests: built-in exceptions live in a different module in 3.x
6 years ago
cbcd8267d1
tests: must decode() zlib result for 3.x.
6 years ago
ec176bf1f8
tests: unittest2 import behaviour appears to differ between 2/3.
...
In 2 the module is loaded as __main__
In 3 it has its actual name.
6 years ago
410016ff47
Initial Python 3.x port work.
...
* ansible: use unicode_literals everywhere since it only needs to be
compatible back to 2.6.
* compat/collections.py: delete this entirely and rip out the parts of
functools that require it.
* Introduce serializable Kwargs dict subclass that translates keys to
Unicode on instantiation.
* enable_debug_logging() must set _v/_vv globals.
* cStringIO does not exist in 3.x.
* Treat IOLogger and LogForwarder input as latin-1.
* Avoid ResourceWarnings in first stage by explicitly closing fps.
* Fix preamble_size.py syntax errors.
6 years ago
4f57c59b7e
issue #275 : Don't run virtualnv test on 2.6.
6 years ago
cec564654e
issue #275 : tests: fix module_finder_test for 2.6.
6 years ago
4be8afa3d3
issue #275 : tests: fix test_simple for 2.6.
6 years ago
7b84a2c2e4
issue #275 : tests: use same EC0_MARKER as parent.py
6 years ago
6e0883f369
issue #275 : tests: fix bug in 2.6 compat check_output(), ignore it for >2.6.
6 years ago
3b1cc3676c
issue #275 : ssh_debug_level=3 for tests
6 years ago
6d618593f3
issue #275 : Python 2.6 reports linux as 'linux3'.
6 years ago
1d04a99adb
issue #275 : missing check_output() call
6 years ago
38d69a6ecd
issue #275 : tests: drop docker client dep, doesn't run on 2.6.
6 years ago
b38318dfec
issue #275 : build for centos 6 too (python2.6)
6 years ago
27ab051289
Merge pull request #282 from dw/issue278
...
Issue278
6 years ago
6d14652077
issue #278 : tests: fix fakessh.
...
See source comment. This behaviour always existed, but it now seems to
be triggered since we started draining the master side input buffer,
which someone was prolonging the life of the PTY.
6 years ago
21199f290e
Fix bash loop when add users to docker images
6 years ago
9617f4d7bf
Revert "try to catch EINTR on travis"
...
This reverts commit 42797d5cff
6 years ago
fbb67e837e
tests: import nice_stdout plugin
6 years ago
42797d5cff
try to catch EINTR on travis
6 years ago
ffc7306cf8
tests: better runner_two_simultaneous_jobs.yml.
6 years ago
1d96d80e8d
tests: osx_setup.yml missing line
6 years ago
3994f1b30a
ansible: implment async job time limit.
6 years ago
df8fe59eda
tests: replace hard-coded sleep with a polling loop
6 years ago
64b60be50c
tests: split runner_new_process out of runner_one_job
6 years ago
f7d2eace08
tests: importer fixes
7 years ago
cee76ee7b9
tests: gcloud setup fixes.
7 years ago
3b0addcfb0
service: v2. Closes #213
7 years ago
633585524f
tests: don't need separate module for id_allocation_test any more
...
This used to be because everything would explode while importing
__main__ under py.test, but that was fixed months ago.
7 years ago
ddf28987a0
master: split Select() into new module to reduce wire size.
...
service.py currently imports master.py(+parent.py) just to get Select().
7 years ago
b0ce6eecd7
fork: support on_start= argument.
7 years ago
00edf0d66d
core: have ExternalContext accept a config dict rather than kwargs.
...
The parameter lists had gotten out of control.
7 years ago
eac4cc7afe
tests: speed things up
7 years ago
b0aa413173
tests: import benchmark reproduction setup playbook
...
Incomplete, also needs to mess around with Gcloud routing and handle box
setup/teardown, because that's another "well engineered" waste of time.
7 years ago
a99c7a12f9
tests: output split groups in gcloud.py
7 years ago
dbcee4041a
tests: refactor gcloud.py to be dynamic inventory.
7 years ago
a3995f8e5f
ansible: remove hard-coded dw username.
7 years ago
2c58591129
Bump Ansible version in dev_requirements.txt
7 years ago
78d375e0c5
core: CallError should handle any exception type.
...
Previously SystemExit would be pickled.
7 years ago
faaac43a78
Disable SSH variables test on vanilla Ansible.
7 years ago
68d6e6bf34
ansible: tests for all SSH variables.
...
Closes #184 .
7 years ago
356647bef4
issue #132 : initial unidirectional routing mode.
7 years ago
2a4157723a
tests: fix breakage from moving is_stdlib_name()
7 years ago
7d9b7eec0c
tests: must wrap log_to_file() in is_master
...
Without it, end up with a billion loggers attached in some tests
7 years ago
2ad0d0521d
ansible: reload /etc/resolv.conf for each task.
...
The OpenShift installer modifies /etc/resolv.conf then tests the new
resolver configuration, however, there was no mechanism to reload
resolv.conf in our reuseable interpreter.
https://github.com/openshift/openshift-ansible/blob/release-3.9/roles/openshift_web_console/tasks/install.yml#L137
This inserts an explicit call to res_init() for every new style
invocation, with an approximate cost of ~1usec on Linux since glibc
verifies resolv.conf has changed before reloading it.
There is little to be done for users of the thread-safe resolver APIs,
their state is hidden from us. If bugs like that manifest, whack-a-mole
style 'del sys.modules[thatmod]' patches may suffice.
7 years ago
60781ecab6
tests: fix test for vanilla Ansible.
7 years ago
eb56a8f98d
tests: add debug
7 years ago
267f787d20
issue #217 : tests: import (unused) module_utils tests.
7 years ago
ee741da2b3
tests: reenable remaining Ansible tests.
7 years ago
cecef992b0
issue #218 : core: add Secret and Blob types.
7 years ago
be5c03c152
tests: many test fixes. Travis broken for >1 week.
7 years ago
69f58875c8
tests: more ansible fixes from recent brakage.
7 years ago
b20174729d
issue #199 : fix readonly_homedir test.
7 years ago
f98279fc95
tests: fix LRU test after splitting up Connection class.
...
The module the connection class is now loaded as is
"ansible.plugins.connection.mitogen_ssh", etc., which breaks the test.
Instead, check if the connection is an instance of the base Connection
class.
7 years ago
f9e1905ec6
issue #199 : ansible: stop writing temp files for new style modules
...
While adding support for non-new style module types, NewStyleRunner
began writing modules to a temporary file, and sys.argv was patched to
actually include the script filename. The argv change was never required
to fix any particular bug, and a search of the standard modules reveals
no argv users. Update argv[0] to be '', like an interactive interpreter
would have.
While fixing #210 , new style runner began setting __file__ to the
temporary file path in order to allow apt.py to discover the Ansiballz
temporary directory. 5 out of 1,516 standard modules follow this
pattern, but in each case, none actually attempt to access __file__,
they just call dirname on it. Therefore do not write the contents of
file, simply set it to the path as it would exist, within a real
temporary directory.
Finally move temporary directory creation out of runner and into target.
Now a single directory exists for the duration of a run, and is emptied
by runner.py as necessary after each task invocation.
This could be further extended to stop rewriting non-new-style modules
in a with_items loop, but that's another step.
Finally the last bullet point in the documentation almost isn't a lie
again.
7 years ago
6109de51a0
tests: Ansible SSH timeout test
...
Also change Docker image to new 'mitogen' organization.
7 years ago
d4d4f46006
tests: update check_host_keys parameter style in testlib.
7 years ago
b7fe0e09f4
tests: su integration test.
7 years ago
3203846708
issue #239 : ansible: ignore remote_tmp in new style runner.
7 years ago
baa4e75526
tests: tidy up thread_pileup for use as a toy benchmark.
7 years ago
7c5bbc5168
setns: support changing user.
...
To match existing third party plugin.
7 years ago
1be03eb458
parent: change create_child interface.
...
To allow for additional arguments.
7 years ago
fa4746f656
ansible: add connection delegation test targets.
...
For command line use only, no integration tests yet.
7 years ago
962ba862e9
tests: use test-targets group, not all group
7 years ago
86c9978e09
Ensure mod.__file__ is set; closes #210 .
7 years ago
e63ae4768e
core: support Receiver.get(thread_dead=False)
...
For tests.
7 years ago
6541779dd6
tests: import Ansible file transfer benchmark
7 years ago
7c88e4d013
Move _DEAD into header, autogenerate dead messages
...
This change blocks off 2 common scenarios where a race condition is
upgraded to a hang, when the library could internally do better.
* Since we don't know whether the receiver of a `reply_to` is expecting
a raw or pickled message, and since in the case of a raw reply, there
is no way to signal "dead" to the receiver, override the reply_to
field to explicitly mark a message as dead using a special handle.
This replaces the serialized _DEAD sentinel value with a slightly
neater interface, in the form of the reserved IS_DEAD handle, and
enables an important subsequent change: when a context cannot route a
message, it can send a generic 'dead' reply back towards the message
source, ensuring any sleeping thread is woken with ChannelError.
The use of this field could potentially be extended later on if
additional flags are needed, but for now this seems to suffice.
* Teach Router._invoke() to reply with a dead message when it receives a
message for an invalid local handle.
* Teach Router._async_route() to reply with a dead message when it
receives an unroutable message.
7 years ago
8c3b1fcf15
ansible: disable script interpreter processing for new-style
...
Re: #199
7 years ago
2f02b5c0b1
ansible: prevent Unicode strings leaking into sys.argv
...
The module name comes from YAML via Jinja2.. it's always Unicode. Mixing
it into a temporary directory name produces a Unicode tempdir name,
which ends up in sys.argv via TemporaryArgv.
7 years ago
e56608ab91
parent: don't wait for SIGTERM to complete.
7 years ago
dc4433ace6
issue #202 : ansible: forget all dependent contexts on Stream disconnect
...
This is a partial fix, there are still at least 2 cases needing covered:
- In-progress connections must have CallError or similar sent to any
waiters
- Once connection delegation exists, it is possible for other worker
processes to be active (and in any step in the process), trying to
communicate with a context that we know can no longer be communicated
with. The solution to that isn't clear yet.
Additionally ensure root has /bin/bash shell in both Docker images.
7 years ago
9fe14e841c
parent: reap the child process if connection fails
...
For example if no response is received in :attr:`connect_timeout`
seconds, the child would be left running.
7 years ago
e7831a801f
issue #195 : handle non-ASCII scripts in runner.py.
7 years ago
85e1f5f515
ansible: remove JobResultService, more compatible async jobs; closes #191 .
...
And by "compatible" I mean "terrible". This does not implement async job
timeouts, but I'm not going to bother, upstream async implementation is
so buggy and inconsistent it resists even having its behaviour captured
in tests.
7 years ago
6ad18b6719
issue #191 : move async tests to their own category
7 years ago
e43c6c531b
Mostly implement hybrid TTY/socket mode for sudo and SSH.
...
Presently there is still no mechanism to add :attr:`tty_stream` to the
multiplexer after connection is successful, but for now it's not
expected that anything will be logged to it anyway.
Closes #148 .
7 years ago
fca22efe90
tests: enable profile_tasks callback plugin
7 years ago
c6284e00e9
Use subprocess to start child processes; closes #185 .
7 years ago
1e882a72c0
tests: install virtualenv in the Docker images.
7 years ago
b91785c9a1
tests: workaround for issue_109
7 years ago
ce260933d9
tests: consistent play naming everywhere
7 years ago
d827bdb848
tests: fixes to get regression/ running under vanilla Ansible
7 years ago
b882b78d35
tests: clean up remaining reg tests
...
Delete some that are impossible to detect, fix up the remainder to
detect the condition they describe.
7 years ago
aeeba54d96
tests: better regression test for issue #109
7 years ago
f4d791662e
ansible: better planner logging, try again
7 years ago
b4bb1c5a2a
tests: fix suspected readdir() ordering issue (!)
7 years ago
0046a3de0b
tests: insert debug print for travis :(
7 years ago
ef47347cdf
tests: raft of fixes for vanilla Ansible
7 years ago
89e11ed25c
tests: make osx_setup a little more generic again
7 years ago
2c3d2db4ec
tests: fix output checks for Linux
7 years ago
7e49e73683
tests: add perl-JSON to the test images too.
...
Needed for the runner tests.
7 years ago
ac80bf12f0
tests: start making osx_setup.yml more generic
7 years ago
16b5aa2d10
tests: disable host key checking for Paramiko.
7 years ago
41d2661ecb
tests: fix sudo rule order.
7 years ago
ed915b6e63
tests: magic mitogen_shutdown_all action
...
LRU tests break when run as part of the whole suite rather than
individually, because LRU stuff is already happening for earlier tests.
7 years ago
6614d17021
tests: explicit sudo rules to require password from sudo_nopw
...
This account is used on Travis. It needs to be forced to type passwords
in some cases
7 years ago
ba8022424b
tests: more work to standardize user accounts.
7 years ago
ce6fb05d87
tests: 'fix' responder test.
...
Needs a complete rewrite, but this will do for now.
7 years ago
00aef80fac
tests: /bin/bash login shell for all users.
7 years ago
63e2ec6406
tests: expanduser lookup runs locally
7 years ago
472610805f
tests: fix remote_tmp test on 2.5.x.
7 years ago
e2eac65347
tests: import mitogen_ansible_playbook.sh helper
7 years ago
89676b1257
tests: put unittest.skip() around fakessh tests for the time being
7 years ago
6390e36a4e
tests: document selecting a target distribution.
7 years ago
f203a91e1a
tests: support CentOS Docker images.
...
- namespace & document test accounts in README.md
- standardize the password format everywhere, and ensure the passwords
differ everywhere.
- Add MITOGEN_TEST_DISTRO environment variable.
7 years ago
9f94fb78c8
issue #159 : make LRU size configurable.
7 years ago
6394226722
issue #159 : verify no more than 20 tasks exist on the remote
7 years ago
633cd888a0
issue #182 : test for previous commit.
7 years ago
9acca37050
issue #159 : lots more test users.
7 years ago
0c803141a7
tests: fix filename.
7 years ago
ec720eab1a
Merge commit 'refs/pull/178/head' of github.com:dw/mitogen
7 years ago
3682ac6e29
fork: ensure importer handle is installed on the new router.
7 years ago
c14f6c98d1
ansible: import osx_setup.yml.
7 years ago
98ee3e177a
ansible: tests for sudo behaviour; closes #143 .
7 years ago
3613162bc0
ansible: enable forking when requested and for async jobs.
...
Closes #105 .
References #155 .
mitogen/service.py:
Refactor services to support individually exposed methods with
different security policies for each method.
- @mitogen.service.expose() to expose a method and set its policy
- @mitogen.service.arg_spec() to validate input.
- Require basic service message format to be a tuple of
`(method, kwargs)`, where kwargs is always a dict.
- Update DeduplicatingService to match the new scheme.
ansible_mitogen/connection.py:
- Rename 'method' to 'method_name' to disambiguate it from the
service.call()'s method= argument.
ansible_mitogen/planner.py:
- Generate an ID for every job, sync or not, and fetch job results
from JobResultService rather than via the initiating function
call's return value.
- Planner subclasses now get to select whether their Runner should
run in a forked process. The base implementation requests this if
the 'mitogen_isolation_mode=fork' task variable is present.
ansible_mitogen/runner.py:
Teach runners to deliver their result via JobResultService executing
in their indirect parent mux process.
ansible_mitogen/plugins/actions/mitogen_async_status.py:
Split the implementation up into methods, and more compatibly
emulate Ansible's existing output.
ansible_mitogen/process.py:
Mux processes now host JobResultService.
ansible_mitogen/services.py:
Update existing services to the new mitogen.service scheme, and
implement JobResultService:
* listen() method for synchronous jobs. planner.invoke() registers a
Sender with the service prior to invoking the job, then sleeps
waiting for the service to write the job result to the
corresponding Receiver.
* Non-blocking get() method for implementing mitogen_async_status
action.
* Child-accessible push() method for delivering task results.
ansible_mitogen/target.py:
New helpers for spawning a virginal subprocess on startup, from
which asynchronous and mitogen_task_isolation=fork jobs are forked.
Necessary to avoid a task inheriting potentially
polluted/monkey-patched parent environment, since remaining jobs
continue to run in the original child process.
docs/ansible.rst:
Add/merge/remove some behaviours/risks.
tests/ansible/integration:
New tests for forking/async.
7 years ago
1bc32adad4
Issue #160 : Cache minimize_source()
...
Before
```
python tests/bench/local.py
0 120.245933533
1 119.300842285
2 118.355035782
3 123.839855194
```
After
```
python tests/bench/local.py
0 66.3640499115
1 65.9508705139
2 72.4799633026
3 65.7958984375
```
7 years ago
dc3f5730a2
Merge branch 'master' into eye-of-the-token-its-the-thrill-of-the-light
7 years ago
b247c320d2
issue #164 : rename tests for clarity
7 years ago
bc4a6b39bf
issue #164 : teach debops_tests.sh to use SSH
...
Login with a non-privileged account over SSH rather than just jumping
straight in as root via Docker.
7 years ago
35fdd97f9a
issue #164 : utility to print Docker hostname for use from shell scripts.
7 years ago
b9d4ec57b3
issue #164 : some more ActionMixin tests.
7 years ago
29288b236b
issue #164 : import run_ansible_playbook.sh.
7 years ago
db894478f8
issue #164 : make become_flags work without FOO=2 env var.
7 years ago
e4b49997d6
issue #164 : whups, delete checked in binaries.
7 years ago
d068a36c1e
issue #164 : more dir layout contortions.
...
all.yml slurps in tests from each file/subdir in the CWD.
7 years ago
680dc1bf68
issue #164 : basic connection loader tests.
7 years ago
20ecd0af02
issue #164 : fix makefile
7 years ago
48a0938d04
issue #164 : add action module to return active strategy.
7 years ago
0247561fc7
issue #164 : rename lib/modules
7 years ago
6aeb4e9f05
issue #164 : precisely emulate Ansible's stdio behaviour.
...
* Use identical logic to select when stdout/stderr are merged, so
'stdout', 'stdout_lines', 'stderr', 'stderr_lines' contain the same
output before/after the extension.
* When stdout/stderr are merged, synthesize carriage returns just like
the TTY layer.
* Mimic the SSH connection multiplexing message on stderr. Not really
for user code, but so compare_output_test.sh needs fewer fixups.
7 years ago
c5ca2e87ea
issue #164 : stop tests on first failure
7 years ago
26cc0f2724
issue #164 : fix remote_tmp handling on <2.5
7 years ago
3ebe600389
issue #164 : convert "examples" into actual tests
...
- Add new Travis mode, "ansible_tests.sh" that runs
integrations/all.yml. Slowly build this up over time to cover more of
the existing junk.
- Add basic assertions on the output of the existing runner__* files.
- Wire up 2.4.3/2.5.0 jobs in Travis.
7 years ago
ae75a0ca8c
issue #164 : rearrange playbooks a little more
7 years ago
563639961d
issue #164 : dir structure is gross, but at least tab completion works :>
7 years ago
49aa8834b0
issue #164 : split "examples" out into regression/integration tests.
7 years ago
4805f3cf36
issue #164 : slightly flatten docker image layers
7 years ago
8ca8b43df1
tests/bench: import "slightly more reliable time" script
7 years ago
eb402c8bd4
tests/bench: import wrapper script used for blog charts
7 years ago
de27fb3a28
issue #174 : test all io_op() logic.
7 years ago
dc60f05a40
tests: Switch to unit2 test runner, with coverage
...
This means test files are imported as modules, not run as scripts. THey
can still be run individually if so desired. Test coverage is measured,
and an html report generated in htmlcov/. Test cases are automativally
discovered, so they need not be listed twice. An overall
passed/failed/skipped summary is printed, rather than for each file.
Arguments passed to ./test are passed on to unit2. For instance
./test -v
will print each test name as it is run.
7 years ago
7b8fef5284
tests: Make the tests directory an importable package
...
Required for test discovery by e.g. unit2, pytest
7 years ago
a22294dda9
call_function_test: Fix assumption that we run as a script
7 years ago
0dcaeb21a2
master_test: Don't assume __file__ points to source code
...
When run under a test runner the unit tests are imported as modules.
This triggers .pyc generation, after which __file__ resolves to the .pyc
file.
7 years ago
841c2b13a1
fakessh_test: Apply timeout decorators to rsync tests
...
timeoutcontext.timeout uses SIGALRM, hence it will only work on Unix
like operating systems.
7 years ago
48623763d6
minimize_source: Implement reindentation
7 years ago
556ee2aec6
minimize_source: Handling indentation
...
In the case that string(s) are replaced, any indent or dedent tags must
be re-inserted after the replacemnts.
7 years ago
36c5ff1d05
minimize_source: Make comments test invariant on hashbang/coding handling
...
strip_comments() currently ignores comments on lines 1 and 2, in order
to preserve lines such as
The comments test had normal comments on those lines, hence it was
failing.
7 years ago
3bf61bb311
tests: Clarify which minimize_source samples are the reference
7 years ago
35ae4e4227
Issue #160 : Add minimize_source testcases
7 years ago
bbb0f1bbd8
issue #155 : fix double-fork behaviour and test it this time.
7 years ago
4c433dbed1
parent_test: Add explanation.
7 years ago
bde1778373
tests: merge tty_create_child() test into parent_test and fix hang
7 years ago
6670cba41c
Introduce handler policy functions; closes #138 .
...
Now you can specify a function to add_handler() that authenticates the
message header, with has_parent_authority() and is_immediate_child()
built in.
7 years ago
f726ef86de
tests: first_stage_test regression due to 1ff27ada49
7 years ago
40b978c9b7
core: Fix source verification.
...
Previously:
* src_id could be spoofed
* auth_id was checked but the message was still delivered!
7 years ago
fe614aa966
core: cleanup handlers on broker crash; closes #112 .
7 years ago
1ff27ada49
Add maximum message size checks. Closes #151 .
7 years ago
80a97fbc9b
core: Rename Sender.put() to Sender.send().
...
Been annoying me for months.
7 years ago
085b3d21bd
core: fix call_function_test regression
...
Second time in 3 weeks. So stupid. This time write tests.
7 years ago
0f29baa077
core: support pickling senders, Receiver.to_sender()
...
CC @moreati, in case this impacts you
7 years ago
17aef51e6e
tests: Import .local() latency test
7 years ago
a8a31728a0
tests: Import Latch soak test
7 years ago
03fcf057dd
tests: just call log_to_file() from testlib
...
Now we can run test.sh with MITOGEN_LOG_LEVEL=debug and things just
work.
7 years ago
761cd9eaf8
tests: import tty_create_child_test.py.
7 years ago
7b12f84366
core: support CallError(str) for service.py.
7 years ago
fccca54068
tests: ensure OpenSSL is initialized prior to test.
7 years ago
4903052f42
fork: reseed Python/SSL PRNGs
...
Mac's SSL seems to have a pthread_atfork handler or similar that does
this for us, no clue if Linux is the same.
7 years ago
48351a1889
issue #155 : parent: support Context.shutdown(), reap children on exit.
...
This permits graceful shutdown of individual contexts, without tearing
down everything.
Update mitogen.parent.Stream to also wait for the child to exit, to
prevent the buildup of zombie processes. This introduces a blocking wait
for process exit on the Broker thread, let's see if we can get away with
it. Chances are reasonable that it'll cause needless hangs on heavily
loaded machines.
7 years ago
4f93c6823a
issue #155 : skeletal fork_test.
7 years ago
2d7821b824
tests: test_stream_name: fix non-localhost Docker
7 years ago
23e279b617
tests: get import_test limping back to health.
7 years ago
f4ba66e3ee
issue #155 : allocate child IDs in batches of 1000.
...
Avoids a roundtrip for every fork.
7 years ago
2132c311b2
tests: mark some tests as skipped
7 years ago
8aada2646c
core: support throwing LatchError in every sleeping thread
...
This is to allow Select() to be used as a generic queueing primitive
that supports graceful shutdown.
7 years ago
e3b700b553
tests: Fix no such option -o running FakeSsh.test_okay()
...
Full output of failed test
```
ERROR: test_okay (__main__.FakeSshTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "tests/ssh_test.py", line 16, in test_okay
ssh_path=testlib.data_path('fakessh.py'),
File "/home/alex/src/mitogen/mitogen/master.py", line 650, in ssh
return self.connect('ssh', **kwargs)
File "/home/alex/src/mitogen/mitogen/parent.py", line 463, in connect
return self._connect(context_id, klass, name=name, **kwargs)
File "/home/alex/src/mitogen/mitogen/parent.py", line 449, in _connect
stream.connect()
File "/home/alex/src/mitogen/mitogen/ssh.py", line 104, in connect
super(Stream, self).connect()
File "/home/alex/src/mitogen/mitogen/parent.py", line 395, in connect
self._connect_bootstrap()
File "/home/alex/src/mitogen/mitogen/ssh.py", line 116, in
_connect_bootstrap
time.time() + 10.0):
File "/home/alex/src/mitogen/mitogen/parent.py", line 207, in
iter_read
(''.join(bits)[-300:],)
mitogen.core.StreamError: EOF on stream; last 300 bytes received:
'Usage: fakessh.py [options]\n\nfakessh.py: error: no such option: -o\n'
```
7 years ago
0f82f68fee
parent: Precompute preamble sizes for first stage
...
SSH command size: 453 (no change)
Preamble size: 8941 (-5 bytes)
7 years ago
b433645d11
tests: Fix import error
7 years ago
c6f3bfd93a
tests: Correct path to apply_mode_spec()
7 years ago
23f78ca5a2
README: move testing bits into tests directory.
7 years ago
f5b5e4849e
tests: import very basic latch_test
7 years ago
f6d87faf37
tests: import ansible_helpers_test.
7 years ago
4b373c421b
core: Standardise type of Importer.whitelist
...
This seemed a reasonable streamlining, but I'm happy to be overruled.
7 years ago
8338caa419
tests: Add mitogen.core.is_blacklisted_import() tests
...
These test the current behviour, which may not be exactly the intended
behaviour. Refs #98
7 years ago
491355548d
tests: Fix typo in ResolveRelPathTest
7 years ago
ef35d55523
tests: Remove jinja2/markupsafe modules from FindRelatedTest
...
Not sure how they got there, but Django doesn't use Jinja without
explicit configuration.
7 years ago
eee312a57e
tests: Fix expected values FindRelatedTest for Django 1.11.4
7 years ago
4424bfbb7a
tests: Add new FindRelatedImportsTest
7 years ago
9e43f5e6ba
tests: Remove module under search from expected results
...
This matches a tweak made in 8765f761c9
7 years ago
0f9bfc1e21
tests: Rename FindRelatedImportsTest -> FindRelatedTest
7 years ago
afc8697288
core: Ensure add_handler() callbacks really receive _DEAD on shutdown
7 years ago
ccd9c62399
tests: stubs for future whitelist/blacklist tests.
7 years ago
f4405c6bbc
Split IterReadTest & WriteAllTest into test_parent
...
This matches their respective functions under test, which now reside in
mitogen.parent.
7 years ago
4fb1b928b7
Adjust unittest for master -> parent split
...
Tests should now match changes in
4d31300dd0
7 years ago
9ccff0f5d1
Fix TypeError while initiliazing ImporterMixin
...
Since f44356af32
7 years ago
fa0f390d4d
FIx syntax error in FindRelatedImportsTest.test_django_db_models
7 years ago
dd088908df
select: clean up API.
7 years ago
219718740b
Move django test script into permanent test
7 years ago
ec1de4b4b9
tests: ensure strace is available in the docker image..
...
..and enable privileged=True since that's needed for ptrace()
7 years ago
b2909ee5f4
Replace nasty print statements in six_brokenpkg.
7 years ago
7e01c5bed5
Import and use unittest2 without aliasing it
7 years ago
e8e023ce59
Use specific TestCase assertions throughout tests
...
e.g. assert x == y -> self.assertEqual(x, y);
self.assertTrue(isinstance(x, y)) -> self.assertIsInstance(x, y)
These specific methods give more useful errors in the case of a test
failure.
7 years ago
df9556d1d9
Replace custom assertContains() with unitest2 assertIn()
7 years ago
17da6e9998
Use unittest2 in all tests
...
This allows using features such as TestCase,assertIsInstance on Python
2.6 and earlier.
7 years ago
3831ac360f
Replace all calls to file() with open()
...
Although these are synonyms in Python 2.x, when using MyPy to typecheck
code use of file() causes spurious errors.
This commit also serves as one small step to Python 3.x compatibility,
since 3.x removes the file() builtin.
7 years ago
df61f6ab4d
Prevent MacOS exception on shutdown of closed socket.
7 years ago
39f325af3e
Fix getting the directory path on Mac OS X.
7 years ago
026669aa93
tests: Fix GetModuleViaPkgutilTest fetching .pyc
...
On my laptop (Ubuntu 17.10, Python 2.7.14 in a virtualenv),
`test_regular_mod` fails with
```
AssertionError: "\nimport sys\n\n\ndef say_hi():\n print 'hi'\n" !=
'\x03\xf3\r\n\xbbW\xd5Yc\x00\x00\x00\x00\x00\x00\x00\x00\x02\x00\x00\x00@\x00\x00\x00s\x19\x00\x00\x00d\x00\x00d\x01\x00l\x00\x00Z\x00\x00d\x02\x00\x84\x00\x00Z\x01\x00d\x01\x00S(\x03\x00\x00\x00i\xff\xff\xff\xffNc\x00\x00\x00\x00\x00\x00\x00\x00\x01\x00\x00\x00C\x00\x00\x00s\t\x00\x00\x00d\x01\x00GHd\x00\x00S(\x02\x00\x00\x00Nt\x02\x00\x00\x00hi(\x00\x00\x00\x00(\x00\x00\x00\x00(\x00\x00\x00\x00(\x00\x00\x00\x00sF\x00\x00\x00/home/alex/src/mitogen/tests/data/module_finder_testmod/regular_mod.pyt\x06\x00\x00\x00say_hi\x05\x00\x00\x00s\x02\x00\x00\x00\x00\x01(\x02\x00\x00\x00t\x03\x00\x00\x00sysR\x01\x00\x00\x00(\x00\x00\x00\x00(\x00\x00\x00\x00(\x00\x00\x00\x00sF\x00\x00\x00/home/alex/src/mitogen/tests/data/module_finder_testmod/regular_mod.pyt\x08\x00\x00\x00<module>\x02\x00\x00\x00s\x02\x00\x00\x00\x0c\x03'
```
`__file__` contains the path of the compiled `.pyc`, not the `.py`
source file.
7 years ago
65defaa354
tests: initial first_stage_test.
7 years ago
8dcfb1b7f7
testlib: Auto negotiate Docker API version
...
Ubuntu 17.04 provides Docker 1.12.6, which has API version 1.24.
`dev_requirements.txt` specifies the docker-py 2.5.1, which by default
requests API version 1.30.
Hence when the SSH unit tests try to run the container specified in
`DockerizedSshDaemon` an error occurs
```
APIError: 400 Client Error: Bad Request ("client is newer than server
(client API version: 1.30, server API version: 1.24)")
```
7 years ago
94992940dd
ssh_test: Correct hostname in SShTest.test_stream_name()
...
I presume that `u1704` is a relic of a bygone container/host.
7 years ago
dfc7b85504
testlib: Wait for sshd before running tests
...
On Ubuntu 17.10 something (probably Docker) appears to be accepting
connections, before sshd is fully ready. This results in a race
condition, and hence connection errors for the first few tests (2-3 on
my laptop).
testlib.wait_for_port() checks not only that the port can be connected
to, but also something resembling the sshd banner is sent.
Fixes #51
7 years ago
f8a84616d7
tests: stop responder_test spamming the logs
7 years ago
7389272dc4
tests: stop fakessh spamming the logs
7 years ago
828f60351b
importer: Delete _get_module_via_parent entirely
...
Can't figure out what it's supposed to do any more, and can't find a
version of Ansible before August 2016 (when I wrote that code) that
seems to need it.
Add some more mitigations to avoid sending dylibs.
7 years ago
17a05dc14f
Try to be compatible with older Docker daemons; (hopefully) closes #46
7 years ago
b7a9aa46cf
core: More robust shutdown
...
Now there is a separate SHUTDOWN message that relies only on being
received by the broker thread, the main thread can be hung horribly and
the process will still eventually receive a SIGTERM.
7 years ago
32d029ed75
Add test that hangs the main thread during shutdown.
7 years ago
3285fc2f75
Implement test_aborted_on_local_context_disconnect
7 years ago
dfe68b33d6
Handle docker running on localhost.
7 years ago
bee1a86aa1
Let utils_test run directly too.
7 years ago
690ee6dbe2
Fix select_test failure, remove crap old timing_test.
7 years ago
9c8ff7ecf6
Remove proxy_test (duplicates sudo_test)
7 years ago
f22d05a7ad
frameworkize nested_test.
7 years ago
15bf0f54e2
Beginnings of module_finder_test
7 years ago
d17af194b5
Fix importer_test constructor signature.
7 years ago
2454dcc990
core: loosen assertion to allow fakessh_test to succeed.
7 years ago
bc801bc2ed
Allow call_function_test to succeed depite testlib import.
7 years ago
118fe01be5
Use enhanced assertRaises in call_function_test.py.
7 years ago
9b13a4cc61
Fix 2 call_function_test failures.
7 years ago
236d83418c
Simple scan_code_imports test.
7 years ago
af6812b458
Fix context naming for sudo and via=.
7 years ago
1449c972eb
Allow running responder_test with unittest.
7 years ago
849ccebe04
receiver: only permit one notify callback
...
There is no point spamming a list for every function call, there is no
use case where multiple notify callbacks would be useful.
7 years ago
bcae62c682
issue #20 : TestCase subclass with a nicer assertRaises
7 years ago
f869e088f8
issue #20 : tests and fixes for mitogen.master.Select().
7 years ago
ced6d8e404
Fix up importer_test.
7 years ago
40e2e6eb4c
Add README.md to tests subdir.
7 years ago
2fed3613e9
Syntax error.
7 years ago
d706b7d6b8
Update lingering references to with_broker & run_with_broker
...
A previous commit renamed run_with_broker() and with_broker() to
run_with_router() and with_router() respctively. Some references were
missed.
7 years ago
1510b72a25
fakessh: Add integration test for inter-child rsync.
7 years ago
f01e457d70
Allow running without py.test.
7 years ago
750e9fab24
Make log_to_file accept string level rather than logging package constant
...
Saves an import, pain in the ass to type all the time.
7 years ago
1411790f56
master: make write_all() handle O_NONBLOCK and deadlines.
7 years ago
db225638f0
core: Make iter_read() handle deadline (and non-blocking IO) properly
7 years ago
3c8c1f71a6
Update test.
7 years ago
5dff221842
fakessh: cleanup master test.
7 years ago
David Wilson