6aeb4e9f05
issue #164 : precisely emulate Ansible's stdio behaviour.
...
* Use identical logic to select when stdout/stderr are merged, so
'stdout', 'stdout_lines', 'stderr', 'stderr_lines' contain the same
output before/after the extension.
* When stdout/stderr are merged, synthesize carriage returns just like
the TTY layer.
* Mimic the SSH connection multiplexing message on stderr. Not really
for user code, but so compare_output_test.sh needs fewer fixups.
7 years ago
e0381606af
Ensure remote_tmp is respected everywhere.
...
Logic is still somewhat different from Ansible: we don't have to care
about sudo/non-sudo cases, etc.
7 years ago
38311336e1
docs: link to Ansible video demo
7 years ago
380ef7376d
ansible: Add support for free strategy.
7 years ago
8425b196e7
docs: merge duplicate risks
7 years ago
6dcefd631a
issue #106 : docs: remove built-in only limitation :>
7 years ago
6958b8ff09
docs: More getting started.
7 years ago
8674ec42dd
docs: add new risk
7 years ago
bbb0f1bbd8
issue #155 : fix double-fork behaviour and test it this time.
7 years ago
6670cba41c
Introduce handler policy functions; closes #138 .
...
Now you can specify a function to add_handler() that authenticates the
message header, with has_parent_authority() and is_immediate_child()
built in.
7 years ago
80a97fbc9b
core: Rename Sender.put() to Sender.send().
...
Been annoying me for months.
7 years ago
b48d63f33b
docs: add to_sender() and update serialization notes
7 years ago
8676c40674
core: make _start_transmit / _stop_transmit async-only
...
For now at least, these APIs are always used in an asynchronous context,
so stop using the defer mechanism.
7 years ago
c33bc22f21
docs: fix reading time tracking :(
7 years ago
4903052f42
fork: reseed Python/SSL PRNGs
...
Mac's SSL seems to have a pthread_atfork handler or similar that does
this for us, no clue if Linux is the same.
7 years ago
7f4368db87
docs: pad out signal handlers note
7 years ago
d68833757b
docs: slightly bikeshed last testimonial
7 years ago
d23a6174a2
Merge pull request #167 from danielcompton/patch-1
...
Add testimonial from Clojars
7 years ago
0dbb63ae3d
docs: typo
7 years ago
b254373cd7
docs: add local task serialization risk
7 years ago
871b853b59
Add testimonial from Clojars
7 years ago
2813d1a968
docs: update
7 years ago
5579ac936b
issue #155 : docs: more fork() liability warnings
7 years ago
f457f54758
docs: fix formatting
7 years ago
d370290687
docs: one more warning
7 years ago
03e08e25fd
docs: put huge liability notice in fork() docs.
7 years ago
48351a1889
issue #155 : parent: support Context.shutdown(), reap children on exit.
...
This permits graceful shutdown of individual contexts, without tearing
down everything.
Update mitogen.parent.Stream to also wait for the child to exit, to
prevent the buildup of zombie processes. This introduces a blocking wait
for process exit on the Broker thread, let's see if we can get away with
it. Chances are reasonable that it'll cause needless hangs on heavily
loaded machines.
7 years ago
6a74edce6b
issue #155 : parent: move master.Context into parent.
...
The Context and Router APIs for constructing children and making
function calls should be available in every parent context, as user code
wants to have access to the same API.
7 years ago
447353ecb8
docs: ansible.rst: note multi-host perf isn't great right now
7 years ago
20780820a6
docs: typo
7 years ago
75b9e1d71e
issue #155 : docs: document behaviour of forked children
7 years ago
110fdf24cd
docs: add mitogen.fork.Stream to internals.rst
7 years ago
1a8ac9f4d1
issue #155 : introduce mitogen.fork / Router.fork()
7 years ago
27175e3126
docs: tidy up signals.rst a little.
7 years ago
732a610246
docs: add beginnings of section on func decorators
7 years ago
2abe87472c
issue #162 : docs: begin documenting mitogen.service
7 years ago
54ff1c90fa
issue #155 : add DEL_ROUTE, propagate ADD_ROUTE upwards
...
* IDs are allocated by the parent responsible for contructing a new
child, using ALLOCATE_ID to the master as necessary to allocate new ID
ranges.
* ADD_ROUTE is sent up the tree rather than down. This permits
construction of the new context to complete concurrent to parent
contexts learning about its existence. Since all streams are strictly
ordered, it's not possible for any parent to observe messages from the
new context prior to arrival of an ADD_ROUTE from the parent notifying
of its existence.
If the new context, for example, implements an Ansible async task, its
parent can start executing that without waiting for any synchronous
confirmation from any parent or the master.
* Since routes propagate up, it's no longer possible for a plain
non-parent child to ever receive ADD_ROUTE, so that code can be moved
out of core.py and into parent.py (-0.2kb compressed).
* Add a .routes attribute to parent.Stream, and respond to disconnection
signal on the stream by propagating DEL_ROUTE for any ADD_ROUTE ever
received from that stream.
* Centralize route management in a new parent.RouteMonitor class
7 years ago
aeeeb45ccb
docs: farewell, glorious iframe!
7 years ago
1ed86774b5
issue #156 : document select exception
7 years ago
20f5d89dfa
issue #156 : fix several more races
...
* Don't need to sleep if queue>sleepers, can just pop the right queue
element and return it.
* If queue>sleeping and waking==sleeping, no mechanism existed to ensure
a thread newly added to sleeping would ever be woken. Above change
fixes that.
* Cannot trust select() return value, scheduler might sleep us
indefinitely while put() writes a byte.
* Sleeping threads didn't pop FIFO, they popped in whatever order
scheduler woke them up. Must recover index and use it to pick the pop
index.
7 years ago
526b0a514b
issue #156 : prevent Latch.close() triggering spurious wakeups
7 years ago
18e2977baf
docs: annoying phrasing
7 years ago
2c22c41819
issue #156 : don't decrement `waking` if we timed out rather than being woken.
7 years ago
07a8994ff5
issue #156 : waking thread result dictionary with an integer.
7 years ago
b5398bd17f
issue #156 : docs typo
7 years ago
512ff77a46
issue #156 : prevent non-sleeping threads from starving sleeping threads.
...
See new docs
7 years ago
148ce1d703
issue #155 : increase context ID width to 32 bits
...
Needed to make large range allocations (1000 per ALLOCATE_ID roundtrip)
feasible.
7 years ago
071d9fbfb3
docs: tidy ansible docs.
7 years ago
f241eac5ce
parent: allow Python to determine its install prefix from argv[0]
...
Fixes support for virtualenv. Closes #152 .
7 years ago
dec3af375a
issue #144 : ansible: increase default pool size to 16.
7 years ago
4f361be7e7
issue #144 : teach Select() to close its latch
...
Causes all threads sleeping on the select to wake.
7 years ago
8aada2646c
core: support throwing LatchError in every sleeping thread
...
This is to allow Select() to be used as a generic queueing primitive
that supports graceful shutdown.
7 years ago
7a74bb0a39
docs: update ansible risks/differences.
7 years ago
bcc15987fc
docs: extra ansible paragraph.
7 years ago
7a394dc73e
ansible: allow establishment of duplicate SSH connections
7 years ago
4691ce0b95
issue #150 : ansible: add basic Docker support.
7 years ago
67ff762ba5
issue #139 : docs: remove note about bad buffering
7 years ago
d1888f1908
docs: reorder sections
7 years ago
014247ce66
docs: another crazy Ansible success story
7 years ago
7063d172e9
tests: Add Tox config for Python 2.6 and 2.7
...
I could not get Python 2.5 or earlier to work. Too many packages
(critically docker) don't support it.
7 years ago
88c198ea05
issue #141 : copy Ansible's connect_timeout for sudo too.
7 years ago
63c3fc623c
docs: note the semantic difference in Mitogen vs. Ansible timeouts
...
Related to issue #141 .
7 years ago
8f85943083
issue #139 : mention relating buffering issue
7 years ago
1f1d691a28
docs: update to match @moreati's code golf birdies :)
7 years ago
9aa83ef77f
docs: First round of Pickle-likes survey
7 years ago
a1fc21bb06
docs: Maximum size of pencode values
7 years ago
e24db89f3a
docs: Disco comparison
7 years ago
04f4851138
docs: multiprocessing comparison
...
Not strictly a rival, but has enough commonalities to be worth noting
7 years ago
8c227b2bdd
docs: More detail about Baker
7 years ago
e06e438228
docs: More detail about execnet
7 years ago
da58f8595d
docs: More detail about chopsticks
7 years ago
d7fbb9aef6
docs: Link compared projects to their website
...
All outgoing links checked with
```bash
cd docs
make linkcheck
```
7 years ago
4615ab1a8e
docs: Enable sphinx-autobuild
...
```bash
cd docs
make
```
to run a webserver that automatically rerenders whenever the rST is
modified.
7 years ago
f8c85b549f
docs: typo
7 years ago
dc9dda08e1
Add link to IRC; closes #116
7 years ago
b2a433dcc4
ssh: CompressionLevel is a v1-only option.
...
It's ignored by newer SSHes, which only pay attention to Compression.
7 years ago
1c20c61605
docs: Convert all URLs that support https://
...
Excluded: graphml XML namespaces, links to e.g. Fabric homepage
Fixes #128
7 years ago
089f39716e
docs: beginnings of testimonials section
7 years ago
500c4f419c
docs: update limitations list for Ansible.
7 years ago
537a263261
docs: So many typos
7 years ago
6bd4c5ead5
docs: Ansible logging update ( #111 )
7 years ago
4f352d7d4b
Pin Sphinx version
7 years ago
53e51c4af8
docs: update Python 3 support to match reality.
7 years ago
ce9a1fef26
docs: fix float
7 years ago
04bb5881b6
ansible: doc updates
7 years ago
9515291024
docs: small fix
7 years ago
3ddbf1a503
ansible: basic support for ssh_args
7 years ago
1b28252ad0
docs: get rid of "medium risk" category
7 years ago
da00437f1e
ansible: Support ansible_ssh_private_key_file
7 years ago
a87b665099
ansible: limited support for become_flags, more docs.
7 years ago
235e1df987
sudo: support parsing sudo flags back out into parameters
7 years ago
cd53023768
docs: Fix install docs now Ansible package layout changed.
7 years ago
03e51fdaa7
docs: mitogen.core.Latch docs
7 years ago
712e5dfca1
docs: fix image labels
7 years ago
c2793b7102
docs: import but don't link compared.rst
7 years ago
2ecc6f43a4
docs: Import, but do not yet link signals.rst
7 years ago
7cf2edc3a8
ansible: Support many more common playbook variables.
7 years ago
ba644e184d
docs: Split up limitations list, add warning
7 years ago
3183dd4147
ansible: initial support for async jobs
...
Running in a thread to begin with, but this must change.
7 years ago
e913c11e50
docs: new Ansible limitation
7 years ago
860a635500
docs: remove delegate_to limitation
7 years ago
dfdb7ab128
docs: more Ansible
7 years ago
cf7f8ff490
docs: document one more Ansible limitation
7 years ago
7179ca163b
docs: Replace shifty hacker dude with plebey skater dude
...
Farewell, shifty hacker dude! May your 0days be many and your
indictments be few
7 years ago
0c056ddbe2
docs: new Ansible limitation, add new heading
...
Some differences are eventually likely to become permanent, because the
existing behaviour is unforgiveable.
7 years ago
14251539cd
docs: Docker typo.
7 years ago
5036a9448f
Add Docker method.
7 years ago
77f6b31e5c
docs: more images.
7 years ago
56b563161b
docs: single-threaded connection is the most important limitation
7 years ago
c1bea0dd49
docs: store blog images for fear of laptop crash
...
There is only so much trackpad-driven yEd work one man can handle
7 years ago
dd9d3494e0
docs: small ansible.rst updates
7 years ago
ce6648da51
docs: mention CPU usage reduction
7 years ago
270db025c0
docs: fix up Ansible install docs.
7 years ago
e9060b3b7f
docs: more modest and accurate numbers for Ansible
7 years ago
b221eaaa10
ansible: log call timings
7 years ago
a817f5e9e8
docs: more marketing, add lots of drama bold.
7 years ago
5933723d70
docs: a little more marketing
7 years ago
de1b3602e5
docs: tidy up ansible.rst
7 years ago
52da0d882e
ansible: add a new limitation
7 years ago
14b5c4d504
docs: remove fixed Ansible limitation
...
The solution was that Mitogen's loader should emulate the behaviour of
ansible.executor.module_common, which restricts dependency scanning to
the ansible.module_utils namespace.
7 years ago
91116810a1
ansible: delete utils.py and promote cast() to mitogen.utils
7 years ago
18eaf14dca
ansible: migrate logging variables into utils.
7 years ago
10c2de2845
examples: rename playbooks for clarity.
7 years ago
ea126bb7e8
docs: add stats tracking
7 years ago
875ee29d4f
docs: initial Ansible extension docs.
7 years ago
bdd8648bae
ssh: enable compression by default
...
Using the same test as in 7af97c0365
7 years ago
4d940f08ae
importer: drop redundant prefix from pkg_present
...
For the 52 submodules of ansible.modules.system, this produced a 1602
byte pkg_present list. After stripping it becomes 406 bytes, and the
entire LOAD_MODULE size drops from 1988 bytes to 792 bytes (-60%).
For the 68 submodules of ansible.module_utils, 1902 bytes pkg_present
becomes 474 bytes (-75%), and LOAD_MODULE size drops from 2867 bytes to
1439 bytes (-49%).
In a simple test running Ansible's "setup" module followed by its "apt"
module, wire bytes sent drops from 140,357 to 135,531 (-3.4%).
7 years ago
71a6b9e32a
master: Select.all() sugar
7 years ago
ac4a42a43e
docs: fix Select() example for new style API.
7 years ago
a69d9650ad
Fix indentation of Router.route anchor
7 years ago
eb1ad66469
docs: Fix out of date get_data() snippets
...
As of adc8fe3aed
7 years ago
20afa5b90c
Latch v2: combined queue + one self-pipe-per-thread
...
Turns out it is far too easy to burn through available file descriptors,
so try something else: self-pipes are per thread, and only temporarily
associated with a Lack that wishes to sleep.
Reduce pointless locking by giving Latch its own queue, and removing
Queue.Queue() use in some places.
Temporarily undo merging of of Waker and Latch, let's do this one step
at a time.
7 years ago
e63e9d299e
docs: add Message documentation
7 years ago
dd088908df
select: clean up API.
7 years ago
a39cd44bf2
core: add auth_id field.
7 years ago
07d4d799f1
Add mitogen.main() decorator mainly for docs and demo use.
7 years ago
09eb3fd9ba
utils: support log_to_file(usec=True)
7 years ago
592ebd59c2
docs: reorder sections
7 years ago
dee856f6f4
docs: remove obsolete warning
7 years ago
b941bce964
docs: sphinx-autobuild default target.
7 years ago
4d9d21c808
docs: fix typo
7 years ago
4a6d55ced6
docs: vastly simplify importer concurrency docs
7 years ago
984b39180e
importer: Beginnings of howitworks section.
7 years ago
b580ada89f
Tidy up and correct the new example
7 years ago
eb2aef866b
Add shell replacement example.
7 years ago
641498e7f6
docs: Fix function name.
7 years ago
f1f36cec35
Simplify the API, make Broker optional and auto-shutdown on main thread exit.
7 years ago
3831ac360f
Replace all calls to file() with open()
...
Although these are synonyms in Python 2.x, when using MyPy to typecheck
code use of file() causes spurious errors.
This commit also serves as one small step to Python 3.x compatibility,
since 3.x removes the file() builtin.
7 years ago
038ab04908
docs: convert paragraph to footnote.
7 years ago
e3d2c8d649
issue #49 : update howitworks.rst for command line change
7 years ago
58102c8179
docs: waiting on multiple calls
7 years ago
b1ad04330b
docs: move Router.route() into Sphinx.
7 years ago
cf0668b2b1
docs: Add warning to preloading section.
7 years ago
fb759f7c16
docs: move Broker docstrings into Sphinx.
7 years ago
ac7cada323
docs: more getting started guide
7 years ago
ffa063cc01
docs: annother barriage of cross-reference fixes.
7 years ago
9372d2c3de
docs: Fix up tons of references, document trust chain
7 years ago
051285437f
importer: module preloading docs
7 years ago
b3bd075d37
docs: getting started
7 years ago
792e789908
More.
7 years ago
c15d227da4
docs: way more appropriate image
7 years ago
b94e7b3678
docs: more getting started
7 years ago
709b38c36e
docs: Getting started tidyups
7 years ago
dcc45bc7de
docs: Get started on Getting Started
7 years ago
0299f86bc9
docs: fix reference to with:
7 years ago
c9daa2ff30
docs: move fakessh docs into Sphinx.
7 years ago
6a10ab605e
docs: move mitogen.utils docs to Sphinx.
7 years ago
270b242ec5
docs: fix decorator types.
7 years ago
ec66152e37
docs: better io_op doc, move Side docs to Sphinx.
7 years ago
0767abf26f
docs: move BasicStream docs into Sphinx.
7 years ago
b7a9aa46cf
core: More robust shutdown
...
Now there is a separate SHUTDOWN message that relies only on being
received by the broker thread, the main thread can be hung horribly and
the process will still eventually receive a SIGTERM.
7 years ago
79dd00db5a
master: hack to avoid executing __main__.
7 years ago
416ab90e02
docs: Fix index generation everywhere.
7 years ago
976c643f21
docs: remove note, unpickling can no longer trigger module loads
7 years ago
decc9a900c
docs: s/random/pseudorandom/
7 years ago
83f8f1863e
docs: fix pickler docs, begin relabelling master/slave->parent/child
7 years ago
4327baabfa
docs: remove final references to call_with_deadline().
7 years ago
dd69b8feeb
docs: with_context element is replaced by a decorator.
7 years ago
12fe884f1a
Reference Select
7 years ago
a81f804e92
Accidentally hecked in incomplete paragraph.
7 years ago
83e3e1b82a
Typo.
7 years ago
e9af841e60
docs: fix :return: syntax.
7 years ago
f1d82c7284
More API documentation.
7 years ago
9d2a11e70f
Fix function reference.
7 years ago
5772e06368
Typo.
7 years ago
b7f95e558f
Better document Router API and constructors.
7 years ago
3eb60d777a
Add mitogen.parent_ids to docs.
7 years ago
0c573d0e47
Tidy up select examples even more.
7 years ago
e624295d63
Document channel class
7 years ago
c4d9f124c6
Document Sender and Receiver classes.
7 years ago
33643222de
docs: Add spacing between list items in body text.
7 years ago
265d9f0293
Tidy up select docs.
7 years ago
112f76fe89
More concise text.
7 years ago
19869da087
issue #20 : Return type fix.
7 years ago
0565784164
Package rename cleanup.
7 years ago
f869e088f8
issue #20 : tests and fixes for mitogen.master.Select().
7 years ago
e3d967ebeb
issue #20 : initial implementation of mitogen.master.Select().
7 years ago
abfa85d7da
Remove set from permitted types.
7 years ago
9c4bf37cfc
Remove final vestiges of context.key.
7 years ago
0ff65c9780
docs: Use sphinx-programoutput plugin for preamble_size.py
7 years ago
2af1830323
Update preamble_size output.
7 years ago
04ea5306e9
Document a bunch of mitogen.master and move more docstrings into Sphinx.
7 years ago
092bbef0b3
Reorder table of contents.
7 years ago
caa1fde4fb
Add serialization rules section.
7 years ago
4720eb1c55
core: add ALLOCATE_ID message for fakessh.
7 years ago
6f2d514813
Import unused images.
7 years ago
b809d43865
Move more docstrings out of core.py.
7 years ago
4f50707b82
core: support takes_econtext and takes_router decorators.
7 years ago
025954af32
Typo.
7 years ago
6b9e46ecd6
Add subheading to describe each import hack.
7 years ago
36f0584087
Link to six bug.
7 years ago
6ff2a49f10
Pad out shame.rst.
7 years ago
fa427d83c8
Tidy.
7 years ago
38a9482860
Add hacks to allow Mock to be imported.
7 years ago
1f99dcb435
fix unbelievably dumb variable shadowing
7 years ago
25e4724bac
A few more mitogen.slave/master changes
7 years ago
708b742a9c
Mention git.
7 years ago
e7ff6259a3
Initial commit.
7 years ago
David Wilson