Welcome to Noodles’s documentation!¶
Often, a computer program can be sped up by executing parts of its code in parallel (simultaneously), as opposed to synchronously (one part after another).
A simple example may be where you assign two variables, as follows
a = 2 * i
b = 3 * i. Either statement is only dependent on
i, but whether you
b or vice versa, does not matter for how your program
works. Whenever this is the case, there is potential to speed up a program,
because the assignment of
b could be done in parallel, using
multiple cores on your computer’s CPU. Obviously, for simple assignments like
a = 2 * i, there is not much time to be gained, but what if
a is the
result of a time-consuming function, e.g.
a = very_difficult_function(i)?
And what if your program makes many calls to that function, e.g.
[very_difficult_function(i) for i in list_of_i]? The potential speed-up could
So, parallel execution of computer programs is great for improving performance, but how do you tell the computer which parts should be executed in parallel, and which parts should be executed synchronously? How do you identify the order in which to execute each part, since the optimal order may be different from the order in which the parts appear in your program. These questions quickly become nearly impossible to answer as your program grows and changes during development. Because of this, many developers accept the slow execution of their program only because it saves them from the headaches associated with keeping track of which parts of their program depend on which other parts.
Noodles is a Python package that can automatically construct a callgraph for a given Python program, listing exactly which parts depend on which parts. Moreover, Noodles can subsequently use the callgraph to execute code in parallel on your local machine using multiple cores. If you so choose, you can even configure Noodles such that it will execute the code remotely, for example on a big compute node in a cluster computer.
Copyright & Licence¶
Noodles 0.3.0 is copyright by the Netherlands eScience Center (NLeSC) and released under the Apache v2 License.
See http://www.esciencecenter.nl for more information on the NLeSC.
We don’t support Python versions lower than 3.5.
The core of Noodles runs on Python 3.5 and above. To run Noodles on your own machine, no extra dependencies are required. It is advised to install Noodles in a virtualenv. If you want support for Xenon, install pyxenon too.
# create the virtualenv virtualenv -p python3 <venv-dir> . <venv-dir>/bin/activate # install noodles pip install noodles
Noodles has several optional dependencies. To be able to use the Xenon job scheduler, install Noodles with:
pip install noodles[xenon]
The provenance/caching feature needs TinyDB installed:
pip install noodles[prov]
To be able to run the unit tests:
pip install noodles[test]
- Eating noodles (user docs)
- Cooking of Noodles (library docs)