1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
|
============
untokenize
============
*untokenize* transforms tokens into source code. Unlike the standard library's
``tokenize.untokenize()``, it preserves the original whitespace between tokens.
.. image:: https://travis-ci.org/myint/untokenize.png?branch=master
:target: https://travis-ci.org/myint/untokenize
:alt: Build status
Usage
=====
.. code-block:: python
import untokenize
source_code = untokenize.untokenize(tokens)
Tests
=====
To run the unit tests::
$ ./test_untokenize.py
There is also an acid test. It tokenizes Python code and confirms that the code
generated by untokenize exactly matches the original source code from before
tokenization::
$ ./test_acid.py
|
