1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
|
.. Copyright (c) 2017-2026 Juancarlo Añez (apalala@gmail.com)
.. SPDX-License-Identifier: BSD-4-Clause
.. include:: links.rst
.. _mini-tutorial: mini-tutorial.rst
.. _pegen: https://github.com/we-like-parsers/pegen
.. _PEG parser: https://peps.python.org/pep-0617/
Translation
-----------
Translation is one of the most common tasks in language processing. |TatSu|
doesn't impose a way to create translators, but it dose expose the
functionality it uses to generate `Python`_ source code from grammars.
Print Translation
~~~~~~~~~~~~~~~~~
Translation in |TatSu| is based on subclasses of ``NodeWalker``. Print-based translation
relies on classes that inherit from ``IndentPrintMixin``, a strategy copied from
the new PEG_ parser in Python_ (see `PEP 617`_).
``IndentPrintMixin`` provides an ``indent()`` method, which is a context manager,
and should be used thus:
.. code:: python
class MyTranslationWalker(NodeWalker, IndentPrintMixin):
def walk_SomeNodeType(self, node: NodeType):
self.print('some preamble')
with self.indent():
# continue walking the tree
self.print('something else')
The ``self.print()`` method takes note of the current level of indentation, so
output will be indented by the `indent` passed to
the ``IndentPrintMixin`` constructor, or to the ``indent(amount: int)`` method.
The mixin keeps as stack of the indent amounts so it can go back to where it
was after each ``with indent(amount=n):`` statement:
.. code:: python
def walk_SomeNodeType(self, node: NodeType):
with self.indent(amount=2):
self.print(node.exp)
The printed code can be retrieved using the ``printed_text()`` method, but other
possibilities are available by assigning a stream-like object to
``self.output_stream`` in the ``__init__()`` method.
A good example of how to do code generation with a ``NodeWalker`` and
``IndentPrintMixin`` is |TatSu|'s own code generator, which can be found
in ``tatsu/ngcodegen/pythongen.py``, or the model generation found in
``tatsu/ngcodegen/objectomdel.py``.
.. _PEP 617: https://peps.python.org/pep-0617/
|
