File: basics.rst

package info (click to toggle)
nanobind 2.11.0-3
  • links: PTS, VCS
  • area: main
  • in suites: forky, sid
  • size: 3,300 kB
  • sloc: cpp: 12,232; python: 6,315; ansic: 4,813; makefile: 22; sh: 15
file content (481 lines) | stat: -rw-r--r-- 14,897 bytes parent folder | download | duplicates (3)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
.. _basics:

.. cpp:namespace:: nanobind

Creating your first extension
#############################

This section assumes that you have followed the instructions to :ref:`install
<installing>` nanobind and set up a basic :ref:`build system <building>`.

We are now ready to define a first basic extension that wraps a function
to add two numbers. Create a new file ``my_ext.cpp`` with the following
contents (the meaning of this code will be explained shortly):

.. code-block:: cpp

   #include <nanobind/nanobind.h>

   int add(int a, int b) { return a + b; }

   NB_MODULE(my_ext, m) {
       m.def("add", &add);
   }

Afterwards, you should be able to compile and run the extension.

Building using CMake
--------------------

Launch ``cmake`` in the project directory to set up a build system that will
write all output into a separate ``build`` subdirectory.

.. code-block:: bash

   cmake -S . -B build

.. note::

   If this step fails with an error message saying that Python cannot be
   found, you will need to install a suitable Python 3 development package.

   For example, on Ubuntu you would run:

   .. code-block:: bash

       apt install libpython3-dev

   On Windows, you we recommend downloading and running one of the `installers
   <https://www.python.org/downloads>`_ provided by the Python foundation.

.. note::

   If you have multiple versions of Python on your system, the CMake build
   system may not find the specific version you had in mind. This is
   problematic: extension built for one version of Python usually won't run on
   another version. You can provide a hint to the build system to help it find
   a specific version.

   In this case, delete the ``build`` folder (if you already created one) and
   re-run `cmake` while specifying the command line parameter ``-DPython_EXECUTABLE=<path to python executable>``.

   .. code-block:: bash

      rm -Rf build
      cmake -S . -B build -DPython_EXECUTABLE=<path to python executable>

Assuming the ``cmake`` ran without issues, you can now compile the extension using
the following command:

.. code-block:: bash

   cmake --build build

Finally, navigate into the ``build`` directory and launch an interactive Python
session:

.. code-block:: bash

   cd build
   python3

(The default build output directory is different on Windows: use ``cd build\Debug`` and ``python`` instead of the above.)

You should be able to import the extension and call the newly defined function ``my_ext.add()``.

.. code-block:: pycon

   Python 3.11.1 (main, Dec 23 2022, 09:28:24) [Clang 14.0.0 (clang-1400.0.29.202)] on darwin
   Type "help", "copyright", "credits" or "license" for more information.
   >>> import my_ext
   >>> my_ext.add(1, 2)
   3


Binding functions
-----------------

Let's step through the example binding code to understand what each line does.
The directive on the first line includes the core parts of nanobind:

.. code-block:: cpp

    #include <nanobind/nanobind.h>

nanobind also provides many optional add-on components that are aren't
included by default. They are discussed throughout this documentation along
with pointers to the header files that must be included when using them.

Next is the function to be exposed in Python, followed by the
mysterious-looking :c:macro:`NB_MODULE` macro.

.. code-block:: cpp

   int add(int a, int b) { return a + b; }

   NB_MODULE(my_ext, m) {
       m.def("add", &add);
   }

:c:macro:`NB_MODULE(my_ext, m) <NB_MODULE>` declares the extension with the
name ``my_ext``. This name **must** match the extension name provided to the
``nanobind_add_module()`` function in the CMake build system---otherwise,
importing the extension will fail with an obscure error about a missing
symbol. The second argument (``m``) names a variable of
type :cpp:class:`nanobind::module_` that represents the created module.

The part within curly braces (``{``, ``}``) consists of a sequence of
statements that initialize the desired function and class bindings. It is best
thought of as the ``main()`` function that will run when a user imports the
extension into a running Python session.

In this case, there is only one binding declaration that wraps the ``add``
referenced using the ampersand (``&``) operator. nanobind determines the
function's type signature and generates the necessary binding code. All of
this happens automatically at compile time.

.. note::

    Notice how little code was needed to expose our function to Python: all
    details regarding the function’s parameters and return value were
    automatically inferred using template metaprogramming. This overall
    approach and the used syntax go back to `Boost.Python
    <https://github.com/boostorg/python>`_, though the implementation in
    nanobind is very different.

.. _keyword_and_default_args:

Keyword and default arguments
-----------------------------

There are limits to what nanobind can determine at compile time. For example,
the argument names were lost and calling ``add()`` in Python using keyword
arguments fails:

.. code-block:: pycon

   >>> my_ext.add(a=1, b=2)
   TypeError: add(): incompatible function arguments. The following argument types are supported:
       1. add(arg0: int, arg1: int, /) -> int

   Invoked with types: kwargs = { a: int, b: int }

Let's improve the bindings to fix this. We will also add a docstring and a
default ``b`` argument so that ``add()`` increments when only one value is
provided. The modified binding code looks as follows:

.. code-block:: cpp

   #include <nanobind/nanobind.h>

   namespace nb = nanobind;
   using namespace nb::literals;

   int add(int a, int b = 1) { return a + b; }

   NB_MODULE(my_ext, m) {
       m.def("add", &add, "a"_a, "b"_a = 1,
             "This function adds two numbers and increments if only one is provided.");
   }

Let's go through all of the changed lines. The first sets up a short
namespace alias named ``nb``:

.. code-block:: cpp

   namespace nb = nanobind;

This is convenient because binding code usually ends up referencing many
classes and functions from this namespace. The subsequent ``using``
declaration is optional and enables a convenient syntax for annotating
function arguments:

.. code-block:: cpp

   using namespace nb::literals;

Without it, you would have to change every occurrence of the pattern ``"..."_a``
to the more verbose ``nb::arg("...")``.

The function binding declaration includes several changes. It is common to pile
on a few attributes and modifiers in :cpp:func:`.def(...) <module_::def()>`
binding declarations, which can be specified in any order.

.. code-block:: cpp

   m.def("add", &add, "a"_a, "b"_a = 1,
         "This function adds two numbers and increments if only one is provided.");

The string at the end is a `docstring <https://peps.python.org/pep-0257/>`_
that will later show up in generated documentation. The argument annotations
(``"a"_a, "b"_a``) associate parameters with names for keyword-based
argument passing.

Besides argument names, nanobind also cannot infer *default arguments*---you
*must repeat them* in the binding declaration. In the above snippet, the
``"b"_a = 1`` annotation informs nanobind about the value of the default
argument.

Exporting values
----------------

To export a value, use the :cpp:func:`attr() <nanobind::detail::api::attr>`
function to register it in the module as shown below. Bound classes and
built-in types are automatically converted when they are assigned in this
way.

.. code-block:: cpp

    m.attr("the_answer") = 42;

.. _docstrings:

Docstrings
----------

Let's add one more bit of flourish by assigning a docstring to the extension
module itself. Include the following line anywhere in the body of the
``NB_MODULE() {...}`` declaration:

.. code-block:: cpp

    m.doc() = "A simple example python extension";

After recompiling the extension, you should be able to view the associated
documentation using the ``help()`` builtin or the ``?`` operator in
IPython.

.. code-block:: pycon

   >>> import my_ext
   >>> help(my_ext)

   Help on module my_ext:

   NAME
       my_ext - A simple example python extension

   DATA
       add = <nanobind.nb_func object>
           add(a: int, b: int = 1) -> int

           This function adds two numbers and increments if only one is provided

       the_answer = 42

   FILE
       /Users/wjakob/my_ext/my_ext.cpython-311-darwin.so

The automatically generated documentation covers functions, classes,
parameter and return value type information, argument names, and default
arguments.


.. _binding_types:

Binding a custom type
---------------------

Let's now turn to an object oriented example. We will create bindings for a
simple C++ type named ``Dog`` defined as follows:

.. code-block:: cpp

   #include <string>

   struct Dog {
       std::string name;

       std::string bark() const {
           return name + ": woof!";
       }
   };

The ``Dog`` bindings look as follows:

.. code-block:: cpp

   #include <nanobind/nanobind.h>
   #include <nanobind/stl/string.h>

   namespace nb = nanobind;

   NB_MODULE(my_ext, m) {
       nb::class_<Dog>(m, "Dog")
           .def(nb::init<>())
           .def(nb::init<const std::string &>())
           .def("bark", &Dog::bark)
           .def_rw("name", &Dog::name);
   }

Let's look at selected lines of this example, starting with the added include directive:

.. code-block:: cpp

   #include <nanobind/stl/string.h>

nanobind has a minimal core and initially doesn't know how to deal with STL
types like ``std::string``. This line imports a *type caster* that realizes a
bidirectional conversion (C++ ``std::string`` ↔ Python ``str``) to make the
example usable. An upcoming :ref:`documentation section <type_casters>` will
provide more detail on type casters and other alternatives.

The class binding declaration :class:`nb::class_\<T\>() <class_>` supports both
``class`` and ``struct``-style data structures.

.. code-block:: cpp

   nb::class_<Dog>(m, "Dog")

Here, it associates the C++ type ``Dog`` with a new Python type named ``"Dog"``
and installs it in the :cpp:class:`nb::module_ <module_>` ``m``.

Initially, this type is completely empty---it has no members and cannot be
instantiated. The subsequent chain of binding declarations binds two
constructor overloads (via :cpp:class:`nb::init\<...\>() <init>`), a method,
and the mutable ``name`` field (via :cpp:func:`.def_rw(..)
<class_::def_rw>`, where ``rw`` stands for read/write access).

.. code-block:: cpp

   .def(nb::init<>())
   .def(nb::init<const std::string &>())
   .def("bark", &Dog::bark)
   .def_rw("name", &Dog::name);

An interactive Python session demonstrating this example is shown below:

.. code-block:: pycon

   Python 3.11.1 (main, Dec 23 2022, 09:28:24) [Clang 14.0.0 (clang-1400.0.29.202)] on darwin
   Type "help", "copyright", "credits" or "license" for more information.
   >>> import my_ext
   >>> d = my_ext.Dog('Max')
   >>> print(d)
   <my_ext.Dog object at 0x1044540f0>
   >>> d.name
   'Max'
   >>> d.name = 'Charlie'
   >>> d.bark()
   'Charlie: woof!'

The example showed how to bind constructors, methods, and mutable fields. Many
other things can be bound using analogous :cpp:class:`nb::class_\<...\>
<class_>` methods:

.. list-table::
  :widths: 40 60
  :header-rows: 1

  * - Type
    - Method
  * - Methods & constructors
    - :cpp:func:`.def() <class_::def>`
  * - Fields
    - :cpp:func:`.def_ro() <class_::def_ro>`,
      :cpp:func:`.def_rw() <class_::def_rw>`
  * - Properties
    - :cpp:func:`.def_prop_ro() <class_::def_prop_ro>`,
      :cpp:func:`.def_prop_rw() <class_::def_prop_rw>`
  * - Static methods
    - :cpp:func:`.def_static() <class_::def_static>`
  * - Static fields
    - :cpp:func:`.def_ro_static() <class_::def_ro_static>`,
      :cpp:func:`.def_rw_static() <class_::def_rw_static>`
  * - Static properties
    - :cpp:func:`.def_prop_ro_static() <class_::def_prop_ro_static>`,
      :cpp:func:`.def_prop_rw_static() <class_::def_prop_rw_static>`

.. note::

    All of these binding declarations support :ref:`docstrings <docstrings>`,
    :ref:`keyword, and default argument <keyword_and_default_args>` annotations
    as before.

.. _binding_lambdas:

Binding lambda functions
------------------------

Note how ``print(d)`` produced a rather useless summary in the example above:

.. code-block:: pycon

    >>> print(d)
    <my_ext.Dog object at 0x1044540f0>

To address this, we can add a special Python method named ``__repr__`` that
returns a human-readable summary. Unfortunately, a corresponding function with
such functionality does not currently exist in the C++ type, and it would be
nice if we did not have to modify it. We can bind a *lambda function* to
achieve both goals:

.. code-block:: cpp

   nb::class_<Dog>(m, "Dog")
       // ... skipped ...
       .def("__repr__",
            [](const Dog &p) { return "<my_ext.Dog named '" + p.name + "'>"; });

nanobind supports both stateless [#f1]_ and stateful lambda closures.

Higher order functions
----------------------

nanobind's support for higher-order functions [#f2]_ further blurs the language
boundary. The snippet below extends the ``Dog`` class with higher-order
function ``bark_later()`` that calls :cpp:func:`nb::cpp_function()
<cpp_function>` to convert and return a *stateful* C++ lambda function
(``callback``) as a Python function object.

.. code-block:: cpp

   nb::class_<Dog>(m, "Dog")
       // ... skipped ...
       .def("bark_later", [](const Dog &p) {
           auto callback = [name = p.name] {
               nb::print(nb::str("{}: woof!").format(name));
           };
           return nb::cpp_function(callback);
       });

The lambda function captures the ``Dog::name()`` property (a C++
``std::string``) and in turn calls Python functions (:cpp:func:`nb::print()
<print>`, :cpp:func:`nb::str::format() <str::format>`) to print onto the
console. Here is an example use of the binding in Python:

.. code-block:: pycon

   >>> f = d.bark_later()
   >>> f
   <nanobind.nb_func object at 0x10537c140>
   >>> f()
   Charlie: woof!

Wrap-up
-------

This concludes the basic part of the documentation, which provided a first
taste of nanobind and typical steps needed to create a custom extension.

The upcoming intermediate-level material covers performance and
safety-critical points:

- C++ and Python can exchange information in various different ways. 

  *Which one is best for a particular task?*

- A bound object can simultaneously exist in both C++ and Python.

  *Who owns it?*
  *When is it safe to delete it?*

Following these topics, the documentation revisits function and class
bindings in full detail.

.. [#f1] Stateless closures are those with an empty pair of brackets ``[]`` as
   the capture object.

.. [#f2] Higher-order functions are functions that take functions as arguments
   and/or return them.