File: index.rst

package info (click to toggle)
python-imageio 2.37.2-1
  • links: PTS, VCS
  • area: main
  • in suites: forky, sid
  • size: 2,144 kB
  • sloc: python: 26,306; makefile: 138
file content (514 lines) | stat: -rw-r--r-- 18,527 bytes parent folder | download | duplicates (2)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
============
Contributing
============


.. toctree::
    :hidden:
    :maxdepth: 2
  
    Writing v2 Plugins <plugins>


Becoming a contributor can take as little as 2 minutes (e.g., via a small doc
PR) and doesn't require vast coding experience. We are open for contributions in
many ways and, if you would like to get involved but aren't sure where to start,
create a new issue and we will help you get started. In particular, we are also
extremely happy for any help with
    
    - bugfixes,
    - improving our documentation, 
    - improving our DevOp pipeline,
    - improving the design of our website,
    - new backends/plugins,
    - and new features.
    
Check the relevant section below for a guide on how to get started in any of
these areas.


Small Changes to the Documentation
----------------------------------

.. note::
    A small documentation pull request includes changes that only affect a single
    file. Examples include fixing typos or broken links, rewriting a paragraph for
    clarity, or adding examples.

A small doc PR is very quick and doesn't require any local setup on your end.
All you need is a GitHub account. Here are the steps involved:

1. Navigate to the page you wish to improve.
2. Click on the "Edit this Page" button on the right side panel.
3. Make your changes to the file that opens.
4. At the bottom of the page under "Commit Changes" choose a descriptive commit
   message (e.g., "fixed typo in examples").
5. Click the button "Propose Changes".
6. That's it. The ImageIO team thanks you for your contribution!


Large Changes to the Documentation
----------------------------------

**Installation**

For large changes to the documentation, you will have to set up a local development
environment with the documentation dependencies installed::

    # 1. Fork the ImageIO repository
    # 2. If you want to use a virtual environment for your setup, create and activate it now.

    git clone https://github.com/<replace_by_your_username>/imageio.git
    cd imageio
    pip install -e .[doc]

    # create and checkout a new branch for your contribution
    # Note: replace <branch_name> with a descriptive, but short, name
    git checkout -b <branch_name>
    git push --set-upstream origin <branch_name>

    # building the docs locally on Linux or MacOS
    # Note: to rebuild the docs, execute this line again
    sphinx-build ./docs ./build

    # building the docs locally on Windows
    # Note: to rebuild the docs, execute this line again
    sphinx-build .\docs .\build

**Developing the PR**

Next, you will have to add your modifications to the docs; remember to commit
frequently. You are welcome to reach out during this process if you want
feedback or have any doubts. Further, you may wish to create a draft PR with
your changes, so that we can discuss more easily.

We use sphinx to generate the website and the API has narrative docs.
Documentation of the actual functions is autogenerated using numpydoc, and is
linked to from the narrative API docs. Further, the list of supported formats,
too, is autogenerated using a custom sphinx extension (``imageio_ext.py``);
essentially, it parses the respective format RST files using jinja and inserts
the formats from ``imageio.config.known_extensions``.

**Submitting the PR**

Once you are happy with your changes, push your changes to your local fork, head
over to the `main repo <https://github.com/imageio/imageio>`_ and create a new
PR. In the description, briefly summarize what the changes are about (there is
no fixed format). If we discussed them before in an issue, add a reference to
that issue, so that we can track it. From there, we will help you by reviewing
your changes, discussing any changes and eventually merging your work into
ImageIO.

Thank you for contributing!


Fixing a Bug
------------

.. note::
    We currently don't have a dedicated maintainer that uses MacOS as their
    primary development platform. If you would like to suggest yourself,
    please get in touch, e.g., via a new issue.

The first step to fixing a bug is to open a new issue that describes the bug
(ideally including a
[mwe](https://en.wikipedia.org/wiki/Minimal_working_example)) to discuss where
the fix should live. Alternatively, if an issue already exists, leave a comment
to let us know you want to work on it.

In general, a bugfix follows the usual open-source routine. Here is a rough
outline::
    
    # Fork the ImageIO repository

    git clone https://github.com/<replace_by_fork_location>/imageio.git
    cd imageio

    # Note: replace <plugin_name> with the plugin that has the bug to 
    #       install optional dependencies
    pip install -e .[dev,<plugin_name>]

    # Note: replace <branch_name> with a descriptive, but short, name
    git checkout -b <branch_name>
    git push --set-upstream origin <branch_name>

    pytest  # run the existing test suite to verify install

    # Add a unit test that reproduces the faulty behavior

    # Apply the changes to fix the bug. Remember to commit frequently.

    # check if your changes are covered by tests
    coverage run -m pytest
    coverage report -m

    # If changes are not fully covered, add test(s) to cover the
    # missing branches.

    # Submit a PR. In the description, reference the abovementioned
    # issue and give a brief description of the changes.

Thank you for contributing!


Adding a new Feature
--------------------

.. note::
    We currently don't have a dedicated maintainer that uses MacOS as their
    primary development platform. If you would like to suggest yourself,
    please get in touch, e.g., via a new issue.

The first step to contributing a new feature is to open a new issue on our issue
page so we can discuss how the feature should look like, if it can work with
the relevant backends, and fits within the scope of the library.

Once that is out of the way, the procedure usually follows the following steps::

    # Fork the ImageIO repository

    git clone https://github.com/<replace_by_fork_location>/imageio.git
    cd imageio

    # Note: replace <plugin_name> with the plugin that has the bug to 
    #       install optional dependencies
    pip install -e .[dev,<plugin_name>]

    # Note: replace <branch_name> with a descriptive, but short, name
    git checkout -b <branch_name>
    git push --set-upstream origin <branch_name>

    pytest  # run the existing test suite to verify install

    # Add the desired/discussed functionality

    # For each new function you've created add a descriptive docstring
    # compliant with numpydoc

    # Add an example to ``docs/examples.rst`` showing off the new
    # feature

    # Add unit tests to verify that the feature does what it is 
    # intended to do

    # check if your changes are covered by tests
    coverage run -m pytest
    coverage report -m

    # If changes are not fully covered, add test(s) to cover the
    # missing branches.

    # Submit a PR. In the description, reference the feature issue and 
    # give a brief description of the changes.

Thank you for contributing!


Webdesign
---------

.. warning::
    We currently don't have a dedicated maintainer for this area. If you would
    like to suggest yourself, please get in touch, e.g., via a new issue.

There is currently no established way of suggestion webdesign related changes.
If you have any suggestions regarding

- the structure/layout of the docs
- improvements of the template or its config
- styling of the website
- (other webdesign related items)

Please open a new issue and we will discuss with you.


DevOps
------

Before you go and improve our tooling, please start by first opening a new issue
and discussing your idea with us. We ask this, because we want to make sure that
there is at least one maintainer familiar with the technology you want to use.
If anything breaks in the CI/CD pipeline, it will have a direct impact on our
release cycle, and we would like to make sure that at least one maintainer is
able to step in and fix it in a timely fashion.

**Installation**

While you may be able to complete some devops related contributions in GitHub itself,
a local setup will perform better in most situations::

    # 1. Fork the ImageIO repository

    git clone https://github.com/<replace_by_your_username>/imageio.git
    cd imageio
    pip install -e .

    # create and checkout a new branch for your contribution
    # Note: replace <branch_name> with a descriptive, but short, name
    git checkout -b <branch_name>
    git push --set-upstream origin <branch_name>

**Developing the PR**

Do your changes, and remember to commit frequently. If you want to test your
changes against our CI/CD provider (GH Actions), you can submit a draft PR,
which we will review and run. Alternatively, you configure your local fork to
execute actions and develop against it. You can find our workflows in the
``.github`` folder.

*Continuous Integration (CI)*: The core of our CI is a matrix test across all
major OSes and supported python versions running a testsuite based on
``pytest``. Additionally, we track linting errors (black + flake8), coverage
(codecov), and have readthedocs build a preview of the documentation.

*Continuous Deployment (CD)*: Our continuous deployment pipeline checks weekly
(Monday night, EU time) for any changes to the repository. If there are any, it
uses python-semantic-release to figure out if the version should bump and a new
release should be made. If so, all tests are run against the master branch, the
version is bumped, and a new release is made and published to GitHub and PyPI.
Further, we have a feedstock on conda-forge which manages releases to conda.

**Submitting the PR**

Once you are happy with your changes, push your changes to your local fork, head
over to the `main repo <https://github.com/imageio/imageio>`_ and create a new
PR. In the description, briefly summarize what the changes are about (there is
no fixed format) and add a reference to the issue in which we discussed them.
From there, we will help you by reviewing your changes, discussing them and
eventually merging your work into ImageIO.

Thank you for contributing!


Implementing a new Plugin
-------------------------

Plugins allow integration of a new backends into ImageIO. They can
exist independently of ImageIO; however, we encourage you to contribute any
plugins back upstream. This way others, too, can benefit from using the new
backend and you will get compatibility guarantees by virtue of the backend
becoming part of our test suite.

.. note::

    These instructions assume that you indeed wish to contribute the plugin.

If you don't, then you won't need a dev installation of ImageIO and can
write the plugin directly. In this case, you will have to pass the plugin
class to API calls using the plugin kwarg. For example::

    import imageio as iio
    from my_plugin import PluginClass

    iio.imread(ImageResource, plugin=PluginClass)

**Installation**

To develop a new plugin, you can start off with a simple dev install::
    
    # 1. Fork the ImageIO repository

    git clone https://github.com/<replace_by_your_username>/imageio.git
    cd imageio
    pip install -e .[dev]

    # create and checkout a new branch for your contribution
    # Note: replace <branch_name> with a descriptive, but short, name
    git checkout -b <branch_name>
    git push --set-upstream origin <branch_name>

    # verify installation
    pytest

**Develop the Plugin**

To write a new plugin, you have to create a new class that follows our plugin
API, which is documented below:

**v2 plugin docs**

.. autosummary::

    imageio.plugins

**v3 plugin docs**

.. autosummary::
    :template: better_class.rst
    :toctree: ../_autosummary

    imageio.core.v3_plugin_api.PluginV3
    imageio.core.v3_plugin_api.ImageProperties

The file itself should be placed into our plugins folder at
``imageio\plugins\your_plugin.py``.

**Declare Dependencies**

Plugins typically have at least one external dependency: the backend they use to
do the decoding/encoding. This dependency (and any others a plugin may have)
have to be declared in our ``setup.py``.

All plugins start out as optional dependencies (but may be promoted if they turn
out stable and useful ;) ). As such, to declare dependencies of a plugin add an
item to the extra_requires dict. The key name typically matches the name of the
backend, and the value is a list of dependencies::

    extras_require = {
        # ...
        "my_backend": ["my_backend", ...],
    }

That said, a plugin can assume that its dependencies are installed, i.e., it
doesn't have to explicitly assert that imports resolve. We catch any ImportError
internally and use it to inform the user that they have to install missing
dependencies via::

    pip install imageio[my_backend]

**Register the Plugin**

Registering the plugin with ImageIO enables various kinds of auto-magic. Currently
this involves two steps:

1. Register the plugin as a known_plugin
2. Associate supported extensions with the plugin

First, add the plugin to the list of known plugins. This allows ImageIO to try
the plugin in case no better suited one can be found and also enables all other
optimizations. For this, add a new item to the dict in
``imageio.config.plugins.py``. The key is the name under which the plugin will
be known (usually the name of the backend) and the value is an instance of
``PluginConfig``, for example::

    known_plugins["my_plugin"] = PluginConfig(
        name="my_plugin",  # (same as key)
        class_name="MyPluginClass",  # the name of the class
        module_name="imageio.plugins.my_plugin" # where the class is implemented
        is_legacy: bool = True,  # True if plugin follows V2 API
        install_name: str = "my_backend",  # name of the optional dependency
    )

For more details on the PluginConfig class, check the classes docstring.

Second, if the plugin adds support for any new formats that were not previously
supported by ImageIO, declare those formats in ``imageio.config.extensions.py``.
For this, add items to the ``extension_list``; items are instances of the
``FileExtension`` class::

    FileExtension(
        name="Full Name of Format",
        extension=".file_extension", # e.g. ".png"
        priority=["my_plugin"], # a list of plugins that supports reading this format
    ),

Plugins listed in ``priority`` are assumed to be able to read the declared
format. Further, ImageIO will prefer plugins that appear earlier over plugins
that appear later in the list, i.e., they are tried first.

Finally, for each format that is already supported by other plugins, add the new plugin
at the end of the ``priority`` list. (This avoids breaking existing downstream code.)


**Document the Plugin**

.. code-block::

    # build the docs
    sphinx-build ./docs ./build  # MacOS / Linux
    sphinx-build .\docs .\build  # Windows

Beyond the plugin itself, you will have to write documentation for it that tells
others what features are available and how to use it. In ImageIO classes are
documented using numpydoc, so they should follow numpy's documentation style.
Most importantly, you will have to add a module docstring to the plugin file
(check the other plugins for examples), which will be used as the entrypoint for
your plugin's documentation. 

Once you have written something, hook the documentation into our docs. For this
add it's import path (imageio.plugins.your_module_name) in
``docs\reference\index.rst``. It should be inside the autosummary block that
lists all plugins.


**Test the Plugin**

.. code-block::

    # run tests
    pytest  # run all
    pytest path/to/test/file.py  # run specific module
    pytest path/to/test/file.py::test_name_of_test  # run specific test

    # check coverage
    coverage run -m pytest  # update the coverage logs
    coverage report -m  # report coverage in shell

To test your plugin, create a new test file at ``tests\test_myplugin.py``. In
the file, define functions that have their name begin with ``test_`` (example:
``def test_png_reading():``) and fill them with code that uses your plugin.

Our main requirement for tests of new plugins is that they cover the full
plugin. Ideally, they also test reading and writing of all supported formats,
but this is not strictly necessary. Check the commands above for how to run
tests and check test coverage of your plugin.


**Submitting the PR**

Once you are happy with the plugin, push your changes to your local fork, head
over to the `main repo <https://github.com/imageio/imageio>`_ and create a new
PR. In the description, briefly summarize what the plugin does (there is no
fixed format) and, if it exists, add a reference to the issue in which the
plugin is discussed. From there, we will help you by reviewing your changes,
discussing them and eventually merging your plugin into ImageIO.

Thank you for contributing!


Adding a missing Format
-----------------------

Adding a new format (or updating an existing one) can be done directly in
GitHub. Navigate to [this
page](https://github.com/imageio/imageio/blob/master/imageio/config/extensions.py)
and click on the "edit this file" button (looks like a pen). From here,
either edit the existing format, e.g., by adding a new backend that supports it in ``priority``,
or by add a new format. For this add this snippet to the bottom of the ``extension_list``::

    FileExtension(
        name="<Full Name of File Format>", # e.g., Hasselblad raw
        extension="<extension>", # e.g., .3fr
        priority=<list of supporting backend names>, # e.g., ["RAW-FI"]
    )

Thank you for contributing!

Full Developer Setup
--------------------

.. note::
    This section is intended for library maintainers and people that plan to make
    multiple contributions of various kinds. 

If you plan to make a series of contributions, we recommend a development
installation with all plugins::

    # 1. Fork the ImageIO repository
    # 2. Optional: Create and activate your virtual environment of choice

    # install
    git clone https://github.com/<replace_by_fork_location>/imageio.git
    cd imageio
    pip install -e .[full]

    # download test images and run all tests
    pytest

    # build the docs
    sphinx-build ./docs ./build  # MacOS / Linux
    sphinx-build .\docs .\build  # Windows

    # check coverage
    coverage run -m pytest  # update the coverage logs
    coverage report -m  # report coverage in shell