1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118
|
.. _id.appendix.formatters:
==============================================================================
Formatters and Reporters
==============================================================================
:pypi:`behave` provides 2 different concepts for reporting results of a test run:
* formatters
* reporters
A slightly different interface is provided for each "formatter" concept.
The ``Formatter`` is informed about each step that is taken.
The ``Reporter`` has a more coarse-grained API.
Reporters
------------------------------------------------------------------------------
The following reporters are currently supported:
============== ================================================================
Name Description
============== ================================================================
junit Provides JUnit XML-like output.
summary Provides a summary of the test run.
============== ================================================================
Formatters
------------------------------------------------------------------------------
The following formatters are currently supported:
============== ======== ================================================================
Name Mode Description
============== ======== ================================================================
help normal Shows all registered formatters.
json normal JSON dump of test run
json.pretty normal JSON dump of test run (human readable)
plain normal Very basic formatter with maximum compatibility
pretty normal Standard colourised pretty formatter
progress normal Shows dotted progress for each executed scenario.
progress2 normal Shows dotted progress for each executed step.
progress3 normal Shows detailed progress for each step of a scenario.
rerun normal Emits scenario file locations of failing scenarios
sphinx.steps dry-run Generate sphinx-based documentation for step definitions.
steps dry-run Shows step definitions (step implementations).
steps.doc dry-run Shows documentation for step definitions.
steps.usage dry-run Shows how step definitions are used by steps (in feature files).
tags dry-run Shows tags (and how often they are used).
tags.location dry-run Shows tags and the location where they are used.
============== ======== ================================================================
.. note::
You can use more than one formatter during a test run.
But in general you have only one formatter that writes to ``stdout``.
The "Mode" column indicates if a formatter is intended to be used in
dry-run (``--dry-run`` command-line option) or normal mode.
User-Defined Formatters
------------------------------------------------------------------------------
Behave allows you to provide your own formatter (class)::
# -- USE: Formatter class "Json2Formatter" in python module "foo.bar"
# NOTE: Formatter must be importable from python search path.
behave -f foo.bar:Json2Formatter ...
The usage of a user-defined formatter can be simplified by providing an
alias name for it in the configuration file:
.. code-block:: ini
# -- FILE: behave.ini
# ALIAS SUPPORTS: behave -f json2 ...
# NOTE: Formatter aliases may override builtin formatters.
[behave.formatters]
json2 = foo.bar:Json2Formatter
If your formatter can be configured, you should use the userdata concept
to provide them. The formatter should use the attribute schema:
.. code-block:: ini
# -- FILE: behave.ini
# SCHEMA: behave.formatter.<FORMATTER_NAME>.<ATTRIBUTE_NAME>
[behave.userdata]
behave.formatter.json2.use_pretty = true
# -- SUPPORTS ALSO:
# behave -f json2 -D behave.formatter.json2.use_pretty ...
More Formatters
------------------------------------------------------------------------------
The following formatters are currently known:
============== =========================================================================
Name Description
============== =========================================================================
allure :pypi:`allure-behave`, an Allure formatter for behave:
``allure_behave.formatter:AllureFormatter``
teamcity :pypi:`behave-teamcity`, a formatter for Jetbrains TeamCity CI testruns
with behave.
============== =========================================================================
.. code-block:: ini
# -- FILE: behave.ini
# FORMATTER ALIASES: behave -f allure ...
[behave.formatters]
allure = allure_behave.formatter:AllureFormatter
teamcity = behave_teamcity:TeamcityFormatter
|