1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
|
.. Licensed under the Apache License: http://www.apache.org/licenses/LICENSE-2.0
.. For details: https://github.com/nedbat/coveragepy/blob/master/NOTICE.txt
Gold files
==========
These are files used in comparisons for some of the tests. Code to support
these comparisons is in tests/goldtest.py.
If gold tests are failing, you may need to update the gold files by copying the
current output of the tests into the gold files. When a test fails, the actual
output is in the tests/actual directory. Those files are ignored by git.
There's a Makefile in the html directory for working with gold files and their
associated support files.
The gold files and the actual output files are not viewable as-is: they are
missing the support files (css etc) they need. You can copy those support
files with::
cd tests/gold/html
make complete
If the new actual output is correct, you can use ``make update-gold`` to copy
the actual output as the new gold files.
If you have changed some of the supporting files (.css or .js), then ``make
update-support`` will copy the updated files to the tests/gold/html/support
directory for checking test output.
If you have added a gold test, you'll need to manually copy the tests/actual
files to tests/gold.
Once you've copied the actual results to the gold files, or to check your work
again, you can run just the failed tests again with::
tox -e py39 -- -n 0 --lf
The saved HTML files in the html directories can't be viewed properly without
the supporting CSS and Javascript files. But we don't want to save copies of
those files in every subdirectory. The make target ``make complete`` in
tests/gold/html will copy the support files so you can open the HTML files to
see how they look. When you are done checking the output, you can use ``make
clean`` to remove the support files from the gold directories.
If the output files are correct, you can update the gold files with ``make
update-gold``. If there are version-specific gold files (for example,
bom/2/\*), you'll need to update them manually.
|
