1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
|
= HIGHLIGHT TESTCASES MANUAL
André Simon
v4.0, March 2021
:lang: en
:icons: font
:toc: left
:toc-title: Contents
:toclevels: 4
:sectnums:
:sectnumlevels: 1
:sectanchors:
// GitHub Settings to enable Admonitions Icons in preview:
ifdef::env-github[]
:caution-caption: :fire:
:important-caption: :heavy_exclamation_mark:
:note-caption: :information_source:
:tip-caption: :bulb:
:warning-caption: :warning:
endif::[]
== ABOUT
Input files whose filenames start with `syntax_test_` can contain column and state
indicators in comment sections to test the highlight syntax recognition of the
previous line. If such a test fails, highlight will print an error message and
exit with FAILURE return value.
See the feature discussion here: https://gitlab.com/saalen/highlight/issues/80
[NOTE]
================================================================================
For UTF-8 encoded input, you need to set `--encoding=utf-8`. Otherwise the
state indicator positions will not be calculated correctly.
================================================================================
[NOTE]
================================================================================
Only the last 100 states of each input line are being tracked.
================================================================================
== TEST CASE NOTATION
A test case is defined by two entities: column and expected state.
The column is defined by ``^`` ("here") or ``<`` ("comment start / first column").
The state is defined by one of the following identifiers:
[horizontal]
`def` :: standard / no recognition // SEE V4 migration note below
`sng` :: string // SEE V4 migration note below
`num` :: number
`slc` :: single line comment
`com` :: multiline comment
`esc` :: escape character
`ppc` :: preprocessor
`pps` :: preprocessor string
`opt` :: operator
`ipl` :: interpolation
`ws` :: whitespace
`kwX` :: keyword group X (X: a..z)
`stX` :: semantic token X (X: a..z)
The state identifiers match the corresponding HTML output CSS class names.
Since release 3.47, the whitespace indicator `ws` is no longer exclusive.
A test will succeed at a position with whitespace if the enclosing state is matched
or if `ws` is tested specifically.
V4 migration: For a smooth transition after the V4 release, `std` will be recognized
as `def`, and `str` is equivalent to `sng`.
Add a leading `~` to an indicator to match any other state as success.
=== Example
The following C file `syntax_test_1.c` contains various state indicators:
[source,C]
--------------------------------------------------------------------------------
#include <iostream>
#include "myheader"
// ^ ppc ^^^^^^^^^^ pps 1)
int main() {
// ^^^^ kwd 2)
/* comment comment comment
* < com ^ ws ^ com 3)
*/
int var = 0x1234;
/* ^^^ def ^ ^ num */
// ^ opt 4)
std::cout << "whatever: " << var << "\n";
// ^^^^^^^^^^^^ str ^^opt ^^ esc
return 0;
// < kwa 5)
}
--------------------------------------------------------------------------------
1) This line contains a test for preprocessor and a preprocessor string.
The `^` indicators point at the tested string sections of the previous line.
2) The keyword group `kwd` is checked (functions are highlighted as `kwd` in C syntax)
3) The `<` points to column 0 as the comment starts there.
`ws` tests for whitespace.
4) A source code line can be tested with various test comments.
Here the `opt` test looks for the operator two lines before.
5) `<` points at column 4, the beginning of the comment.
Running highlight with this file will not produce any additional output, as all
tests pass. The exit status will be 0.
If you change the `kwa` in 5 to `kwb` (or any other state), highlight will print
an error like this, and exit with status 1:
.........................................................
highlight: Could not validate file:
syntax_test_1.c line 17, column 4: got kwa instead of kwb
.........................................................
The highlight GUI will show error messages in an error summary prompt.
|
