1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
|
llvm-remark-size-diff - diff size remarks
=========================================
.. program:: llvm-remark-size-diff
SYNOPSIS
--------
:program:`llvm-remark-size-diff` [*options*] *file_a* *file_b* **--parser** *parser*
DESCRIPTION
-----------
:program:`llvm-remark-size-diff` diffs size
`remarks <https://llvm.org/docs/Remarks.html>`_ in two remark files: ``file_a``
and ``file_b``.
:program:`llvm-remark-size-diff` can be used to gain insight into which
functions were impacted the most by code generation changes.
In most common use-cases ``file_a`` and ``file_b`` will be remarks output by
compiling a **fixed source** with **differing compilers** or
**differing optimization settings**.
:program:`llvm-remark-size-diff` handles both
`YAML <https://llvm.org/docs/Remarks.html#yaml-remarks>`_ and
`bitstream <https://llvm.org/docs/Remarks.html#llvm-bitstream-remarks>`_
remarks.
OPTIONS
-------
.. option:: --parser=<yaml|bitstream>
Select the type of input remark parser. Required.
* ``yaml``: The tool will parse YAML remarks.
* ``bitstream``: The tool will parse bitstream remarks.
.. option:: --report-style=<human|json>
Output style.
* ``human``: Human-readable textual report. Default option.
* ``json``: JSON report.
.. option:: --pretty
Pretty-print JSON output. Optional.
If output is not set to JSON, this does nothing.
.. option:: -o=<file>
Output file for the report. Outputs to stdout by default.
HUMAN-READABLE OUTPUT
---------------------
The human-readable format for :program:`llvm-remark-size-diff` is composed of
two sections:
* Per-function changes.
* A high-level summary of all changes.
Changed Function Section
########################
Suppose you are comparing two remark files OLD and NEW.
For each function with a **changed instruction count** in OLD and NEW,
:program:`llvm-remark-size-diff` will emit a line like below:
::
(++|--|==) (>|<) function_name, N instrs, M stack B
A breakdown of the format is below:
``(++|--|==)``
Which of OLD and NEW the ``function_name`` is present in.
* ``++``: Only in NEW. ("Added")
* ``--``: Only in OLD. ("Removed")
* ``==``: In both.
``(>|<)``
Denotes if ``function_name`` has more instructions or fewer instructions in
the second file.
* ``>``: More instructions in second file than first file.
* ``<``: Fewer instructions in second file than in first file.
``function_name``
The name of the changed function.
``N instrs``
Second file instruction count - first file instruction count.
``M stack B``
Second file stack byte count - first file stack byte count.
Summary Section
###############
:program:`llvm-remark-size-diff` will output a high-level summary after
printing all changed functions.
::
instruction count: N (inst_pct_change%)
stack byte usage: M (sb_pct_change%)
``N``
Sum of all instruction count changes between the second and first file.
``inst_pct_change%``
Percent increase or decrease in instruction count between the second and first
file.
``M``
Sum of all stack byte count changes between the second and first file.
``sb_pct_change%``
Percent increase or decrease in stack byte usage between the second and first
file.
JSON OUTPUT
-----------
High-Level view
###############
Suppose we are comparing two files, OLD and NEW.
:program:`llvm-remark-size-diff` will output JSON as follows.
::
"Files": [
"A": "path/to/OLD",
"B": "path/to/NEW"
]
"InBoth": [
...
],
"OnlyInA": [
...
],
"OnlyInB": [
...
]
``Files``
Original paths to remark files.
* ``A``: Path to the first file.
* ``B``: Path to the second file.
``InBoth``
Functions present in both files.
``OnlyInA``
Functions only present in the first file.
``OnlyInB``
Functions only present in the second file.
Function JSON
#############
The ``InBoth``, ``OnlyInA``, and ``OnlyInB`` sections contain size information
for each function in the input remark files.
::
{
"FunctionName" : "function_name"
"InstCount": [
INST_COUNT_A,
INST_COUNT_B
],
"StackSize": [
STACK_BYTES_A,
STACK_BYTES_B
],
}
``FunctionName``
Name of the function.
``InstCount``
Instruction counts for the function.
* ``INST_COUNT_A``: Instruction count in OLD.
* ``INST_COUNT_B``: Instruction count in NEW.
``StackSize``
Stack byte counts for the function.
* ``STACK_BYTES_A``: Stack bytes in OLD.
* ``STACK_BYTES_B``: Stack bytes in NEW.
Computing Diffs From Function JSON
**********************************
Function JSON does not contain the diffs. Tools consuming JSON output from
:program:`llvm-remark-size-diff` are responsible for computing the diffs
separately.
**To compute the diffs:**
* Instruction count diff: ``INST_COUNT_B - INST_COUNT_A``
* Stack byte count diff: ``STACK_BYTES_B - STACK_BYTES_A``
EXIT STATUS
-----------
:program:`llvm-remark-size-diff` returns 0 on success, and a non-zero value
otherwise.
|
