File: config.md

package info (click to toggle)
xenium 0.0.2%2Bds-3
  • links: PTS, VCS
  • area: main
  • in suites: bullseye
  • size: 1,088 kB
  • sloc: cpp: 12,297; makefile: 20
file content (293 lines) | stat: -rw-r--r-- 8,902 bytes parent folder | download | duplicates (3)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
# General

The configuration files are JSON with the following basic structure:
```json
{
  "type": string,
  "ds": <data-structure>,
  "threads": <benchmark-type::threads>,
  "warmup": <warmup> (optional),
  "runtime": integer (in ms; optional),
  "rounds": integer (optional),

  <type-specific-params...>
}
```
`type` defines the type of the benchmark; most of the other parameters depend
on the value of `type`. At the moment, the only supported type is `queue`.

`ds` defines the data structure to be used; the possible values depend on the
specified benchmark type.
Many data structures are designed to use template paramters for compile time
configuration. One can define which configuration variations for each data
structure should be built for the benchmark. At runtime, the configuration
specified in `ds` is compared to the available configurations in order to run
the benchmark with the correctly configured data structure.
This is a sample `ds` configuration:
```json
  {
    "type": "michael_scott_queue",
    "reclaimer": {
      "type": "epoch_based"
    }
  }
```
It always requires a `type` field that specifies the data structure type. The
other parameters depend on that type. To get a list of available benchmarks
with their respective `ds` configurations, one can run the benchmark executable
with `--help`.

`threads` defines the number and types of threads. The thread
configuration looks like this:
```json
{
  <name>: {
   "count": 4,
   "type": string (optional; defaults to <name>),
   <type-specific-params>
  },
  <more threads...>
}
```
It is an oject consisting of an arbitrary number of name/value pairs. This
allows one to use different kinds of threads like producers/consumers with
different configurations. The type of the thread defaults to the given
`<name>`, but it is also possible to use a user defined name, and specify the
type explicitly. This is useful when you have multiple configurations of the
same type.

`warmup` defines the number of warmup rounds and the runtime of each warmup round:
```json
{
  "rounds": integer (optional; defaults to 0),
  "runtime": integer (in ms; optional; defaults to 5000)
}
```
The `warmup` parameter as well as both members are optional. Unless specified,
`rounds` defaults to zero and `runtime` defaults to 5000; the `runtime` is
specified in milliseconds. Warmup rounds are executed just the same as the normal
rounds, but they are not considered in the result report.

`runtime` defines the runtime of each round in milliseconds; defaults to 10000.

`rounds` defines the number of rounds to be executed. Each round has its own set
of threads, i.e., the configured threads are started, and once all threads are
up, the execution begins. Once the runtime expires, all threads are stopped, and
a report for the round is created, containing informations like actual runtime
and number of executed operations.

# Benchmarks

## Queue

This is a simple synthetic benchmark for the different queues:
  * `michael_scott_queue`
  * `ramalhete_queue`
  * `vyukov_bounded_queue`

### General

`batch_size` defines the number of operations in a single "batch". This is the
granularity at which the worker threads execute and count operations on the data
structure under test. Each batch is executed under its own `region_guard`. This
parameter is optional; the default value is 100.

`prefill` defines the number of items the queue should be prefilled with before
starting each round.
```json
{
  "serial": boolean (optional; defaults to false),
  "count": integer (optional; defaults to 100)
}
```

### Data structure

This is a list of the supported queue data structures with their respective
properties. For details about the various parameters please consult the
[documentation](https://mpoeter.github.io/xenium). Some of the data structures
require a reclaimer to be configured. For a list of available reclaimers and
their configurations see section "Reclaimers".

**`vyukov_bounded_queue`**
```json
{
  "type": "vyukov_bounded_queue",
  "weak": boolean,
  "size": integer (has to be a power to 2; is a runtime parameter)
}
```

**`ramalhete_queue`**
```json
{
  "type": "ramalhete_queue",
  "reclaimer": <reclaimer>
}
```

**`michael_scott_queue`**
```json
{
  "type": "michael_scott_queue",
  "reclaimer": <reclaimer>
}
```

### Threads

**`producer`** defines threads that _push_ values into the queue.
```json
{
  "count": integer,
  "pop_ratio": float (optional; defaults to 0.0),
  "workload": <workload> | integer | (optional; defaults to `nothing`)
}
```
`pop_ratio` defines the ratio of pop operations the thread should perform.

**`consumer`** defines threads that _pop_ values from the queue.
```json
{
  "count": integer,
  "push_ratio": float (optional; defaults to 0.0),
  "workload": <workload> | integer | (optional; defaults to `nothing`)
}
```
`push_ratio` defines the ratio of push operations the thread should perform.

`workload` defines a virtual workload that a thread has to perform between
each push/pop operation. This value can be a simple integer, in which case
it defines the number of iterations for the `dummy` workload. Otherwise this
defines a workload object.

## HashMap

This is a simple synthetic benchmark for the different hash-maps:
  * `harris_michael_hash_map`
  * `vyukov_hash_map`

### General

`batch_size` defines the number of operations in a single "batch". This is the
granularity at which the worker threads execute and count operations on the data
structure under test. Each batch is executed under its own `region_guard`. This
parameter is optional; the default value is 100.

`key_range` and `key_offset` define the interval from which keys are picked randomly,
i.e., generated keys are `>= key_offset` and < `key_offset + key_range`.
`key_range` defaults to 2048; `key_offset` defaults to 0.

`prefill` defines the number of items the hash-map should be prefilled with before
starting each round. `serial` defines whether the prefilling should be performed by
all worker threads (work is distributed evenly among all workers), or single threaded.
Note: the keys generated when prefilling are always based on the globally defined
`key_range` and `key_offset`, regardless of any worker thread specific overrides.
```json
{
  "serial": boolean (optional; defaults to false),
  "count": integer (optional; defaults to 10% of `key_range`)
}
```

### Data structure

This is a list of the supported queue data structures with their respective
properties. For details about the various parameters please consult the
[documentation](https://mpoeter.github.io/xenium). Some of the data structures
require a reclaimer to be configured. For a list of available reclaimers and
their configurations see section "Reclaimers".

**`harris_michael_hash_map`**
```json
{
  "type": "harris_michael_hash_map",
  "reclaimer": <reclaimer>,
  "buckets": <integer> (optional; defaults to 512)
}
```

**`vyukov_hash_map`**
```json
{
  "type": "vyukov_hash_map",
  "reclaimer": <reclaimer>,
  "initial_capacity": integer (optional; defaults to 128; is a runtime parameter)
}
```

### Threads

**`mixed`** defines threads that performs inserts, removes and searches for items in the hash-map.
```json
{
  "count": integer,
  "key_range": integer (optional; defaults to the globally defined key_range),
  "key_offset": integer (optional; defaults to the globally defined key_offset),
  "remove_ratio": float (optional; defaults to 0.2),
  "insert_ratio": float (optional; defaults to 0.2),
  "workload": <workload> | integer (optional; defaults to `nothing`)
}
```

`key_range` and `key_range` can be specfied to override the globally defined values.
This way it is possible to define separate key ranges for different threads that do
not overlap, or that overlap only partially.

`remove_ratio` defines the ratio of remove operations the thread should perform.

`insert_ratio` defines the ratio of insert operations the thread should perform.

`workload` defines a virtual workload that a thread has to perform between
each operation. This value can be a simple integer, in which case it defines the
number of iterations for the `dummy` workload. Otherwise this defines a workload
object.

# Reclaimers

Many data structures require specification of a `reclaimer`. This is a list
of supported reclaimers with their respective properties:

**`epoch_based`**
```json
{
  "type": "epoch_based",
  "update_threshold": integer
}
```

**`new_epoch_based`**
```json
{
  "type": "new_epoch_based",
  "update_threshold": integer
}
```

**`quiescent_state_based`**
```json
{
  "type": "quiescent_state_based"
}
```

**`debra`**
```json
{
  "type": "debra",
  "update_threshold": integer
}
```

`hazard_pointer`
```json
{
  "type": "hazard_pointer",
  "policy": {
    "type": "static_hazard_pointer_policy" | "dynamic_hazard_pointer_policy",
    "K": integer,
    "A": integer,
    "B": integer
  }
}
```