1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440
|
<!--
~ Licensed to the Apache Software Foundation (ASF) under one
~ or more contributor license agreements. See the NOTICE file
~ distributed with this work for additional information
~ regarding copyright ownership. The ASF licenses this file
~ to you under the Apache License, Version 2.0 (the
~ "License"); you may not use this file except in compliance
~ with the License. You may obtain a copy of the License at
~
~ http://www.apache.org/licenses/LICENSE-2.0
~
~ Unless required by applicable law or agreed to in writing,
~ software distributed under the License is distributed on an
~ "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
~ KIND, either express or implied. See the License for the
~ specific language governing permissions and limitations
~ under the License.
-->
`delta_binary_packed.parquet` is generated with parquet-mr version 1.10.0.
The expected file contents are in `delta_binary_packed_expect.csv`.
Each column is DELTA_BINARY_PACKED-encoded, with a different delta bitwidth
for each column.
Each column has 200 rows including 1 first value and 2 blocks. The first block
has 4 miniblocks, the second block has 3. Each miniblock contains 32 values,
except the last one which only contains 7 values (1 + 6 \* 32 + 7 == 200).
Here is the file structure:
```
File Name: /home/antoine/parquet/testing/data/delta_binary_packed.parquet
Version: 1.0
Created By: parquet-mr version 1.10.0 (build 031a6654009e3b82020012a18434c582bd74c73a)
Total rows: 200
Number of RowGroups: 1
Number of Real Columns: 66
Number of Columns: 66
Number of Selected Columns: 66
Column 0: bitwidth0 (INT64)
Column 1: bitwidth1 (INT64)
Column 2: bitwidth2 (INT64)
Column 3: bitwidth3 (INT64)
Column 4: bitwidth4 (INT64)
Column 5: bitwidth5 (INT64)
Column 6: bitwidth6 (INT64)
Column 7: bitwidth7 (INT64)
Column 8: bitwidth8 (INT64)
Column 9: bitwidth9 (INT64)
Column 10: bitwidth10 (INT64)
Column 11: bitwidth11 (INT64)
Column 12: bitwidth12 (INT64)
Column 13: bitwidth13 (INT64)
Column 14: bitwidth14 (INT64)
Column 15: bitwidth15 (INT64)
Column 16: bitwidth16 (INT64)
Column 17: bitwidth17 (INT64)
Column 18: bitwidth18 (INT64)
Column 19: bitwidth19 (INT64)
Column 20: bitwidth20 (INT64)
Column 21: bitwidth21 (INT64)
Column 22: bitwidth22 (INT64)
Column 23: bitwidth23 (INT64)
Column 24: bitwidth24 (INT64)
Column 25: bitwidth25 (INT64)
Column 26: bitwidth26 (INT64)
Column 27: bitwidth27 (INT64)
Column 28: bitwidth28 (INT64)
Column 29: bitwidth29 (INT64)
Column 30: bitwidth30 (INT64)
Column 31: bitwidth31 (INT64)
Column 32: bitwidth32 (INT64)
Column 33: bitwidth33 (INT64)
Column 34: bitwidth34 (INT64)
Column 35: bitwidth35 (INT64)
Column 36: bitwidth36 (INT64)
Column 37: bitwidth37 (INT64)
Column 38: bitwidth38 (INT64)
Column 39: bitwidth39 (INT64)
Column 40: bitwidth40 (INT64)
Column 41: bitwidth41 (INT64)
Column 42: bitwidth42 (INT64)
Column 43: bitwidth43 (INT64)
Column 44: bitwidth44 (INT64)
Column 45: bitwidth45 (INT64)
Column 46: bitwidth46 (INT64)
Column 47: bitwidth47 (INT64)
Column 48: bitwidth48 (INT64)
Column 49: bitwidth49 (INT64)
Column 50: bitwidth50 (INT64)
Column 51: bitwidth51 (INT64)
Column 52: bitwidth52 (INT64)
Column 53: bitwidth53 (INT64)
Column 54: bitwidth54 (INT64)
Column 55: bitwidth55 (INT64)
Column 56: bitwidth56 (INT64)
Column 57: bitwidth57 (INT64)
Column 58: bitwidth58 (INT64)
Column 59: bitwidth59 (INT64)
Column 60: bitwidth60 (INT64)
Column 61: bitwidth61 (INT64)
Column 62: bitwidth62 (INT64)
Column 63: bitwidth63 (INT64)
Column 64: bitwidth64 (INT64)
Column 65: int_value (INT32)
--- Row Group: 0 ---
--- Total Bytes: 65467 ---
--- Total Compressed Bytes: 0 ---
--- Rows: 200 ---
Column 0
Values: 200, Null Values: 0, Distinct Values: 0
Max: 6374628540732951412, Min: 6374628540732951412
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 95, Compressed Size: 95
Column 1
Values: 200, Null Values: 0, Distinct Values: 0
Max: 0, Min: -104
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 114, Compressed Size: 114
Column 2
Values: 200, Null Values: 0, Distinct Values: 0
Max: 0, Min: -82
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 144, Compressed Size: 144
Column 3
Values: 200, Null Values: 0, Distinct Values: 0
Max: 0, Min: -96
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 172, Compressed Size: 172
Column 4
Values: 200, Null Values: 0, Distinct Values: 0
Max: 0, Min: -132
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 200, Compressed Size: 200
Column 5
Values: 200, Null Values: 0, Distinct Values: 0
Max: 24, Min: -290
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 228, Compressed Size: 228
Column 6
Values: 200, Null Values: 0, Distinct Values: 0
Max: 259, Min: -93
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 256, Compressed Size: 256
Column 7
Values: 200, Null Values: 0, Distinct Values: 0
Max: 476, Min: -64
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 284, Compressed Size: 284
Column 8
Values: 200, Null Values: 0, Distinct Values: 0
Max: 387, Min: -732
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 314, Compressed Size: 314
Column 9
Values: 200, Null Values: 0, Distinct Values: 0
Max: 194, Min: -1572
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 342, Compressed Size: 342
Column 10
Values: 200, Null Values: 0, Distinct Values: 0
Max: 5336, Min: -2353
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 370, Compressed Size: 370
Column 11
Values: 200, Null Values: 0, Distinct Values: 0
Max: 13445, Min: -8028
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 398, Compressed Size: 398
Column 12
Values: 200, Null Values: 0, Distinct Values: 0
Max: 2017, Min: -35523
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 426, Compressed Size: 426
Column 13
Values: 200, Null Values: 0, Distinct Values: 0
Max: 48649, Min: -4096
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 454, Compressed Size: 454
Column 14
Values: 200, Null Values: 0, Distinct Values: 0
Max: 65709, Min: -8244
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 482, Compressed Size: 482
Column 15
Values: 200, Null Values: 0, Distinct Values: 0
Max: 69786, Min: -106702
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 512, Compressed Size: 512
Column 16
Values: 200, Null Values: 0, Distinct Values: 0
Max: 162951, Min: -347012
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 540, Compressed Size: 540
Column 17
Values: 200, Null Values: 0, Distinct Values: 0
Max: 0, Min: -1054098
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 568, Compressed Size: 568
Column 18
Values: 200, Null Values: 0, Distinct Values: 0
Max: 664380, Min: -372793
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 596, Compressed Size: 596
Column 19
Values: 200, Null Values: 0, Distinct Values: 0
Max: 4001179, Min: -402775
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 624, Compressed Size: 624
Column 20
Values: 200, Null Values: 0, Distinct Values: 0
Max: 788039, Min: -4434785
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 652, Compressed Size: 652
Column 21
Values: 200, Null Values: 0, Distinct Values: 0
Max: 12455554, Min: -1070042
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 680, Compressed Size: 680
Column 22
Values: 200, Null Values: 0, Distinct Values: 0
Max: 2189135, Min: -17987827
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 710, Compressed Size: 710
Column 23
Values: 200, Null Values: 0, Distinct Values: 0
Max: 25967351, Min: -19361900
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 738, Compressed Size: 738
Column 24
Values: 200, Null Values: 0, Distinct Values: 0
Max: 95688064, Min: -17271207
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 766, Compressed Size: 766
Column 25
Values: 200, Null Values: 0, Distinct Values: 0
Max: 169215083, Min: -18759951
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 794, Compressed Size: 794
Column 26
Values: 200, Null Values: 0, Distinct Values: 0
Max: 163626565, Min: -168761837
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 822, Compressed Size: 822
Column 27
Values: 200, Null Values: 0, Distinct Values: 0
Max: 131734874, Min: -736933601
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 850, Compressed Size: 850
Column 28
Values: 200, Null Values: 0, Distinct Values: 0
Max: 913547745, Min: -490714808
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 878, Compressed Size: 878
Column 29
Values: 200, Null Values: 0, Distinct Values: 0
Max: 500305035, Min: -5834684238
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 908, Compressed Size: 908
Column 30
Values: 200, Null Values: 0, Distinct Values: 0
Max: 566280334, Min: -7728643109
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 936, Compressed Size: 936
Column 31
Values: 200, Null Values: 0, Distinct Values: 0
Max: 18831788461, Min: -2498101101
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 964, Compressed Size: 964
Column 32
Values: 200, Null Values: 0, Distinct Values: 0
Max: 23720914586, Min: -2147483648
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 992, Compressed Size: 992
Column 33
Values: 200, Null Values: 0, Distinct Values: 0
Max: 24075494509, Min: -4817999329
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1020, Compressed Size: 1020
Column 34
Values: 200, Null Values: 0, Distinct Values: 0
Max: 12118456329, Min: -156025641218
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1048, Compressed Size: 1048
Column 35
Values: 200, Null Values: 0, Distinct Values: 0
Max: 41614351758, Min: -114682966820
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1076, Compressed Size: 1076
Column 36
Values: 200, Null Values: 0, Distinct Values: 0
Max: 82484946621, Min: -244178626927
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1106, Compressed Size: 1106
Column 37
Values: 200, Null Values: 0, Distinct Values: 0
Max: 361459323159, Min: -275190620271
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1134, Compressed Size: 1134
Column 38
Values: 200, Null Values: 0, Distinct Values: 0
Max: 1665294434042, Min: -420452598502
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1162, Compressed Size: 1162
Column 39
Values: 200, Null Values: 0, Distinct Values: 0
Max: 110454290134, Min: -2926211785103
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1190, Compressed Size: 1190
Column 40
Values: 200, Null Values: 0, Distinct Values: 0
Max: 3215717068302, Min: -4988823342986
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1218, Compressed Size: 1218
Column 41
Values: 200, Null Values: 0, Distinct Values: 0
Max: 2166086616318, Min: -6488418568768
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1246, Compressed Size: 1246
Column 42
Values: 200, Null Values: 0, Distinct Values: 0
Max: 10182365256028, Min: -8738522616121
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1274, Compressed Size: 1274
Column 43
Values: 200, Null Values: 0, Distinct Values: 0
Max: 22909885827147, Min: -21214625470327
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1304, Compressed Size: 1304
Column 44
Values: 200, Null Values: 0, Distinct Values: 0
Max: 67902133645749, Min: -9796939892175
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1332, Compressed Size: 1332
Column 45
Values: 200, Null Values: 0, Distinct Values: 0
Max: 199494208930939, Min: -102473613757961
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1360, Compressed Size: 1360
Column 46
Values: 200, Null Values: 0, Distinct Values: 0
Max: 18564971260296, Min: -359696498357610
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1388, Compressed Size: 1388
Column 47
Values: 200, Null Values: 0, Distinct Values: 0
Max: 65624006999260, Min: -933995610201533
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1416, Compressed Size: 1416
Column 48
Values: 200, Null Values: 0, Distinct Values: 0
Max: 983500521840940, Min: -878019827431629
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1444, Compressed Size: 1444
Column 49
Values: 200, Null Values: 0, Distinct Values: 0
Max: 975533803684560, Min: -2091164446177739
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1472, Compressed Size: 1472
Column 50
Values: 200, Null Values: 0, Distinct Values: 0
Max: 1276327559487856, Min: -5741928190724373
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1502, Compressed Size: 1502
Column 51
Values: 200, Null Values: 0, Distinct Values: 0
Max: 0, Min: -15996275819941210
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1530, Compressed Size: 1530
Column 52
Values: 200, Null Values: 0, Distinct Values: 0
Max: 12697545666077932, Min: -8823113595895130
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1558, Compressed Size: 1558
Column 53
Values: 200, Null Values: 0, Distinct Values: 0
Max: 4785870085681342, Min: -24800000653307089
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1586, Compressed Size: 1586
Column 54
Values: 200, Null Values: 0, Distinct Values: 0
Max: 26202576654140994, Min: -94647392931900711
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1614, Compressed Size: 1614
Column 55
Values: 200, Null Values: 0, Distinct Values: 0
Max: 358302517069012889, Min: -32197353745654772
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1642, Compressed Size: 1642
Column 56
Values: 200, Null Values: 0, Distinct Values: 0
Max: 678791154000627912, Min: -36028797018963968
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1670, Compressed Size: 1670
Column 57
Values: 200, Null Values: 0, Distinct Values: 0
Max: 1444945950888122232, Min: -79246600304853010
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1700, Compressed Size: 1700
Column 58
Values: 200, Null Values: 0, Distinct Values: 0
Max: 140747723990970254, Min: -1492687553985044679
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1728, Compressed Size: 1728
Column 59
Values: 200, Null Values: 0, Distinct Values: 0
Max: 6318360990909070, Min: -3778424577629102559
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1756, Compressed Size: 1756
Column 60
Values: 200, Null Values: 0, Distinct Values: 0
Max: 4574162334421819801, Min: -576460752303423488
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1784, Compressed Size: 1784
Column 61
Values: 200, Null Values: 0, Distinct Values: 0
Max: 8803535686130338880, Min: -1155450847100943978
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1812, Compressed Size: 1812
Column 62
Values: 200, Null Values: 0, Distinct Values: 0
Max: 9026687750017193101, Min: -4454039315625288390
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1840, Compressed Size: 1840
Column 63
Values: 200, Null Values: 0, Distinct Values: 0
Max: 9150047972721273816, Min: -9220123451143279334
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1868, Compressed Size: 1868
Column 64
Values: 200, Null Values: 0, Distinct Values: 0
Max: 8846115173408951296, Min: -9223372036854775808
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 1898, Compressed Size: 1898
Column 65
Values: 200, Null Values: 0, Distinct Values: 0
Max: 2142811258, Min: -2078683524
Compression: UNCOMPRESSED, Encodings: DELTA_BINARY_PACKED
Uncompressed Size: 980, Compressed Size: 980
```
|