File: README.md

package info (click to toggle)
c-blosc2 2.22.0%2Bds-1
  • links: PTS, VCS
  • area: main
  • in suites: forky, sid
  • size: 14,020 kB
  • sloc: ansic: 46,325; python: 332; lisp: 82; makefile: 63; sh: 3
file content (92 lines) | stat: -rw-r--r-- 2,347 bytes parent folder | download | duplicates (3)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
Here there are stored testing complementary files that are available for
all users to test their plugins.

The folder files are multidimensional arrays created by b2nd using
the 'example_frame_generator.c' example.
(https://github.com/Blosc/c-blosc2/blob/main/examples/b2nd/example_frame_generator.c).
Moreover, they have the next parameters:
- nthreads = 1;
- splitmode = BLOSC_ALWAYS_SPLIT;
- compcodec = BLOSC_ZSTD;
- complevel = 9;

Moreover, each dataset has different types and shapes:

**example_rand.b2nd**:

- ndim = 3;
- type = int;
- typesize = 4;
- shape[8] = {32, 18, 32};
- chunkshape[8] = {17, 16, 24};
- blockshape[8] = {8, 9, 8};

**example_same_cells.b2nd**:

- ndim = 2;
- type = int;
- typesize = 4;
- shape[8] = {128, 111};
- chunkshape[8] = {32, 11};
- blockshape[8] = {16, 7};

**example_some_matches.b2nd**:

- ndim = 2;
- type = long;
- typesize = 8;
- shape[8] = {128, 111};
- chunkshape[8] = {48, 32};
- blockshape[8] = {14, 18};

**example_float_cyclic.b2nd**:

- int8_t ndim = 3;
- type = float;
- typesize = 4;
- int64_t shape[] = {40, 60, 20};
- int32_t chunkshape[] = {20, 30, 16};
- int32_t blockshape[] = {11, 14, 7};

**example_double_same_cells.b2nd**:

- int8_t ndim = 2;
- type = double;
- typesize = 8;
- int64_t shape[] = {40, 60};
- int32_t chunkshape[] = {20, 30};
- int32_t blockshape[] = {16, 16};

**example_day_month_temp.b2nd**:

- int ndim = 2;
- type = float;
- typesize = 4;
- int64_t shape[] = {400, 3};
- int32_t chunkshape[] = {110, 3};
- int32_t blockshape[] = {57, 3};

This frame simulates values for: 
- Day: between 1 and 31 (column 0)
- Month: between 1 and 12 (column 1)
- Temperature: between -20 and 40 (column 2)

These fields are grouped by columns, so the frame has 400 rows that 
represent different days with a value for each of the three columns.

**example_item_prices.b2nd**:

- int ndim = 3;
- type = float;
- typesize = 4;
- int64_t shape[] = {12, 25, 250};
- int32_t chunkshape[] = {8, 10, 50};
- int32_t blockshape[] = {4, 5, 10};
    
This frame simulates item prices based on 3 dimensions:
- Month (dim 0): items are more expensive depending on the month
- Store ID (dim 1): items are more expensive depending on the store type
- Item ID (dim 2): each item has a different base price

Depending on each dimension index, the final price is calculated for 
each situation.