File: pbzip2.1

package info (click to toggle)
pbzip2 1.1.13-1
  • links: PTS, VCS
  • area: main
  • in suites: bookworm, bullseye, sid, trixie
  • size: 448 kB
  • sloc: cpp: 4,357; ruby: 101; makefile: 31
file content (176 lines) | stat: -rw-r--r-- 5,569 bytes parent folder | download
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
.TH pbzip2 1
.SH NAME
pbzip2  \-  parallel bzip2 file compressor, v1.1.10
.SH SYNOPSIS
.B pbzip2
.RB [ " \-123456789 " ]
.RB [ " \-b#cdfhklm#p#qrS#tvVz " ]
[
.I "filenames \&..."
]
.SH DESCRIPTION
.I pbzip2
is a parallel implementation of the bzip2 block-sorting file
compressor that uses pthreads and achieves near-linear speedup on SMP
machines. The output of this version is fully compatible with bzip2
v1.0.2 or newer (ie: anything compressed with
.I pbzip2
can be decompressed with bzip2).
.PP
.I pbzip2
should work on any system that has a pthreads compatible C++
compiler (such as gcc). It has been tested on: Linux, Windows (cygwin),
Solaris, Tru64/OSF1, HP-UX, and Irix.
.PP
The default settings for
.I pbzip2
will work well in most cases. The only switch you will likely need to
use is -d to decompress files and -p to set the # of processors for
.I pbzip2
to use if autodetect is not supported
on your system, or you want to use a specific # of CPUs.
.SH OPTIONS
.TP
.B \-b#
Where # is block size in 100k steps (default 9 = 900k)
.TP
.B \-c, \-\-stdout
Output to standard out (stdout)
.TP
.B \-d,\-\-decompress
Decompress file
.TP
.B \-f,\-\-force
Force, overwrite existing output file
.TP
.B \-h,\-\-help
Print this help message
.TP
.B \-k,\-\-keep
Keep input file, do not delete
.TP
.B \-l,\-\-loadavg
Load average determines max number processors to use
.TP
.B \-m#
Where # is max memory usage in 1MB steps (default 100 = 100MB)
.TP
.B \-p#
Where # is the number of processors (default: autodetect)
.TP
.B \-q,\-\-quiet
Quiet mode (default)
.TP
.B \-r,\-\-read
Read entire input file into RAM and split between processors
.TP
.B \-S#
Child thread stack size in 1KB steps (default stack size if unspecified)
.TP
.B \-t,\-\-test
Test compressed file integrity
.TP
.B \-v,\-\-verbose
Verbose mode
.TP
.B \-V
Display version info for
.I pbzip2
then exit
.TP
.B \-z,\-\-compress
Compress file (default)
.TP
.B \-1,\-\-fast ... \-9,\-\-best
Set BWT block size to 100k .. 900k (default 900k).
.TP
.B \-\-ignore-trailing-garbage=#
Ignore trailing garbage flag (1 - ignored; 0 - forbidden)
.PP
If no file names are given, pbzip2 compresses or decompresses from standard input to standard output.
.SH FILE SIZES
You should be able to compress files larger than 4GB with
.I pbzip2.
.PP
Files that are compressed with
.I pbzip2
are broken up into pieces and
each individual piece is compressed.  This is how
.I pbzip2
runs faster
on multiple CPUs since the pieces can be compressed simultaneously.
The final .bz2 file may be slightly larger than if it was compressed
with the regular bzip2 program due to this file splitting (usually
less than 0.2% larger).  Files that are compressed with
.I pbzip2
will also gain considerable speedup when decompressed using
.I pbzip2.
.PP
Files that were compressed using bzip2 will not see speedup since
bzip2 packages the data into a single chunk that cannot be split
between processors.
.SH EXAMPLES
Example 1: pbzip2 myfile.tar
.PP
This example will compress the file "myfile.tar" into the compressed file
"myfile.tar.bz2". It will use the autodetected # of processors (or 2
processors if autodetect not supported) with the default file block size
of 900k and default BWT block size of 900k.
.PP
Example 2: pbzip2 -b15k myfile.tar
.PP
This example will compress the file "myfile.tar" into the compressed file
"myfile.tar.bz2". It will use the autodetected # of processors (or 2
processors if autodetect not supported) with a file block size of 1500k
and a BWT block size of 900k. The file "myfile.tar" will not be deleted
after compression is finished.
.PP
Example 3: pbzip2 -p4 -r -5 myfile.tar second*.txt
.PP
This example will compress the file "myfile.tar" into the compressed file
"myfile.tar.bz2". It will use 4 processors with a BWT block size of 500k.
The file block size will be the size of "myfile.tar" divided by 4 (# of
processors) so that the data will be split evenly among each processor.
This requires you have enough RAM for pbzip2 to read the entire file into
memory for compression. Pbzip2 will then use the same options to compress
all other files that match the wildcard "second*.txt" in that directory.
.PP
Example 4: tar cf myfile.tar.bz2 --use-compress-prog=pbzip2 dir_to_compress/
.br
Example 4: tar -c directory_to_compress/ | pbzip2 -c > myfile.tar.bz2
.PP
These examples will compress the data being given to pbzip2 via pipe
from TAR into the compressed file "myfile.tar.bz2".  It will use the
autodetected # of processors (or 2 processors if autodetect not
supported) with the default file block size of 900k and default BWT
block size of 900k.  TAR is collecting all of the files from the
"directory_to_compress/" directory and passing the data to pbzip2 as
it works.
.PP
Example 5: pbzip2 -d -m500 myfile.tar.bz2
.PP
This example will decompress the file "myfile.tar.bz2" into the decompressed
file "myfile.tar". It will use the autodetected # of processors (or 2
processors if autodetect not supported). It will use a maximum of 500MB of
memory for decompression.  The switches -b, -r, and -1..-9 are not valid for
decompression.
.PP
Example 6: pbzip2 -dc myfile.tar.bz2 | tar x
.PP
This example will decompress and untar the file "myfile.tar.bz2" piping
the output of the decompressing pbzip2 to tar.
.PP
Example 7: pbzip2 -c < myfile.txt > myfile.txt.bz2
.PP
This example will read myfile.txt from standard input compressing
it to standard output which is redirected to to myfile.txt.bz2.
.SH "SEE ALSO"
bzip2(1)
gzip(1)
lzip(1)
rzip(1)
zip(1)
.SH AUTHOR
Jeff Gilchrist

http://compression.ca