1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
|
Install
#######
Install with your favorite package manager
Latest Release
**************
Pip:
.. code:: bash
pip install kafka-python
Releases are also listed at https://github.com/dpkp/kafka-python/releases
Bleeding-Edge
*************
.. code:: bash
git clone https://github.com/dpkp/kafka-python
pip install ./kafka-python
Optional LZ4 install
********************
To enable LZ4 compression/decompression, install python-lz4:
>>> pip install lz4
Optional crc32c install
********************
To enable optimized CRC32 checksum validation, install crc32c:
>>> pip install crc32c
Optional Snappy install
***********************
Install Development Libraries
=============================
Download and build Snappy from https://google.github.io/snappy/
Ubuntu:
.. code:: bash
apt-get install libsnappy-dev
OSX:
.. code:: bash
brew install snappy
From Source:
.. code:: bash
wget https://github.com/google/snappy/releases/download/1.1.3/snappy-1.1.3.tar.gz
tar xzvf snappy-1.1.3.tar.gz
cd snappy-1.1.3
./configure
make
sudo make install
Install Python Module
=====================
Install the `python-snappy` module
.. code:: bash
pip install python-snappy
Optional crc32c install
***********************
Highly recommended if you are using Kafka 11+ brokers. For those `kafka-python`
uses a new message protocol version, that requires calculation of `crc32c`,
which differs from `zlib.crc32` hash implementation. By default `kafka-python`
calculates it in pure python, which is quite slow. To speed it up we optionally
support https://pypi.python.org/pypi/crc32c package if it's installed.
.. code:: bash
pip install crc32c
|
