1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
|
The scripts in this directory provide various examples of using Confluent's Python client for Kafka:
* [adminapi.py](adminapi.py): Various AdminClient operations.
* [asyncio_example.py](asyncio_example.py): AsyncIO webserver with Kafka producer.
* [consumer.py](consumer.py): Read messages from a Kafka topic.
* [producer.py](producer.py): Read lines from stdin and send them to a Kafka topic.
* [eos_transactions.py](eos_transactions.py): Transactional producer with exactly once semantics (EOS).
* [avro_producer.py](avro_producer.py): Produce Avro serialized data using AvroSerializer.
* [avro_consumer.py](avro_consumer.py): Read Avro serialized data using AvroDeserializer.
* [json_producer.py](json_producer.py): Produce JSON serialized data using JSONSerializer.
* [json_consumer.py](json_consumer.py): Read JSON serialized data using JSONDeserializer.
* [protobuf_producer.py](protobuf_producer.py): Produce Protobuf serialized data using ProtobufSerializer.
* [protobuf_consumer.py](protobuf_consumer.py): Read Protobuf serialized data using ProtobufDeserializer.
* [sasl_producer.py](sasl_producer.py): Demonstrates SASL Authentication.
* [get_watermark_offsets.py](get_watermark_offsets.py): Consumer method for listing committed offsets and consumer lag for group and topics.
* [oauth_producer.py](oauth_producer.py): Demonstrates OAuth Authentication (client credentials).
Additional examples for [Confluent Cloud](https://www.confluent.io/confluent-cloud/):
* [confluent_cloud.py](confluent_cloud.py): Produce messages to Confluent Cloud and then read them back again.
* [confluentinc/examples](https://github.com/confluentinc/examples/tree/master/clients/cloud/python): Integration with Confluent Cloud and Confluent Cloud Schema Registry
## venv setup
It's usually a good idea to install Python dependencies in a virtual environment to avoid
conflicts between projects.
To setup a venv with the latest release version of confluent-kafka and dependencies of all examples installed:
```
$ python3 -m venv venv_examples
$ source venv_examples/bin/activate
$ pip install confluent_kafka
$ pip install -r requirements/requirements-examples.txt
```
To setup a venv that uses the current source tree version of confluent_kafka, you
need to have a C compiler and librdkafka installed
([from a package](https://github.com/edenhill/librdkafka#installing-prebuilt-packages), or
[from source](https://github.com/edenhill/librdkafka#build-from-source)). Then:
```
$ python3 -m venv venv_examples
$ source venv_examples/bin/activate
$ pip install .[examples]
```
When you're finished with the venv:
```
$ deactivate
```
|
