File: use-cases.rst

package info (click to toggle)
python-streamz 0.6.5-2
  • links: PTS, VCS
  • area: main
  • in suites: forky, sid
  • size: 824 kB
  • sloc: python: 6,739; sh: 18; makefile: 16
file content (28 lines) | stat: -rw-r--r-- 1,025 bytes parent folder | download
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
Use cases
=========

ETL applications
----------------

  In LorryStream_, we use Streamz at the core for relaying data from streaming
  sources into CrateDB_, because we have been looking for something smaller
  and more concise than Beam, Flink, or Spark. Streamz gives us the freedom
  to use advanced stream processing and flow control primitives within Python
  applications to feed databases, without the need to spin up compute clusters,
  or deal with Java class paths.

In this spirit, LorryStream is effectively just a humble CLI interface for
Streamz.

Telemetry readings
------------------

  At my company, we use it at two different points in our data processing to
  create a disjoint subcover of a noisy stream of telemetry readings and then
  blend in metadata from users and external authoritative resources to give
  users an understanding of what (and what kinds of) events are happening in
  their space.


.. _CrateDB: https://github.com/crate/crate
.. _LorryStream: https://lorrystream.readthedocs.io/