1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90
|
.. _cases:
Cases
=====
This chapter lists various cases/projects where Stetl is used.
NLExtract
---------
NLExtract http://nlextract.nl is a development project that aims to provide ETL-tooling for all
Dutch Open Geo-Datasets, in particular the country wide
"Key Registries" (Dutch: Basisregistraties) like Cadastral Parcels (BRK), Topography (BRT+BGT) and
Buildings and Addresses (BAG). These datasets are provided as XML/GML. The ETL mostly provides
a transformation to PostGIS. For all Key Registries, except for the BAG, Stetl is used, basically
as-is, without extra (Python) programming. See also the NLExtract GitHub:
https://github.com/nlextract/NLExtract
Topography (BRT/Top10NL)
~~~~~~~~~~~~~~~~~~~~~~~~
See https://github.com/nlextract/NLExtract/tree/master/top10nl/etl and the Stetl conf at
https://github.com/nlextract/NLExtract/tree/master/top10nl/etl/conf/
Detailed Topography (BGT)
~~~~~~~~~~~~~~~~~~~~~~~~~
See https://github.com/nlextract/NLExtract/tree/master/bgt and the Stetl conf at
https://github.com/nlextract/NLExtract/blob/master/bgt/etl/conf/
Cadastral Parcels (BRK)
~~~~~~~~~~~~~~~~~~~~~~~
See https://github.com/nlextract/NLExtract/tree/master/brk/etl
and the Stetl conf at https://github.com/nlextract/NLExtract/tree/master/brk/etl/conf
INSPIRE
-------
These were the origins of Stetl. This project was sponsored by Kadaster.
See https://github.com/justb4/inspire-foss. The ETL involved the transformation of Dutch Key Registries (see above)
to harmonized INSPIRE GML according to the Annexes.
Addresses
~~~~~~~~~
BAG to INSPIRE Addresses Annex II Theme.
See https://github.com/justb4/inspire-foss/blob/master/etl/NL.Kadaster/Addresses/
Ordnance Survey
---------------
A successful Proof-of-Concept to convert Ordnance Survey Mastermap GML to PostGIS:
https://github.com/geopython/stetl/tree/master/examples/ordnancesurvey
SOSPilot
--------
A SensorWeb project by Geonovum, see http://sensors.geonovum.nl.
Dutch AQ to WFS/WMS(-Time) and SOS
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Stetl was used
for ETL from Dutch Air Quality Data from RIVM (XML) to WMS(-Time), WFS and SOS.
The latter was effected by SOS-Transactional publication. Documentation at
http://sospilot.readthedocs.org and ETL on GitHub at
https://github.com/Geonovum/sospilot/tree/master/src/rivm-lml
Dutch AQ to EAI Reporting
~~~~~~~~~~~~~~~~~~~~~~~~~
Stetl was used to generate XML-based reports for the EU EAI:
https://github.com/Geonovum/sospilot/tree/master/src/aq-report
This involved the first use of Jinja2 templating for complex XML/GML generation.
Smart Emission
--------------
Sensors for air quality, meteo and audio at civilians. Project by University of Nijmegen/Gemeente Nijmegen with participation
by Geonovum. Stetl is used to transform a low-level sensor API to PostGIS and later on WMS/WFS/SOS and the SensorThings API.
Also InfluxDB output is developed here.
This is also an example how to use a Stetl Docker image:
See https://github.com/Geonovum/smartemission/tree/master/etl
|