1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 801 802 803 804 805 806 807 808 809 810 811 812 813 814 815 816 817 818 819 820 821 822 823 824 825 826 827 828 829 830 831 832 833 834 835 836 837 838 839 840 841 842 843 844 845 846 847 848 849 850 851 852 853 854 855 856 857 858 859 860 861 862 863 864 865 866 867 868 869 870 871 872 873 874 875 876 877 878 879 880 881 882 883 884 885 886 887 888 889 890 891 892 893 894 895 896 897 898 899 900 901 902 903 904 905 906 907 908 909 910 911 912 913 914 915 916 917 918 919 920 921 922 923 924 925 926 927 928 929 930 931 932 933 934 935 936 937 938 939 940 941 942 943 944 945 946 947 948 949 950 951 952 953 954 955 956 957 958 959 960 961 962 963 964 965 966 967 968 969 970 971 972 973 974 975 976 977 978 979 980 981 982 983 984 985 986 987 988 989 990 991 992 993 994 995 996 997 998 999 1000 1001 1002 1003 1004 1005 1006 1007 1008 1009 1010 1011 1012 1013 1014 1015 1016 1017 1018 1019 1020 1021 1022 1023 1024 1025 1026 1027 1028 1029 1030 1031 1032 1033 1034 1035 1036 1037 1038 1039 1040 1041 1042 1043 1044 1045 1046 1047 1048 1049 1050 1051 1052 1053 1054 1055 1056 1057 1058 1059 1060 1061 1062 1063 1064 1065 1066 1067 1068 1069 1070 1071 1072 1073 1074 1075 1076 1077 1078 1079 1080 1081 1082 1083 1084 1085 1086 1087 1088 1089 1090 1091 1092 1093 1094 1095 1096 1097 1098 1099 1100 1101 1102 1103 1104 1105 1106 1107 1108 1109 1110 1111 1112 1113 1114 1115 1116 1117 1118 1119 1120 1121 1122 1123 1124 1125 1126 1127 1128 1129 1130 1131 1132 1133 1134 1135 1136 1137 1138 1139 1140 1141 1142 1143 1144 1145 1146 1147 1148 1149 1150 1151 1152 1153 1154 1155 1156 1157 1158 1159 1160 1161 1162 1163 1164 1165 1166 1167 1168 1169 1170 1171 1172 1173 1174 1175 1176 1177 1178 1179 1180 1181 1182 1183 1184 1185 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201 1202 1203 1204 1205 1206 1207 1208 1209 1210 1211 1212 1213 1214 1215 1216 1217 1218 1219 1220 1221 1222 1223 1224 1225 1226 1227 1228 1229 1230 1231 1232 1233 1234 1235 1236 1237 1238 1239 1240 1241 1242 1243 1244 1245 1246 1247 1248 1249 1250 1251 1252 1253 1254 1255 1256 1257 1258 1259 1260 1261 1262 1263 1264 1265 1266
|
/stetl/examples/basics/10_jinja2_templating /stetl/examples/basics
==== running etl.sh for 10_jinja2_templating ====
2019-03-22 22:19:54,997 util INFO Found lxml.etree, native XML parsing, fabulous!
2019-03-22 22:19:55,046 util INFO Found GDAL/OGR Python bindings, super!!
2019-03-22 22:19:55,053 main INFO Stetl version = 2.0rc1
2019-03-22 22:19:55,054 ETL INFO INIT - Stetl version is 2.0rc1
2019-03-22 22:19:55,056 ETL INFO Config/working dir = /stetl/examples/basics/10_jinja2_templating
2019-03-22 22:19:55,056 ETL INFO Reading config_file = etl.cfg
2019-03-22 22:19:55,064 ETL INFO START
2019-03-22 22:19:55,064 util INFO Timer start: total ETL
2019-03-22 22:19:55,065 chain INFO Assembling Chain: input_json|filter_template_xml|output_xml_file...
2019-03-22 22:19:55,069 input INFO cfg = {'file_path': 'input/cities.json', 'class': 'stetl.inputs.fileinput.JsonFileInput'}
2019-03-22 22:19:55,072 fileinput INFO file_list=['input/cities.json']
2019-03-22 22:19:55,074 output INFO cfg = {'file_path': 'output/cities.xml', 'class': 'stetl.outputs.fileoutput.FileOutput'}
2019-03-22 22:19:55,075 fileoutput INFO working dir /stetl/examples/basics/10_jinja2_templating
2019-03-22 22:19:55,075 chain INFO Running Chain: input_json|filter_template_xml|output_xml_file
2019-03-22 22:19:55,076 templatingfilter INFO Init: templating
2019-03-22 22:19:55,129 templatingfilter INFO template file read and template created OK: templates/cities-json2xml.jinja2
2019-03-22 22:19:55,130 fileinput INFO Read/parse for start for file=input/cities.json....
2019-03-22 22:19:55,136 fileinput INFO Read/parse ok for file=input/cities.json
2019-03-22 22:19:55,136 fileinput INFO all files done
2019-03-22 22:19:55,137 fileoutput INFO writing to file output/cities.xml
2019-03-22 22:19:55,142 fileoutput INFO written to output/cities.xml
2019-03-22 22:19:55,143 component INFO JsonFileInput invokes=1 time(total, min, max, avg) = 0.007 0.007 0.007 0.007
2019-03-22 22:19:55,143 templatingfilter INFO Exit: templating
2019-03-22 22:19:55,144 component INFO Jinja2TemplatingFilter invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2019-03-22 22:19:55,144 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.006 0.006 0.006 0.006
2019-03-22 22:19:55,145 chain INFO DONE - 1 rounds - chain=input_json|filter_template_xml|output_xml_file
2019-03-22 22:19:55,145 chain INFO Assembling Chain: input_json|filter_template_gml|output_gml_file...
2019-03-22 22:19:55,146 input INFO cfg = {'file_path': 'input/cities.json', 'class': 'stetl.inputs.fileinput.JsonFileInput'}
2019-03-22 22:19:55,148 fileinput INFO file_list=['input/cities.json']
2019-03-22 22:19:55,148 output INFO cfg = {'file_path': 'output/cities.gml', 'class': 'stetl.outputs.fileoutput.FileOutput'}
2019-03-22 22:19:55,149 fileoutput INFO working dir /stetl/examples/basics/10_jinja2_templating
2019-03-22 22:19:55,149 chain INFO Running Chain: input_json|filter_template_gml|output_gml_file
2019-03-22 22:19:55,150 templatingfilter INFO Init: templating
2019-03-22 22:19:55,151 templatingfilter INFO Read JSON file with globals from: input/globals.json
2019-03-22 22:19:55,168 templatingfilter INFO template file read and template created OK: templates/cities-json2gml.jinja2
2019-03-22 22:19:55,169 fileinput INFO Read/parse for start for file=input/cities.json....
2019-03-22 22:19:55,175 fileinput INFO Read/parse ok for file=input/cities.json
2019-03-22 22:19:55,176 fileinput INFO all files done
2019-03-22 22:19:55,190 fileoutput INFO writing to file output/cities.gml
2019-03-22 22:19:55,196 fileoutput INFO written to output/cities.gml
2019-03-22 22:19:55,196 component INFO JsonFileInput invokes=1 time(total, min, max, avg) = 0.007 0.007 0.007 0.007
2019-03-22 22:19:55,197 templatingfilter INFO Exit: templating
2019-03-22 22:19:55,197 component INFO Jinja2TemplatingFilter invokes=1 time(total, min, max, avg) = 0.014 0.014 0.014 0.014
2019-03-22 22:19:55,198 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.006 0.006 0.006 0.006
2019-03-22 22:19:55,198 chain INFO DONE - 1 rounds - chain=input_json|filter_template_gml|output_gml_file
2019-03-22 22:19:55,199 chain INFO Assembling Chain: input_geojson|filter_template_geojson2gml|output_gml_file2...
2019-03-22 22:19:55,200 input INFO cfg = {'file_path': 'https://raw.githubusercontent.com/justb4/stetl/master/examples/basics/10_jinja2_templating/input/cities-gjson.json', 'output_format': 'geojson_collection', 'class': 'stetl.inputs.fileinput.JsonFileInput'}
2019-03-22 22:19:55,201 fileinput INFO file_list=['https://raw.githubusercontent.com/justb4/stetl/master/examples/basics/10_jinja2_templating/input/cities-gjson.json']
2019-03-22 22:19:55,201 output INFO cfg = {'file_path': 'output/cities-gjson.gml', 'class': 'stetl.outputs.fileoutput.FileOutput'}
2019-03-22 22:19:55,202 fileoutput INFO working dir /stetl/examples/basics/10_jinja2_templating
2019-03-22 22:19:55,202 chain INFO Running Chain: input_geojson|filter_template_geojson2gml|output_gml_file2
2019-03-22 22:19:55,203 templatingfilter INFO Init: templating
2019-03-22 22:19:55,203 templatingfilter INFO Read JSON file with globals from: input/globals.json
2019-03-22 22:19:55,209 templatingfilter INFO Read JSON file with globals from: https://raw.githubusercontent.com/justb4/stetl/master/examples/basics/10_jinja2_templating/input/more-globals.json
2019-03-22 22:19:55,591 templatingfilter INFO template file read and template created OK: templates/cities-gjson2gml.jinja2
2019-03-22 22:19:55,592 fileinput INFO Read/parse for start for file=https://raw.githubusercontent.com/justb4/stetl/master/examples/basics/10_jinja2_templating/input/cities-gjson.json....
2019-03-22 22:19:55,802 fileinput INFO Read/parse ok for file=https://raw.githubusercontent.com/justb4/stetl/master/examples/basics/10_jinja2_templating/input/cities-gjson.json
2019-03-22 22:19:55,803 fileinput INFO all files done
2019-03-22 22:19:55,820 fileoutput INFO writing to file output/cities-gjson.gml
2019-03-22 22:19:55,825 fileoutput INFO written to output/cities-gjson.gml
2019-03-22 22:19:55,826 component INFO JsonFileInput invokes=1 time(total, min, max, avg) = 0.212 0.212 0.212 0.212
2019-03-22 22:19:55,826 templatingfilter INFO Exit: templating
2019-03-22 22:19:55,827 component INFO Jinja2TemplatingFilter invokes=1 time(total, min, max, avg) = 0.016 0.016 0.016 0.016
2019-03-22 22:19:55,827 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.006 0.006 0.006 0.006
2019-03-22 22:19:55,828 chain INFO DONE - 1 rounds - chain=input_geojson|filter_template_geojson2gml|output_gml_file2
2019-03-22 22:19:55,828 chain INFO Assembling Chain: input_geojson|filter_template_geojson2gml|output_std...
2019-03-22 22:19:55,829 input INFO cfg = {'file_path': 'https://raw.githubusercontent.com/justb4/stetl/master/examples/basics/10_jinja2_templating/input/cities-gjson.json', 'output_format': 'geojson_collection', 'class': 'stetl.inputs.fileinput.JsonFileInput'}
2019-03-22 22:19:55,829 fileinput INFO file_list=['https://raw.githubusercontent.com/justb4/stetl/master/examples/basics/10_jinja2_templating/input/cities-gjson.json']
2019-03-22 22:19:55,830 output INFO cfg = {'class': 'stetl.outputs.standardoutput.StandardOutput'}
2019-03-22 22:19:55,831 chain INFO Running Chain: input_geojson|filter_template_geojson2gml|output_std
2019-03-22 22:19:55,831 templatingfilter INFO Init: templating
2019-03-22 22:19:55,832 templatingfilter INFO Read JSON file with globals from: input/globals.json
2019-03-22 22:19:55,837 templatingfilter INFO Read JSON file with globals from: https://raw.githubusercontent.com/justb4/stetl/master/examples/basics/10_jinja2_templating/input/more-globals.json
2019-03-22 22:19:55,910 templatingfilter INFO template file read and template created OK: templates/cities-gjson2gml.jinja2
2019-03-22 22:19:55,911 fileinput INFO Read/parse for start for file=https://raw.githubusercontent.com/justb4/stetl/master/examples/basics/10_jinja2_templating/input/cities-gjson.json....
2019-03-22 22:19:55,974 fileinput INFO Read/parse ok for file=https://raw.githubusercontent.com/justb4/stetl/master/examples/basics/10_jinja2_templating/input/cities-gjson.json
2019-03-22 22:19:55,975 fileinput INFO all files done
2019-03-22 22:19:55,991 component INFO JsonFileInput invokes=1 time(total, min, max, avg) = 0.065 0.065 0.065 0.065
2019-03-22 22:19:55,992 templatingfilter INFO Exit: templating
2019-03-22 22:19:55,992 component INFO Jinja2TemplatingFilter invokes=1 time(total, min, max, avg) = 0.015 0.015 0.015 0.015
2019-03-22 22:19:55,993 component INFO StandardOutput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2019-03-22 22:19:55,993 chain INFO DONE - 1 rounds - chain=input_geojson|filter_template_geojson2gml|output_std
2019-03-22 22:19:55,994 chain INFO Assembling Chain: input_addresses_csv|convert_record_array_to_struct|filter_template_addresses2inspire|output_inspire_addresses...
2019-03-22 22:19:55,995 input INFO cfg = {'file_path': 'input/addresses.csv', 'class': 'stetl.inputs.fileinput.CsvFileInput'}
2019-03-22 22:19:55,997 fileinput INFO file_list=['input/addresses.csv']
2019-03-22 22:19:55,998 output INFO cfg = {'file_path': 'output/inspire-addresses.gml', 'class': 'stetl.outputs.fileoutput.FileOutput'}
2019-03-22 22:19:55,998 fileoutput INFO working dir /stetl/examples/basics/10_jinja2_templating
2019-03-22 22:19:55,999 chain INFO Running Chain: input_addresses_csv|convert_record_array_to_struct|filter_template_addresses2inspire|output_inspire_addresses
2019-03-22 22:19:55,999 fileinput INFO Open CSV file: input/addresses.csv
2019-03-22 22:19:56,002 templatingfilter INFO Init: templating
2019-03-22 22:19:56,002 templatingfilter INFO Read JSON file with globals from: input/addresses-globals.json
2019-03-22 22:19:56,054 templatingfilter INFO template file read and template created OK: templates/addresses2inspire-ad.jinja2
2019-03-22 22:19:56,069 fileoutput INFO writing to file output/inspire-addresses.gml
2019-03-22 22:19:56,074 fileoutput INFO written to output/inspire-addresses.gml
2019-03-22 22:19:56,074 component INFO CsvFileInput invokes=1 time(total, min, max, avg) = 0.002 0.002 0.002 0.002
2019-03-22 22:19:56,075 component INFO FormatConverter invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2019-03-22 22:19:56,075 templatingfilter INFO Exit: templating
2019-03-22 22:19:56,076 component INFO Jinja2TemplatingFilter invokes=1 time(total, min, max, avg) = 0.012 0.012 0.012 0.012
2019-03-22 22:19:56,076 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.005 0.005 0.005 0.005
2019-03-22 22:19:56,076 chain INFO DONE - 1 rounds - chain=input_addresses_csv|convert_record_array_to_struct|filter_template_addresses2inspire|output_inspire_addresses
2019-03-22 22:19:56,077 util INFO Timer end: total ETL time=1.0 sec
2019-03-22 22:19:56,077 ETL INFO ALL DONE
<?xml version='1.0' encoding='utf-8'?>
<cities:FeatureCollection xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xmlns:cities="http://cities.maptools.org/"
xmlns:gml="http://www.opengis.net/gml"
xsi:schemaLocation="http://cities.maptools.org/ ../gmlcities.xsd http://www.opengis.net/gml http://schemas.opengis.net/gml/2.1.2/feature.xsd">
<!--
Generated with a Jinja2 template. The 'globs' variables come from the file globals.json containing global
variables/structures. The actual/dynamic data (cities) comes from the input CSV file cities.json.
Also a file with macros templates/macros.tpl.xml is imported, allowing reuse for common structures like INSPIRE id's.
-->
<gml:description>
This example tests GML generation with Jinja2 templating, including the use of Jinja2 globals., such as for this description. Globals provide more or less constant/semi static information like point of contacts, global names, id-prefixes etc.
</gml:description>
<!-- Rendered by macro render_name() -->
<gml:name>
Test for GML generation via Jinja2 templating
</gml:name>
<!-- bbox present in geojson input -->
<gml:boundedBy>
<gml:Box>
<gml:coord>
<gml:X>4.88</gml:X>
<gml:Y>41.88</gml:Y>
</gml:coord>
<gml:coord>
<gml:X>12.52</gml:X>
<gml:Y>53.98</gml:Y>
</gml:coord>
</gml:Box>
</gml:boundedBy>
<gml:featureMember>
<cities:City>
<cities:name>Amsterdam</cities:name>
<cities:population>779808</cities:population>
<cities:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG::4258" gml:id="point-1"><gml:pos>52.373045454545455 4.894836363636363</gml:pos></gml:Point>
</cities:geometry>
</cities:City>
</gml:featureMember>
<gml:featureMember>
<cities:City>
<cities:name>Bonn</cities:name>
<cities:population>327913</cities:population>
<cities:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG::4258" gml:id="point-2"><gml:pos>50.734554545454543 7.099818181818182</gml:pos></gml:Point>
</cities:geometry>
</cities:City>
</gml:featureMember>
<gml:featureMember>
<cities:City>
<cities:name>Rome</cities:name>
<cities:population>2753000</cities:population>
<cities:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG::4258" gml:id="point-3"><gml:pos>41.88 12.52</gml:pos></gml:Point>
</cities:geometry>
</cities:City>
</gml:featureMember>
</cities:FeatureCollection>
/stetl/examples/basics
/stetl/examples/basics/11_formatconvert /stetl/examples/basics
==== running etl.sh for 11_formatconvert ====
2019-03-22 22:19:56,330 util INFO Found lxml.etree, native XML parsing, fabulous!
2019-03-22 22:19:56,377 util INFO Found GDAL/OGR Python bindings, super!!
2019-03-22 22:19:56,384 main INFO Stetl version = 2.0rc1
2019-03-22 22:19:56,386 ETL INFO INIT - Stetl version is 2.0rc1
2019-03-22 22:19:56,387 ETL INFO Config/working dir = /stetl/examples/basics/11_formatconvert
2019-03-22 22:19:56,388 ETL INFO Reading config_file = etl.cfg
2019-03-22 22:19:56,394 ETL INFO START
2019-03-22 22:19:56,395 util INFO Timer start: total ETL
2019-03-22 22:19:56,395 chain INFO Assembling Chain: input_xml_file|convert_xml_to_string|convert_string_to_xml|output_xml_file...
2019-03-22 22:19:56,399 input INFO cfg = {'class': 'stetl.inputs.fileinput.XmlFileInput', 'file_path': 'input/cities.xml'}
2019-03-22 22:19:56,402 fileinput INFO file_list=['input/cities.xml']
2019-03-22 22:19:56,404 output INFO cfg = {'class': 'stetl.outputs.fileoutput.FileOutput', 'file_path': 'output/cities.xml'}
2019-03-22 22:19:56,405 fileoutput INFO working dir /stetl/examples/basics/11_formatconvert
2019-03-22 22:19:56,406 chain INFO Running Chain: input_xml_file|convert_xml_to_string|convert_string_to_xml|output_xml_file
2019-03-22 22:19:56,406 fileinput INFO Read/parse for start for file=input/cities.xml....
2019-03-22 22:19:56,411 fileinput INFO Read/parse ok for file=input/cities.xml
2019-03-22 22:19:56,411 fileinput INFO all files done
2019-03-22 22:19:56,412 fileoutput INFO writing to file output/cities.xml
2019-03-22 22:19:56,417 fileoutput INFO written to output/cities.xml
2019-03-22 22:19:56,418 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.006 0.006 0.006 0.006
2019-03-22 22:19:56,418 component INFO FormatConverter invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2019-03-22 22:19:56,418 component INFO FormatConverter invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2019-03-22 22:19:56,419 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.006 0.006 0.006 0.006
2019-03-22 22:19:56,419 chain INFO DONE - 1 rounds - chain=input_xml_file|convert_xml_to_string|convert_string_to_xml|output_xml_file
2019-03-22 22:19:56,420 chain INFO Assembling Chain: input_complex_xml_file|convert_to_json|output_json_file...
2019-03-22 22:19:56,420 input INFO cfg = {'class': 'stetl.inputs.fileinput.XmlFileInput', 'file_path': 'input/building-dutch-bag.xml'}
2019-03-22 22:19:56,422 fileinput INFO file_list=['input/building-dutch-bag.xml']
2019-03-22 22:19:56,423 output INFO cfg = {'class': 'stetl.outputs.fileoutput.FileOutput', 'file_path': 'output/building-dutch.json'}
2019-03-22 22:19:56,423 fileoutput INFO working dir /stetl/examples/basics/11_formatconvert
2019-03-22 22:19:56,424 chain INFO Running Chain: input_complex_xml_file|convert_to_json|output_json_file
2019-03-22 22:19:56,424 fileinput INFO Read/parse for start for file=input/building-dutch-bag.xml....
2019-03-22 22:19:56,431 fileinput INFO Read/parse ok for file=input/building-dutch-bag.xml
2019-03-22 22:19:56,432 fileinput INFO all files done
2019-03-22 22:19:56,439 fileoutput INFO writing to file output/building-dutch.json
2019-03-22 22:19:56,447 fileoutput INFO written to output/building-dutch.json
2019-03-22 22:19:56,448 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.008 0.008 0.008 0.008
2019-03-22 22:19:56,449 component INFO FormatConverter invokes=1 time(total, min, max, avg) = 0.007 0.007 0.007 0.007
2019-03-22 22:19:56,449 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.009 0.009 0.009 0.009
2019-03-22 22:19:56,450 chain INFO DONE - 1 rounds - chain=input_complex_xml_file|convert_to_json|output_json_file
2019-03-22 22:19:56,450 chain INFO Assembling Chain: input_gml_sf_file|convert_to_geojson|output_geojson_file...
2019-03-22 22:19:56,451 input INFO cfg = {'class': 'stetl.inputs.fileinput.XmlFileInput', 'file_path': 'input/cities.gml'}
2019-03-22 22:19:56,453 fileinput INFO file_list=['input/cities.gml']
2019-03-22 22:19:56,454 output INFO cfg = {'class': 'stetl.outputs.fileoutput.FileOutput', 'file_path': 'output/cities-gjson.json'}
2019-03-22 22:19:56,454 fileoutput INFO working dir /stetl/examples/basics/11_formatconvert
2019-03-22 22:19:56,454 chain INFO Running Chain: input_gml_sf_file|convert_to_geojson|output_geojson_file
2019-03-22 22:19:56,455 fileinput INFO Read/parse for start for file=input/cities.gml....
2019-03-22 22:19:56,459 fileinput INFO Read/parse ok for file=input/cities.gml
2019-03-22 22:19:56,459 fileinput INFO all files done
2019-03-22 22:19:56,461 fileoutput INFO writing to file output/cities-gjson.json
2019-03-22 22:19:56,466 fileoutput INFO written to output/cities-gjson.json
2019-03-22 22:19:56,467 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.005 0.005 0.005 0.005
2019-03-22 22:19:56,467 component INFO FormatConverter invokes=1 time(total, min, max, avg) = 0.001 0.001 0.001 0.001
2019-03-22 22:19:56,467 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.006 0.006 0.006 0.006
2019-03-22 22:19:56,468 chain INFO DONE - 1 rounds - chain=input_gml_sf_file|convert_to_geojson|output_geojson_file
2019-03-22 22:19:56,469 util INFO Timer end: total ETL time=0.0 sec
2019-03-22 22:19:56,470 ETL INFO ALL DONE
/stetl/examples/basics
/stetl/examples/basics/12_gdal_ogr /stetl/examples/basics
==== running etl.sh for 12_gdal_ogr ====
2019-03-22 22:19:56,719 util INFO Found lxml.etree, native XML parsing, fabulous!
2019-03-22 22:19:56,765 util INFO Found GDAL/OGR Python bindings, super!!
2019-03-22 22:19:56,773 main INFO Stetl version = 2.0rc1
2019-03-22 22:19:56,774 ETL INFO INIT - Stetl version is 2.0rc1
2019-03-22 22:19:56,776 ETL INFO Config/working dir = /stetl/examples/basics/12_gdal_ogr
2019-03-22 22:19:56,777 ETL INFO Reading config_file = etl.cfg
2019-03-22 22:19:56,782 ETL INFO START
2019-03-22 22:19:56,783 util INFO Timer start: total ETL
2019-03-22 22:19:56,783 chain INFO Assembling Chain: input_geojson_file|geojson_coll_to_ogr_feature_arr|output_ogr_gmlfile...
2019-03-22 22:19:56,788 input INFO cfg = {'file_path': 'input/cities.geojson', 'output_format': 'geojson_collection', 'class': 'stetl.inputs.fileinput.JsonFileInput'}
2019-03-22 22:19:56,790 fileinput INFO file_list=['input/cities.geojson']
2019-03-22 22:19:56,793 output INFO cfg = {'overwrite': 'True', 'dest_data_source': 'output/cities.gml', 'class': 'stetl.outputs.ogroutput.OgrOutput', 'dest_format': 'GML', 'new_layer_name': 'cities', 'input_format': 'ogr_feature_array'}
2019-03-22 22:19:56,794 chain INFO Running Chain: input_geojson_file|geojson_coll_to_ogr_feature_arr|output_ogr_gmlfile
2019-03-22 22:19:56,794 ogroutput INFO Using GDAL/OGR version: 1100100
2019-03-22 22:19:56,816 ogroutput INFO Opened OGR dest ok: output/cities.gml
2019-03-22 22:19:56,817 fileinput INFO Read/parse for start for file=input/cities.geojson....
2019-03-22 22:19:56,822 fileinput INFO Read/parse ok for file=input/cities.geojson
2019-03-22 22:19:56,822 fileinput INFO all files done
2019-03-22 22:19:56,823 ogroutput INFO End writing to: output/cities.gml
2019-03-22 22:19:56,829 component INFO JsonFileInput invokes=1 time(total, min, max, avg) = 0.006 0.006 0.006 0.006
2019-03-22 22:19:56,830 component INFO FormatConverter invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2019-03-22 22:19:56,830 component INFO OgrOutput invokes=1 time(total, min, max, avg) = 0.006 0.006 0.006 0.006
2019-03-22 22:19:56,831 chain INFO DONE - 1 rounds - chain=input_geojson_file|geojson_coll_to_ogr_feature_arr|output_ogr_gmlfile
2019-03-22 22:19:56,831 chain INFO Assembling Chain: input_gml_file_to_array|ogr_feature_array_to_geojson_collection|tolowercase_filter|output_file...
2019-03-22 22:19:56,833 input INFO cfg = {'output_format': 'ogr_feature_array', 'data_source': 'input/cities.gml', 'class': 'stetl.inputs.ogrinput.OgrInput', 'source_format': 'GML'}
2019-03-22 22:19:56,844 output INFO cfg = {'file_path': 'output/cities.geojson', 'class': 'stetl.outputs.fileoutput.FileOutput'}
2019-03-22 22:19:56,844 fileoutput INFO working dir /stetl/examples/basics/12_gdal_ogr
2019-03-22 22:19:56,845 chain INFO Running Chain: input_gml_file_to_array|ogr_feature_array_to_geojson_collection|tolowercase_filter|output_file
2019-03-22 22:19:56,845 ogrinput INFO Using GDAL/OGR version: 1100100
2019-03-22 22:19:56,854 ogrinput INFO Opened OGR source ok: input/cities.gml layer count=1
2019-03-22 22:19:56,854 ogrinput INFO Start reading from OGR Source: input/cities.gml, Layer: heronfeat
2019-03-22 22:19:56,855 ogrinput INFO End reading all features from Layer: heronfeat count=5
2019-03-22 22:19:56,864 fileoutput INFO writing to file output/cities.geojson
2019-03-22 22:19:56,869 fileoutput INFO written to output/cities.geojson
2019-03-22 22:19:56,869 ogrinput INFO Closing OGR source: input/cities.gml
2019-03-22 22:19:56,870 component INFO OgrInput invokes=2 time(total, min, max, avg) = 0.003 0.001 0.002 0.001
2019-03-22 22:19:56,871 component INFO FormatConverter invokes=2 time(total, min, max, avg) = 0.008 0.008 0.008 0.004
2019-03-22 22:19:56,871 component INFO ToLowerFilter invokes=2 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2019-03-22 22:19:56,872 component INFO FileOutput invokes=2 time(total, min, max, avg) = 0.005 0.005 0.005 0.003
2019-03-22 22:19:56,872 chain INFO DONE - 2 rounds - chain=input_gml_file_to_array|ogr_feature_array_to_geojson_collection|tolowercase_filter|output_file
2019-03-22 22:19:56,872 chain INFO Assembling Chain: input_gml_file|output_ogr_shapefile...
2019-03-22 22:19:56,873 input INFO cfg = {'output_format': 'ogr_feature', 'data_source': 'input/cities.gml', 'class': 'stetl.inputs.ogrinput.OgrInput', 'source_format': 'GML', 'source_options': "{'GDAL_CACHEMAX': '64', 'CPL_DEBUG': 'OFF'}"}
2019-03-22 22:19:56,873 output INFO cfg = {'overwrite': 'True', 'dest_data_source': 'output/cities.shp', 'class': 'stetl.outputs.ogroutput.OgrOutput', 'dest_format': 'ESRI Shapefile', 'new_layer_name': 'cities', 'input_format': 'ogr_feature'}
2019-03-22 22:19:56,874 chain INFO Running Chain: input_gml_file|output_ogr_shapefile
2019-03-22 22:19:56,874 ogrinput INFO Using GDAL/OGR version: 1100100
2019-03-22 22:19:56,884 ogrinput INFO Opened OGR source ok: input/cities.gml layer count=1
2019-03-22 22:19:56,884 ogroutput INFO Using GDAL/OGR version: 1100100
2019-03-22 22:19:56,913 ogroutput INFO Opened OGR dest ok: output/cities.shp
2019-03-22 22:19:56,914 ogrinput INFO Start reading from OGR Source: input/cities.gml, Layer: heronfeat
2019-03-22 22:19:56,918 ogrinput INFO End reading from Layer: heronfeat
2019-03-22 22:19:56,918 ogroutput INFO End writing to: output/cities.shp
2019-03-22 22:19:56,923 ogrinput INFO Closing OGR source: input/cities.gml
2019-03-22 22:19:56,924 ogroutput INFO End writing to: output/cities.shp
2019-03-22 22:19:56,925 component INFO OgrInput invokes=7 time(total, min, max, avg) = 0.003 0.001 0.002 0.000
2019-03-22 22:19:56,925 component INFO OgrOutput invokes=7 time(total, min, max, avg) = 0.008 0.001 0.005 0.001
2019-03-22 22:19:56,926 chain INFO DONE - 7 rounds - chain=input_gml_file|output_ogr_shapefile
2019-03-22 22:19:56,927 util INFO Timer end: total ETL time=0.0 sec
2019-03-22 22:19:56,927 ETL INFO ALL DONE
/stetl/examples/basics
/stetl/examples/basics/13_dbinput /stetl/examples/basics
==== running etl.sh for 13_dbinput ====
2019-03-22 22:19:57,177 util INFO Found lxml.etree, native XML parsing, fabulous!
2019-03-22 22:19:57,225 util INFO Found GDAL/OGR Python bindings, super!!
2019-03-22 22:19:57,233 main INFO Stetl version = 2.0rc1
2019-03-22 22:19:57,234 ETL INFO INIT - Stetl version is 2.0rc1
2019-03-22 22:19:57,236 ETL INFO Config/working dir = /stetl/examples/basics/13_dbinput
2019-03-22 22:19:57,237 ETL INFO Reading config_file = etl.cfg
2019-03-22 22:19:57,243 ETL INFO START
2019-03-22 22:19:57,243 util INFO Timer start: total ETL
2019-03-22 22:19:57,244 chain INFO Assembling Chain: input_sqlite_all|convert_records_to_json|output_cities_file...
/usr/local/lib/python3.4/site-packages/psycopg2/__init__.py:144: UserWarning: The psycopg2 wheel package will be renamed from release 2.8; in order to keep installing from binary please use "pip install psycopg2-binary" instead. For details see: <http://initd.org/psycopg/docs/install.html#binary-install-from-pypi>.
""")
2019-03-22 22:19:57,270 input INFO cfg = {'output_format': 'record_array', 'class': 'stetl.inputs.dbinput.SqliteDbInput', 'database_name': 'input/cities.sdb', 'table': 'cities', 'query': 'select * from cities', 'read_once': 'True'}
2019-03-22 22:19:57,275 output INFO cfg = {'class': 'stetl.outputs.fileoutput.FileOutput', 'file_path': 'output/cities.json'}
2019-03-22 22:19:57,276 fileoutput INFO working dir /stetl/examples/basics/13_dbinput
2019-03-22 22:19:57,277 chain INFO Running Chain: input_sqlite_all|convert_records_to_json|output_cities_file
2019-03-22 22:19:57,277 dbinput INFO Connect to SQLite DB: input/cities.sdb
2019-03-22 22:19:57,287 dbinput INFO Connect to SQLite DB: input/cities.sdb
2019-03-22 22:19:57,295 dbinput INFO 3 records read
2019-03-22 22:19:57,297 dbinput INFO Nothing to do. All file_records done
2019-03-22 22:19:57,297 fileoutput INFO writing to file output/cities.json
2019-03-22 22:19:57,303 fileoutput INFO written to output/cities.json
2019-03-22 22:19:57,303 component INFO SqliteDbInput invokes=1 time(total, min, max, avg) = 0.010 0.010 0.010 0.010
2019-03-22 22:19:57,304 component INFO FormatConverter invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2019-03-22 22:19:57,304 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.006 0.006 0.006 0.006
2019-03-22 22:19:57,305 chain INFO DONE - 1 rounds - chain=input_sqlite_all|convert_records_to_json|output_cities_file
2019-03-22 22:19:57,305 chain INFO Assembling Chain: input_sqlite_single|convert_record_to_json|output_city_file...
2019-03-22 22:19:57,306 input INFO cfg = {'output_format': 'record', 'class': 'stetl.inputs.dbinput.SqliteDbInput', 'database_name': 'input/cities.sdb', 'table': 'cities', 'query': "select * from cities where name = 'Rome'", 'read_once': 'True'}
2019-03-22 22:19:57,307 output INFO cfg = {'class': 'stetl.outputs.fileoutput.FileOutput', 'file_path': 'output/city.json'}
2019-03-22 22:19:57,307 fileoutput INFO working dir /stetl/examples/basics/13_dbinput
2019-03-22 22:19:57,308 chain INFO Running Chain: input_sqlite_single|convert_record_to_json|output_city_file
2019-03-22 22:19:57,308 dbinput INFO Connect to SQLite DB: input/cities.sdb
2019-03-22 22:19:57,318 dbinput INFO Connect to SQLite DB: input/cities.sdb
2019-03-22 22:19:57,323 dbinput INFO 1 records read
2019-03-22 22:19:57,325 dbinput INFO Nothing to do. All file_records done
2019-03-22 22:19:57,325 fileoutput INFO writing to file output/city.json
2019-03-22 22:19:57,331 fileoutput INFO written to output/city.json
2019-03-22 22:19:57,332 component INFO SqliteDbInput invokes=1 time(total, min, max, avg) = 0.007 0.007 0.007 0.007
2019-03-22 22:19:57,332 component INFO FormatConverter invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2019-03-22 22:19:57,333 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.006 0.006 0.006 0.006
2019-03-22 22:19:57,333 chain INFO DONE - 1 rounds - chain=input_sqlite_single|convert_record_to_json|output_city_file
2019-03-22 22:19:57,334 util INFO Timer end: total ETL time=0.0 sec
2019-03-22 22:19:57,334 ETL INFO ALL DONE
/stetl/examples/basics
/stetl/examples/basics/14_logfileinput /stetl/examples/basics
==== running etl.sh for 14_logfileinput ====
2019-03-22 22:19:57,565 util INFO Found lxml.etree, native XML parsing, fabulous!
2019-03-22 22:19:57,612 util INFO Found GDAL/OGR Python bindings, super!!
2019-03-22 22:19:57,618 main INFO Stetl version = 2.0rc1
2019-03-22 22:19:57,620 ETL INFO INIT - Stetl version is 2.0rc1
2019-03-22 22:19:57,621 ETL INFO Config/working dir = /stetl/examples/basics/14_logfileinput
2019-03-22 22:19:57,622 ETL INFO Reading config_file = etl.cfg
2019-03-22 22:19:57,626 ETL WARNING Expanding config arguments (non fatal yet): argument of type 'NoneType' is not iterable
2019-03-22 22:19:57,627 ETL INFO START
2019-03-22 22:19:57,627 util INFO Timer start: total ETL
2019-03-22 22:19:57,628 chain INFO Assembling Chain: input_apache_log|to_record_array|output_std...
2019-03-22 22:19:57,633 input INFO cfg = {'class': 'stetl.inputs.fileinput.ApacheLogFileInput', 'log_format': '%h %l %u %t \\"%r\\" %>s %b \\"%{Referer}i\\" \\"%{User-agent}i\\" %D', 'file_path': 'input', 'key_map': '{\'%>s\': \'status\', \'%D\': \'deltat\', \'%{User-agent}i\': \'agent\', \'%b\': \'bytes\', \'%{Referer}i\': \'referer\', \'%t\': \'time\', "\'%h": \'host\', \'%r\': \'request\'}', 'filename_pattern': '*.log'}
2019-03-22 22:19:57,638 fileinput INFO file_list=['input/apache.log', 'input/apache2.log']
2019-03-22 22:19:57,641 output INFO cfg = {'class': 'stetl.outputs.standardoutput.StandardOutput'}
2019-03-22 22:19:57,641 chain INFO Running Chain: input_apache_log|to_record_array|output_std
2019-03-22 22:19:57,643 fileinput INFO file opened : input/apache.log
2019-03-22 22:19:57,646 fileinput INFO EOF file
2019-03-22 22:19:57,649 fileinput INFO file opened : input/apache2.log
[{'key': '3a3589c8da99e1a4ad2cfa4baf439551', 'status': 200, 'request': '/map/gast/tms/1.0.0/opentopo/EPSG28992/6/32/40.png', 'time': 20150420084459, 'deltat': 2580, 'referer': 'http://217.21.192.135/sekaarten/?id=baggeren', 'bytes': 32085, 'agent': 'Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; rv:11.0) like Gecko'}, {'key': '1d084c702d7de9a3c233c918ec39b20b', 'status': 200, 'request': '/map/gast/tms/1.0.0/opentopo/EPSG28992/6/32/41.png', 'time': 20150420084459, 'deltat': 2939, 'referer': 'http://217.21.192.135/sekaarten/?id=baggeren', 'bytes': 10891, 'agent': 'Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; rv:11.0) like Gecko'}, {'key': 'e96220cf161b72970a7394232e61bb48', 'status': 200, 'request': '/map/gast/tms/1.0.0/opentopo/EPSG28992/8/93/112.png', 'time': 20150422150832, 'deltat': 30144, 'referer': 'http://kadviewer.kademo.nl/', 'bytes': 6859, 'agent': 'Mozilla/5.0 (Windows NT 6.1; Trident/7.0; rv:11.0) like Gecko'}, {'key': '76a5a5b8daddb9ee6c5b5dec8b70779a', 'status': 200, 'request': '/map/gast/tms/1.0.0/opentopo/EPSG28992/12/2306/1962.png', 'time': 20150422151830, 'deltat': 109691, 'referer': 'http://kadviewer.kademo.nl/', 'bytes': 19305, 'agent': 'Mozilla/5.0 (Windows NT 6.1; Trident/7.0; rv:11.0) like Gecko'}, {'key': '17ca27452b4323d6a6825e5d2c42d80e', 'status': 404, 'request': '/map/gast/tms/1.0.0/bonne_test/EPSG900913/1', 'time': 20150422153023, 'deltat': 1817, 'referer': None, 'bytes': 141, 'agent': 'Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)'}, {'key': '56065549a4e881b1d73ebd99ac53f718', 'status': 200, 'request': '/map/gast/tiles/opentopo/EPSG900913/9/263/167.png', 'time': 20150422154124, 'deltat': 2208, 'referer': 'http://app.nlextract.nl/ot/opentopo.html', 'bytes': 30537, 'agent': 'Mozilla/5.0 (iPad; CPU OS 8_3 like Mac OS X) AppleWebKit/600.1.4 (KHTML, like Gecko) Version/8.0 Mobile/12F69 Safari/600.1.4'}, {'key': 'c3c8b74e634101a60d9a66493dfd1589', 'status': 200, 'request': '/map/gast/tiles/opentopo/EPSG900913/9/262/167.png', 'time': 20150422154124, 'deltat': 1992, 'referer': 'http://app.nlextract.nl/ot/opentopo.html', 'bytes': 26812, 'agent': 'Mozilla/5.0 (iPad; CPU OS 8_3 like Mac OS X) AppleWebKit/600.1.4 (KHTML, like Gecko) Version/8.0 Mobile/12F69 Safari/600.1.4'}, {'key': '9dd101a6505f7f0ad3c761a5b2773d7d', 'status': 304, 'request': '/map/gast/tms/1.0.0/opentopo/EPSG28992/13/4187/3689.png', 'time': 20150421123121, 'deltat': 2639355, 'referer': None, 'bytes': 0, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': 'b3cb64d87c2fd56a9c39c0285ff3f9c2', 'status': 200, 'request': '/map/gast/tms/1.0.0/opentopo/EPSG28992/13/4187/3689.png', 'time': 20150421123142, 'deltat': 313308, 'referer': None, 'bytes': 36969, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': 'f9f4683cd9dde640b2ae599631198475', 'status': 404, 'request': '/favicon.ico', 'time': 20150421123143, 'deltat': 383, 'referer': 'http://s.test.map5.nl/map/gast/tms/1.0.0/opentopo/EPSG28992/13/4187/3689.png', 'bytes': 279, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}]
[{'key': 'fc13bf751bd5f2d30e58b1dab897fd9f', 'status': 500, 'request': '/map/gast/wmts', 'time': 20150421123333, 'deltat': 251096, 'referer': None, 'bytes': 469, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': 'b25bb9dbb324a3261ad630465e21f081', 'status': 301, 'request': '/map/gast', 'time': 20150421123346, 'deltat': 240, 'referer': None, 'bytes': 297, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': '37f931cbdeea1bd2d97e45c429bd8412', 'status': 200, 'request': '/map/gast/demo/', 'time': 20150421123354, 'deltat': 309244, 'referer': None, 'bytes': 1912, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': 'fd86097f57e403c78b47a13bc50d01d4', 'status': 200, 'request': '/map/gast/demo/static/logo.png', 'time': 20150421123354, 'deltat': 93184, 'referer': 'http://s.test.map5.nl/map/gast/demo/', 'bytes': 1368, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': 'fdb800acc46fc1d151e5b71cf63a6f1d', 'status': 200, 'request': '/map/gast/demo/static/site.css', 'time': 20150421123354, 'deltat': 273346, 'referer': 'http://s.test.map5.nl/map/gast/demo/', 'bytes': 686, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': '927418d112a3ea48d026d7c5e81e31fe', 'status': 200, 'request': '/map/gast/wmts/1.0.0/WMTSCapabilities.xml', 'time': 20150421123400, 'deltat': 315229, 'referer': None, 'bytes': 20873, 'agent': 'Python-urllib/2.7'}, {'key': '5ff5a5507519c7c6696e1bcc378916d4', 'status': 200, 'request': '/map/gast/demo/?wmts_capabilities', 'time': 20150421123400, 'deltat': 623112, 'referer': 'http://s.test.map5.nl/map/gast/demo/', 'bytes': 2522, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': '0ddeb36ca0dcbc1bd47dc0e382f43ccc', 'status': 200, 'request': '/map/gast/demo/static/site.css', 'time': 20150421123401, 'deltat': 233173, 'referer': 'http://s.test.map5.nl/map/gast/demo/?wmts_capabilities', 'bytes': 686, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': '3fa2f7b728b651de6f3ecca01f97a83d', 'status': 200, 'request': '/map/gast/demo/static/logo.png', 'time': 20150421123401, 'deltat': 219583, 'referer': 'http://s.test.map5.nl/map/gast/demo/?wmts_capabilities', 'bytes': 1368, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': '7690b82905bf0a885ebc03da0e6616c7', 'status': 200, 'request': '/map/gast/wmts/1.0.0/WMTSCapabilities.xml', 'time': 20150421123416, 'deltat': 18173, 'referer': 'http://s.test.map5.nl/map/gast/demo/', 'bytes': 2093, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}]
[{'key': 'b77ee455d69c470e371b1f5c292df2cf', 'status': 500, 'request': '/map/gast/wmts/1.0.0', 'time': 20150421123420, 'deltat': 3407, 'referer': None, 'bytes': 475, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': '9c3cfcfda14cf2245be08c8ef71d2267', 'status': 500, 'request': '/map/gast/wmts/1.0.0?SERVICE=WMS&REQUEST=GetCapabilities', 'time': 20150421123447, 'deltat': 3203, 'referer': None, 'bytes': 475, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': '9a320bb3cfd4f6c134caa7063c76bcf3', 'status': 500, 'request': '/map/gast/wmts/1.0.0?SERVICE=WMS&REQUEST=GetCapabilities', 'time': 20150421123447, 'deltat': 3017, 'referer': None, 'bytes': 475, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': 'cc57618237b53725a3ee90c8d5f7c1a1', 'status': 500, 'request': '/map/gast/wmts/1.0.0?service=WMTS&SERVICE=WMS&REQUEST=GetCapabilities', 'time': 20150421123527, 'deltat': 2807, 'referer': None, 'bytes': 475, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': 'ae456061214d7e4df27e406dab5a8adc', 'status': 500, 'request': '/map/gast/wmts/1.0.0?service=WMTS&SERVICE=WMS&REQUEST=GetCapabilities', 'time': 20150421123527, 'deltat': 2838, 'referer': None, 'bytes': 475, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': 'e081f3f758ae6d576d2a5b9c759e100d', 'status': 200, 'request': '/map/gast/service?REQUEST=GetCapabilities', 'time': 20150421123610, 'deltat': 355693, 'referer': 'http://s.test.map5.nl/map/gast/demo/', 'bytes': 11637, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': '2b4776d82dbfca56eb7a158598d9e5c9', 'status': 200, 'request': '/map/gast/service?REQUEST=GetCapabilities', 'time': 20150421123613, 'deltat': 20349, 'referer': None, 'bytes': 11637, 'agent': 'Python-urllib/2.7'}, {'key': '0eae782262946407d202efb59b87bea3', 'status': 200, 'request': '/map/gast/demo/?wms_capabilities', 'time': 20150421123613, 'deltat': 33616, 'referer': 'http://s.test.map5.nl/map/gast/demo/', 'bytes': 2118, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': '2b674278396f7e4be03ae5df79616e01', 'status': 200, 'request': '/map/gast/demo/static/site.css', 'time': 20150421123613, 'deltat': 11009, 'referer': 'http://s.test.map5.nl/map/gast/demo/?wms_capabilities', 'bytes': 686, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': '0fbef65ceebfd0a53a24a67f2b534f64', 'status': 200, 'request': '/map/gast/demo/static/logo.png', 'time': 20150421123613, 'deltat': 548, 'referer': 'http://s.test.map5.nl/map/gast/demo/?wms_capabilities', 'bytes': 1368, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}]
[{'key': '9f252dda369b0991378e0002ff747066', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&REQUEST=GetCapabilities', 'time': 20150421123639, 'deltat': 243456, 'referer': None, 'bytes': 11637, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': '8e3c2ba8bf2a77619563064d7aec48e8', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&REQUEST=GetCapabilities', 'time': 20150421123657, 'deltat': 18184, 'referer': None, 'bytes': 11637, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': '0e0c5ca42cd927560642ba4f653c37e0', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&SLD_VERSION=1.1.0&REQUEST=GetLegendGraphic&FORMAT=image/jpeg&LAYER=opentopo&STYLE=', 'time': 20150421123657, 'deltat': 23229, 'referer': None, 'bytes': 299, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': '728a83ce640cbc2e216d473338b6bc1d', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.88164117735196346,52.31994791109101328,4.89823868298099274,52.32472313490021776&SRS=EPSG:4326&WIDTH=2304&HEIGHT=663&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421123657, 'deltat': 2497535, 'referer': None, 'bytes': 435275, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': 'cd40c6c9517328aa245d0d6e5921c505', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.88229860033138774,52.32140511929905102,4.89059794862468866,52.32379346153169308&SRS=EPSG:4326&WIDTH=2304&HEIGHT=663&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421123831, 'deltat': 2524536, 'referer': None, 'bytes': 303472, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': '450ac577d203446eba69768c6affe182', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.88262727962318266,52.32213390486452909,4.88677710265483434,52.32332825857095315&SRS=EPSG:4326&WIDTH=2304&HEIGHT=663&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421123835, 'deltat': 100590, 'referer': None, 'bytes': 211421, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': '2031d456829cc9d6ab970422c90b9b48', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.87973479282001321,52.32194070900506233,4.88388482393072909,52.32313536508878826&SRS=EPSG:4326&WIDTH=2303&HEIGHT=663&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421123836, 'deltat': 733634, 'referer': None, 'bytes': 203168, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': '0ace604b9167add63693acb024c20382', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.87937162596551133,52.32102294377313711,4.88767136038388816,52.32341189790105318&SRS=EPSG:4326&WIDTH=2304&HEIGHT=663&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421123840, 'deltat': 720723, 'referer': None, 'bytes': 285902, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': 'a1c2b0a1f04af1de85f3a0bf0c7a8800', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.87864515655996378,52.31919416543242818,4.89524331676138758,52.32397064165057543&SRS=EPSG:4326&WIDTH=2304&HEIGHT=663&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421123842, 'deltat': 208428, 'referer': None, 'bytes': 415065, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': '3c8b1445048b0e580fac3390cb2091fc', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.87719189388992547,52.31554442593828469,4.91038298583838273,52.32509165098211668&SRS=EPSG:4326&WIDTH=2304&HEIGHT=663&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421123843, 'deltat': 2053654, 'referer': None, 'bytes': 533192, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}]
[{'key': 'd05312a6597600ca85aaa8b308a0c75c', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.87428421837786807,52.30826341961707726,4.94064551776737115,52.32733496592636868&SRS=EPSG:4326&WIDTH=2306&HEIGHT=663&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421123846, 'deltat': 2593224, 'referer': None, 'bytes': 682877, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': 'a5b3a08668ff94c8598750848981667f', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.86846485697270648,52.29372410561443019,5.0011039973744742,52.33177562740801392&SRS=EPSG:4326&WIDTH=2299&HEIGHT=659&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421123849, 'deltat': 1725956, 'referer': None, 'bytes': 844321, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': '2c8095c6af22634f68400ab75ebbdc46', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.8386881899267058,52.26824729178458995,5.10374475576453523,52.34410523064467924&SRS=EPSG:4326&WIDTH=2302&HEIGHT=659&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421123853, 'deltat': 716366, 'referer': None, 'bytes': 812335, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': '109cf66bd9a44fc1a304c96dbd7e7ba1', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.77894557379025109,52.21751645706958556,5.30817506128564354,52.36825370247181155&SRS=EPSG:4326&WIDTH=2298&HEIGHT=655&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421123855, 'deltat': 692476, 'referer': None, 'bytes': 779078, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': '4c9075307b9f2fb8cb577fd9403fe530', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.65903537607470053,52.11649001307762319,5.72053894950784159,52.41540823102885582&SRS=EPSG:4326&WIDTH=2309&HEIGHT=650&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421123857, 'deltat': 695197, 'referer': None, 'bytes': 682860, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': '74c554ec9cc5efabadf6f5dea635bd06', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.4167226914176565,51.91069625797302223,6.55825004706046322,52.51214626634031646&SRS=EPSG:4326&WIDTH=2320&HEIGHT=651&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421123859, 'deltat': 591190, 'referer': None, 'bytes': 817945, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': 'e17f6e3bcce09653ed7f4aba653df0a6', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=3.91960989940337212,51.47689466327312147,7.27517291177000036,52.7270589886328267&SRS=EPSG:4326&WIDTH=1819&HEIGHT=678&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421123901, 'deltat': 287085, 'referer': None, 'bytes': 593483, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': '1afc39c5205b64c519582cd0e0da1923', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=3.19733405078999988,50.67175914229999734,7.27517291177000036,53.22782022896856802&SRS=EPSG:4326&WIDTH=1106&HEIGHT=693&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421123903, 'deltat': 198528, 'referer': None, 'bytes': 317587, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': '9e2e3fc6ffef97aad540a51ed075255e', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=3.91960989940337212,51.47689466327312147,7.27517291177000036,52.7270589886328267&SRS=EPSG:4326&WIDTH=1819&HEIGHT=678&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421123905, 'deltat': 441662, 'referer': None, 'bytes': 593483, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': '3cca37318f9e175ea24014d70790adfe', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.41536394174170166,51.91072288572560467,6.5568903118917472,52.51213375315666809&SRS=EPSG:4326&WIDTH=2320&HEIGHT=651&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421123906, 'deltat': 280547, 'referer': None, 'bytes': 816821, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}]
[{'key': '974e99ce0716bf1b23e6eb4ef037f3bf', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.65634629858872362,52.116047279264194,5.71784019987099157,52.41501733832054555&SRS=EPSG:4326&WIDTH=2308&HEIGHT=650&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421123906, 'deltat': 1008772, 'referer': None, 'bytes': 687988, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': '3c5e0760f744d9a4c3717d5417925ce0', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.77526617288530009,52.21666243590728129,5.30452226852465358,52.36744868951445397&SRS=EPSG:4326&WIDTH=2298&HEIGHT=655&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421123908, 'deltat': 252914, 'referer': None, 'bytes': 780735, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': '81047645093ca25af14caff9f1e5a62d', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.83418264422592525,52.26709043929363219,5.09925482811618025,52.34297845193199805&SRS=EPSG:4326&WIDTH=2301&HEIGHT=659&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421123909, 'deltat': 1417207, 'referer': None, 'bytes': 811840, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': '6027477daff12771656e7cc380281b3b', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.86354731013050845,52.29241753793147041,4.99619483822194965,52.33048548888342566&SRS=EPSG:4326&WIDTH=2298&HEIGHT=659&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421123911, 'deltat': 390434, 'referer': None, 'bytes': 847725, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': 'c55c2e7a861238ae5fd651cdd935e794', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.7983907345342578,52.30068851058355506,4.9312260836665196,52.33897414157453909&SRS=EPSG:4326&WIDTH=2311&HEIGHT=666&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421123926, 'deltat': 563186, 'referer': None, 'bytes': 787450, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': 'b7e838751d57e3e1ae877ef133b26ac0', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.82507774754855934,52.31044365558483378,4.89150389391215157,52.32959746344092622&SRS=EPSG:4326&WIDTH=2311&HEIGHT=666&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421123930, 'deltat': 927171, 'referer': None, 'bytes': 688485, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': 'a37e724dac90bc7c562b66ce8d7fc928', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.83838815624467333,52.31532167233618935,4.87160336391397841,52.32490134373566093&SRS=EPSG:4326&WIDTH=2310&HEIGHT=666&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421123932, 'deltat': 440856, 'referer': None, 'bytes': 628432, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': '5bd9f9c57282233337bcf62d6f7e91d8', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.84504031284738623,52.31776082437207975,4.86164845074635377,52.32255135217919673&SRS=EPSG:4326&WIDTH=2310&HEIGHT=666&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421123936, 'deltat': 1516336, 'referer': None, 'bytes': 486076, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': 'aba89b0c68f807506f8dd88f2a8c739d', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.848365629293232,52.31898043640777018,4.85666983181408707,52.32137587336808338&SRS=EPSG:4326&WIDTH=2310&HEIGHT=666&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421123940, 'deltat': 1670260, 'referer': None, 'bytes': 282828, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': '279fd18856e6ba1079927b15b784556b', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.85002809706240523,52.31959025144288944,4.85418023172258284,52.32078801319095618&SRS=EPSG:4326&WIDTH=2310&HEIGHT=666&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421123943, 'deltat': 215961, 'referer': None, 'bytes': 194466, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}]
[{'key': 'cbf88f1a13a6ae7d66b68c92b2323692', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.85085928333482297,52.31989516121636541,4.8529353590157136,52.32049405290776178&SRS=EPSG:4326&WIDTH=2310&HEIGHT=666&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421123945, 'deltat': 96065, 'referer': None, 'bytes': 160121, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': '480d5490b4182b724cdd6262508cb306', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.8512748645681425,52.32004761666721748,4.85231290449639907,52.3203470652173479&SRS=EPSG:4326&WIDTH=2310&HEIGHT=666&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421123946, 'deltat': 390538, 'referer': None, 'bytes': 123241, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': '81a915e522be57ca32577ea2cd0d4077', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.85093093342004078,52.31990548311836164,4.85300700678140018,52.32050437106456542&SRS=EPSG:4326&WIDTH=2310&HEIGHT=666&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421124002, 'deltat': 147369, 'referer': None, 'bytes': 157238, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': '2941e1a7df8278e2c1902078c3c56db2', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.85024305101700559,52.31962122226092049,4.85439517176004642,52.32081896153741951&SRS=EPSG:4326&WIDTH=2310&HEIGHT=666&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421124003, 'deltat': 109193, 'referer': None, 'bytes': 199468, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': '168da9ddd5e547267abdf647334927cc', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.84886720578289587,52.31905272550537234,4.8571713433574466,52.32144805759834583&SRS=EPSG:4326&WIDTH=2310&HEIGHT=666&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421124004, 'deltat': 218693, 'referer': None, 'bytes': 300113, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': 'd5aae676d66a35d885222bb1f61ca8e3', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.84611519359641374,52.3179158318183184,4.86272305315710884,52.32270591019437944&SRS=EPSG:4326&WIDTH=2310&HEIGHT=666&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421124005, 'deltat': 266274, 'referer': None, 'bytes': 489524, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': '344e31a2ea16c9724f1ded447af0ec3e', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.84060980355999337,52.31564884059808662,4.87382386563584902,52.32522665442184007&SRS=EPSG:4326&WIDTH=2310&HEIGHT=666&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421124006, 'deltat': 268617, 'referer': None, 'bytes': 634317, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': '4b04dee4c3f829a064c4b862a55237dc', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.82961476217944696,52.31111656397721532,4.89603623584240832,52.33026278690169875&SRS=EPSG:4326&WIDTH=2311&HEIGHT=666&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421124007, 'deltat': 257901, 'referer': None, 'bytes': 696250, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': '76439c9398aef57604a8d7fe1ccdbe63', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.85319246456894948,52.32761554091926115,4.91960915414784417,52.34672235725444267&SRS=EPSG:4326&WIDTH=2305&HEIGHT=663&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421124009, 'deltat': 1808540, 'referer': None, 'bytes': 750968, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': 'e4bbb235397b6ee227d3d1c3c6e57cc0', 'status': 500, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'time': 20150421124512, 'deltat': 466396, 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'bytes': 602, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}]
[{'key': 'a616a207e569ddd2d91b2ba792551c74', 'status': 500, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'time': 20150421124530, 'deltat': 1937, 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'bytes': 602, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': 'c95995380731c2afaffc3a12fb0f46bd', 'status': 500, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'time': 20150421124607, 'deltat': 288315, 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'bytes': 602, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': '96746359ba453f8c3596bdc8e4e571fe', 'status': 200, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'time': 20150421124759, 'deltat': 549090, 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'bytes': 331806, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': '70903236f35cd3720fd91a06a34125e4', 'status': 200, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'time': 20150421124803, 'deltat': 333467, 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'bytes': 334352, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': '16a53a4566b74c22dd75a304cda8d1ee', 'status': 200, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'time': 20150421124805, 'deltat': 352004, 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'bytes': 331806, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': '02b436134de2a948b12b0285c7fdcec2', 'status': 200, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'time': 20150421124808, 'deltat': 115182, 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'bytes': 331806, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': 'e9ade15bdc1a7502baa263200fe8fb78', 'status': 200, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'time': 20150421124810, 'deltat': 115765, 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'bytes': 331806, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': '21898776c499a6053c63ab368e9218c9', 'status': 200, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'time': 20150421124811, 'deltat': 119957, 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'bytes': 331806, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': '6f7f90fd0db81a9f6852abed2123942a', 'status': 200, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'time': 20150421124813, 'deltat': 363011, 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'bytes': 331806, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': 'f1435089ee58c4d1c7879ef2e965f0d3', 'status': 200, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'time': 20150421124815, 'deltat': 386568, 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'bytes': 331806, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}]
[{'key': 'fcb9860ee4326e052aa9a045d6446b2d', 'status': 200, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'time': 20150421124818, 'deltat': 365184, 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'bytes': 334352, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': '8c0e30fa89b06d3875ded38f5a897e8a', 'status': 404, 'request': '/favicon.ico', 'time': 20150421124819, 'deltat': 102, 'referer': 'http://s.test.map5.nl/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'bytes': 279, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': '7c722ffad7c5795196bd669efee5cbbe', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.83005370038209136,52.33939510971103459,4.89651704885155681,52.35854062445694979&SRS=EPSG:4326&WIDTH=2313&HEIGHT=666&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421124824, 'deltat': 1757049, 'referer': None, 'bytes': 791655, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': 'fdb3cab338635542b11cc6fd23efa191', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.79175980191256379,52.34824612602871241,4.85828446955923443,52.36745569430535596&SRS=EPSG:4326&WIDTH=2309&HEIGHT=667&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421124828, 'deltat': 1933968, 'referer': None, 'bytes': 749230, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': 'b0807755ba01626a6c9be481eb7dedff', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.77385759552589573,52.35751052638513414,4.84041867055299946,52.37675005343851353&SRS=EPSG:4326&WIDTH=2308&HEIGHT=667&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421124833, 'deltat': 2185241, 'referer': None, 'bytes': 707773, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': '676bc4fd00f630098628fbadb404947f', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.77125456138848403,52.37023903120333301,4.83783806710879727,52.3894829312327488&SRS=EPSG:4326&WIDTH=2309&HEIGHT=667&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421124839, 'deltat': 1532564, 'referer': None, 'bytes': 718675, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': '66e7825e2733e29c38cbfc0cfe6a2ade', 'status': 200, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.76145165848030949,52.37107784519862719,4.82804874484703994,52.39033814774672493&SRS=EPSG:4326&WIDTH=2308&HEIGHT=667&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'time': 20150421124843, 'deltat': 1265574, 'referer': None, 'bytes': 699224, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera'}, {'key': '13bb8dc96ba53ea751078e0f792b9a8e', 'status': 200, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'time': 20150421124910, 'deltat': 486046, 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'bytes': 334352, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': '1cb68e659426256b71bf9426c6a0d2b2', 'status': 200, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'time': 20150421124914, 'deltat': 376900, 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'bytes': 331806, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': '86a9ead11f9f06c5a1ef4036daa0d6a8', 'status': 404, 'request': '/favicon.ico', 'time': 20150421124914, 'deltat': 365, 'referer': 'http://s.test.map5.nl/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'bytes': 279, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}]2019-03-22 22:19:57,668 fileinput INFO EOF file
2019-03-22 22:19:57,668 fileinput INFO EOF file list
2019-03-22 22:19:57,669 component INFO ApacheLogFileInput invokes=112 time(total, min, max, avg) = 0.016 0.001 0.003 0.000
2019-03-22 22:19:57,669 component INFO FormatConverter invokes=112 time(total, min, max, avg) = 0.002 9223372036854775808.000 0.000 0.000
2019-03-22 22:19:57,670 component INFO StandardOutput invokes=112 time(total, min, max, avg) = 0.004 0.001 0.001 0.000
2019-03-22 22:19:57,670 chain INFO DONE - 112 rounds - chain=input_apache_log|to_record_array|output_std
2019-03-22 22:19:57,671 util INFO Timer end: total ETL time=0.0 sec
2019-03-22 22:19:57,671 ETL INFO ALL DONE
[{'key': '12f5a57f05e9454adad12cf3e6039a12', 'status': 200, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'time': 20150421124916, 'deltat': 340430, 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'bytes': 334352, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': '56747125858beeaa5646ca380c30b336', 'status': 404, 'request': '/favicon.ico', 'time': 20150421124916, 'deltat': 378, 'referer': 'http://s.test.map5.nl/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'bytes': 279, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': 'e64ce7345af21c379f2dc3b45d3cd7fd', 'status': 200, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'time': 20150421124917, 'deltat': 370053, 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'bytes': 334352, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': '96b7758cb0eb60414eee0246bc7b12c0', 'status': 404, 'request': '/favicon.ico', 'time': 20150421124918, 'deltat': 379, 'referer': 'http://s.test.map5.nl/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'bytes': 279, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': '79f3135bd6c5fb9de8b777325cfbc8a4', 'status': 200, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'time': 20150421124919, 'deltat': 332777, 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'bytes': 334352, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': '76375e80e49aea17fe0c2506ad629a5d', 'status': 404, 'request': '/favicon.ico', 'time': 20150421124920, 'deltat': 144, 'referer': 'http://s.test.map5.nl/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'bytes': 279, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': 'a9a531365255bba9e0f222df276036c6', 'status': 200, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'time': 20150421124921, 'deltat': 109812, 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'bytes': 334352, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': '540ccd4ed5e696a29edc6c35111ce5b6', 'status': 404, 'request': '/favicon.ico', 'time': 20150421124921, 'deltat': 346, 'referer': 'http://s.test.map5.nl/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'bytes': 279, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': 'd72f1e2f07a6b1d18575642d9ce38e85', 'status': 200, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'time': 20150421124922, 'deltat': 110987, 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'bytes': 331806, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}, {'key': '03eb6c54f3dcbc2619b574c16e58d412', 'status': 404, 'request': '/favicon.ico', 'time': 20150421124923, 'deltat': 478, 'referer': 'http://s.test.map5.nl/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'bytes': 279, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36'}]
/stetl/examples/basics
/stetl/examples/basics/15_splitter /stetl/examples/basics
==== running etl.sh for 15_splitter ====
2019-03-22 22:19:57,916 util INFO Found lxml.etree, native XML parsing, fabulous!
2019-03-22 22:19:57,963 util INFO Found GDAL/OGR Python bindings, super!!
2019-03-22 22:19:57,970 main INFO Stetl version = 2.0rc1
2019-03-22 22:19:57,972 ETL INFO INIT - Stetl version is 2.0rc1
2019-03-22 22:19:57,973 ETL INFO Config/working dir = /stetl/examples/basics/15_splitter
2019-03-22 22:19:57,974 ETL INFO Reading config_file = etl.cfg
2019-03-22 22:19:57,982 ETL INFO START
2019-03-22 22:19:57,983 util INFO Timer start: total ETL
2019-03-22 22:19:57,984 chain INFO Assembling Chain: input_xml_file|transformer_xslt|(output_file)(output_std)...
2019-03-22 22:19:57,988 input INFO cfg = {'file_path': 'input/cities.xml', 'class': 'stetl.inputs.fileinput.XmlFileInput'}
2019-03-22 22:19:57,991 fileinput INFO file_list=['input/cities.xml']
2019-03-22 22:19:57,999 output INFO cfg = {'file_path': 'output/gmlcities.gml', 'class': 'stetl.outputs.fileoutput.FileOutput'}
2019-03-22 22:19:57,999 fileoutput INFO working dir /stetl/examples/basics/15_splitter
2019-03-22 22:19:58,000 output INFO cfg = {'class': 'stetl.outputs.standardoutput.StandardOutput'}
2019-03-22 22:19:58,001 chain INFO Running Chain: input_xml_file|transformer_xslt|(output_file)(output_std)
2019-03-22 22:19:58,001 fileinput INFO Read/parse for start for file=input/cities.xml....
2019-03-22 22:19:58,007 fileinput INFO Read/parse ok for file=input/cities.xml
2019-03-22 22:19:58,007 fileinput INFO all files done
2019-03-22 22:19:58,008 xsltfilter INFO XSLT Transform OK
2019-03-22 22:19:58,009 fileoutput INFO writing to file output/gmlcities.gml
2019-03-22 22:19:58,014 fileoutput INFO written to output/gmlcities.gml
2019-03-22 22:19:58,015 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.007 0.007 0.007 0.007
2019-03-22 22:19:58,015 component INFO XsltFilter invokes=1 time(total, min, max, avg) = 0.001 0.001 0.001 0.001
2019-03-22 22:19:58,017 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.006 0.006 0.006 0.006
2019-03-22 22:19:58,017 component INFO StandardOutput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2019-03-22 22:19:58,018 chain INFO DONE - 1 rounds - chain=input_xml_file|transformer_xslt|(output_file)(output_std)
2019-03-22 22:19:58,018 chain INFO Assembling Chain: input_xml_file |(transformer_xslt|output_file) (output_std) (transformer_xslt|output_std)...
2019-03-22 22:19:58,019 input INFO cfg = {'file_path': 'input/cities.xml', 'class': 'stetl.inputs.fileinput.XmlFileInput'}
2019-03-22 22:19:58,021 fileinput INFO file_list=['input/cities.xml']
2019-03-22 22:19:58,022 chain INFO Assembling Chain: transformer_xslt|output_file...
2019-03-22 22:19:58,029 output INFO cfg = {'file_path': 'output/gmlcities.gml', 'class': 'stetl.outputs.fileoutput.FileOutput'}
2019-03-22 22:19:58,029 fileoutput INFO working dir /stetl/examples/basics/15_splitter
2019-03-22 22:19:58,030 output INFO cfg = {'class': 'stetl.outputs.standardoutput.StandardOutput'}
2019-03-22 22:19:58,030 chain INFO Assembling Chain: transformer_xslt|output_std...
2019-03-22 22:19:58,036 output INFO cfg = {'class': 'stetl.outputs.standardoutput.StandardOutput'}
2019-03-22 22:19:58,037 chain INFO Running Chain: input_xml_file |(transformer_xslt|output_file) (output_std) (transformer_xslt|output_std)
2019-03-22 22:19:58,037 fileinput INFO Read/parse for start for file=input/cities.xml....
2019-03-22 22:19:58,042 fileinput INFO Read/parse ok for file=input/cities.xml
2019-03-22 22:19:58,043 fileinput INFO all files done
2019-03-22 22:19:58,044 xsltfilter INFO XSLT Transform OK
2019-03-22 22:19:58,044 fileoutput INFO writing to file output/gmlcities.gml
2019-03-22 22:19:58,050 fileoutput INFO written to output/gmlcities.gml
2019-03-22 22:19:58,050 xsltfilter INFO XSLT Transform OK
2019-03-22 22:19:58,051 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.006 0.006 0.006 0.006
2019-03-22 22:19:58,052 component INFO XsltFilter invokes=1 time(total, min, max, avg) = 0.001 0.001 0.001 0.001
2019-03-22 22:19:58,052 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.006 0.006 0.006 0.006
2019-03-22 22:19:58,053 component INFO StandardOutput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2019-03-22 22:19:58,053 component INFO XsltFilter invokes=1 time(total, min, max, avg) = 0.001 0.001 0.001 0.001
2019-03-22 22:19:58,054 component INFO StandardOutput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2019-03-22 22:19:58,054 chain INFO DONE - 1 rounds - chain=input_xml_file |(transformer_xslt|output_file) (output_std) (transformer_xslt|output_std)
2019-03-22 22:19:58,054 util INFO Timer end: total ETL time=0.0 sec
2019-03-22 22:19:58,055 ETL INFO ALL DONE
<?xml version='1.0' encoding='utf-8'?>
<ogr:FeatureCollection xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:ogr="http://ogr.maptools.org/" xmlns:gml="http://www.opengis.net/gml" xsi:schemaLocation="http://ogr.maptools.org/ ../gmlcities.xsd http://www.opengis.net/gml http://schemas.opengis.net/gml/2.1.2/feature.xsd">
<gml:boundedBy>
<gml:Box>
<gml:coord>
<gml:X>-180.0</gml:X>
<gml:Y>-90.0</gml:Y>
</gml:coord>
<gml:coord>
<gml:X>180.0</gml:X>
<gml:Y>90.0</gml:Y>
</gml:coord>
</gml:Box>
</gml:boundedBy>
<gml:featureMember>
<ogr:City>
<ogr:name>Amsterdam</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>52.4,4.9</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
<gml:featureMember>
<ogr:City>
<ogr:name>Bonn</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>50.7,7.1</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
<gml:featureMember>
<ogr:City>
<ogr:name>Rome</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>41.9,12.5</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
</ogr:FeatureCollection>
<?xml version='1.0' encoding='utf-8'?>
<cities>
<city>
<name>Amsterdam</name>
<lat>52.4</lat>
<lon>4.9</lon>
</city>
<city>
<name>Bonn</name>
<lat>50.7</lat>
<lon>7.1</lon>
</city>
<city>
<name>Rome</name>
<lat>41.9</lat>
<lon>12.5</lon>
</city>
</cities>
<?xml version='1.0' encoding='utf-8'?>
<ogr:FeatureCollection xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:ogr="http://ogr.maptools.org/" xmlns:gml="http://www.opengis.net/gml" xsi:schemaLocation="http://ogr.maptools.org/ ../gmlcities.xsd http://www.opengis.net/gml http://schemas.opengis.net/gml/2.1.2/feature.xsd">
<gml:boundedBy>
<gml:Box>
<gml:coord>
<gml:X>-180.0</gml:X>
<gml:Y>-90.0</gml:Y>
</gml:coord>
<gml:coord>
<gml:X>180.0</gml:X>
<gml:Y>90.0</gml:Y>
</gml:coord>
</gml:Box>
</gml:boundedBy>
<gml:featureMember>
<ogr:City>
<ogr:name>Amsterdam</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>52.4,4.9</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
<gml:featureMember>
<ogr:City>
<ogr:name>Bonn</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>50.7,7.1</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
<gml:featureMember>
<ogr:City>
<ogr:name>Rome</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>41.9,12.5</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
</ogr:FeatureCollection>
/stetl/examples/basics
/stetl/examples/basics/16_merger /stetl/examples/basics
==== running etl.sh for 16_merger ====
2019-03-22 22:19:58,309 util INFO Found lxml.etree, native XML parsing, fabulous!
2019-03-22 22:19:58,356 util INFO Found GDAL/OGR Python bindings, super!!
2019-03-22 22:19:58,364 main INFO Stetl version = 2.0rc1
2019-03-22 22:19:58,366 ETL INFO INIT - Stetl version is 2.0rc1
2019-03-22 22:19:58,368 ETL INFO Config/working dir = /stetl/examples/basics/16_merger
2019-03-22 22:19:58,368 ETL INFO Reading config_file = etl.cfg
2019-03-22 22:19:58,375 ETL INFO START
2019-03-22 22:19:58,376 util INFO Timer start: total ETL
2019-03-22 22:19:58,376 chain INFO Assembling Chain: (input_1) (input_2)|transformer_xslt|output_std...
2019-03-22 22:19:58,381 input INFO cfg = {'class': 'stetl.inputs.fileinput.XmlFileInput', 'file_path': 'input1/cities.xml'}
2019-03-22 22:19:58,383 fileinput INFO file_list=['input1/cities.xml']
2019-03-22 22:19:58,384 input INFO cfg = {'class': 'stetl.inputs.fileinput.XmlFileInput', 'file_path': 'input2/cities.xml'}
2019-03-22 22:19:58,386 fileinput INFO file_list=['input2/cities.xml']
2019-03-22 22:19:58,393 output INFO cfg = {'class': 'stetl.outputs.standardoutput.StandardOutput'}
2019-03-22 22:19:58,394 chain INFO Running Chain: (input_1) (input_2)|transformer_xslt|output_std
2019-03-22 22:19:58,394 fileinput INFO Read/parse for start for file=input1/cities.xml....
2019-03-22 22:19:58,398 fileinput INFO Read/parse ok for file=input1/cities.xml
2019-03-22 22:19:58,399 fileinput INFO all files done
2019-03-22 22:19:58,399 xsltfilter INFO XSLT Transform OK
2019-03-22 22:19:58,400 fileinput INFO Read/parse for start for file=input2/cities.xml....
2019-03-22 22:19:58,405 fileinput INFO Read/parse ok for file=input2/cities.xml
2019-03-22 22:19:58,405 fileinput INFO all files done
2019-03-22 22:19:58,406 xsltfilter INFO XSLT Transform OK
2019-03-22 22:19:58,406 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.005 0.005 0.005 0.005
2019-03-22 22:19:58,407 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.006 0.006 0.006 0.006
2019-03-22 22:19:58,407 component INFO XsltFilter invokes=2 time(total, min, max, avg) = 0.001 0.001 0.001 0.001
2019-03-22 22:19:58,408 component INFO StandardOutput invokes=2 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2019-03-22 22:19:58,408 chain INFO DONE - 1 rounds - chain=(input_1) (input_2)|transformer_xslt|output_std
2019-03-22 22:19:58,409 chain INFO Assembling Chain: (input_1) (input_2)|transformer_xslt|(output_file)(output_std)...
2019-03-22 22:19:58,409 input INFO cfg = {'class': 'stetl.inputs.fileinput.XmlFileInput', 'file_path': 'input1/cities.xml'}
2019-03-22 22:19:58,412 fileinput INFO file_list=['input1/cities.xml']
2019-03-22 22:19:58,412 input INFO cfg = {'class': 'stetl.inputs.fileinput.XmlFileInput', 'file_path': 'input2/cities.xml'}
2019-03-22 22:19:58,414 fileinput INFO file_list=['input2/cities.xml']
2019-03-22 22:19:58,419 output INFO cfg = {'class': 'stetl.outputs.fileoutput.FileOutput', 'file_path': 'output/gmlcities.gml'}
2019-03-22 22:19:58,420 fileoutput INFO working dir /stetl/examples/basics/16_merger
2019-03-22 22:19:58,420 output INFO cfg = {'class': 'stetl.outputs.standardoutput.StandardOutput'}
2019-03-22 22:19:58,421 chain INFO Running Chain: (input_1) (input_2)|transformer_xslt|(output_file)(output_std)
2019-03-22 22:19:58,422 fileinput INFO Read/parse for start for file=input1/cities.xml....
2019-03-22 22:19:58,427 fileinput INFO Read/parse ok for file=input1/cities.xml
2019-03-22 22:19:58,427 fileinput INFO all files done
2019-03-22 22:19:58,428 xsltfilter INFO XSLT Transform OK
2019-03-22 22:19:58,428 fileoutput INFO writing to file output/gmlcities.gml
2019-03-22 22:19:58,433 fileoutput INFO written to output/gmlcities.gml
2019-03-22 22:19:58,433 fileinput INFO Read/parse for start for file=input2/cities.xml....
2019-03-22 22:19:58,437 fileinput INFO Read/parse ok for file=input2/cities.xml
2019-03-22 22:19:58,438 fileinput INFO all files done
2019-03-22 22:19:58,438 xsltfilter INFO XSLT Transform OK
2019-03-22 22:19:58,439 fileoutput INFO writing to file output/gmlcities.gml
2019-03-22 22:19:58,443 fileoutput INFO written to output/gmlcities.gml
2019-03-22 22:19:58,445 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.006 0.006 0.006 0.006
2019-03-22 22:19:58,445 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.005 0.005 0.005 0.005
2019-03-22 22:19:58,446 component INFO XsltFilter invokes=2 time(total, min, max, avg) = 0.001 0.001 0.001 0.001
2019-03-22 22:19:58,447 component INFO FileOutput invokes=2 time(total, min, max, avg) = 0.011 0.005 0.006 0.005
2019-03-22 22:19:58,448 component INFO StandardOutput invokes=2 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2019-03-22 22:19:58,448 chain INFO DONE - 1 rounds - chain=(input_1) (input_2)|transformer_xslt|(output_file)(output_std)
2019-03-22 22:19:58,449 util INFO Timer end: total ETL time=0.0 sec
2019-03-22 22:19:58,450 ETL INFO ALL DONE
<?xml version='1.0' encoding='utf-8'?>
<ogr:FeatureCollection xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:ogr="http://ogr.maptools.org/" xmlns:gml="http://www.opengis.net/gml" xsi:schemaLocation="http://ogr.maptools.org/ ../gmlcities.xsd http://www.opengis.net/gml http://schemas.opengis.net/gml/2.1.2/feature.xsd">
<gml:boundedBy>
<gml:Box>
<gml:coord>
<gml:X>-180.0</gml:X>
<gml:Y>-90.0</gml:Y>
</gml:coord>
<gml:coord>
<gml:X>180.0</gml:X>
<gml:Y>90.0</gml:Y>
</gml:coord>
</gml:Box>
</gml:boundedBy>
<gml:featureMember>
<ogr:City>
<ogr:name>Amsterdam</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>52.4,4.9</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
<gml:featureMember>
<ogr:City>
<ogr:name>Bonn</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>50.7,7.1</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
<gml:featureMember>
<ogr:City>
<ogr:name>Rome</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>41.9,12.5</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
</ogr:FeatureCollection>
<?xml version='1.0' encoding='utf-8'?>
<ogr:FeatureCollection xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:ogr="http://ogr.maptools.org/" xmlns:gml="http://www.opengis.net/gml" xsi:schemaLocation="http://ogr.maptools.org/ ../gmlcities.xsd http://www.opengis.net/gml http://schemas.opengis.net/gml/2.1.2/feature.xsd">
<gml:boundedBy>
<gml:Box>
<gml:coord>
<gml:X>-180.0</gml:X>
<gml:Y>-90.0</gml:Y>
</gml:coord>
<gml:coord>
<gml:X>180.0</gml:X>
<gml:Y>90.0</gml:Y>
</gml:coord>
</gml:Box>
</gml:boundedBy>
<gml:featureMember>
<ogr:City>
<ogr:name>Amsterdam</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>52.4,4.9</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
<gml:featureMember>
<ogr:City>
<ogr:name>Bonn</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>50.7,7.1</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
<gml:featureMember>
<ogr:City>
<ogr:name>Rome</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>41.9,12.5</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
</ogr:FeatureCollection>
<?xml version='1.0' encoding='utf-8'?>
<ogr:FeatureCollection xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:ogr="http://ogr.maptools.org/" xmlns:gml="http://www.opengis.net/gml" xsi:schemaLocation="http://ogr.maptools.org/ ../gmlcities.xsd http://www.opengis.net/gml http://schemas.opengis.net/gml/2.1.2/feature.xsd">
<gml:boundedBy>
<gml:Box>
<gml:coord>
<gml:X>-180.0</gml:X>
<gml:Y>-90.0</gml:Y>
</gml:coord>
<gml:coord>
<gml:X>180.0</gml:X>
<gml:Y>90.0</gml:Y>
</gml:coord>
</gml:Box>
</gml:boundedBy>
<gml:featureMember>
<ogr:City>
<ogr:name>Amsterdam</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>52.4,4.9</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
<gml:featureMember>
<ogr:City>
<ogr:name>Bonn</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>50.7,7.1</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
<gml:featureMember>
<ogr:City>
<ogr:name>Rome</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>41.9,12.5</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
</ogr:FeatureCollection>
<?xml version='1.0' encoding='utf-8'?>
<ogr:FeatureCollection xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:ogr="http://ogr.maptools.org/" xmlns:gml="http://www.opengis.net/gml" xsi:schemaLocation="http://ogr.maptools.org/ ../gmlcities.xsd http://www.opengis.net/gml http://schemas.opengis.net/gml/2.1.2/feature.xsd">
<gml:boundedBy>
<gml:Box>
<gml:coord>
<gml:X>-180.0</gml:X>
<gml:Y>-90.0</gml:Y>
</gml:coord>
<gml:coord>
<gml:X>180.0</gml:X>
<gml:Y>90.0</gml:Y>
</gml:coord>
</gml:Box>
</gml:boundedBy>
<gml:featureMember>
<ogr:City>
<ogr:name>Amsterdam</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>52.4,4.9</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
<gml:featureMember>
<ogr:City>
<ogr:name>Bonn</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>50.7,7.1</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
<gml:featureMember>
<ogr:City>
<ogr:name>Rome</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>41.9,12.5</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
</ogr:FeatureCollection>
/stetl/examples/basics
/stetl/examples/basics/17_sieve /stetl/examples/basics
==== running etl.sh for 17_sieve ====
2019-03-22 22:19:58,689 util INFO Found lxml.etree, native XML parsing, fabulous!
2019-03-22 22:19:58,736 util INFO Found GDAL/OGR Python bindings, super!!
2019-03-22 22:19:58,742 main INFO Stetl version = 2.0rc1
2019-03-22 22:19:58,744 ETL INFO INIT - Stetl version is 2.0rc1
2019-03-22 22:19:58,745 ETL INFO Config/working dir = /stetl/examples/basics/17_sieve
2019-03-22 22:19:58,746 ETL INFO Reading config_file = etl.cfg
2019-03-22 22:19:58,752 ETL INFO START
2019-03-22 22:19:58,752 util INFO Timer start: total ETL
2019-03-22 22:19:58,753 chain INFO Assembling Chain: input_csv|attr_value_sieve|output_std...
2019-03-22 22:19:58,757 input INFO cfg = {'class': 'stetl.inputs.fileinput.CsvFileInput', 'output_format': 'record_array', 'file_path': 'input/cities.csv'}
2019-03-22 22:19:58,760 fileinput INFO file_list=['input/cities.csv']
2019-03-22 22:19:58,762 output INFO cfg = {'class': 'stetl.outputs.standardoutput.StandardOutput'}
2019-03-22 22:19:58,763 chain INFO Running Chain: input_csv|attr_value_sieve|output_std
2019-03-22 22:19:58,763 fileinput INFO Open CSV file: input/cities.csv
2019-03-22 22:19:58,768 component INFO CsvFileInput invokes=1 time(total, min, max, avg) = 0.002 0.002 0.002 0.002
2019-03-22 22:19:58,768 component INFO AttrValueRecordSieve invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2019-03-22 22:19:58,769 component INFO StandardOutput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2019-03-22 22:19:58,769 chain INFO DONE - 1 rounds - chain=input_csv|attr_value_sieve|output_std
2019-03-22 22:19:58,770 chain INFO Assembling Chain: input_csv|attr_value_sieve|output_file...
2019-03-22 22:19:58,770 input INFO cfg = {'class': 'stetl.inputs.fileinput.CsvFileInput', 'output_format': 'record_array', 'file_path': 'input/cities.csv'}
2019-03-22 22:19:58,772 fileinput INFO file_list=['input/cities.csv']
2019-03-22 22:19:58,773 output INFO cfg = {'class': 'stetl.outputs.fileoutput.FileOutput', 'file_path': 'output/cities_sieved.txt'}
2019-03-22 22:19:58,774 fileoutput INFO working dir /stetl/examples/basics/17_sieve
2019-03-22 22:19:58,774 chain INFO Running Chain: input_csv|attr_value_sieve|output_file
2019-03-22 22:19:58,775 fileinput INFO Open CSV file: input/cities.csv
2019-03-22 22:19:58,779 fileoutput INFO writing to file output/cities_sieved.txt
2019-03-22 22:19:58,784 fileoutput INFO written to output/cities_sieved.txt
2019-03-22 22:19:58,784 component INFO CsvFileInput invokes=1 time(total, min, max, avg) = 0.002 0.002 0.002 0.002
2019-03-22 22:19:58,785 component INFO AttrValueRecordSieve invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2019-03-22 22:19:58,785 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.005 0.005 0.005 0.005
2019-03-22 22:19:58,785 chain INFO DONE - 1 rounds - chain=input_csv|attr_value_sieve|output_file
2019-03-22 22:19:58,786 util INFO Timer end: total ETL time=0.0 sec
2019-03-22 22:19:58,786 ETL INFO ALL DONE
[{'city': 'amsterdam', 'lat': '52.4', 'lon': '4.9'}, {'city': 'otterlo', 'lat': '52.101', 'lon': '5.773'}]
/stetl/examples/basics
/stetl/examples/basics/1_copystd /stetl/examples/basics
==== running etl.sh for 1_copystd ====
2019-03-22 22:19:59,032 util INFO Found lxml.etree, native XML parsing, fabulous!
2019-03-22 22:19:59,085 util INFO Found GDAL/OGR Python bindings, super!!
2019-03-22 22:19:59,091 main INFO Stetl version = 2.0rc1
2019-03-22 22:19:59,093 ETL INFO INIT - Stetl version is 2.0rc1
2019-03-22 22:19:59,094 ETL INFO Config/working dir = /stetl/examples/basics/1_copystd
2019-03-22 22:19:59,095 ETL INFO Reading config_file = etl.cfg
2019-03-22 22:19:59,099 ETL INFO START
2019-03-22 22:19:59,100 util INFO Timer start: total ETL
2019-03-22 22:19:59,100 chain INFO Assembling Chain: input_xml_file|output_std...
2019-03-22 22:19:59,104 input INFO cfg = {'class': 'stetl.inputs.fileinput.XmlFileInput', 'file_path': 'input/cities.xml'}
2019-03-22 22:19:59,106 fileinput INFO file_list=['input/cities.xml']
2019-03-22 22:19:59,107 output INFO cfg = {'class': 'stetl.outputs.standardoutput.StandardXmlOutput'}
2019-03-22 22:19:59,108 chain INFO Running Chain: input_xml_file|output_std
2019-03-22 22:19:59,108 fileinput INFO Read/parse for start for file=input/cities.xml....
2019-03-22 22:19:59,111 fileinput INFO Read/parse ok for file=input/cities.xml
2019-03-22 22:19:59,112 fileinput INFO all files done
2019-03-22 22:19:59,112 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.004 0.004 0.004 0.004
2019-03-22 22:19:59,113 component INFO StandardXmlOutput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2019-03-22 22:19:59,113 chain INFO DONE - 1 rounds - chain=input_xml_file|output_std
2019-03-22 22:19:59,114 util INFO Timer end: total ETL time=0.0 sec
2019-03-22 22:19:59,114 ETL INFO ALL DONE
<?xml version='1.0' encoding='utf-8'?>
<cities>
<city>
<name>Amsterdam</name>
<lat>52.4</lat>
<lon>4.9</lon>
</city>
<city>
<name>Bonn</name>
<lat>50.7</lat>
<lon>7.1</lon>
</city>
<city>
<name>Rome</name>
<lat>41.9</lat>
<lon>12.5</lon>
</city>
</cities>
/stetl/examples/basics
/stetl/examples/basics/2_xslt /stetl/examples/basics
==== running etl.sh for 2_xslt ====
2019-03-22 22:19:59,357 util INFO Found lxml.etree, native XML parsing, fabulous!
2019-03-22 22:19:59,404 util INFO Found GDAL/OGR Python bindings, super!!
2019-03-22 22:19:59,410 main INFO Stetl version = 2.0rc1
2019-03-22 22:19:59,412 ETL INFO INIT - Stetl version is 2.0rc1
2019-03-22 22:19:59,413 ETL INFO Config/working dir = /stetl/examples/basics/2_xslt
2019-03-22 22:19:59,414 ETL INFO Reading config_file = etl.cfg
2019-03-22 22:19:59,419 ETL INFO START
2019-03-22 22:19:59,420 util INFO Timer start: total ETL
2019-03-22 22:19:59,420 chain INFO Assembling Chain: input_xml_file|transformer_xslt|output_file...
2019-03-22 22:19:59,425 input INFO cfg = {'class': 'stetl.inputs.fileinput.XmlFileInput', 'file_path': 'input/cities.xml'}
2019-03-22 22:19:59,428 fileinput INFO file_list=['input/cities.xml']
2019-03-22 22:19:59,435 output INFO cfg = {'class': 'stetl.outputs.fileoutput.FileOutput', 'file_path': 'output/gmlcities.gml'}
2019-03-22 22:19:59,436 fileoutput INFO working dir /stetl/examples/basics/2_xslt
2019-03-22 22:19:59,436 chain INFO Running Chain: input_xml_file|transformer_xslt|output_file
2019-03-22 22:19:59,437 fileinput INFO Read/parse for start for file=input/cities.xml....
2019-03-22 22:19:59,441 fileinput INFO Read/parse ok for file=input/cities.xml
2019-03-22 22:19:59,442 fileinput INFO all files done
2019-03-22 22:19:59,442 xsltfilter INFO XSLT Transform OK
2019-03-22 22:19:59,443 fileoutput INFO writing to file output/gmlcities.gml
2019-03-22 22:19:59,448 fileoutput INFO written to output/gmlcities.gml
2019-03-22 22:19:59,448 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.005 0.005 0.005 0.005
2019-03-22 22:19:59,449 component INFO XsltFilter invokes=1 time(total, min, max, avg) = 0.001 0.001 0.001 0.001
2019-03-22 22:19:59,449 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.006 0.006 0.006 0.006
2019-03-22 22:19:59,450 chain INFO DONE - 1 rounds - chain=input_xml_file|transformer_xslt|output_file
2019-03-22 22:19:59,450 util INFO Timer end: total ETL time=0.0 sec
2019-03-22 22:19:59,451 ETL INFO ALL DONE
/stetl/examples/basics
/stetl/examples/basics/3_shape /stetl/examples/basics
==== running etl.sh for 3_shape ====
2019-03-22 22:19:59,708 util INFO Found lxml.etree, native XML parsing, fabulous!
2019-03-22 22:19:59,755 util INFO Found GDAL/OGR Python bindings, super!!
2019-03-22 22:19:59,761 main INFO Stetl version = 2.0rc1
2019-03-22 22:19:59,763 ETL INFO INIT - Stetl version is 2.0rc1
2019-03-22 22:19:59,764 ETL INFO Config/working dir = /stetl/examples/basics/3_shape
2019-03-22 22:19:59,765 ETL INFO Reading config_file = etl.cfg
2019-03-22 22:19:59,770 ETL INFO START
2019-03-22 22:19:59,771 util INFO Timer start: total ETL
2019-03-22 22:19:59,771 chain INFO Assembling Chain: input_xml_file|transformer_xslt|output_ogr_shape...
2019-03-22 22:19:59,776 input INFO cfg = {'class': 'stetl.inputs.fileinput.XmlFileInput', 'file_path': 'input/cities.xml'}
2019-03-22 22:19:59,778 fileinput INFO file_list=['input/cities.xml']
2019-03-22 22:19:59,786 output INFO cfg = {'ogr2ogr_cmd': 'ogr2ogr\n-overwrite\n-f "ESRI Shapefile"\n-a_srs epsg:4326\noutput/gmlcities.shp\ntemp/gmlcities.gml', 'temp_file': 'temp/gmlcities.gml', 'class': 'stetl.outputs.ogroutput.Ogr2OgrOutput'}
2019-03-22 22:19:59,786 chain INFO Running Chain: input_xml_file|transformer_xslt|output_ogr_shape
2019-03-22 22:19:59,787 fileinput INFO Read/parse for start for file=input/cities.xml....
2019-03-22 22:19:59,791 fileinput INFO Read/parse ok for file=input/cities.xml
2019-03-22 22:19:59,791 fileinput INFO all files done
2019-03-22 22:19:59,792 xsltfilter INFO XSLT Transform OK
2019-03-22 22:19:59,793 ogroutput INFO writing to file temp/gmlcities.gml
2019-03-22 22:19:59,797 ogroutput INFO written to temp/gmlcities.gml
2019-03-22 22:19:59,797 ogroutput INFO executing cmd=ogr2ogr -overwrite -f "ESRI Shapefile" -a_srs epsg:4326 output/gmlcities.shp temp/gmlcities.gml
2019-03-22 22:19:59,879 ogroutput INFO execute done
2019-03-22 22:19:59,879 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.005 0.005 0.005 0.005
2019-03-22 22:19:59,880 component INFO XsltFilter invokes=1 time(total, min, max, avg) = 0.001 0.001 0.001 0.001
2019-03-22 22:19:59,880 component INFO Ogr2OgrOutput invokes=1 time(total, min, max, avg) = 0.087 0.087 0.087 0.087
2019-03-22 22:19:59,881 chain INFO DONE - 1 rounds - chain=input_xml_file|transformer_xslt|output_ogr_shape
2019-03-22 22:19:59,881 util INFO Timer end: total ETL time=0.0 sec
2019-03-22 22:19:59,882 ETL INFO ALL DONE
/stetl/examples/basics
/stetl/examples/basics/4_validate /stetl/examples/basics
==== running etl.sh for 4_validate ====
2019-03-22 22:20:00,108 util INFO Found lxml.etree, native XML parsing, fabulous!
2019-03-22 22:20:00,154 util INFO Found GDAL/OGR Python bindings, super!!
2019-03-22 22:20:00,160 main INFO Stetl version = 2.0rc1
2019-03-22 22:20:00,162 ETL INFO INIT - Stetl version is 2.0rc1
2019-03-22 22:20:00,163 ETL INFO Config/working dir = /stetl/examples/basics/4_validate
2019-03-22 22:20:00,164 ETL INFO Reading config_file = etl.cfg
2019-03-22 22:20:00,169 ETL INFO START
2019-03-22 22:20:00,169 util INFO Timer start: total ETL
2019-03-22 22:20:00,169 chain INFO Assembling Chain: input_xml_file|transformer_xslt|xml_schema_validator|output_file...
2019-03-22 22:20:00,174 input INFO cfg = {'file_path': 'input/cities.xml', 'class': 'stetl.inputs.fileinput.XmlFileInput'}
2019-03-22 22:20:00,176 fileinput INFO file_list=['input/cities.xml']
2019-03-22 22:20:00,182 xmlvalidator INFO Building the Schema once with (GML XSD) dependencies for schema=gmlcities.xsd (be patient...)
2019-03-22 22:20:16,520 output INFO cfg = {'file_path': 'output/gmlcities.gml', 'class': 'stetl.outputs.fileoutput.FileOutput'}
2019-03-22 22:20:16,522 fileoutput INFO working dir /stetl/examples/basics/4_validate
2019-03-22 22:20:16,523 chain INFO Running Chain: input_xml_file|transformer_xslt|xml_schema_validator|output_file
2019-03-22 22:20:16,523 fileinput INFO Read/parse for start for file=input/cities.xml....
2019-03-22 22:20:16,528 fileinput INFO Read/parse ok for file=input/cities.xml
2019-03-22 22:20:16,529 fileinput INFO all files done
2019-03-22 22:20:16,529 xsltfilter INFO XSLT Transform OK
2019-03-22 22:20:16,530 xmlvalidator INFO Validating doc against schema=gmlcities.xsd ...
2019-03-22 22:20:16,530 xmlvalidator INFO Validation result: True
2019-03-22 22:20:16,531 fileoutput INFO writing to file output/gmlcities.gml
2019-03-22 22:20:16,535 fileoutput INFO written to output/gmlcities.gml
2019-03-22 22:20:16,536 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.006 0.006 0.006 0.006
2019-03-22 22:20:16,536 component INFO XsltFilter invokes=1 time(total, min, max, avg) = 0.001 0.001 0.001 0.001
2019-03-22 22:20:16,537 component INFO XmlSchemaValidator invokes=1 time(total, min, max, avg) = 0.001 0.001 0.001 0.001
2019-03-22 22:20:16,537 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.005 0.005 0.005 0.005
2019-03-22 22:20:16,538 chain INFO DONE - 1 rounds - chain=input_xml_file|transformer_xslt|xml_schema_validator|output_file
2019-03-22 22:20:16,538 util INFO Timer end: total ETL time=16.0 sec
2019-03-22 22:20:16,538 ETL INFO ALL DONE
/stetl/examples/basics
/stetl/examples/basics/5_split /stetl/examples/basics
==== running etl.sh for 5_split ====
2019-03-22 22:20:16,779 util INFO Found lxml.etree, native XML parsing, fabulous!
2019-03-22 22:20:16,825 util INFO Found GDAL/OGR Python bindings, super!!
2019-03-22 22:20:16,831 main INFO Stetl version = 2.0rc1
2019-03-22 22:20:16,833 ETL INFO INIT - Stetl version is 2.0rc1
2019-03-22 22:20:16,834 ETL INFO Config/working dir = /stetl/examples/basics/5_split
2019-03-22 22:20:16,835 ETL INFO Reading config_file = etl.cfg
2019-03-22 22:20:16,840 ETL INFO START
2019-03-22 22:20:16,840 util INFO Timer start: total ETL
2019-03-22 22:20:16,841 chain INFO Assembling Chain: input_big_xml_file|xml_assembler|transformer_xslt|multi_output_file...
2019-03-22 22:20:16,846 input INFO cfg = {'class': 'stetl.inputs.fileinput.XmlElementStreamerFileInput', 'file_path': 'input', 'element_tags': 'city'}
2019-03-22 22:20:16,851 fileinput INFO file_list=['input/cities.xml']
2019-03-22 22:20:16,851 fileinput INFO Element tags to be matched: ['city']
2019-03-22 22:20:16,853 xmlassembler INFO cfg = {'class': 'stetl.filters.xmlassembler.XmlAssembler', 'container_doc': "<?xml version='1.0' encoding='utf-8'?>\n<cities>\n</cities>", 'element_container_tag': 'cities', 'max_elements': '2'}
2019-03-22 22:20:16,860 output INFO cfg = {'class': 'stetl.outputs.fileoutput.MultiFileOutput', 'file_path': 'output/gmlcities-%03d.gml'}
2019-03-22 22:20:16,860 chain INFO Running Chain: input_big_xml_file|xml_assembler|transformer_xslt|multi_output_file
2019-03-22 22:20:16,862 fileinput INFO file opened : input/cities.xml
2019-03-22 22:20:16,867 xmlassembler INFO xmldoc ready: elms=2 total_elms=2
2019-03-22 22:20:16,867 xsltfilter INFO XSLT Transform OK
2019-03-22 22:20:16,868 fileoutput INFO writing to file output/gmlcities-001.gml
2019-03-22 22:20:16,872 fileoutput INFO written to output/gmlcities-001.gml
2019-03-22 22:20:16,875 fileinput INFO End of doc: input/cities.xml elem_count=3
2019-03-22 22:20:16,875 fileinput INFO End of stream
2019-03-22 22:20:16,876 xmlassembler INFO xmldoc ready: elms=1 total_elms=3
2019-03-22 22:20:16,877 xsltfilter INFO XSLT Transform OK
2019-03-22 22:20:16,877 fileoutput INFO writing to file output/gmlcities-002.gml
2019-03-22 22:20:16,881 fileoutput INFO written to output/gmlcities-002.gml
2019-03-22 22:20:16,881 component INFO XmlElementStreamerFileInput invokes=26 time(total, min, max, avg) = 0.007 0.002 0.004 0.000
2019-03-22 22:20:16,882 component INFO XmlAssembler invokes=26 time(total, min, max, avg) = 0.002 0.001 0.001 0.000
2019-03-22 22:20:16,882 component INFO XsltFilter invokes=26 time(total, min, max, avg) = 0.001 0.001 0.001 0.000
2019-03-22 22:20:16,883 component INFO MultiFileOutput invokes=26 time(total, min, max, avg) = 0.009 0.004 0.005 0.000
2019-03-22 22:20:16,883 chain INFO DONE - 26 rounds - chain=input_big_xml_file|xml_assembler|transformer_xslt|multi_output_file
2019-03-22 22:20:16,884 chain INFO Assembling Chain: input_big_xml_file|xml_assembler|transformer_xslt|output_std...
2019-03-22 22:20:16,884 input INFO cfg = {'class': 'stetl.inputs.fileinput.XmlElementStreamerFileInput', 'file_path': 'input', 'element_tags': 'city'}
2019-03-22 22:20:16,889 fileinput INFO file_list=['input/cities.xml']
2019-03-22 22:20:16,889 fileinput INFO Element tags to be matched: ['city']
2019-03-22 22:20:16,890 xmlassembler INFO cfg = {'class': 'stetl.filters.xmlassembler.XmlAssembler', 'container_doc': "<?xml version='1.0' encoding='utf-8'?>\n<cities>\n</cities>", 'element_container_tag': 'cities', 'max_elements': '2'}
2019-03-22 22:20:16,895 output INFO cfg = {'class': 'stetl.outputs.standardoutput.StandardXmlOutput'}
2019-03-22 22:20:16,896 chain INFO Running Chain: input_big_xml_file|xml_assembler|transformer_xslt|output_std
2019-03-22 22:20:16,898 fileinput INFO file opened : input/cities.xml
2019-03-22 22:20:16,901 xmlassembler INFO xmldoc ready: elms=2 total_elms=2
2019-03-22 22:20:16,902 xsltfilter INFO XSLT Transform OK
2019-03-22 22:20:16,904 fileinput INFO End of doc: input/cities.xml elem_count=3
2019-03-22 22:20:16,905 fileinput INFO End of stream
2019-03-22 22:20:16,905 xmlassembler INFO xmldoc ready: elms=1 total_elms=3
2019-03-22 22:20:16,906 xsltfilter INFO XSLT Transform OK
2019-03-22 22:20:16,906 component INFO XmlElementStreamerFileInput invokes=26 time(total, min, max, avg) = 0.005 0.002 0.003 0.000
2019-03-22 22:20:16,907 component INFO XmlAssembler invokes=26 time(total, min, max, avg) = 0.002 0.001 0.001 0.000
2019-03-22 22:20:16,907 component INFO XsltFilter invokes=26 time(total, min, max, avg) = 0.001 0.001 0.001 0.000
2019-03-22 22:20:16,908 component INFO StandardXmlOutput invokes=26 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2019-03-22 22:20:16,908 chain INFO DONE - 26 rounds - chain=input_big_xml_file|xml_assembler|transformer_xslt|output_std
2019-03-22 22:20:16,909 util INFO Timer end: total ETL time=0.0 sec
2019-03-22 22:20:16,909 ETL INFO ALL DONE
<?xml version='1.0' encoding='utf-8'?>
<ogr:FeatureCollection xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:ogr="http://ogr.maptools.org/" xmlns:gml="http://www.opengis.net/gml" xsi:schemaLocation="http://ogr.maptools.org/ ../gmlcities.xsd http://www.opengis.net/gml http://schemas.opengis.net/gml/2.1.2/feature.xsd">
<gml:boundedBy>
<gml:Box>
<gml:coord>
<gml:X>-180.0</gml:X>
<gml:Y>-90.0</gml:Y>
</gml:coord>
<gml:coord>
<gml:X>180.0</gml:X>
<gml:Y>90.0</gml:Y>
</gml:coord>
</gml:Box>
</gml:boundedBy>
<gml:featureMember>
<ogr:City>
<ogr:name>Amsterdam</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>52.4,4.9</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
<gml:featureMember>
<ogr:City>
<ogr:name>Bonn</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>50.7,7.1</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
</ogr:FeatureCollection>
<?xml version='1.0' encoding='utf-8'?>
<ogr:FeatureCollection xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:ogr="http://ogr.maptools.org/" xmlns:gml="http://www.opengis.net/gml" xsi:schemaLocation="http://ogr.maptools.org/ ../gmlcities.xsd http://www.opengis.net/gml http://schemas.opengis.net/gml/2.1.2/feature.xsd">
<gml:boundedBy>
<gml:Box>
<gml:coord>
<gml:X>-180.0</gml:X>
<gml:Y>-90.0</gml:Y>
</gml:coord>
<gml:coord>
<gml:X>180.0</gml:X>
<gml:Y>90.0</gml:Y>
</gml:coord>
</gml:Box>
</gml:boundedBy>
<gml:featureMember>
<ogr:City>
<ogr:name>Rome</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>41.9,12.5</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
</ogr:FeatureCollection>
/stetl/examples/basics
/stetl/examples/basics/6_cmdargs /stetl/examples/basics
==== running etl.sh for 6_cmdargs ====
2019-03-22 22:20:17,138 util INFO Found lxml.etree, native XML parsing, fabulous!
2019-03-22 22:20:17,184 util INFO Found GDAL/OGR Python bindings, super!!
2019-03-22 22:20:17,191 main INFO Stetl version = 2.0rc1
2019-03-22 22:20:17,193 ETL INFO INIT - Stetl version is 2.0rc1
2019-03-22 22:20:17,194 ETL INFO Config/working dir = /stetl/examples/basics/6_cmdargs
2019-03-22 22:20:17,195 ETL INFO Reading config_file = etl.cfg
2019-03-22 22:20:17,200 ETL INFO Substituting 3 args in config file from args_dict: ['out_xml', 'in_xml', 'in_xsl']
2019-03-22 22:20:17,201 ETL INFO Substituting args OK
2019-03-22 22:20:17,202 ETL INFO START
2019-03-22 22:20:17,202 util INFO Timer start: total ETL
2019-03-22 22:20:17,203 chain INFO Assembling Chain: input_xml_file|transformer_xslt|output_file...
2019-03-22 22:20:17,207 input INFO cfg = {'file_path': 'input/cities.xml', 'class': 'stetl.inputs.fileinput.XmlFileInput'}
2019-03-22 22:20:17,209 fileinput INFO file_list=['input/cities.xml']
2019-03-22 22:20:17,217 output INFO cfg = {'file_path': 'output/gmlcities.gml', 'class': 'stetl.outputs.fileoutput.FileOutput'}
2019-03-22 22:20:17,217 fileoutput INFO working dir /stetl/examples/basics/6_cmdargs
2019-03-22 22:20:17,218 chain INFO Running Chain: input_xml_file|transformer_xslt|output_file
2019-03-22 22:20:17,218 fileinput INFO Read/parse for start for file=input/cities.xml....
2019-03-22 22:20:17,222 fileinput INFO Read/parse ok for file=input/cities.xml
2019-03-22 22:20:17,222 fileinput INFO all files done
2019-03-22 22:20:17,223 xsltfilter INFO XSLT Transform OK
2019-03-22 22:20:17,223 fileoutput INFO writing to file output/gmlcities.gml
2019-03-22 22:20:17,228 fileoutput INFO written to output/gmlcities.gml
2019-03-22 22:20:17,228 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.005 0.005 0.005 0.005
2019-03-22 22:20:17,228 component INFO XsltFilter invokes=1 time(total, min, max, avg) = 0.001 0.001 0.001 0.001
2019-03-22 22:20:17,229 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.005 0.005 0.005 0.005
2019-03-22 22:20:17,229 chain INFO DONE - 1 rounds - chain=input_xml_file|transformer_xslt|output_file
2019-03-22 22:20:17,230 util INFO Timer end: total ETL time=0.0 sec
2019-03-22 22:20:17,230 ETL INFO ALL DONE
2019-03-22 22:20:17,466 util INFO Found lxml.etree, native XML parsing, fabulous!
2019-03-22 22:20:17,512 util INFO Found GDAL/OGR Python bindings, super!!
2019-03-22 22:20:17,519 main INFO Stetl version = 2.0rc1
2019-03-22 22:20:17,522 main INFO Found args file at: etl.args
2019-03-22 22:20:17,528 ETL INFO INIT - Stetl version is 2.0rc1
2019-03-22 22:20:17,529 ETL INFO Config/working dir = /stetl/examples/basics/6_cmdargs
2019-03-22 22:20:17,530 ETL INFO Reading config_file = etl.cfg
2019-03-22 22:20:17,535 ETL INFO Substituting 3 args in config file from args_dict: ['out_xml', 'in_xml', 'in_xsl']
2019-03-22 22:20:17,535 ETL INFO Substituting args OK
2019-03-22 22:20:17,536 ETL INFO START
2019-03-22 22:20:17,536 util INFO Timer start: total ETL
2019-03-22 22:20:17,537 chain INFO Assembling Chain: input_xml_file|transformer_xslt|output_file...
2019-03-22 22:20:17,542 input INFO cfg = {'class': 'stetl.inputs.fileinput.XmlFileInput', 'file_path': 'input/cities.xml'}
2019-03-22 22:20:17,544 fileinput INFO file_list=['input/cities.xml']
2019-03-22 22:20:17,551 output INFO cfg = {'class': 'stetl.outputs.fileoutput.FileOutput', 'file_path': 'output/gmlcities.gml'}
2019-03-22 22:20:17,552 fileoutput INFO working dir /stetl/examples/basics/6_cmdargs
2019-03-22 22:20:17,552 chain INFO Running Chain: input_xml_file|transformer_xslt|output_file
2019-03-22 22:20:17,553 fileinput INFO Read/parse for start for file=input/cities.xml....
2019-03-22 22:20:17,556 fileinput INFO Read/parse ok for file=input/cities.xml
2019-03-22 22:20:17,557 fileinput INFO all files done
2019-03-22 22:20:17,557 xsltfilter INFO XSLT Transform OK
2019-03-22 22:20:17,558 fileoutput INFO writing to file output/gmlcities.gml
2019-03-22 22:20:17,563 fileoutput INFO written to output/gmlcities.gml
2019-03-22 22:20:17,564 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.004 0.004 0.004 0.004
2019-03-22 22:20:17,564 component INFO XsltFilter invokes=1 time(total, min, max, avg) = 0.001 0.001 0.001 0.001
2019-03-22 22:20:17,565 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.005 0.005 0.005 0.005
2019-03-22 22:20:17,565 chain INFO DONE - 1 rounds - chain=input_xml_file|transformer_xslt|output_file
2019-03-22 22:20:17,566 util INFO Timer end: total ETL time=0.0 sec
2019-03-22 22:20:17,566 ETL INFO ALL DONE
2019-03-22 22:20:17,781 util INFO Found lxml.etree, native XML parsing, fabulous!
2019-03-22 22:20:17,826 util INFO Found GDAL/OGR Python bindings, super!!
2019-03-22 22:20:17,833 main INFO Stetl version = 2.0rc1
2019-03-22 22:20:17,835 main INFO Found args file at: etl.args
2019-03-22 22:20:17,839 ETL INFO INIT - Stetl version is 2.0rc1
2019-03-22 22:20:17,840 ETL INFO Config/working dir = /stetl/examples/basics/6_cmdargs
2019-03-22 22:20:17,840 ETL INFO Reading config_file = etl.cfg
2019-03-22 22:20:17,843 ETL INFO Substituting 3 args in config file from args_dict: ['out_xml', 'in_xsl', 'in_xml']
2019-03-22 22:20:17,844 ETL INFO Substituting args OK
2019-03-22 22:20:17,844 ETL INFO START
2019-03-22 22:20:17,845 util INFO Timer start: total ETL
2019-03-22 22:20:17,845 chain INFO Assembling Chain: input_xml_file|transformer_xslt|output_file...
2019-03-22 22:20:17,850 input INFO cfg = {'class': 'stetl.inputs.fileinput.XmlFileInput', 'file_path': 'input/amsterdam.xml'}
2019-03-22 22:20:17,852 fileinput INFO file_list=['input/amsterdam.xml']
2019-03-22 22:20:17,858 output INFO cfg = {'class': 'stetl.outputs.fileoutput.FileOutput', 'file_path': 'output/gmlcities.gml'}
2019-03-22 22:20:17,859 fileoutput INFO working dir /stetl/examples/basics/6_cmdargs
2019-03-22 22:20:17,859 chain INFO Running Chain: input_xml_file|transformer_xslt|output_file
2019-03-22 22:20:17,859 fileinput INFO Read/parse for start for file=input/amsterdam.xml....
2019-03-22 22:20:17,863 fileinput INFO Read/parse ok for file=input/amsterdam.xml
2019-03-22 22:20:17,864 fileinput INFO all files done
2019-03-22 22:20:17,864 xsltfilter INFO XSLT Transform OK
2019-03-22 22:20:17,865 fileoutput INFO writing to file output/gmlcities.gml
2019-03-22 22:20:17,868 fileoutput INFO written to output/gmlcities.gml
2019-03-22 22:20:17,869 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.005 0.005 0.005 0.005
2019-03-22 22:20:17,869 component INFO XsltFilter invokes=1 time(total, min, max, avg) = 0.001 0.001 0.001 0.001
2019-03-22 22:20:17,870 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.004 0.004 0.004 0.004
2019-03-22 22:20:17,870 chain INFO DONE - 1 rounds - chain=input_xml_file|transformer_xslt|output_file
2019-03-22 22:20:17,870 util INFO Timer end: total ETL time=0.0 sec
2019-03-22 22:20:17,871 ETL INFO ALL DONE
/stetl/examples/basics
/stetl/examples/basics/7_mycomponent /stetl/examples/basics
==== running etl.sh for 7_mycomponent ====
2019-03-22 22:20:18,111 util INFO Found lxml.etree, native XML parsing, fabulous!
2019-03-22 22:20:18,156 util INFO Found GDAL/OGR Python bindings, super!!
2019-03-22 22:20:18,163 main INFO Stetl version = 2.0rc1
2019-03-22 22:20:18,165 ETL INFO INIT - Stetl version is 2.0rc1
2019-03-22 22:20:18,166 ETL INFO Config/working dir = /stetl/examples/basics/7_mycomponent
2019-03-22 22:20:18,167 ETL INFO Reading config_file = etl.cfg
2019-03-22 22:20:18,172 ETL INFO START
2019-03-22 22:20:18,173 util INFO Timer start: total ETL
2019-03-22 22:20:18,173 chain INFO Assembling Chain: input_xml_file|my_filter|output_std...
2019-03-22 22:20:18,178 input INFO cfg = {'file_path': 'input/cities.xml', 'class': 'stetl.inputs.fileinput.XmlFileInput'}
2019-03-22 22:20:18,181 fileinput INFO file_list=['input/cities.xml']
2019-03-22 22:20:18,201 output INFO cfg = {'class': 'stetl.outputs.standardoutput.StandardXmlOutput'}
2019-03-22 22:20:18,202 chain INFO Running Chain: input_xml_file|my_filter|output_std
2019-03-22 22:20:18,202 fileinput INFO Read/parse for start for file=input/cities.xml....
2019-03-22 22:20:18,207 fileinput INFO Read/parse ok for file=input/cities.xml
2019-03-22 22:20:18,207 fileinput INFO all files done
2019-03-22 22:20:18,208 myfilter INFO CALLING MyFilter OK!!!!
2019-03-22 22:20:18,208 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.006 0.006 0.006 0.006
2019-03-22 22:20:18,209 component INFO MyFilter invokes=1 time(total, min, max, avg) = 0.001 0.001 0.001 0.001
2019-03-22 22:20:18,209 component INFO StandardXmlOutput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2019-03-22 22:20:18,210 chain INFO DONE - 1 rounds - chain=input_xml_file|my_filter|output_std
2019-03-22 22:20:18,210 util INFO Timer end: total ETL time=0.0 sec
2019-03-22 22:20:18,211 ETL INFO ALL DONE
Welcome to Amsterdam !
Welcome to Bonn !
Welcome to Rome !
<?xml version='1.0' encoding='utf-8'?>
<cities>
<city>
<name>Amsterdam</name>
<lat>52.4</lat>
<lon>4.9</lon>
</city>
<city>
<name>Bonn</name>
<lat>50.7</lat>
<lon>7.1</lon>
</city>
<city>
<name>Rome</name>
<lat>41.9</lat>
<lon>12.5</lon>
</city>
</cities>
/stetl/examples/basics
/stetl/examples/basics/8_wfs /stetl/examples/basics
==== running etl.sh for 8_wfs ====
2019-03-22 22:20:18,451 util INFO Found lxml.etree, native XML parsing, fabulous!
2019-03-22 22:20:18,498 util INFO Found GDAL/OGR Python bindings, super!!
2019-03-22 22:20:18,505 main INFO Stetl version = 2.0rc1
2019-03-22 22:20:18,506 ETL INFO INIT - Stetl version is 2.0rc1
2019-03-22 22:20:18,508 ETL INFO Config/working dir = /stetl/examples/basics/8_wfs
2019-03-22 22:20:18,508 ETL INFO Reading config_file = etl.cfg
2019-03-22 22:20:18,514 ETL INFO START
2019-03-22 22:20:18,514 util INFO Timer start: total ETL
2019-03-22 22:20:18,515 chain INFO Assembling Chain: input_wfs|output_std...
2019-03-22 22:20:18,527 input INFO cfg = {'url': 'http://geodata.nationaalgeoregister.nl/bag/wfs', 'class': 'stetl.inputs.httpinput.HttpInput', 'parameters': '{\n\'service\' : \'WFS\',\n\'version\' : \'1.1.0\',\n\'request\' : \'GetFeature\',\n\'srsName\' : \'EPSG:28992\',\n\'outputFormat\' : \'text/xml; subtype=gml/2.1.2\',\n\'typename\' : \'verblijfsobject\',\n\'filter\' :\'<ogc:Filter xmlns:ogc="http://www.opengis.net/ogc"><ogc:BBOX><gml:Envelope xmlns:gml="http://www.opengis.net/gml" srsName="EPSG:28992"><gml:lowerCorner>183774.83 450577.24</gml:lowerCorner><gml:upperCorner>184277.99 450809.92</gml:upperCorner></gml:Envelope></ogc:BBOX></ogc:Filter>\'\n}'}
2019-03-22 22:20:18,528 httpinput INFO url=http://geodata.nationaalgeoregister.nl/bag/wfs parameters={'service': 'WFS', 'outputFormat': 'text/xml; subtype=gml/2.1.2', 'srsName': 'EPSG:28992', 'typename': 'verblijfsobject', 'version': '1.1.0', 'filter': '<ogc:Filter xmlns:ogc="http://www.opengis.net/ogc"><ogc:BBOX><gml:Envelope xmlns:gml="http://www.opengis.net/gml" srsName="EPSG:28992"><gml:lowerCorner>183774.83 450577.24</gml:lowerCorner><gml:upperCorner>184277.99 450809.92</gml:upperCorner></gml:Envelope></ogc:BBOX></ogc:Filter>', 'request': 'GetFeature'}
2019-03-22 22:20:18,529 output INFO cfg = {'class': 'stetl.outputs.standardoutput.StandardOutput'}
2019-03-22 22:20:18,530 chain INFO Running Chain: input_wfs|output_std
2019-03-22 22:20:18,622 httpinput INFO EOF URL reading done
2019-03-22 22:20:18,623 component INFO HttpInput invokes=2 time(total, min, max, avg) = 0.092 0.001 0.091 0.046
2019-03-22 22:20:18,624 component INFO StandardOutput invokes=2 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2019-03-22 22:20:18,624 chain INFO DONE - 2 rounds - chain=input_wfs|output_std
2019-03-22 22:20:18,625 util INFO Timer end: total ETL time=0.0 sec
2019-03-22 22:20:18,625 ETL INFO ALL DONE
b'<?xml version="1.0" encoding="UTF-8"?><wfs:FeatureCollection xmlns="http://www.opengis.net/wfs" xmlns:wfs="http://www.opengis.net/wfs" xmlns:gml="http://www.opengis.net/gml" xmlns:bag="http://bag.geonovum.nl" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.opengis.net/wfs http://schemas.opengis.net/wfs/1.0.0/WFS-basic.xsd http://bag.geonovum.nl https://geodata.nationaalgeoregister.nl/bag/wfs?service=WFS&version=1.0.0&request=DescribeFeatureType&typeName=bag%3Averblijfsobject"><gml:boundedBy><gml:null>unknown</gml:null></gml:boundedBy><gml:featureMember><bag:verblijfsobject fid="verblijfsobject.5427647"><bag:identificatie>228010000047219</bag:identificatie><bag:oppervlakte>121</bag:oppervlakte><bag:status>Verblijfsobject in gebruik</bag:status><bag:gebruiksdoel>woonfunctie</bag:gebruiksdoel><bag:openbare_ruimte>Harderwijkerweg</bag:openbare_ruimte><bag:huisnummer>1</bag:huisnummer><bag:postcode>6731ST</bag:postcode><bag:woonplaats>Otterlo</bag:woonplaats><bag:bouwjaar>1947</bag:bouwjaar><bag:pandidentificatie>228100000027383</bag:pandidentificatie><bag:pandstatus>Pand in gebruik</bag:pandstatus><bag:geometrie><gml:Point srsName="http://www.opengis.net/gml/srs/epsg.xml#28992"><gml:coordinates xmlns:gml="http://www.opengis.net/gml" decimal="." cs="," ts=" ">183936,450637,0</gml:coordinates></gml:Point></bag:geometrie><bag:pandgeometrie><gml:Polygon srsName="http://www.opengis.net/gml/srs/epsg.xml#28992"><gml:outerBoundaryIs><gml:LinearRing><gml:coordinates xmlns:gml="http://www.opengis.net/gml" decimal="." cs="," ts=" ">183932.603,450639.512,0 183934.594,450634.73,0 183933.375,450634.222,0 183935.064,450630.167,0 183936.343,450630.691,0 183938.458,450625.344,0 183943.859,450627.593,0 183939.957,450636.963,0 183938.748,450636.46,0 183936.757,450641.242,0 183932.603,450639.512,0</gml:coordinates></gml:LinearRing></gml:outerBoundaryIs></gml:Polygon></bag:pandgeometrie></bag:verblijfsobject></gml:featureMember><gml:featureMember><bag:verblijfsobject fid="verblijfsobject.5427708"><bag:identificatie>228010000047281</bag:identificatie><bag:oppervlakte>71</bag:oppervlakte><bag:status>Verblijfsobject in gebruik</bag:status><bag:gebruiksdoel>woonfunctie</bag:gebruiksdoel><bag:openbare_ruimte>Harderwijkerweg</bag:openbare_ruimte><bag:huisnummer>2</bag:huisnummer><bag:postcode>6731ST</bag:postcode><bag:woonplaats>Otterlo</bag:woonplaats><bag:bouwjaar>1947</bag:bouwjaar><bag:pandidentificatie>228100000006908</bag:pandidentificatie><bag:pandstatus>Pand in gebruik</bag:pandstatus><bag:geometrie><gml:Point srsName="http://www.opengis.net/gml/srs/epsg.xml#28992"><gml:coordinates xmlns:gml="http://www.opengis.net/gml" decimal="." cs="," ts=" ">183987,450673,0</gml:coordinates></gml:Point></bag:geometrie><bag:pandgeometrie><gml:Polygon srsName="http://www.opengis.net/gml/srs/epsg.xml#28992"><gml:outerBoundaryIs><gml:LinearRing><gml:coordinates xmlns:gml="http://www.opengis.net/gml" decimal="." cs="," ts=" ">183980.433,450671.062,0 183984.017,450666.347,0 183995.069,450674.891,0 183991.349,450679.562,0 183980.433,450671.062,0</gml:coordinates></gml:LinearRing></gml:outerBoundaryIs></gml:Polygon></bag:pandgeometrie></bag:verblijfsobject></gml:featureMember></wfs:FeatureCollection>'
/stetl/examples/basics
/stetl/examples/basics/9_string_templating /stetl/examples/basics
==== running etl.sh for 9_string_templating ====
2019-03-22 22:20:18,865 util INFO Found lxml.etree, native XML parsing, fabulous!
2019-03-22 22:20:18,910 util INFO Found GDAL/OGR Python bindings, super!!
2019-03-22 22:20:18,917 main INFO Stetl version = 2.0rc1
2019-03-22 22:20:18,919 ETL INFO INIT - Stetl version is 2.0rc1
2019-03-22 22:20:18,920 ETL INFO Config/working dir = /stetl/examples/basics/9_string_templating
2019-03-22 22:20:18,921 ETL INFO Reading config_file = etl.cfg
2019-03-22 22:20:18,926 ETL INFO START
2019-03-22 22:20:18,927 util INFO Timer start: total ETL
2019-03-22 22:20:18,928 chain INFO Assembling Chain: input_csv|filter_template|output_file...
2019-03-22 22:20:18,932 input INFO cfg = {'output_format': 'record', 'file_path': 'input/city.csv', 'class': 'stetl.inputs.fileinput.CsvFileInput'}
2019-03-22 22:20:18,935 fileinput INFO file_list=['input/city.csv']
2019-03-22 22:20:18,937 output INFO cfg = {'file_path': 'output/city.xml', 'class': 'stetl.outputs.fileoutput.FileOutput'}
2019-03-22 22:20:18,938 fileoutput INFO working dir /stetl/examples/basics/9_string_templating
2019-03-22 22:20:18,938 chain INFO Running Chain: input_csv|filter_template|output_file
2019-03-22 22:20:18,939 fileinput INFO Open CSV file: input/city.csv
2019-03-22 22:20:18,941 templatingfilter INFO Init: templating
2019-03-22 22:20:18,941 templatingfilter INFO Init: reading template file %s ..." % self.template_file
2019-03-22 22:20:18,946 templatingfilter INFO template file read OK: city_template.xml
2019-03-22 22:20:18,948 fileinput INFO CSV row nr 1 read: {'lat': '52.4', 'lon': '4.9', 'city': 'amsterdam'}
2019-03-22 22:20:18,948 fileoutput INFO writing to file output/city.xml
2019-03-22 22:20:18,953 fileoutput INFO written to output/city.xml
2019-03-22 22:20:18,955 component INFO CsvFileInput invokes=2 time(total, min, max, avg) = 0.002 0.001 0.002 0.001
2019-03-22 22:20:18,955 templatingfilter INFO Exit: templating
2019-03-22 22:20:18,956 component INFO StringTemplatingFilter invokes=2 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2019-03-22 22:20:18,956 component INFO FileOutput invokes=2 time(total, min, max, avg) = 0.006 0.006 0.006 0.003
2019-03-22 22:20:18,957 chain INFO DONE - 2 rounds - chain=input_csv|filter_template|output_file
2019-03-22 22:20:18,958 util INFO Timer end: total ETL time=0.0 sec
2019-03-22 22:20:18,958 ETL INFO ALL DONE
/stetl/examples/basics
|