1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 801 802 803 804 805 806 807 808 809 810 811 812 813 814 815 816 817 818 819 820 821 822 823 824 825 826 827 828 829 830 831 832 833 834 835 836 837 838 839 840 841 842 843 844 845 846 847 848 849 850 851 852 853 854 855 856 857 858 859 860 861 862 863 864 865 866 867 868 869 870 871 872 873 874 875 876 877 878 879 880 881 882 883 884 885 886 887 888 889 890 891 892 893 894 895 896 897 898 899 900 901 902 903 904 905 906 907 908 909 910 911 912 913 914 915 916 917 918 919 920 921 922 923 924 925 926 927 928 929 930 931 932 933 934 935 936 937 938 939 940 941 942 943 944 945 946 947 948 949 950 951 952 953 954 955 956 957 958 959 960 961 962 963 964 965 966 967 968 969 970 971 972 973 974 975 976 977 978 979 980 981 982 983 984 985 986 987 988 989 990 991 992 993 994 995 996 997 998 999 1000 1001 1002 1003 1004 1005 1006 1007 1008 1009 1010 1011 1012 1013 1014 1015 1016 1017 1018 1019 1020 1021 1022 1023 1024 1025 1026 1027 1028 1029 1030 1031 1032 1033 1034 1035 1036 1037 1038 1039 1040 1041 1042 1043 1044 1045 1046 1047 1048 1049 1050 1051 1052 1053 1054 1055 1056 1057 1058 1059 1060 1061 1062 1063 1064 1065 1066 1067 1068 1069 1070 1071 1072 1073 1074 1075 1076 1077 1078 1079 1080 1081 1082 1083 1084 1085 1086 1087 1088 1089 1090 1091 1092 1093 1094 1095 1096 1097 1098 1099 1100 1101 1102 1103 1104 1105 1106 1107 1108 1109 1110 1111 1112 1113 1114 1115 1116 1117 1118 1119 1120 1121 1122 1123 1124 1125 1126 1127 1128 1129 1130 1131 1132 1133 1134 1135 1136 1137 1138 1139 1140 1141 1142 1143 1144 1145 1146 1147 1148 1149 1150 1151 1152 1153 1154 1155 1156 1157 1158 1159 1160 1161 1162 1163 1164 1165 1166 1167 1168 1169 1170 1171 1172 1173 1174 1175 1176 1177 1178 1179 1180 1181 1182 1183 1184 1185 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201 1202 1203 1204 1205 1206 1207 1208 1209 1210 1211 1212 1213 1214 1215 1216 1217 1218 1219 1220 1221 1222 1223 1224 1225 1226 1227 1228 1229 1230 1231 1232 1233 1234 1235 1236 1237 1238 1239 1240 1241 1242 1243 1244 1245 1246 1247 1248 1249 1250 1251 1252 1253 1254 1255 1256 1257 1258 1259 1260 1261 1262 1263 1264 1265 1266 1267 1268 1269 1270 1271 1272 1273 1274 1275 1276 1277 1278 1279 1280
|
~/project/stetl/git/examples/basics/10_jinja2_templating ~/project/stetl/git/examples/basics
==== running etl.sh for 10_jinja2_templating ====
2018-07-04 15:50:03,805 util INFO Found cStringIO, good!
2018-07-04 15:50:03,817 util INFO Found lxml.etree, native XML parsing, fabulous!
2018-07-04 15:50:03,853 util INFO Found GDAL/OGR Python bindings, super!!
2018-07-04 15:50:03,859 main INFO Stetl version = 1.2-rc3
2018-07-04 15:50:03,860 ETL INFO INIT - Stetl version is 1.2-rc3
2018-07-04 15:50:03,860 ETL INFO Config/working dir = /Users/just/project/stetl/git/examples/basics/10_jinja2_templating
2018-07-04 15:50:03,860 ETL INFO Reading config_file = etl.cfg
2018-07-04 15:50:03,862 ETL INFO START
2018-07-04 15:50:03,862 util INFO Timer start: total ETL
2018-07-04 15:50:03,862 chain INFO Assembling Chain: input_json|filter_template_xml|output_xml_file...
2018-07-04 15:50:03,864 input INFO cfg = {'class': 'inputs.fileinput.JsonFileInput', 'file_path': 'input/cities.json'}
2018-07-04 15:50:03,865 fileinput INFO file_list=['input/cities.json']
2018-07-04 15:50:03,866 output INFO cfg = {'class': 'outputs.fileoutput.FileOutput', 'file_path': 'output/cities.xml'}
2018-07-04 15:50:03,866 fileoutput INFO working dir /Users/just/project/stetl/git/examples/basics/10_jinja2_templating
2018-07-04 15:50:03,866 chain INFO Running Chain: input_json|filter_template_xml|output_xml_file
2018-07-04 15:50:03,866 templatingfilter INFO Init: templating
2018-07-04 15:50:03,888 templatingfilter INFO template file read and template created OK: templates/cities-json2xml.jinja2
2018-07-04 15:50:03,888 fileinput INFO Read/parse for start for file=input/cities.json....
2018-07-04 15:50:03,889 fileinput INFO Read/parse ok for file=input/cities.json
2018-07-04 15:50:03,889 fileinput INFO all files done
2018-07-04 15:50:03,889 fileoutput INFO writing to file output/cities.xml
2018-07-04 15:50:03,889 fileoutput INFO written to output/cities.xml
2018-07-04 15:50:03,889 component INFO JsonFileInput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:03,889 templatingfilter INFO Exit: templating
2018-07-04 15:50:03,889 component INFO Jinja2TemplatingFilter invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:03,889 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:03,889 chain INFO DONE - 1 rounds - chain=input_json|filter_template_xml|output_xml_file
2018-07-04 15:50:03,889 chain INFO Assembling Chain: input_json|filter_template_gml|output_gml_file...
2018-07-04 15:50:03,890 input INFO cfg = {'class': 'inputs.fileinput.JsonFileInput', 'file_path': 'input/cities.json'}
2018-07-04 15:50:03,890 fileinput INFO file_list=['input/cities.json']
2018-07-04 15:50:03,890 output INFO cfg = {'class': 'outputs.fileoutput.FileOutput', 'file_path': 'output/cities.gml'}
2018-07-04 15:50:03,890 fileoutput INFO working dir /Users/just/project/stetl/git/examples/basics/10_jinja2_templating
2018-07-04 15:50:03,890 chain INFO Running Chain: input_json|filter_template_gml|output_gml_file
2018-07-04 15:50:03,890 templatingfilter INFO Init: templating
2018-07-04 15:50:03,891 templatingfilter INFO Read JSON file with globals from: input/globals.json
2018-07-04 15:50:03,896 templatingfilter INFO template file read and template created OK: templates/cities-json2gml.jinja2
2018-07-04 15:50:03,896 fileinput INFO Read/parse for start for file=input/cities.json....
2018-07-04 15:50:03,896 fileinput INFO Read/parse ok for file=input/cities.json
2018-07-04 15:50:03,896 fileinput INFO all files done
2018-07-04 15:50:03,902 fileoutput INFO writing to file output/cities.gml
2018-07-04 15:50:03,902 fileoutput INFO written to output/cities.gml
2018-07-04 15:50:03,903 component INFO JsonFileInput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:03,903 templatingfilter INFO Exit: templating
2018-07-04 15:50:03,903 component INFO Jinja2TemplatingFilter invokes=1 time(total, min, max, avg) = 0.006 0.006 0.006 0.006
2018-07-04 15:50:03,903 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:03,903 chain INFO DONE - 1 rounds - chain=input_json|filter_template_gml|output_gml_file
2018-07-04 15:50:03,903 chain INFO Assembling Chain: input_geojson|filter_template_geojson2gml|output_gml_file2...
2018-07-04 15:50:03,903 input INFO cfg = {'output_format': 'geojson_collection', 'class': 'inputs.fileinput.JsonFileInput', 'file_path': 'https://raw.githubusercontent.com/justb4/stetl/master/examples/basics/10_jinja2_templating/input/cities-gjson.json'}
2018-07-04 15:50:03,903 fileinput INFO file_list=['https://raw.githubusercontent.com/justb4/stetl/master/examples/basics/10_jinja2_templating/input/cities-gjson.json']
2018-07-04 15:50:03,903 output INFO cfg = {'class': 'outputs.fileoutput.FileOutput', 'file_path': 'output/cities-gjson.gml'}
2018-07-04 15:50:03,903 fileoutput INFO working dir /Users/just/project/stetl/git/examples/basics/10_jinja2_templating
2018-07-04 15:50:03,903 chain INFO Running Chain: input_geojson|filter_template_geojson2gml|output_gml_file2
2018-07-04 15:50:03,903 templatingfilter INFO Init: templating
2018-07-04 15:50:03,903 templatingfilter INFO Read JSON file with globals from: input/globals.json
2018-07-04 15:50:03,904 templatingfilter INFO Read JSON file with globals from: https://raw.githubusercontent.com/justb4/stetl/master/examples/basics/10_jinja2_templating/input/more-globals.json
2018-07-04 15:50:04,608 templatingfilter INFO template file read and template created OK: templates/cities-gjson2gml.jinja2
2018-07-04 15:50:04,608 fileinput INFO Read/parse for start for file=https://raw.githubusercontent.com/justb4/stetl/master/examples/basics/10_jinja2_templating/input/cities-gjson.json....
2018-07-04 15:50:05,122 fileinput INFO Read/parse ok for file=https://raw.githubusercontent.com/justb4/stetl/master/examples/basics/10_jinja2_templating/input/cities-gjson.json
2018-07-04 15:50:05,122 fileinput INFO all files done
2018-07-04 15:50:05,137 fileoutput INFO writing to file output/cities-gjson.gml
2018-07-04 15:50:05,137 fileoutput INFO written to output/cities-gjson.gml
2018-07-04 15:50:05,137 component INFO JsonFileInput invokes=1 time(total, min, max, avg) = 0.514 0.514 0.514 0.514
2018-07-04 15:50:05,137 templatingfilter INFO Exit: templating
2018-07-04 15:50:05,137 component INFO Jinja2TemplatingFilter invokes=1 time(total, min, max, avg) = 0.015 0.015 0.015 0.015
2018-07-04 15:50:05,138 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:05,138 chain INFO DONE - 1 rounds - chain=input_geojson|filter_template_geojson2gml|output_gml_file2
2018-07-04 15:50:05,138 chain INFO Assembling Chain: input_geojson|filter_template_geojson2gml|output_std...
2018-07-04 15:50:05,138 input INFO cfg = {'output_format': 'geojson_collection', 'class': 'inputs.fileinput.JsonFileInput', 'file_path': 'https://raw.githubusercontent.com/justb4/stetl/master/examples/basics/10_jinja2_templating/input/cities-gjson.json'}
2018-07-04 15:50:05,138 fileinput INFO file_list=['https://raw.githubusercontent.com/justb4/stetl/master/examples/basics/10_jinja2_templating/input/cities-gjson.json']
2018-07-04 15:50:05,138 output INFO cfg = {'class': 'outputs.standardoutput.StandardOutput'}
2018-07-04 15:50:05,138 chain INFO Running Chain: input_geojson|filter_template_geojson2gml|output_std
2018-07-04 15:50:05,138 templatingfilter INFO Init: templating
2018-07-04 15:50:05,138 templatingfilter INFO Read JSON file with globals from: input/globals.json
2018-07-04 15:50:05,139 templatingfilter INFO Read JSON file with globals from: https://raw.githubusercontent.com/justb4/stetl/master/examples/basics/10_jinja2_templating/input/more-globals.json
2018-07-04 15:50:05,213 templatingfilter INFO template file read and template created OK: templates/cities-gjson2gml.jinja2
2018-07-04 15:50:05,214 fileinput INFO Read/parse for start for file=https://raw.githubusercontent.com/justb4/stetl/master/examples/basics/10_jinja2_templating/input/cities-gjson.json....
2018-07-04 15:50:05,274 fileinput INFO Read/parse ok for file=https://raw.githubusercontent.com/justb4/stetl/master/examples/basics/10_jinja2_templating/input/cities-gjson.json
2018-07-04 15:50:05,274 fileinput INFO all files done
2018-07-04 15:50:05,283 component INFO JsonFileInput invokes=1 time(total, min, max, avg) = 0.061 0.061 0.061 0.061
2018-07-04 15:50:05,283 templatingfilter INFO Exit: templating
2018-07-04 15:50:05,283 component INFO Jinja2TemplatingFilter invokes=1 time(total, min, max, avg) = 0.008 0.008 0.008 0.008
2018-07-04 15:50:05,283 component INFO StandardOutput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:05,283 chain INFO DONE - 1 rounds - chain=input_geojson|filter_template_geojson2gml|output_std
2018-07-04 15:50:05,283 chain INFO Assembling Chain: input_addresses_csv|convert_record_array_to_struct|filter_template_addresses2inspire|output_inspire_addresses...
2018-07-04 15:50:05,283 input INFO cfg = {'class': 'inputs.fileinput.CsvFileInput', 'file_path': 'input/addresses.csv'}
2018-07-04 15:50:05,283 fileinput INFO file_list=['input/addresses.csv']
2018-07-04 15:50:05,284 output INFO cfg = {'class': 'outputs.fileoutput.FileOutput', 'file_path': 'output/inspire-addresses.gml'}
2018-07-04 15:50:05,284 fileoutput INFO working dir /Users/just/project/stetl/git/examples/basics/10_jinja2_templating
2018-07-04 15:50:05,284 chain INFO Running Chain: input_addresses_csv|convert_record_array_to_struct|filter_template_addresses2inspire|output_inspire_addresses
2018-07-04 15:50:05,284 fileinput INFO Open CSV file: input/addresses.csv
2018-07-04 15:50:05,284 templatingfilter INFO Init: templating
2018-07-04 15:50:05,284 templatingfilter INFO Read JSON file with globals from: input/addresses-globals.json
2018-07-04 15:50:05,310 templatingfilter INFO template file read and template created OK: templates/addresses2inspire-ad.jinja2
2018-07-04 15:50:05,318 fileoutput INFO writing to file output/inspire-addresses.gml
2018-07-04 15:50:05,319 fileoutput INFO written to output/inspire-addresses.gml
2018-07-04 15:50:05,319 component INFO CsvFileInput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:05,319 component INFO FormatConverter invokes=1 time(total, min, max, avg) = 0.002 0.002 0.002 0.002
2018-07-04 15:50:05,319 templatingfilter INFO Exit: templating
2018-07-04 15:50:05,319 component INFO Jinja2TemplatingFilter invokes=1 time(total, min, max, avg) = 0.006 0.006 0.006 0.006
2018-07-04 15:50:05,319 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:05,319 chain INFO DONE - 1 rounds - chain=input_addresses_csv|convert_record_array_to_struct|filter_template_addresses2inspire|output_inspire_addresses
2018-07-04 15:50:05,319 util INFO Timer end: total ETL time=1.0 sec
2018-07-04 15:50:05,319 ETL INFO ALL DONE
<?xml version='1.0' encoding='utf-8'?>
<cities:FeatureCollection xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xmlns:cities="http://cities.maptools.org/"
xmlns:gml="http://www.opengis.net/gml"
xsi:schemaLocation="http://cities.maptools.org/ ../gmlcities.xsd http://www.opengis.net/gml http://schemas.opengis.net/gml/2.1.2/feature.xsd">
<!--
Generated with a Jinja2 template. The 'globs' variables come from the file globals.json containing global
variables/structures. The actual/dynamic data (cities) comes from the input CSV file cities.json.
Also a file with macros templates/macros.tpl.xml is imported, allowing reuse for common structures like INSPIRE id's.
-->
<gml:description>
This example tests GML generation with Jinja2 templating, including the use of Jinja2 globals., such as for this description. Globals provide more or less constant/semi static information like point of contacts, global names, id-prefixes etc.
</gml:description>
<!-- Rendered by macro render_name() -->
<gml:name>
Test for GML generation via Jinja2 templating
</gml:name>
<!-- bbox present in geojson input -->
<gml:boundedBy>
<gml:Box>
<gml:coord>
<gml:X>4.88</gml:X>
<gml:Y>41.88</gml:Y>
</gml:coord>
<gml:coord>
<gml:X>12.52</gml:X>
<gml:Y>53.98</gml:Y>
</gml:coord>
</gml:Box>
</gml:boundedBy>
<gml:featureMember>
<cities:City>
<cities:name>Amsterdam</cities:name>
<cities:population>779808</cities:population>
<cities:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG::4258" gml:id="point-1"><gml:pos>52.3730454545455 4.89483636363636</gml:pos></gml:Point>
</cities:geometry>
</cities:City>
</gml:featureMember>
<gml:featureMember>
<cities:City>
<cities:name>Bonn</cities:name>
<cities:population>327913</cities:population>
<cities:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG::4258" gml:id="point-2"><gml:pos>50.7345545454545 7.09981818181818</gml:pos></gml:Point>
</cities:geometry>
</cities:City>
</gml:featureMember>
<gml:featureMember>
<cities:City>
<cities:name>Rome</cities:name>
<cities:population>2753000</cities:population>
<cities:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG::4258" gml:id="point-3"><gml:pos>41.88 12.52</gml:pos></gml:Point>
</cities:geometry>
</cities:City>
</gml:featureMember>
</cities:FeatureCollection>
~/project/stetl/git/examples/basics
~/project/stetl/git/examples/basics/11_formatconvert ~/project/stetl/git/examples/basics
==== running etl.sh for 11_formatconvert ====
2018-07-04 15:50:05,595 util INFO Found cStringIO, good!
2018-07-04 15:50:05,604 util INFO Found lxml.etree, native XML parsing, fabulous!
2018-07-04 15:50:05,641 util INFO Found GDAL/OGR Python bindings, super!!
2018-07-04 15:50:05,648 main INFO Stetl version = 1.2-rc3
2018-07-04 15:50:05,649 ETL INFO INIT - Stetl version is 1.2-rc3
2018-07-04 15:50:05,650 ETL INFO Config/working dir = /Users/just/project/stetl/git/examples/basics/11_formatconvert
2018-07-04 15:50:05,650 ETL INFO Reading config_file = etl.cfg
2018-07-04 15:50:05,651 ETL INFO START
2018-07-04 15:50:05,652 util INFO Timer start: total ETL
2018-07-04 15:50:05,652 chain INFO Assembling Chain: input_xml_file|convert_xml_to_string|convert_string_to_xml|output_xml_file...
2018-07-04 15:50:05,655 input INFO cfg = {'class': 'inputs.fileinput.XmlFileInput', 'file_path': 'input/cities.xml'}
2018-07-04 15:50:05,655 fileinput INFO file_list=['input/cities.xml']
2018-07-04 15:50:05,656 output INFO cfg = {'class': 'outputs.fileoutput.FileOutput', 'file_path': 'output/cities.xml'}
2018-07-04 15:50:05,656 fileoutput INFO working dir /Users/just/project/stetl/git/examples/basics/11_formatconvert
2018-07-04 15:50:05,656 chain INFO Running Chain: input_xml_file|convert_xml_to_string|convert_string_to_xml|output_xml_file
2018-07-04 15:50:05,657 fileinput INFO Read/parse for start for file=input/cities.xml....
2018-07-04 15:50:05,657 fileinput INFO Read/parse ok for file=input/cities.xml
2018-07-04 15:50:05,657 fileinput INFO all files done
2018-07-04 15:50:05,658 fileoutput INFO writing to file output/cities.xml
2018-07-04 15:50:05,658 fileoutput INFO written to output/cities.xml
2018-07-04 15:50:05,658 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.001 0.001 0.001 0.001
2018-07-04 15:50:05,658 component INFO FormatConverter invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:05,658 component INFO FormatConverter invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:05,658 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:05,658 chain INFO DONE - 1 rounds - chain=input_xml_file|convert_xml_to_string|convert_string_to_xml|output_xml_file
2018-07-04 15:50:05,658 chain INFO Assembling Chain: input_complex_xml_file|convert_to_json|output_json_file...
2018-07-04 15:50:05,658 input INFO cfg = {'class': 'inputs.fileinput.XmlFileInput', 'file_path': 'input/building-dutch-bag.xml'}
2018-07-04 15:50:05,658 fileinput INFO file_list=['input/building-dutch-bag.xml']
2018-07-04 15:50:05,659 output INFO cfg = {'class': 'outputs.fileoutput.FileOutput', 'file_path': 'output/building-dutch.json'}
2018-07-04 15:50:05,659 fileoutput INFO working dir /Users/just/project/stetl/git/examples/basics/11_formatconvert
2018-07-04 15:50:05,659 chain INFO Running Chain: input_complex_xml_file|convert_to_json|output_json_file
2018-07-04 15:50:05,659 fileinput INFO Read/parse for start for file=input/building-dutch-bag.xml....
2018-07-04 15:50:05,661 fileinput INFO Read/parse ok for file=input/building-dutch-bag.xml
2018-07-04 15:50:05,661 fileinput INFO all files done
2018-07-04 15:50:05,673 fileoutput INFO writing to file output/building-dutch.json
2018-07-04 15:50:05,678 fileoutput INFO written to output/building-dutch.json
2018-07-04 15:50:05,678 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.003 0.003 0.003 0.003
2018-07-04 15:50:05,678 component INFO FormatConverter invokes=1 time(total, min, max, avg) = 0.012 0.012 0.012 0.012
2018-07-04 15:50:05,678 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.005 0.005 0.005 0.005
2018-07-04 15:50:05,678 chain INFO DONE - 1 rounds - chain=input_complex_xml_file|convert_to_json|output_json_file
2018-07-04 15:50:05,678 chain INFO Assembling Chain: input_gml_sf_file|convert_to_geojson|output_geojson_file...
2018-07-04 15:50:05,678 input INFO cfg = {'class': 'inputs.fileinput.XmlFileInput', 'file_path': 'input/cities.gml'}
2018-07-04 15:50:05,678 fileinput INFO file_list=['input/cities.gml']
2018-07-04 15:50:05,679 output INFO cfg = {'class': 'outputs.fileoutput.FileOutput', 'file_path': 'output/cities-gjson.json'}
2018-07-04 15:50:05,679 fileoutput INFO working dir /Users/just/project/stetl/git/examples/basics/11_formatconvert
2018-07-04 15:50:05,679 chain INFO Running Chain: input_gml_sf_file|convert_to_geojson|output_geojson_file
2018-07-04 15:50:05,679 fileinput INFO Read/parse for start for file=input/cities.gml....
2018-07-04 15:50:05,679 fileinput INFO Read/parse ok for file=input/cities.gml
2018-07-04 15:50:05,679 fileinput INFO all files done
2018-07-04 15:50:05,680 fileoutput INFO writing to file output/cities-gjson.json
2018-07-04 15:50:05,681 fileoutput INFO written to output/cities-gjson.json
2018-07-04 15:50:05,681 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.001 0.001 0.001 0.001
2018-07-04 15:50:05,681 component INFO FormatConverter invokes=1 time(total, min, max, avg) = 0.001 0.001 0.001 0.001
2018-07-04 15:50:05,681 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.001 0.001 0.001 0.001
2018-07-04 15:50:05,681 chain INFO DONE - 1 rounds - chain=input_gml_sf_file|convert_to_geojson|output_geojson_file
2018-07-04 15:50:05,681 util INFO Timer end: total ETL time=0.0 sec
2018-07-04 15:50:05,681 ETL INFO ALL DONE
~/project/stetl/git/examples/basics
~/project/stetl/git/examples/basics/12_gdal_ogr ~/project/stetl/git/examples/basics
==== running etl.sh for 12_gdal_ogr ====
2018-07-04 15:50:05,942 util INFO Found cStringIO, good!
2018-07-04 15:50:05,951 util INFO Found lxml.etree, native XML parsing, fabulous!
2018-07-04 15:50:05,990 util INFO Found GDAL/OGR Python bindings, super!!
2018-07-04 15:50:05,996 main INFO Stetl version = 1.2-rc3
2018-07-04 15:50:05,997 ETL INFO INIT - Stetl version is 1.2-rc3
2018-07-04 15:50:05,997 ETL INFO Config/working dir = /Users/just/project/stetl/git/examples/basics/12_gdal_ogr
2018-07-04 15:50:05,997 ETL INFO Reading config_file = etl.cfg
2018-07-04 15:50:05,998 ETL INFO START
2018-07-04 15:50:05,998 util INFO Timer start: total ETL
2018-07-04 15:50:05,998 chain INFO Assembling Chain: input_geojson_file|geojson_coll_to_ogr_feature_arr|output_ogr_gmlfile...
2018-07-04 15:50:06,000 input INFO cfg = {'output_format': 'geojson_collection', 'class': 'inputs.fileinput.JsonFileInput', 'file_path': 'input/cities.geojson'}
2018-07-04 15:50:06,000 fileinput INFO file_list=['input/cities.geojson']
2018-07-04 15:50:06,006 output INFO cfg = {'dest_format': 'GML', 'input_format': 'ogr_feature_array', 'new_layer_name': 'cities', 'dest_data_source': 'output/cities.gml', 'overwrite': 'True', 'class': 'outputs.ogroutput.OgrOutput'}
2018-07-04 15:50:06,006 chain INFO Running Chain: input_geojson_file|geojson_coll_to_ogr_feature_arr|output_ogr_gmlfile
2018-07-04 15:50:06,006 ogroutput INFO Using GDAL/OGR version: 2020300
2018-07-04 15:50:06,026 ogroutput INFO Opened OGR dest ok: output/cities.gml
2018-07-04 15:50:06,026 fileinput INFO Read/parse for start for file=input/cities.geojson....
2018-07-04 15:50:06,026 fileinput INFO Read/parse ok for file=input/cities.geojson
2018-07-04 15:50:06,026 fileinput INFO all files done
2018-07-04 15:50:06,028 ogroutput INFO End writing to: output/cities.gml
2018-07-04 15:50:06,028 component INFO JsonFileInput invokes=1 time(total, min, max, avg) = 0.001 0.001 0.001 0.001
2018-07-04 15:50:06,028 component INFO FormatConverter invokes=1 time(total, min, max, avg) = 0.001 0.001 0.001 0.001
2018-07-04 15:50:06,029 component INFO OgrOutput invokes=1 time(total, min, max, avg) = 0.001 0.001 0.001 0.001
2018-07-04 15:50:06,029 chain INFO DONE - 1 rounds - chain=input_geojson_file|geojson_coll_to_ogr_feature_arr|output_ogr_gmlfile
2018-07-04 15:50:06,029 chain INFO Assembling Chain: input_gml_file_to_array|ogr_feature_array_to_geojson_collection|tolowercase_filter|output_file...
2018-07-04 15:50:06,029 input INFO cfg = {'source_format': 'GML', 'data_source': 'input/cities.gml', 'output_format': 'ogr_feature_array', 'class': 'inputs.ogrinput.OgrInput'}
2018-07-04 15:50:06,030 output INFO cfg = {'class': 'outputs.fileoutput.FileOutput', 'file_path': 'output/cities.geojson'}
2018-07-04 15:50:06,030 fileoutput INFO working dir /Users/just/project/stetl/git/examples/basics/12_gdal_ogr
2018-07-04 15:50:06,030 chain INFO Running Chain: input_gml_file_to_array|ogr_feature_array_to_geojson_collection|tolowercase_filter|output_file
2018-07-04 15:50:06,031 ogrinput INFO Using GDAL/OGR version: 2020300
2018-07-04 15:50:06,032 ogrinput INFO Opened OGR source ok: input/cities.gml layer count=1
2018-07-04 15:50:06,032 ogrinput INFO Start reading from OGR Source: input/cities.gml, Layer: heronfeat
2018-07-04 15:50:06,033 ogrinput INFO End reading all features from Layer: heronfeat count=5
2018-07-04 15:50:06,037 fileoutput INFO writing to file output/cities.geojson
2018-07-04 15:50:06,038 fileoutput INFO written to output/cities.geojson
2018-07-04 15:50:06,038 ogrinput INFO Closing OGR source: input/cities.gml
2018-07-04 15:50:06,038 component INFO OgrInput invokes=2 time(total, min, max, avg) = 0.001 0.001 0.001 0.000
2018-07-04 15:50:06,038 component INFO FormatConverter invokes=2 time(total, min, max, avg) = 0.004 0.004 0.004 0.002
2018-07-04 15:50:06,038 component INFO ToLowerFilter invokes=2 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:06,038 component INFO FileOutput invokes=2 time(total, min, max, avg) = 0.001 0.001 0.001 0.001
2018-07-04 15:50:06,038 chain INFO DONE - 2 rounds - chain=input_gml_file_to_array|ogr_feature_array_to_geojson_collection|tolowercase_filter|output_file
2018-07-04 15:50:06,038 chain INFO Assembling Chain: input_gml_file|output_ogr_shapefile...
2018-07-04 15:50:06,038 input INFO cfg = {'source_format': 'GML', 'data_source': 'input/cities.gml', 'output_format': 'ogr_feature', 'source_options': "{'GDAL_CACHEMAX': '64', 'CPL_DEBUG': 'OFF'}", 'class': 'inputs.ogrinput.OgrInput'}
2018-07-04 15:50:06,039 output INFO cfg = {'dest_format': 'ESRI Shapefile', 'input_format': 'ogr_feature', 'new_layer_name': 'cities', 'dest_data_source': 'output/cities.shp', 'overwrite': 'True', 'class': 'outputs.ogroutput.OgrOutput'}
2018-07-04 15:50:06,039 chain INFO Running Chain: input_gml_file|output_ogr_shapefile
2018-07-04 15:50:06,039 ogrinput INFO Using GDAL/OGR version: 2020300
2018-07-04 15:50:06,039 ogrinput INFO Opened OGR source ok: input/cities.gml layer count=1
2018-07-04 15:50:06,040 ogroutput INFO Using GDAL/OGR version: 2020300
2018-07-04 15:50:06,044 ogroutput INFO Opened OGR dest ok: output/cities.shp
2018-07-04 15:50:06,044 ogrinput INFO Start reading from OGR Source: input/cities.gml, Layer: heronfeat
2018-07-04 15:50:06,045 ogrinput INFO End reading from Layer: heronfeat
2018-07-04 15:50:06,045 ogroutput INFO End writing to: output/cities.shp
2018-07-04 15:50:06,045 ogrinput INFO Closing OGR source: input/cities.gml
2018-07-04 15:50:06,045 ogroutput INFO End writing to: output/cities.shp
2018-07-04 15:50:06,046 component INFO OgrInput invokes=7 time(total, min, max, avg) = 0.001 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:06,046 component INFO OgrOutput invokes=7 time(total, min, max, avg) = 0.001 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:06,046 chain INFO DONE - 7 rounds - chain=input_gml_file|output_ogr_shapefile
2018-07-04 15:50:06,046 util INFO Timer end: total ETL time=0.0 sec
2018-07-04 15:50:06,046 ETL INFO ALL DONE
~/project/stetl/git/examples/basics
~/project/stetl/git/examples/basics/13_dbinput ~/project/stetl/git/examples/basics
==== running etl.sh for 13_dbinput ====
2018-07-04 15:50:06,346 util INFO Found cStringIO, good!
2018-07-04 15:50:06,355 util INFO Found lxml.etree, native XML parsing, fabulous!
2018-07-04 15:50:06,391 util INFO Found GDAL/OGR Python bindings, super!!
2018-07-04 15:50:06,397 main INFO Stetl version = 1.2-rc3
2018-07-04 15:50:06,398 ETL INFO INIT - Stetl version is 1.2-rc3
2018-07-04 15:50:06,398 ETL INFO Config/working dir = /Users/just/project/stetl/git/examples/basics/13_dbinput
2018-07-04 15:50:06,398 ETL INFO Reading config_file = etl.cfg
2018-07-04 15:50:06,400 ETL INFO START
2018-07-04 15:50:06,400 util INFO Timer start: total ETL
2018-07-04 15:50:06,400 chain INFO Assembling Chain: input_sqlite_all|convert_records_to_json|output_cities_file...
2018-07-04 15:50:06,413 input INFO cfg = {'read_once': 'True', 'query': 'select * from cities', 'table': 'cities', 'database_name': 'input/cities.sdb', 'output_format': 'record_array', 'class': 'inputs.dbinput.SqliteDbInput'}
2018-07-04 15:50:06,416 output INFO cfg = {'class': 'outputs.fileoutput.FileOutput', 'file_path': 'output/cities.json'}
2018-07-04 15:50:06,417 fileoutput INFO working dir /Users/just/project/stetl/git/examples/basics/13_dbinput
2018-07-04 15:50:06,417 chain INFO Running Chain: input_sqlite_all|convert_records_to_json|output_cities_file
2018-07-04 15:50:06,417 dbinput INFO Connect to SQLite DB: input/cities.sdb
2018-07-04 15:50:06,417 dbinput INFO Connect to SQLite DB: input/cities.sdb
2018-07-04 15:50:06,418 dbinput INFO 3 records read
2018-07-04 15:50:06,418 dbinput INFO Nothing to do. All file_records done
2018-07-04 15:50:06,419 fileoutput INFO writing to file output/cities.json
2018-07-04 15:50:06,419 fileoutput INFO written to output/cities.json
2018-07-04 15:50:06,419 component INFO SqliteDbInput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:06,419 component INFO FormatConverter invokes=1 time(total, min, max, avg) = 0.001 0.001 0.001 0.001
2018-07-04 15:50:06,419 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:06,419 chain INFO DONE - 1 rounds - chain=input_sqlite_all|convert_records_to_json|output_cities_file
2018-07-04 15:50:06,419 chain INFO Assembling Chain: input_sqlite_single|convert_record_to_json|output_city_file...
2018-07-04 15:50:06,419 input INFO cfg = {'read_once': 'True', 'query': "select * from cities where name = 'Rome'", 'table': 'cities', 'database_name': 'input/cities.sdb', 'output_format': 'record', 'class': 'inputs.dbinput.SqliteDbInput'}
2018-07-04 15:50:06,419 output INFO cfg = {'class': 'outputs.fileoutput.FileOutput', 'file_path': 'output/city.json'}
2018-07-04 15:50:06,420 fileoutput INFO working dir /Users/just/project/stetl/git/examples/basics/13_dbinput
2018-07-04 15:50:06,420 chain INFO Running Chain: input_sqlite_single|convert_record_to_json|output_city_file
2018-07-04 15:50:06,420 dbinput INFO Connect to SQLite DB: input/cities.sdb
2018-07-04 15:50:06,420 dbinput INFO Connect to SQLite DB: input/cities.sdb
2018-07-04 15:50:06,421 dbinput INFO 1 records read
2018-07-04 15:50:06,421 dbinput INFO Nothing to do. All file_records done
2018-07-04 15:50:06,421 fileoutput INFO writing to file output/city.json
2018-07-04 15:50:06,421 fileoutput INFO written to output/city.json
2018-07-04 15:50:06,421 component INFO SqliteDbInput invokes=1 time(total, min, max, avg) = 0.001 0.001 0.001 0.001
2018-07-04 15:50:06,421 component INFO FormatConverter invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:06,421 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:06,421 chain INFO DONE - 1 rounds - chain=input_sqlite_single|convert_record_to_json|output_city_file
2018-07-04 15:50:06,421 util INFO Timer end: total ETL time=0.0 sec
2018-07-04 15:50:06,421 ETL INFO ALL DONE
~/project/stetl/git/examples/basics
~/project/stetl/git/examples/basics/14_logfileinput ~/project/stetl/git/examples/basics
==== running etl.sh for 14_logfileinput ====
2018-07-04 15:50:06,691 util INFO Found cStringIO, good!
2018-07-04 15:50:06,700 util INFO Found lxml.etree, native XML parsing, fabulous!
2018-07-04 15:50:06,740 util INFO Found GDAL/OGR Python bindings, super!!
2018-07-04 15:50:06,746 main INFO Stetl version = 1.2-rc3
2018-07-04 15:50:06,747 ETL INFO INIT - Stetl version is 1.2-rc3
2018-07-04 15:50:06,747 ETL INFO Config/working dir = /Users/just/project/stetl/git/examples/basics/14_logfileinput
2018-07-04 15:50:06,747 ETL INFO Reading config_file = etl.cfg
2018-07-04 15:50:06,748 ETL WARNING Expanding config arguments (non fatal yet): argument of type 'NoneType' is not iterable
2018-07-04 15:50:06,748 ETL INFO START
2018-07-04 15:50:06,748 util INFO Timer start: total ETL
2018-07-04 15:50:06,748 chain INFO Assembling Chain: input_apache_log|to_record_array|output_std...
2018-07-04 15:50:06,751 input INFO cfg = {'key_map': '{\'%>s\': \'status\', \'%D\': \'deltat\', \'%{User-agent}i\': \'agent\', \'%b\': \'bytes\', \'%{Referer}i\': \'referer\', \'%t\': \'time\', "\'%h": \'host\', \'%r\': \'request\'}', 'log_format': '%h %l %u %t \\"%r\\" %>s %b \\"%{Referer}i\\" \\"%{User-agent}i\\" %D', 'filename_pattern': '*.log', 'file_path': 'input', 'class': 'inputs.fileinput.ApacheLogFileInput'}
2018-07-04 15:50:06,751 fileinput INFO file_list=['input/apache.log', 'input/apache2.log']
2018-07-04 15:50:06,754 output INFO cfg = {'class': 'outputs.standardoutput.StandardOutput'}
2018-07-04 15:50:06,754 chain INFO Running Chain: input_apache_log|to_record_array|output_std
2018-07-04 15:50:06,754 fileinput INFO file opened : input/apache.log
2018-07-04 15:50:06,755 fileinput INFO EOF file
2018-07-04 15:50:06,755 fileinput INFO file opened : input/apache2.log
[{'status': 200, 'deltat': 2580, 'request': '/map/gast/tms/1.0.0/opentopo/EPSG28992/6/32/40.png', 'bytes': 32085, 'agent': 'Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; rv:11.0) like Gecko', 'referer': 'http://217.21.192.135/sekaarten/?id=baggeren', 'key': 'fbc25dbc7cc817a75f0b1bee87958480', 'time': 20150420084459}, {'status': 200, 'deltat': 2939, 'request': '/map/gast/tms/1.0.0/opentopo/EPSG28992/6/32/41.png', 'bytes': 10891, 'agent': 'Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; rv:11.0) like Gecko', 'referer': 'http://217.21.192.135/sekaarten/?id=baggeren', 'key': '64d17eacf0a99b5fb60c040bd225d4f0', 'time': 20150420084459}, {'status': 200, 'deltat': 30144, 'request': '/map/gast/tms/1.0.0/opentopo/EPSG28992/8/93/112.png', 'bytes': 6859, 'agent': 'Mozilla/5.0 (Windows NT 6.1; Trident/7.0; rv:11.0) like Gecko', 'referer': 'http://kadviewer.kademo.nl/', 'key': 'c26f94f4ff9553192ccb4249ea18ff2f', 'time': 20150422150832}, {'status': 200, 'deltat': 109691, 'request': '/map/gast/tms/1.0.0/opentopo/EPSG28992/12/2306/1962.png', 'bytes': 19305, 'agent': 'Mozilla/5.0 (Windows NT 6.1; Trident/7.0; rv:11.0) like Gecko', 'referer': 'http://kadviewer.kademo.nl/', 'key': 'abb1f1f70221783eb964cc2953c8339e', 'time': 20150422151830}, {'status': 404, 'deltat': 1817, 'request': '/map/gast/tms/1.0.0/bonne_test/EPSG900913/1', 'bytes': 141, 'agent': 'Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)', 'referer': None, 'key': '4835bb27732d37696244e98e713789ab', 'time': 20150422153023}, {'status': 200, 'deltat': 2208, 'request': '/map/gast/tiles/opentopo/EPSG900913/9/263/167.png', 'bytes': 30537, 'agent': 'Mozilla/5.0 (iPad; CPU OS 8_3 like Mac OS X) AppleWebKit/600.1.4 (KHTML, like Gecko) Version/8.0 Mobile/12F69 Safari/600.1.4', 'referer': 'http://app.nlextract.nl/ot/opentopo.html', 'key': 'be40bc2a55abc3067cbe82cd23dfa2ba', 'time': 20150422154124}, {'status': 200, 'deltat': 1992, 'request': '/map/gast/tiles/opentopo/EPSG900913/9/262/167.png', 'bytes': 26812, 'agent': 'Mozilla/5.0 (iPad; CPU OS 8_3 like Mac OS X) AppleWebKit/600.1.4 (KHTML, like Gecko) Version/8.0 Mobile/12F69 Safari/600.1.4', 'referer': 'http://app.nlextract.nl/ot/opentopo.html', 'key': '9e885d89a89c495b637aef7f4b81de58', 'time': 20150422154124}, {'status': 304, 'deltat': 2639355, 'request': '/map/gast/tms/1.0.0/opentopo/EPSG28992/13/4187/3689.png', 'bytes': 0, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': None, 'key': '217527c654da0a4702e71b91bddac70c', 'time': 20150421123121}, {'status': 200, 'deltat': 313308, 'request': '/map/gast/tms/1.0.0/opentopo/EPSG28992/13/4187/3689.png', 'bytes': 36969, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': None, 'key': '84103846e1bdf3e83fc54894cf6781ef', 'time': 20150421123142}, {'status': 404, 'deltat': 383, 'request': '/favicon.ico', 'bytes': 279, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/tms/1.0.0/opentopo/EPSG28992/13/4187/3689.png', 'key': 'f42829bb67f1508cc61f6cdc639f254c', 'time': 20150421123143}]
[{'status': 500, 'deltat': 251096, 'request': '/map/gast/wmts', 'bytes': 469, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': None, 'key': 'a026db25148bb54e94eda0e2cba28578', 'time': 20150421123333}, {'status': 301, 'deltat': 240, 'request': '/map/gast', 'bytes': 297, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': None, 'key': '3605def476d47854f691bee0bccb46c5', 'time': 20150421123346}, {'status': 200, 'deltat': 309244, 'request': '/map/gast/demo/', 'bytes': 1912, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': None, 'key': 'c0264b5233d846225c59cb5a205d812d', 'time': 20150421123354}, {'status': 200, 'deltat': 93184, 'request': '/map/gast/demo/static/logo.png', 'bytes': 1368, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/demo/', 'key': 'fd0b3da705099c146c73922bf74b336d', 'time': 20150421123354}, {'status': 200, 'deltat': 273346, 'request': '/map/gast/demo/static/site.css', 'bytes': 686, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/demo/', 'key': 'c3cc704e044a52dd4cae1cccc7b26151', 'time': 20150421123354}, {'status': 200, 'deltat': 315229, 'request': '/map/gast/wmts/1.0.0/WMTSCapabilities.xml', 'bytes': 20873, 'agent': 'Python-urllib/2.7', 'referer': None, 'key': '5868c46b14e7bfa50e8a50de73c1d31f', 'time': 20150421123400}, {'status': 200, 'deltat': 623112, 'request': '/map/gast/demo/?wmts_capabilities', 'bytes': 2522, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/demo/', 'key': '253101243a4620aa4aa5bfc0bb565451', 'time': 20150421123400}, {'status': 200, 'deltat': 233173, 'request': '/map/gast/demo/static/site.css', 'bytes': 686, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/demo/?wmts_capabilities', 'key': 'b7799ad9fd44c6c33740bd2c1e9c1763', 'time': 20150421123401}, {'status': 200, 'deltat': 219583, 'request': '/map/gast/demo/static/logo.png', 'bytes': 1368, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/demo/?wmts_capabilities', 'key': 'eba12e7d07bada7775e46c81e4614bb4', 'time': 20150421123401}, {'status': 200, 'deltat': 18173, 'request': '/map/gast/wmts/1.0.0/WMTSCapabilities.xml', 'bytes': 2093, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/demo/', 'key': '16fdb6bc667f81dba59aa1ca1ff0e5b1', 'time': 20150421123416}]
[{'status': 500, 'deltat': 3407, 'request': '/map/gast/wmts/1.0.0', 'bytes': 475, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': None, 'key': '1c7ce8547891e786a08d45064e3c6882', 'time': 20150421123420}, {'status': 500, 'deltat': 3203, 'request': '/map/gast/wmts/1.0.0?SERVICE=WMS&REQUEST=GetCapabilities', 'bytes': 475, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': 'ac29dfd21730d13d7c9e6eb5eabb5612', 'time': 20150421123447}, {'status': 500, 'deltat': 3017, 'request': '/map/gast/wmts/1.0.0?SERVICE=WMS&REQUEST=GetCapabilities', 'bytes': 475, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': 'f44ca005c098024254c320ca7ac70e38', 'time': 20150421123447}, {'status': 500, 'deltat': 2807, 'request': '/map/gast/wmts/1.0.0?service=WMTS&SERVICE=WMS&REQUEST=GetCapabilities', 'bytes': 475, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': '1569dd11819c0b8c48173521afea549a', 'time': 20150421123527}, {'status': 500, 'deltat': 2838, 'request': '/map/gast/wmts/1.0.0?service=WMTS&SERVICE=WMS&REQUEST=GetCapabilities', 'bytes': 475, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': '926d9fea9abea2641fd6e076e70f1e76', 'time': 20150421123527}, {'status': 200, 'deltat': 355693, 'request': '/map/gast/service?REQUEST=GetCapabilities', 'bytes': 11637, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/demo/', 'key': '3bcdd748a58c2e96fca4114408d2740e', 'time': 20150421123610}, {'status': 200, 'deltat': 20349, 'request': '/map/gast/service?REQUEST=GetCapabilities', 'bytes': 11637, 'agent': 'Python-urllib/2.7', 'referer': None, 'key': 'fa2f4ec8879999eee7785d72ff1a0bfd', 'time': 20150421123613}, {'status': 200, 'deltat': 33616, 'request': '/map/gast/demo/?wms_capabilities', 'bytes': 2118, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/demo/', 'key': 'd9c685a03eb07bc0f9362a696c0a1294', 'time': 20150421123613}, {'status': 200, 'deltat': 11009, 'request': '/map/gast/demo/static/site.css', 'bytes': 686, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/demo/?wms_capabilities', 'key': 'b3c9d4eb14bb7abef34f88a1dae74540', 'time': 20150421123613}, {'status': 200, 'deltat': 548, 'request': '/map/gast/demo/static/logo.png', 'bytes': 1368, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/demo/?wms_capabilities', 'key': '28b003ccff3ae1240e97f256d4327f53', 'time': 20150421123613}]
[{'status': 200, 'deltat': 243456, 'request': '/map/gast/service?SERVICE=WMS&REQUEST=GetCapabilities', 'bytes': 11637, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': 'de593d9eecf62db260435229e2e46315', 'time': 20150421123639}, {'status': 200, 'deltat': 18184, 'request': '/map/gast/service?SERVICE=WMS&REQUEST=GetCapabilities', 'bytes': 11637, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': '7ffbfd35d514a9680ac4ff9c2622a3ad', 'time': 20150421123657}, {'status': 200, 'deltat': 23229, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&SLD_VERSION=1.1.0&REQUEST=GetLegendGraphic&FORMAT=image/jpeg&LAYER=opentopo&STYLE=', 'bytes': 299, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': '9d81ea882f444582ea7b15e64eb971eb', 'time': 20150421123657}, {'status': 200, 'deltat': 2497535, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.88164117735196346,52.31994791109101328,4.89823868298099274,52.32472313490021776&SRS=EPSG:4326&WIDTH=2304&HEIGHT=663&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 435275, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': '05d9712c466b2f0a242aa32ab62360c7', 'time': 20150421123657}, {'status': 200, 'deltat': 2524536, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.88229860033138774,52.32140511929905102,4.89059794862468866,52.32379346153169308&SRS=EPSG:4326&WIDTH=2304&HEIGHT=663&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 303472, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': '6ee1d1ae5ec26a3376577c9e20a01e30', 'time': 20150421123831}, {'status': 200, 'deltat': 100590, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.88262727962318266,52.32213390486452909,4.88677710265483434,52.32332825857095315&SRS=EPSG:4326&WIDTH=2304&HEIGHT=663&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 211421, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': 'fe303557f4bfa82bd2136693274663f6', 'time': 20150421123835}, {'status': 200, 'deltat': 733634, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.87973479282001321,52.32194070900506233,4.88388482393072909,52.32313536508878826&SRS=EPSG:4326&WIDTH=2303&HEIGHT=663&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 203168, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': '4a6d5c492270562dd816a0f276ea5aed', 'time': 20150421123836}, {'status': 200, 'deltat': 720723, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.87937162596551133,52.32102294377313711,4.88767136038388816,52.32341189790105318&SRS=EPSG:4326&WIDTH=2304&HEIGHT=663&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 285902, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': '161bb9320ab7c2ac2a8b36848a7fede4', 'time': 20150421123840}, {'status': 200, 'deltat': 208428, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.87864515655996378,52.31919416543242818,4.89524331676138758,52.32397064165057543&SRS=EPSG:4326&WIDTH=2304&HEIGHT=663&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 415065, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': '396f1c809d4533ce220fc9e791b09470', 'time': 20150421123842}, {'status': 200, 'deltat': 2053654, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.87719189388992547,52.31554442593828469,4.91038298583838273,52.32509165098211668&SRS=EPSG:4326&WIDTH=2304&HEIGHT=663&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 533192, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': 'f1fd0a66c30f41e4473cefa66fc8569d', 'time': 20150421123843}]
[{'status': 200, 'deltat': 2593224, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.87428421837786807,52.30826341961707726,4.94064551776737115,52.32733496592636868&SRS=EPSG:4326&WIDTH=2306&HEIGHT=663&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 682877, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': '60ebd56e37c277497c5f240d8bf3daa7', 'time': 20150421123846}, {'status': 200, 'deltat': 1725956, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.86846485697270648,52.29372410561443019,5.0011039973744742,52.33177562740801392&SRS=EPSG:4326&WIDTH=2299&HEIGHT=659&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 844321, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': 'b64545dc6810fb6602144803ff8fcb8e', 'time': 20150421123849}, {'status': 200, 'deltat': 716366, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.8386881899267058,52.26824729178458995,5.10374475576453523,52.34410523064467924&SRS=EPSG:4326&WIDTH=2302&HEIGHT=659&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 812335, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': '0f61d6d8e4b00a1a9e732b8a02138f57', 'time': 20150421123853}, {'status': 200, 'deltat': 692476, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.77894557379025109,52.21751645706958556,5.30817506128564354,52.36825370247181155&SRS=EPSG:4326&WIDTH=2298&HEIGHT=655&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 779078, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': '741f0dc2e3305751cd9613bed8b0ae46', 'time': 20150421123855}, {'status': 200, 'deltat': 695197, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.65903537607470053,52.11649001307762319,5.72053894950784159,52.41540823102885582&SRS=EPSG:4326&WIDTH=2309&HEIGHT=650&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 682860, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': 'ffefe9ff5feb63c3af546002ade0299f', 'time': 20150421123857}, {'status': 200, 'deltat': 591190, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.4167226914176565,51.91069625797302223,6.55825004706046322,52.51214626634031646&SRS=EPSG:4326&WIDTH=2320&HEIGHT=651&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 817945, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': 'a87aae11975afbebddf2654b1d9bca65', 'time': 20150421123859}, {'status': 200, 'deltat': 287085, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=3.91960989940337212,51.47689466327312147,7.27517291177000036,52.7270589886328267&SRS=EPSG:4326&WIDTH=1819&HEIGHT=678&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 593483, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': 'f0157c2137e2a31f18bf71f9b31a1e56', 'time': 20150421123901}, {'status': 200, 'deltat': 198528, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=3.19733405078999988,50.67175914229999734,7.27517291177000036,53.22782022896856802&SRS=EPSG:4326&WIDTH=1106&HEIGHT=693&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 317587, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': 'ec55a6dddfccbc8fbd11d2496bf91204', 'time': 20150421123903}, {'status': 200, 'deltat': 441662, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=3.91960989940337212,51.47689466327312147,7.27517291177000036,52.7270589886328267&SRS=EPSG:4326&WIDTH=1819&HEIGHT=678&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 593483, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': '2e043e6404cd886fe70dd690e3ecd945', 'time': 20150421123905}, {'status': 200, 'deltat': 280547, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.41536394174170166,51.91072288572560467,6.5568903118917472,52.51213375315666809&SRS=EPSG:4326&WIDTH=2320&HEIGHT=651&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 816821, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': '057695bc96ec6d202f3672acca93aa4b', 'time': 20150421123906}]
[{'status': 200, 'deltat': 1008772, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.65634629858872362,52.116047279264194,5.71784019987099157,52.41501733832054555&SRS=EPSG:4326&WIDTH=2308&HEIGHT=650&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 687988, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': 'a6fa14558bdaaa9176546374ddb6be05', 'time': 20150421123906}, {'status': 200, 'deltat': 252914, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.77526617288530009,52.21666243590728129,5.30452226852465358,52.36744868951445397&SRS=EPSG:4326&WIDTH=2298&HEIGHT=655&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 780735, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': 'e1e87302396fd0e2a5752650d6897111', 'time': 20150421123908}, {'status': 200, 'deltat': 1417207, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.83418264422592525,52.26709043929363219,5.09925482811618025,52.34297845193199805&SRS=EPSG:4326&WIDTH=2301&HEIGHT=659&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 811840, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': '9b2c0daf25a7d6f2591e3b5a41896ac1', 'time': 20150421123909}, {'status': 200, 'deltat': 390434, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.86354731013050845,52.29241753793147041,4.99619483822194965,52.33048548888342566&SRS=EPSG:4326&WIDTH=2298&HEIGHT=659&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 847725, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': '8912a06341cd567da7a18cc1ef2114f6', 'time': 20150421123911}, {'status': 200, 'deltat': 563186, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.7983907345342578,52.30068851058355506,4.9312260836665196,52.33897414157453909&SRS=EPSG:4326&WIDTH=2311&HEIGHT=666&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 787450, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': 'c67087d9584e1a26046096c78c99faa1', 'time': 20150421123926}, {'status': 200, 'deltat': 927171, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.82507774754855934,52.31044365558483378,4.89150389391215157,52.32959746344092622&SRS=EPSG:4326&WIDTH=2311&HEIGHT=666&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 688485, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': '897e6a2fd0c9a7feb3d8737eaf77d947', 'time': 20150421123930}, {'status': 200, 'deltat': 440856, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.83838815624467333,52.31532167233618935,4.87160336391397841,52.32490134373566093&SRS=EPSG:4326&WIDTH=2310&HEIGHT=666&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 628432, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': '73be724835c429fc856508bcbc74bf10', 'time': 20150421123932}, {'status': 200, 'deltat': 1516336, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.84504031284738623,52.31776082437207975,4.86164845074635377,52.32255135217919673&SRS=EPSG:4326&WIDTH=2310&HEIGHT=666&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 486076, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': '3c18101916f058741694ae7d4398d340', 'time': 20150421123936}, {'status': 200, 'deltat': 1670260, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.848365629293232,52.31898043640777018,4.85666983181408707,52.32137587336808338&SRS=EPSG:4326&WIDTH=2310&HEIGHT=666&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 282828, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': '89096b187b30cf7a12720ac2dbe69451', 'time': 20150421123940}, {'status': 200, 'deltat': 215961, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.85002809706240523,52.31959025144288944,4.85418023172258284,52.32078801319095618&SRS=EPSG:4326&WIDTH=2310&HEIGHT=666&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 194466, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': '9845447cf326cdddbe51de9b99efd693', 'time': 20150421123943}]
[{'status': 200, 'deltat': 96065, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.85085928333482297,52.31989516121636541,4.8529353590157136,52.32049405290776178&SRS=EPSG:4326&WIDTH=2310&HEIGHT=666&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 160121, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': '5ca5425f30d7a1fcf5ccf56f3fc0691a', 'time': 20150421123945}, {'status': 200, 'deltat': 390538, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.8512748645681425,52.32004761666721748,4.85231290449639907,52.3203470652173479&SRS=EPSG:4326&WIDTH=2310&HEIGHT=666&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 123241, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': '8f0749a7c797adc027e62436f01f4a23', 'time': 20150421123946}, {'status': 200, 'deltat': 147369, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.85093093342004078,52.31990548311836164,4.85300700678140018,52.32050437106456542&SRS=EPSG:4326&WIDTH=2310&HEIGHT=666&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 157238, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': 'c80c964858492c86cb997966498dbf58', 'time': 20150421124002}, {'status': 200, 'deltat': 109193, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.85024305101700559,52.31962122226092049,4.85439517176004642,52.32081896153741951&SRS=EPSG:4326&WIDTH=2310&HEIGHT=666&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 199468, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': '10fe5a035dbe0ea11340e40d3c01b811', 'time': 20150421124003}, {'status': 200, 'deltat': 218693, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.84886720578289587,52.31905272550537234,4.8571713433574466,52.32144805759834583&SRS=EPSG:4326&WIDTH=2310&HEIGHT=666&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 300113, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': 'c6ddc044e9702e628c9495b1bee86b15', 'time': 20150421124004}, {'status': 200, 'deltat': 266274, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.84611519359641374,52.3179158318183184,4.86272305315710884,52.32270591019437944&SRS=EPSG:4326&WIDTH=2310&HEIGHT=666&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 489524, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': 'f0083ca70ca48d2e9b33c7fa472ba3c6', 'time': 20150421124005}, {'status': 200, 'deltat': 268617, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.84060980355999337,52.31564884059808662,4.87382386563584902,52.32522665442184007&SRS=EPSG:4326&WIDTH=2310&HEIGHT=666&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 634317, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': '5a5e1ad7ef6870e4d28408115ba97749', 'time': 20150421124006}, {'status': 200, 'deltat': 257901, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.82961476217944696,52.31111656397721532,4.89603623584240832,52.33026278690169875&SRS=EPSG:4326&WIDTH=2311&HEIGHT=666&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 696250, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': 'e24026f9511a8b052efd97e3b637c647', 'time': 20150421124007}, {'status': 200, 'deltat': 1808540, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.85319246456894948,52.32761554091926115,4.91960915414784417,52.34672235725444267&SRS=EPSG:4326&WIDTH=2305&HEIGHT=663&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 750968, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': '31da07deb0226f662fe8f64e9a8f6ecd', 'time': 20150421124009}, {'status': 500, 'deltat': 466396, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'bytes': 602, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'key': 'a8d3adda1d598ad2c368c8360956a4e0', 'time': 20150421124512}]
[{'status': 500, 'deltat': 1937, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'bytes': 602, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'key': '9241cff9f045b9f85a76d60ba6eff582', 'time': 20150421124530}, {'status': 500, 'deltat': 288315, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'bytes': 602, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'key': 'e6bd755773f52a20030b0ea0c970c8e6', 'time': 20150421124607}, {'status': 200, 'deltat': 549090, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'bytes': 331806, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'key': '406f86d0687628903fe718699246443d', 'time': 20150421124759}, {'status': 200, 'deltat': 333467, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'bytes': 334352, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'key': 'ade8d5a1dd345923570c2bbaeac79272', 'time': 20150421124803}, {'status': 200, 'deltat': 352004, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'bytes': 331806, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'key': '6a3092b4065fbab6d6ce5021353e915b', 'time': 20150421124805}, {'status': 200, 'deltat': 115182, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'bytes': 331806, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'key': 'fb2691b4811567a1dca307e121ca8075', 'time': 20150421124808}, {'status': 200, 'deltat': 115765, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'bytes': 331806, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'key': '76f87f58cfbee18cc6ca35e36a807adf', 'time': 20150421124810}, {'status': 200, 'deltat': 119957, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'bytes': 331806, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'key': '07fdf5caec6e15dbe85ffd6efb2ed5fe', 'time': 20150421124811}, {'status': 200, 'deltat': 363011, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'bytes': 331806, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'key': 'ad1b585b9fcf03dfbfa96a8f1609a12e', 'time': 20150421124813}, {'status': 200, 'deltat': 386568, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'bytes': 331806, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'key': 'bc9f48ff31eafc7cceacdcb1914b68d7', 'time': 20150421124815}]
[{'status': 200, 'deltat': 365184, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'bytes': 334352, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'key': 'efa2b4c1b5cf3e9e747cad8380cbda34', 'time': 20150421124818}, {'status': 404, 'deltat': 102, 'request': '/favicon.ico', 'bytes': 279, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'key': 'e56f8837cdc447c4ab10b34043153446', 'time': 20150421124819}, {'status': 200, 'deltat': 1757049, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.83005370038209136,52.33939510971103459,4.89651704885155681,52.35854062445694979&SRS=EPSG:4326&WIDTH=2313&HEIGHT=666&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 791655, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': 'b36af9c77920df89ff799763e0593cd8', 'time': 20150421124824}, {'status': 200, 'deltat': 1933968, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.79175980191256379,52.34824612602871241,4.85828446955923443,52.36745569430535596&SRS=EPSG:4326&WIDTH=2309&HEIGHT=667&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 749230, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': 'c9aa5f9202784faa6e4206442b10d629', 'time': 20150421124828}, {'status': 200, 'deltat': 2185241, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.77385759552589573,52.35751052638513414,4.84041867055299946,52.37675005343851353&SRS=EPSG:4326&WIDTH=2308&HEIGHT=667&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 707773, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': 'f1d2890960707e89ee7e57a4d83f3a08', 'time': 20150421124833}, {'status': 200, 'deltat': 1532564, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.77125456138848403,52.37023903120333301,4.83783806710879727,52.3894829312327488&SRS=EPSG:4326&WIDTH=2309&HEIGHT=667&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 718675, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': 'ae8ff27e7b4967ed5a36bfd2f0514332', 'time': 20150421124839}, {'status': 200, 'deltat': 1265574, 'request': '/map/gast/service?SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&BBOX=4.76145165848030949,52.37107784519862719,4.82804874484703994,52.39033814774672493&SRS=EPSG:4326&WIDTH=2308&HEIGHT=667&LAYERS=opentopo&STYLES=&FORMAT=image/jpeg&DPI=72&MAP_RESOLUTION=72&FORMAT_OPTIONS=dpi:72', 'bytes': 699224, 'agent': 'Mozilla/5.0 QGIS/2.2.0-Valmiera', 'referer': None, 'key': '6cee66783d97694e511af0408269e445', 'time': 20150421124843}, {'status': 200, 'deltat': 486046, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'bytes': 334352, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'key': '3cfbf1603cd9fdd2b835853df93e2652', 'time': 20150421124910}, {'status': 200, 'deltat': 376900, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'bytes': 331806, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'key': 'd240758bd157e4f9d04fc6414b3cb4f3', 'time': 20150421124914}, {'status': 404, 'deltat': 365, 'request': '/favicon.ico', 'bytes': 279, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'key': 'a486970683ba29295e54b0237246ac2b', 'time': 20150421124914}]
[{'status': 200, 'deltat': 340430, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'bytes': 334352, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'key': '05f1a64d9cc59ace6bb7013be9765af8', 'time': 20150421124916}, {'status': 404, 'deltat': 378, 'request': '/favicon.ico', 'bytes': 279, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'key': '195751fab160a19cea2fd1df0219e67e', 'time': 20150421124916}, {'status': 200, 'deltat': 370053, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'bytes': 334352, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'key': '675bbb13d403670483aa72bb3dc4973a', 'time': 20150421124917}, {'status': 404, 'deltat': 379, 'request': '/favicon.ico', 'bytes': 279, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'key': 'f7e53111f0cccc49cd28692e6c89cc9e', 'time': 20150421124918}, {'status': 200, 'deltat': 332777, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'bytes': 334352, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'key': 'cebb42394eb350b698d4b3f6571ad11a', 'time': 20150421124919}, {'status': 404, 'deltat': 144, 'request': '/favicon.ico', 'bytes': 279, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'key': '5fa96fd4572ce0a93262863faaf51aa8', 'time': 20150421124920}, {'status': 200, 'deltat': 109812, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'bytes': 334352, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'key': 'e580f7a6e8f7b7861e393a7cee9a35db', 'time': 20150421124921}, {'status': 404, 'deltat': 346, 'request': '/favicon.ico', 'bytes': 279, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'key': '40d4fbffb03afab8acb58f29f533483b', 'time': 20150421124921}, {'status': 200, 'deltat': 110987, 'request': '/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'bytes': 331806, 'agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/demo/?srs=EPSG%3A4326&format=image%2Fpng&wms_layer=opentopo', 'key': 'f640353f45beef5b8ea7e4a7cd69cba5', 'time': 20150421124922}, {'status': 404, 'deltat': 478, 'request': '/favicon.ico', 'bytes': 279, 'agent': 'Mozilla/5.0 (Macintosh;2018-07-04 15:50:06,762 fileinput INFO EOF file
2018-07-04 15:50:06,762 fileinput INFO EOF file list
2018-07-04 15:50:06,762 component INFO ApacheLogFileInput invokes=112 time(total, min, max, avg) = 0.006 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:06,762 component INFO FormatConverter invokes=112 time(total, min, max, avg) = 0.001 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:06,762 component INFO StandardOutput invokes=112 time(total, min, max, avg) = 0.001 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:06,762 chain INFO DONE - 112 rounds - chain=input_apache_log|to_record_array|output_std
2018-07-04 15:50:06,763 util INFO Timer end: total ETL time=0.0 sec
2018-07-04 15:50:06,763 ETL INFO ALL DONE
Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.90 Safari/537.36', 'referer': 'http://s.test.map5.nl/map/gast/service?LAYERS=opentopo&FORMAT=image%2Fpng&SRS=EPSG%3A4326&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&TRANSPARENT=TRUE&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&BBOX=3.1235377115391,50.892941613156,5.4511713191977,52.087620966958&WIDTH=1169&HEIGHT=600', 'key': 'e161bedea500f0d2201be628b14b8edf', 'time': 20150421124923}]
~/project/stetl/git/examples/basics
~/project/stetl/git/examples/basics/15_splitter ~/project/stetl/git/examples/basics
==== running etl.sh for 15_splitter ====
2018-07-04 15:50:07,056 util INFO Found cStringIO, good!
2018-07-04 15:50:07,065 util INFO Found lxml.etree, native XML parsing, fabulous!
2018-07-04 15:50:07,102 util INFO Found GDAL/OGR Python bindings, super!!
2018-07-04 15:50:07,108 main INFO Stetl version = 1.2-rc3
2018-07-04 15:50:07,109 ETL INFO INIT - Stetl version is 1.2-rc3
2018-07-04 15:50:07,109 ETL INFO Config/working dir = /Users/just/project/stetl/git/examples/basics/15_splitter
2018-07-04 15:50:07,109 ETL INFO Reading config_file = etl.cfg
2018-07-04 15:50:07,110 ETL INFO START
2018-07-04 15:50:07,110 util INFO Timer start: total ETL
2018-07-04 15:50:07,110 chain INFO Assembling Chain: input_xml_file|transformer_xslt|(output_file)(output_std)...
2018-07-04 15:50:07,113 input INFO cfg = {'class': 'inputs.fileinput.XmlFileInput', 'file_path': 'input/cities.xml'}
2018-07-04 15:50:07,113 fileinput INFO file_list=['input/cities.xml']
2018-07-04 15:50:07,116 output INFO cfg = {'class': 'outputs.fileoutput.FileOutput', 'file_path': 'output/gmlcities.gml'}
2018-07-04 15:50:07,116 fileoutput INFO working dir /Users/just/project/stetl/git/examples/basics/15_splitter
2018-07-04 15:50:07,116 output INFO cfg = {'class': 'outputs.standardoutput.StandardOutput'}
2018-07-04 15:50:07,116 chain INFO Running Chain: input_xml_file|transformer_xslt|(output_file)(output_std)
2018-07-04 15:50:07,116 fileinput INFO Read/parse for start for file=input/cities.xml....
2018-07-04 15:50:07,117 fileinput INFO Read/parse ok for file=input/cities.xml
2018-07-04 15:50:07,117 fileinput INFO all files done
2018-07-04 15:50:07,117 xsltfilter INFO XSLT Transform OK
2018-07-04 15:50:07,117 fileoutput INFO writing to file output/gmlcities.gml
2018-07-04 15:50:07,118 fileoutput INFO written to output/gmlcities.gml
2018-07-04 15:50:07,118 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.001 0.001 0.001 0.001
2018-07-04 15:50:07,118 component INFO XsltFilter invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:07,118 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:07,118 component INFO StandardOutput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:07,118 chain INFO DONE - 1 rounds - chain=input_xml_file|transformer_xslt|(output_file)(output_std)
2018-07-04 15:50:07,118 chain INFO Assembling Chain: input_xml_file |(transformer_xslt|output_file) (output_std) (transformer_xslt|output_std)...
2018-07-04 15:50:07,118 input INFO cfg = {'class': 'inputs.fileinput.XmlFileInput', 'file_path': 'input/cities.xml'}
2018-07-04 15:50:07,118 fileinput INFO file_list=['input/cities.xml']
2018-07-04 15:50:07,118 chain INFO Assembling Chain: transformer_xslt|output_file...
2018-07-04 15:50:07,119 output INFO cfg = {'class': 'outputs.fileoutput.FileOutput', 'file_path': 'output/gmlcities.gml'}
2018-07-04 15:50:07,119 fileoutput INFO working dir /Users/just/project/stetl/git/examples/basics/15_splitter
2018-07-04 15:50:07,119 output INFO cfg = {'class': 'outputs.standardoutput.StandardOutput'}
2018-07-04 15:50:07,119 chain INFO Assembling Chain: transformer_xslt|output_std...
2018-07-04 15:50:07,119 output INFO cfg = {'class': 'outputs.standardoutput.StandardOutput'}
2018-07-04 15:50:07,120 chain INFO Running Chain: input_xml_file |(transformer_xslt|output_file) (output_std) (transformer_xslt|output_std)
2018-07-04 15:50:07,120 fileinput INFO Read/parse for start for file=input/cities.xml....
2018-07-04 15:50:07,120 fileinput INFO Read/parse ok for file=input/cities.xml
2018-07-04 15:50:07,120 fileinput INFO all files done
2018-07-04 15:50:07,120 xsltfilter INFO XSLT Transform OK
2018-07-04 15:50:07,120 fileoutput INFO writing to file output/gmlcities.gml
2018-07-04 15:50:07,120 fileoutput INFO written to output/gmlcities.gml
2018-07-04 15:50:07,121 xsltfilter INFO XSLT Transform OK
2018-07-04 15:50:07,121 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:07,121 component INFO XsltFilter invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:07,121 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:07,121 component INFO StandardOutput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:07,121 component INFO XsltFilter invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:07,121 component INFO StandardOutput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:07,121 chain INFO DONE - 1 rounds - chain=input_xml_file |(transformer_xslt|output_file) (output_std) (transformer_xslt|output_std)
2018-07-04 15:50:07,121 util INFO Timer end: total ETL time=0.0 sec
2018-07-04 15:50:07,121 ETL INFO ALL DONE
<?xml version='1.0' encoding='utf-8'?>
<ogr:FeatureCollection xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:ogr="http://ogr.maptools.org/" xmlns:gml="http://www.opengis.net/gml" xsi:schemaLocation="http://ogr.maptools.org/ ../gmlcities.xsd http://www.opengis.net/gml http://schemas.opengis.net/gml/2.1.2/feature.xsd">
<gml:boundedBy>
<gml:Box>
<gml:coord>
<gml:X>-180.0</gml:X>
<gml:Y>-90.0</gml:Y>
</gml:coord>
<gml:coord>
<gml:X>180.0</gml:X>
<gml:Y>90.0</gml:Y>
</gml:coord>
</gml:Box>
</gml:boundedBy>
<gml:featureMember>
<ogr:City>
<ogr:name>Amsterdam</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>52.4,4.9</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
<gml:featureMember>
<ogr:City>
<ogr:name>Bonn</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>50.7,7.1</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
<gml:featureMember>
<ogr:City>
<ogr:name>Rome</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>41.9,12.5</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
</ogr:FeatureCollection>
<?xml version='1.0' encoding='utf-8'?>
<cities>
<city>
<name>Amsterdam</name>
<lat>52.4</lat>
<lon>4.9</lon>
</city>
<city>
<name>Bonn</name>
<lat>50.7</lat>
<lon>7.1</lon>
</city>
<city>
<name>Rome</name>
<lat>41.9</lat>
<lon>12.5</lon>
</city>
</cities>
<?xml version='1.0' encoding='utf-8'?>
<ogr:FeatureCollection xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:ogr="http://ogr.maptools.org/" xmlns:gml="http://www.opengis.net/gml" xsi:schemaLocation="http://ogr.maptools.org/ ../gmlcities.xsd http://www.opengis.net/gml http://schemas.opengis.net/gml/2.1.2/feature.xsd">
<gml:boundedBy>
<gml:Box>
<gml:coord>
<gml:X>-180.0</gml:X>
<gml:Y>-90.0</gml:Y>
</gml:coord>
<gml:coord>
<gml:X>180.0</gml:X>
<gml:Y>90.0</gml:Y>
</gml:coord>
</gml:Box>
</gml:boundedBy>
<gml:featureMember>
<ogr:City>
<ogr:name>Amsterdam</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>52.4,4.9</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
<gml:featureMember>
<ogr:City>
<ogr:name>Bonn</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>50.7,7.1</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
<gml:featureMember>
<ogr:City>
<ogr:name>Rome</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>41.9,12.5</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
</ogr:FeatureCollection>
~/project/stetl/git/examples/basics
~/project/stetl/git/examples/basics/16_merger ~/project/stetl/git/examples/basics
==== running etl.sh for 16_merger ====
2018-07-04 15:50:07,395 util INFO Found cStringIO, good!
2018-07-04 15:50:07,409 util INFO Found lxml.etree, native XML parsing, fabulous!
2018-07-04 15:50:07,447 util INFO Found GDAL/OGR Python bindings, super!!
2018-07-04 15:50:07,453 main INFO Stetl version = 1.2-rc3
2018-07-04 15:50:07,453 ETL INFO INIT - Stetl version is 1.2-rc3
2018-07-04 15:50:07,454 ETL INFO Config/working dir = /Users/just/project/stetl/git/examples/basics/16_merger
2018-07-04 15:50:07,454 ETL INFO Reading config_file = etl.cfg
2018-07-04 15:50:07,454 ETL INFO START
2018-07-04 15:50:07,455 util INFO Timer start: total ETL
2018-07-04 15:50:07,455 chain INFO Assembling Chain: (input_1) (input_2)|transformer_xslt|output_std...
2018-07-04 15:50:07,457 input INFO cfg = {'class': 'inputs.fileinput.XmlFileInput', 'file_path': 'input1/cities.xml'}
2018-07-04 15:50:07,457 fileinput INFO file_list=['input1/cities.xml']
2018-07-04 15:50:07,457 input INFO cfg = {'class': 'inputs.fileinput.XmlFileInput', 'file_path': 'input2/cities.xml'}
2018-07-04 15:50:07,457 fileinput INFO file_list=['input2/cities.xml']
2018-07-04 15:50:07,459 output INFO cfg = {'class': 'outputs.standardoutput.StandardOutput'}
2018-07-04 15:50:07,459 chain INFO Running Chain: (input_1) (input_2)|transformer_xslt|output_std
2018-07-04 15:50:07,459 fileinput INFO Read/parse for start for file=input1/cities.xml....
2018-07-04 15:50:07,459 fileinput INFO Read/parse ok for file=input1/cities.xml
2018-07-04 15:50:07,459 fileinput INFO all files done
2018-07-04 15:50:07,460 xsltfilter INFO XSLT Transform OK
2018-07-04 15:50:07,460 fileinput INFO Read/parse for start for file=input2/cities.xml....
2018-07-04 15:50:07,460 fileinput INFO Read/parse ok for file=input2/cities.xml
2018-07-04 15:50:07,460 fileinput INFO all files done
2018-07-04 15:50:07,460 xsltfilter INFO XSLT Transform OK
2018-07-04 15:50:07,461 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:07,461 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:07,461 component INFO XsltFilter invokes=2 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:07,461 component INFO StandardOutput invokes=2 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:07,461 chain INFO DONE - 1 rounds - chain=(input_1) (input_2)|transformer_xslt|output_std
2018-07-04 15:50:07,461 chain INFO Assembling Chain: (input_1) (input_2)|transformer_xslt|(output_file)(output_std)...
2018-07-04 15:50:07,461 input INFO cfg = {'class': 'inputs.fileinput.XmlFileInput', 'file_path': 'input1/cities.xml'}
2018-07-04 15:50:07,461 fileinput INFO file_list=['input1/cities.xml']
2018-07-04 15:50:07,461 input INFO cfg = {'class': 'inputs.fileinput.XmlFileInput', 'file_path': 'input2/cities.xml'}
2018-07-04 15:50:07,461 fileinput INFO file_list=['input2/cities.xml']
2018-07-04 15:50:07,462 output INFO cfg = {'class': 'outputs.fileoutput.FileOutput', 'file_path': 'output/gmlcities.gml'}
2018-07-04 15:50:07,462 fileoutput INFO working dir /Users/just/project/stetl/git/examples/basics/16_merger
2018-07-04 15:50:07,462 output INFO cfg = {'class': 'outputs.standardoutput.StandardOutput'}
2018-07-04 15:50:07,462 chain INFO Running Chain: (input_1) (input_2)|transformer_xslt|(output_file)(output_std)
2018-07-04 15:50:07,462 fileinput INFO Read/parse for start for file=input1/cities.xml....
2018-07-04 15:50:07,462 fileinput INFO Read/parse ok for file=input1/cities.xml
2018-07-04 15:50:07,462 fileinput INFO all files done
2018-07-04 15:50:07,463 xsltfilter INFO XSLT Transform OK
2018-07-04 15:50:07,463 fileoutput INFO writing to file output/gmlcities.gml
2018-07-04 15:50:07,463 fileoutput INFO written to output/gmlcities.gml
<?xml version='1.0' encoding='utf-8'?>
<ogr:FeatureCollection xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:ogr="http://ogr.maptools.org/" xmlns:gml="http://www.opengis.net/gml" xsi:schemaLocation="http://ogr.maptools.org/ ../gmlcities.xsd http://www.opengis.net/gml http://schemas.opengis.net/gml/2.1.2/feature.xsd">
<gml:boundedBy>
<gml:Box>
<gml:coord>
<gml:X>-180.0</gml:X>
<gml:Y>-90.0</gml:Y>
</gml:coord>
<gml:coord>
<gml:X>180.0</gml:X>
<gml:Y>90.0</gml:Y>
</gml:coord>
</gml:Box>
</gml:boundedBy>
<gml:featureMember>
<ogr:City>
<ogr:name>Amsterdam</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>52.4,4.9</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
<gml:featureMember>
<ogr:City>
<ogr:name>Bonn</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>50.7,7.1</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
<gml:featureMember>
<ogr:City>
<ogr:name>Rome</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>41.9,12.5</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
</ogr:FeatureCollection>
<?xml version='1.0' encoding='utf-8'?>
<ogr:FeatureCollection xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:ogr="http://ogr.maptools.org/" xmlns:gml="http://www.opengis.net/gml" xsi:schemaLocation="http://ogr.maptools.org/ ../gmlcities.xsd http://www.opengis.net/gml http://schemas.opengis.net/gml/2.1.2/feature.xsd">
<gml:boundedBy>
<gml:Box>
<gml:coord>
<gml:X>-180.0</gml:X>
<gml:Y>-90.0</gml:Y>
</gml:coord>
<gml:coord>
<gml:X>180.0</gml:X>
<gml:Y>90.0</gml:Y>
</gml:coord>
</gml:Box>
</gml:boundedBy>
<gml:featureMember>
<ogr:City>
<ogr:name>Amsterdam</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>52.4,4.9</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
<gml:featureMember>
<ogr:City>
<ogr:name>Bonn</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>50.7,7.1</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
<gml:featureMember>
<ogr:City>
<ogr:name>Rome</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>41.9,12.5</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
</ogr:FeatureCollection>
<?xml version='1.0' encoding='utf-8'?>
<ogr:FeatureCollection xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:ogr="http://ogr.maptools.org/" xmlns:gml="http://www.opengis.net/gml" xsi:schemaLocation="http://ogr.maptools.org/ ../gmlcities.xsd http://www.opengis.net/gml http://schemas.opengis.net/gml/2.1.2/feature.xsd">
<gml:boundedBy>
<gml:Box>
<gml:coord>
<gml:X>-180.0</gml:X>
<gml:Y>-90.0</gml:Y>
</gml:coord>
<gml:coord>
<gml:X>180.0</gml:X>
<gml:Y>90.0</gml:Y>
</gml:coord>
</gml:Box>
</gml:boundedBy>
<gml:featureMember>
<ogr:City>
<ogr:name>Amsterdam</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>52.4,4.9</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
<gml:featureMember>
<ogr:City>
<ogr:name>Bonn</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>50.7,7.1</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
<g2018-07-04 15:50:07,463 fileinput INFO Read/parse for start for file=input2/cities.xml....
2018-07-04 15:50:07,463 fileinput INFO Read/parse ok for file=input2/cities.xml
2018-07-04 15:50:07,463 fileinput INFO all files done
2018-07-04 15:50:07,464 xsltfilter INFO XSLT Transform OK
2018-07-04 15:50:07,464 fileoutput INFO writing to file output/gmlcities.gml
2018-07-04 15:50:07,464 fileoutput INFO written to output/gmlcities.gml
2018-07-04 15:50:07,464 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:07,464 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:07,464 component INFO XsltFilter invokes=2 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:07,464 component INFO FileOutput invokes=2 time(total, min, max, avg) = 0.001 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:07,464 component INFO StandardOutput invokes=2 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:07,464 chain INFO DONE - 1 rounds - chain=(input_1) (input_2)|transformer_xslt|(output_file)(output_std)
2018-07-04 15:50:07,464 util INFO Timer end: total ETL time=0.0 sec
2018-07-04 15:50:07,464 ETL INFO ALL DONE
ml:featureMember>
<ogr:City>
<ogr:name>Rome</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>41.9,12.5</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
</ogr:FeatureCollection>
<?xml version='1.0' encoding='utf-8'?>
<ogr:FeatureCollection xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:ogr="http://ogr.maptools.org/" xmlns:gml="http://www.opengis.net/gml" xsi:schemaLocation="http://ogr.maptools.org/ ../gmlcities.xsd http://www.opengis.net/gml http://schemas.opengis.net/gml/2.1.2/feature.xsd">
<gml:boundedBy>
<gml:Box>
<gml:coord>
<gml:X>-180.0</gml:X>
<gml:Y>-90.0</gml:Y>
</gml:coord>
<gml:coord>
<gml:X>180.0</gml:X>
<gml:Y>90.0</gml:Y>
</gml:coord>
</gml:Box>
</gml:boundedBy>
<gml:featureMember>
<ogr:City>
<ogr:name>Amsterdam</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>52.4,4.9</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
<gml:featureMember>
<ogr:City>
<ogr:name>Bonn</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>50.7,7.1</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
<gml:featureMember>
<ogr:City>
<ogr:name>Rome</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>41.9,12.5</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
</ogr:FeatureCollection>
~/project/stetl/git/examples/basics
~/project/stetl/git/examples/basics/17_sieve ~/project/stetl/git/examples/basics
==== running etl.sh for 17_sieve ====
2018-07-04 15:50:07,742 util INFO Found cStringIO, good!
2018-07-04 15:50:07,752 util INFO Found lxml.etree, native XML parsing, fabulous!
2018-07-04 15:50:07,791 util INFO Found GDAL/OGR Python bindings, super!!
2018-07-04 15:50:07,797 main INFO Stetl version = 1.2-rc3
2018-07-04 15:50:07,798 ETL INFO INIT - Stetl version is 1.2-rc3
2018-07-04 15:50:07,798 ETL INFO Config/working dir = /Users/just/project/stetl/git/examples/basics/17_sieve
2018-07-04 15:50:07,798 ETL INFO Reading config_file = etl.cfg
2018-07-04 15:50:07,799 ETL INFO START
2018-07-04 15:50:07,799 util INFO Timer start: total ETL
2018-07-04 15:50:07,799 chain INFO Assembling Chain: input_csv|attr_value_sieve|output_std...
2018-07-04 15:50:07,801 input INFO cfg = {'output_format': 'record_array', 'class': 'inputs.fileinput.CsvFileInput', 'file_path': 'input/cities.csv'}
2018-07-04 15:50:07,802 fileinput INFO file_list=['input/cities.csv']
2018-07-04 15:50:07,802 output INFO cfg = {'class': 'outputs.standardoutput.StandardOutput'}
2018-07-04 15:50:07,803 chain INFO Running Chain: input_csv|attr_value_sieve|output_std
2018-07-04 15:50:07,803 fileinput INFO Open CSV file: input/cities.csv
2018-07-04 15:50:07,803 component INFO CsvFileInput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:07,803 component INFO AttrValueRecordSieve invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:07,803 component INFO StandardOutput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:07,803 chain INFO DONE - 1 rounds - chain=input_csv|attr_value_sieve|output_std
2018-07-04 15:50:07,803 chain INFO Assembling Chain: input_csv|attr_value_sieve|output_file...
2018-07-04 15:50:07,803 input INFO cfg = {'output_format': 'record_array', 'class': 'inputs.fileinput.CsvFileInput', 'file_path': 'input/cities.csv'}
2018-07-04 15:50:07,804 fileinput INFO file_list=['input/cities.csv']
2018-07-04 15:50:07,804 output INFO cfg = {'class': 'outputs.fileoutput.FileOutput', 'file_path': 'output/cities_sieved.txt'}
2018-07-04 15:50:07,804 fileoutput INFO working dir /Users/just/project/stetl/git/examples/basics/17_sieve
2018-07-04 15:50:07,804 chain INFO Running Chain: input_csv|attr_value_sieve|output_file
2018-07-04 15:50:07,804 fileinput INFO Open CSV file: input/cities.csv
2018-07-04 15:50:07,804 fileoutput INFO writing to file output/cities_sieved.txt
2018-07-04 15:50:07,804 fileoutput INFO written to output/cities_sieved.txt
2018-07-04 15:50:07,805 component INFO CsvFileInput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:07,805 component INFO AttrValueRecordSieve invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:07,805 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:07,805 chain INFO DONE - 1 rounds - chain=input_csv|attr_value_sieve|output_file
2018-07-04 15:50:07,805 util INFO Timer end: total ETL time=0.0 sec
2018-07-04 15:50:07,805 ETL INFO ALL DONE
[{'lat': '52.4', 'city': 'amsterdam', 'lon': '4.9'}, {'lat': '52.101', 'city': 'otterlo', 'lon': '5.773'}]
~/project/stetl/git/examples/basics
~/project/stetl/git/examples/basics/1_copystd ~/project/stetl/git/examples/basics
==== running etl.sh for 1_copystd ====
2018-07-04 15:50:08,081 util INFO Found cStringIO, good!
2018-07-04 15:50:08,090 util INFO Found lxml.etree, native XML parsing, fabulous!
2018-07-04 15:50:08,126 util INFO Found GDAL/OGR Python bindings, super!!
2018-07-04 15:50:08,134 main INFO Stetl version = 1.2-rc3
2018-07-04 15:50:08,135 ETL INFO INIT - Stetl version is 1.2-rc3
2018-07-04 15:50:08,135 ETL INFO Config/working dir = /Users/just/project/stetl/git/examples/basics/1_copystd
2018-07-04 15:50:08,136 ETL INFO Reading config_file = etl.cfg
2018-07-04 15:50:08,136 ETL INFO START
2018-07-04 15:50:08,136 util INFO Timer start: total ETL
2018-07-04 15:50:08,136 chain INFO Assembling Chain: input_xml_file|output_std...
2018-07-04 15:50:08,139 input INFO cfg = {'class': 'inputs.fileinput.XmlFileInput', 'file_path': 'input/cities.xml'}
2018-07-04 15:50:08,139 fileinput INFO file_list=['input/cities.xml']
2018-07-04 15:50:08,140 output INFO cfg = {'class': 'outputs.standardoutput.StandardXmlOutput'}
2018-07-04 15:50:08,140 chain INFO Running Chain: input_xml_file|output_std
2018-07-04 15:50:08,140 fileinput INFO Read/parse for start for file=input/cities.xml....
2018-07-04 15:50:08,140 fileinput INFO Read/parse ok for file=input/cities.xml
2018-07-04 15:50:08,140 fileinput INFO all files done
2018-07-04 15:50:08,140 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.001 0.001 0.001 0.001
2018-07-04 15:50:08,141 component INFO StandardXmlOutput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:08,141 chain INFO DONE - 1 rounds - chain=input_xml_file|output_std
2018-07-04 15:50:08,141 util INFO Timer end: total ETL time=0.0 sec
2018-07-04 15:50:08,141 ETL INFO ALL DONE
<?xml version='1.0' encoding='utf-8'?>
<cities>
<city>
<name>Amsterdam</name>
<lat>52.4</lat>
<lon>4.9</lon>
</city>
<city>
<name>Bonn</name>
<lat>50.7</lat>
<lon>7.1</lon>
</city>
<city>
<name>Rome</name>
<lat>41.9</lat>
<lon>12.5</lon>
</city>
</cities>
~/project/stetl/git/examples/basics
~/project/stetl/git/examples/basics/2_xslt ~/project/stetl/git/examples/basics
==== running etl.sh for 2_xslt ====
2018-07-04 15:50:08,402 util INFO Found cStringIO, good!
2018-07-04 15:50:08,412 util INFO Found lxml.etree, native XML parsing, fabulous!
2018-07-04 15:50:08,449 util INFO Found GDAL/OGR Python bindings, super!!
2018-07-04 15:50:08,455 main INFO Stetl version = 1.2-rc3
2018-07-04 15:50:08,456 ETL INFO INIT - Stetl version is 1.2-rc3
2018-07-04 15:50:08,457 ETL INFO Config/working dir = /Users/just/project/stetl/git/examples/basics/2_xslt
2018-07-04 15:50:08,457 ETL INFO Reading config_file = etl.cfg
2018-07-04 15:50:08,458 ETL INFO START
2018-07-04 15:50:08,458 util INFO Timer start: total ETL
2018-07-04 15:50:08,458 chain INFO Assembling Chain: input_xml_file|transformer_xslt|output_file...
2018-07-04 15:50:08,460 input INFO cfg = {'class': 'inputs.fileinput.XmlFileInput', 'file_path': 'input/cities.xml'}
2018-07-04 15:50:08,460 fileinput INFO file_list=['input/cities.xml']
2018-07-04 15:50:08,463 output INFO cfg = {'class': 'outputs.fileoutput.FileOutput', 'file_path': 'output/gmlcities.gml'}
2018-07-04 15:50:08,463 fileoutput INFO working dir /Users/just/project/stetl/git/examples/basics/2_xslt
2018-07-04 15:50:08,463 chain INFO Running Chain: input_xml_file|transformer_xslt|output_file
2018-07-04 15:50:08,463 fileinput INFO Read/parse for start for file=input/cities.xml....
2018-07-04 15:50:08,463 fileinput INFO Read/parse ok for file=input/cities.xml
2018-07-04 15:50:08,463 fileinput INFO all files done
2018-07-04 15:50:08,464 xsltfilter INFO XSLT Transform OK
2018-07-04 15:50:08,464 fileoutput INFO writing to file output/gmlcities.gml
2018-07-04 15:50:08,464 fileoutput INFO written to output/gmlcities.gml
2018-07-04 15:50:08,464 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.001 0.001 0.001 0.001
2018-07-04 15:50:08,464 component INFO XsltFilter invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:08,464 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:08,464 chain INFO DONE - 1 rounds - chain=input_xml_file|transformer_xslt|output_file
2018-07-04 15:50:08,464 util INFO Timer end: total ETL time=0.0 sec
2018-07-04 15:50:08,464 ETL INFO ALL DONE
~/project/stetl/git/examples/basics
~/project/stetl/git/examples/basics/3_shape ~/project/stetl/git/examples/basics
==== running etl.sh for 3_shape ====
2018-07-04 15:50:08,743 util INFO Found cStringIO, good!
2018-07-04 15:50:08,754 util INFO Found lxml.etree, native XML parsing, fabulous!
2018-07-04 15:50:08,801 util INFO Found GDAL/OGR Python bindings, super!!
2018-07-04 15:50:08,810 main INFO Stetl version = 1.2-rc3
2018-07-04 15:50:08,812 ETL INFO INIT - Stetl version is 1.2-rc3
2018-07-04 15:50:08,812 ETL INFO Config/working dir = /Users/just/project/stetl/git/examples/basics/3_shape
2018-07-04 15:50:08,812 ETL INFO Reading config_file = etl.cfg
2018-07-04 15:50:08,813 ETL INFO START
2018-07-04 15:50:08,813 util INFO Timer start: total ETL
2018-07-04 15:50:08,813 chain INFO Assembling Chain: input_xml_file|transformer_xslt|output_ogr_shape...
2018-07-04 15:50:08,817 input INFO cfg = {'class': 'inputs.fileinput.XmlFileInput', 'file_path': 'input/cities.xml'}
2018-07-04 15:50:08,817 fileinput INFO file_list=['input/cities.xml']
2018-07-04 15:50:08,824 output INFO cfg = {'ogr2ogr_cmd': 'ogr2ogr\n-overwrite\n-f "ESRI Shapefile"\n-a_srs epsg:4326\noutput/gmlcities.shp\ntemp/gmlcities.gml', 'class': 'outputs.ogroutput.Ogr2OgrOutput', 'temp_file': 'temp/gmlcities.gml'}
2018-07-04 15:50:08,824 chain INFO Running Chain: input_xml_file|transformer_xslt|output_ogr_shape
2018-07-04 15:50:08,824 fileinput INFO Read/parse for start for file=input/cities.xml....
2018-07-04 15:50:08,825 fileinput INFO Read/parse ok for file=input/cities.xml
2018-07-04 15:50:08,825 fileinput INFO all files done
2018-07-04 15:50:08,825 xsltfilter INFO XSLT Transform OK
2018-07-04 15:50:08,826 ogroutput INFO writing to file temp/gmlcities.gml
2018-07-04 15:50:08,826 ogroutput INFO written to temp/gmlcities.gml
2018-07-04 15:50:08,826 ogroutput INFO executing cmd=ogr2ogr -overwrite -f "ESRI Shapefile" -a_srs epsg:4326 output/gmlcities.shp temp/gmlcities.gml
2018-07-04 15:50:08,873 ogroutput INFO execute done
2018-07-04 15:50:08,874 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.001 0.001 0.001 0.001
2018-07-04 15:50:08,874 component INFO XsltFilter invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:08,874 component INFO Ogr2OgrOutput invokes=1 time(total, min, max, avg) = 0.048 0.048 0.048 0.048
2018-07-04 15:50:08,874 chain INFO DONE - 1 rounds - chain=input_xml_file|transformer_xslt|output_ogr_shape
2018-07-04 15:50:08,874 util INFO Timer end: total ETL time=0.0 sec
2018-07-04 15:50:08,874 ETL INFO ALL DONE
~/project/stetl/git/examples/basics
~/project/stetl/git/examples/basics/4_validate ~/project/stetl/git/examples/basics
==== running etl.sh for 4_validate ====
2018-07-04 15:50:09,153 util INFO Found cStringIO, good!
2018-07-04 15:50:09,163 util INFO Found lxml.etree, native XML parsing, fabulous!
2018-07-04 15:50:09,202 util INFO Found GDAL/OGR Python bindings, super!!
2018-07-04 15:50:09,208 main INFO Stetl version = 1.2-rc3
2018-07-04 15:50:09,209 ETL INFO INIT - Stetl version is 1.2-rc3
2018-07-04 15:50:09,209 ETL INFO Config/working dir = /Users/just/project/stetl/git/examples/basics/4_validate
2018-07-04 15:50:09,209 ETL INFO Reading config_file = etl.cfg
2018-07-04 15:50:09,210 ETL INFO START
2018-07-04 15:50:09,210 util INFO Timer start: total ETL
2018-07-04 15:50:09,210 chain INFO Assembling Chain: input_xml_file|transformer_xslt|xml_schema_validator|output_file...
2018-07-04 15:50:09,212 input INFO cfg = {'class': 'inputs.fileinput.XmlFileInput', 'file_path': 'input/cities.xml'}
2018-07-04 15:50:09,212 fileinput INFO file_list=['input/cities.xml']
2018-07-04 15:50:09,214 xmlvalidator INFO Building the Schema once with (GML XSD) dependencies for schema=gmlcities.xsd (be patient...)
2018-07-04 15:50:26,518 output INFO cfg = {'class': 'outputs.fileoutput.FileOutput', 'file_path': 'output/gmlcities.gml'}
2018-07-04 15:50:26,518 fileoutput INFO working dir /Users/just/project/stetl/git/examples/basics/4_validate
2018-07-04 15:50:26,519 chain INFO Running Chain: input_xml_file|transformer_xslt|xml_schema_validator|output_file
2018-07-04 15:50:26,519 fileinput INFO Read/parse for start for file=input/cities.xml....
2018-07-04 15:50:26,519 fileinput INFO Read/parse ok for file=input/cities.xml
2018-07-04 15:50:26,519 fileinput INFO all files done
2018-07-04 15:50:26,519 xsltfilter INFO XSLT Transform OK
2018-07-04 15:50:26,519 xmlvalidator INFO Validating doc against schema=gmlcities.xsd ...
2018-07-04 15:50:26,520 xmlvalidator INFO Validation result: True
2018-07-04 15:50:26,520 fileoutput INFO writing to file output/gmlcities.gml
2018-07-04 15:50:26,520 fileoutput INFO written to output/gmlcities.gml
2018-07-04 15:50:26,520 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:26,520 component INFO XsltFilter invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:26,520 component INFO XmlSchemaValidator invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:26,520 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:26,520 chain INFO DONE - 1 rounds - chain=input_xml_file|transformer_xslt|xml_schema_validator|output_file
2018-07-04 15:50:26,520 util INFO Timer end: total ETL time=17.0 sec
2018-07-04 15:50:26,520 ETL INFO ALL DONE
~/project/stetl/git/examples/basics
~/project/stetl/git/examples/basics/5_split ~/project/stetl/git/examples/basics
==== running etl.sh for 5_split ====
2018-07-04 15:50:26,794 util INFO Found cStringIO, good!
2018-07-04 15:50:26,804 util INFO Found lxml.etree, native XML parsing, fabulous!
2018-07-04 15:50:26,840 util INFO Found GDAL/OGR Python bindings, super!!
2018-07-04 15:50:26,845 main INFO Stetl version = 1.2-rc3
2018-07-04 15:50:26,846 ETL INFO INIT - Stetl version is 1.2-rc3
2018-07-04 15:50:26,847 ETL INFO Config/working dir = /Users/just/project/stetl/git/examples/basics/5_split
2018-07-04 15:50:26,847 ETL INFO Reading config_file = etl.cfg
2018-07-04 15:50:26,849 ETL INFO START
2018-07-04 15:50:26,849 util INFO Timer start: total ETL
2018-07-04 15:50:26,849 chain INFO Assembling Chain: input_big_xml_file|xml_assembler|transformer_xslt|multi_output_file...
2018-07-04 15:50:26,852 input INFO cfg = {'element_tags': 'city', 'class': 'inputs.fileinput.XmlElementStreamerFileInput', 'file_path': 'input'}
2018-07-04 15:50:26,853 fileinput INFO file_list=['input/cities.xml']
2018-07-04 15:50:26,853 fileinput INFO Element tags to be matched: ['city']
2018-07-04 15:50:26,853 xmlassembler INFO cfg = {'max_elements': '2', 'element_container_tag': 'cities', 'class': 'filters.xmlassembler.XmlAssembler', 'container_doc': "<?xml version='1.0' encoding='utf-8'?>\n<cities>\n</cities>"}
2018-07-04 15:50:26,855 output INFO cfg = {'class': 'outputs.fileoutput.MultiFileOutput', 'file_path': 'output/gmlcities-%03d.gml'}
2018-07-04 15:50:26,855 chain INFO Running Chain: input_big_xml_file|xml_assembler|transformer_xslt|multi_output_file
2018-07-04 15:50:26,855 fileinput INFO file opened : input/cities.xml
2018-07-04 15:50:26,856 xmlassembler INFO xmldoc ready: elms=2 total_elms=2
2018-07-04 15:50:26,857 xsltfilter INFO XSLT Transform OK
2018-07-04 15:50:26,857 fileoutput INFO writing to file output/gmlcities-001.gml
2018-07-04 15:50:26,857 fileoutput INFO written to output/gmlcities-001.gml
2018-07-04 15:50:26,857 fileinput INFO End of doc: input/cities.xml elem_count=3
2018-07-04 15:50:26,857 fileinput INFO End of stream
2018-07-04 15:50:26,857 xmlassembler INFO xmldoc ready: elms=1 total_elms=3
2018-07-04 15:50:26,858 xsltfilter INFO XSLT Transform OK
2018-07-04 15:50:26,858 fileoutput INFO writing to file output/gmlcities-002.gml
2018-07-04 15:50:26,858 fileoutput INFO written to output/gmlcities-002.gml
2018-07-04 15:50:26,858 component INFO XmlElementStreamerFileInput invokes=26 time(total, min, max, avg) = 0.001 0.001 0.001 0.000
2018-07-04 15:50:26,858 component INFO XmlAssembler invokes=26 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:26,858 component INFO XsltFilter invokes=26 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:26,858 component INFO MultiFileOutput invokes=26 time(total, min, max, avg) = 0.001 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:26,858 chain INFO DONE - 26 rounds - chain=input_big_xml_file|xml_assembler|transformer_xslt|multi_output_file
2018-07-04 15:50:26,858 chain INFO Assembling Chain: input_big_xml_file|xml_assembler|transformer_xslt|output_std...
2018-07-04 15:50:26,858 input INFO cfg = {'element_tags': 'city', 'class': 'inputs.fileinput.XmlElementStreamerFileInput', 'file_path': 'input'}
2018-07-04 15:50:26,858 fileinput INFO file_list=['input/cities.xml']
2018-07-04 15:50:26,859 fileinput INFO Element tags to be matched: ['city']
2018-07-04 15:50:26,859 xmlassembler INFO cfg = {'max_elements': '2', 'element_container_tag': 'cities', 'class': 'filters.xmlassembler.XmlAssembler', 'container_doc': "<?xml version='1.0' encoding='utf-8'?>\n<cities>\n</cities>"}
2018-07-04 15:50:26,859 output INFO cfg = {'class': 'outputs.standardoutput.StandardXmlOutput'}
2018-07-04 15:50:26,859 chain INFO Running Chain: input_big_xml_file|xml_assembler|transformer_xslt|output_std
2018-07-04 15:50:26,859 fileinput INFO file opened : input/cities.xml
2018-07-04 15:50:26,860 xmlassembler INFO xmldoc ready: elms=2 total_elms=2
2018-07-04 15:50:26,860 xsltfilter INFO XSLT Transform OK
2018-07-04 15:50:26,860 fileinput INFO End of doc: input/cities.xml elem_count=3
2018-07-04 15:50:26,860 fileinput INFO End of stream
2018-07-04 15:50:26,861 xmlassembler INFO xmldoc ready: elms=1 total_elms=3
2018-07-04 15:50:26,861 xsltfilter INFO XSLT Transform OK
2018-07-04 15:50:26,861 component INFO XmlElementStreamerFileInput invokes=26 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:26,861 component INFO XmlAssembler invokes=26 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:26,861 component INFO XsltFilter invokes=26 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:26,861 component INFO StandardXmlOutput invokes=26 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:26,861 chain INFO DONE - 26 rounds - chain=input_big_xml_file|xml_assembler|transformer_xslt|output_std
2018-07-04 15:50:26,861 util INFO Timer end: total ETL time=0.0 sec
2018-07-04 15:50:26,861 ETL INFO ALL DONE
<?xml version='1.0' encoding='utf-8'?>
<ogr:FeatureCollection xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:ogr="http://ogr.maptools.org/" xmlns:gml="http://www.opengis.net/gml" xsi:schemaLocation="http://ogr.maptools.org/ ../gmlcities.xsd http://www.opengis.net/gml http://schemas.opengis.net/gml/2.1.2/feature.xsd">
<gml:boundedBy>
<gml:Box>
<gml:coord>
<gml:X>-180.0</gml:X>
<gml:Y>-90.0</gml:Y>
</gml:coord>
<gml:coord>
<gml:X>180.0</gml:X>
<gml:Y>90.0</gml:Y>
</gml:coord>
</gml:Box>
</gml:boundedBy>
<gml:featureMember>
<ogr:City>
<ogr:name>Amsterdam</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>52.4,4.9</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
<gml:featureMember>
<ogr:City>
<ogr:name>Bonn</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>50.7,7.1</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
</ogr:FeatureCollection>
<?xml version='1.0' encoding='utf-8'?>
<ogr:FeatureCollection xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:ogr="http://ogr.maptools.org/" xmlns:gml="http://www.opengis.net/gml" xsi:schemaLocation="http://ogr.maptools.org/ ../gmlcities.xsd http://www.opengis.net/gml http://schemas.opengis.net/gml/2.1.2/feature.xsd">
<gml:boundedBy>
<gml:Box>
<gml:coord>
<gml:X>-180.0</gml:X>
<gml:Y>-90.0</gml:Y>
</gml:coord>
<gml:coord>
<gml:X>180.0</gml:X>
<gml:Y>90.0</gml:Y>
</gml:coord>
</gml:Box>
</gml:boundedBy>
<gml:featureMember>
<ogr:City>
<ogr:name>Rome</ogr:name>
<ogr:geometry>
<gml:Point srsName="urn:ogc:def:crs:EPSG:4326">
<gml:coordinates>41.9,12.5</gml:coordinates>
</gml:Point>
</ogr:geometry>
</ogr:City>
</gml:featureMember>
</ogr:FeatureCollection>
~/project/stetl/git/examples/basics
~/project/stetl/git/examples/basics/6_cmdargs ~/project/stetl/git/examples/basics
==== running etl.sh for 6_cmdargs ====
2018-07-04 15:50:27,127 util INFO Found cStringIO, good!
2018-07-04 15:50:27,137 util INFO Found lxml.etree, native XML parsing, fabulous!
2018-07-04 15:50:27,172 util INFO Found GDAL/OGR Python bindings, super!!
2018-07-04 15:50:27,178 main INFO Stetl version = 1.2-rc3
2018-07-04 15:50:27,179 ETL INFO INIT - Stetl version is 1.2-rc3
2018-07-04 15:50:27,179 ETL INFO Config/working dir = /Users/just/project/stetl/git/examples/basics/6_cmdargs
2018-07-04 15:50:27,179 ETL INFO Reading config_file = etl.cfg
2018-07-04 15:50:27,180 ETL INFO Substituting 3 args in config file from args_dict: ['in_xml', 'out_xml', 'in_xsl']
2018-07-04 15:50:27,180 ETL INFO Substituting args OK
2018-07-04 15:50:27,181 ETL INFO START
2018-07-04 15:50:27,181 util INFO Timer start: total ETL
2018-07-04 15:50:27,181 chain INFO Assembling Chain: input_xml_file|transformer_xslt|output_file...
2018-07-04 15:50:27,183 input INFO cfg = {'class': 'inputs.fileinput.XmlFileInput', 'file_path': 'input/cities.xml'}
2018-07-04 15:50:27,183 fileinput INFO file_list=['input/cities.xml']
2018-07-04 15:50:27,185 output INFO cfg = {'class': 'outputs.fileoutput.FileOutput', 'file_path': 'output/gmlcities.gml'}
2018-07-04 15:50:27,185 fileoutput INFO working dir /Users/just/project/stetl/git/examples/basics/6_cmdargs
2018-07-04 15:50:27,185 chain INFO Running Chain: input_xml_file|transformer_xslt|output_file
2018-07-04 15:50:27,185 fileinput INFO Read/parse for start for file=input/cities.xml....
2018-07-04 15:50:27,186 fileinput INFO Read/parse ok for file=input/cities.xml
2018-07-04 15:50:27,186 fileinput INFO all files done
2018-07-04 15:50:27,186 xsltfilter INFO XSLT Transform OK
2018-07-04 15:50:27,186 fileoutput INFO writing to file output/gmlcities.gml
2018-07-04 15:50:27,186 fileoutput INFO written to output/gmlcities.gml
2018-07-04 15:50:27,186 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.001 0.001 0.001 0.001
2018-07-04 15:50:27,187 component INFO XsltFilter invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:27,187 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:27,187 chain INFO DONE - 1 rounds - chain=input_xml_file|transformer_xslt|output_file
2018-07-04 15:50:27,187 util INFO Timer end: total ETL time=0.0 sec
2018-07-04 15:50:27,187 ETL INFO ALL DONE
2018-07-04 15:50:27,453 util INFO Found cStringIO, good!
2018-07-04 15:50:27,463 util INFO Found lxml.etree, native XML parsing, fabulous!
2018-07-04 15:50:27,501 util INFO Found GDAL/OGR Python bindings, super!!
2018-07-04 15:50:27,508 main INFO Stetl version = 1.2-rc3
2018-07-04 15:50:27,510 main INFO Found args file at: etl.args
2018-07-04 15:50:27,511 ETL INFO INIT - Stetl version is 1.2-rc3
2018-07-04 15:50:27,511 ETL INFO Config/working dir = /Users/just/project/stetl/git/examples/basics/6_cmdargs
2018-07-04 15:50:27,512 ETL INFO Reading config_file = etl.cfg
2018-07-04 15:50:27,512 ETL INFO Substituting 3 args in config file from args_dict: ['in_xml', 'out_xml', 'in_xsl']
2018-07-04 15:50:27,512 ETL INFO Substituting args OK
2018-07-04 15:50:27,512 ETL INFO START
2018-07-04 15:50:27,513 util INFO Timer start: total ETL
2018-07-04 15:50:27,513 chain INFO Assembling Chain: input_xml_file|transformer_xslt|output_file...
2018-07-04 15:50:27,515 input INFO cfg = {'class': 'inputs.fileinput.XmlFileInput', 'file_path': 'input/cities.xml'}
2018-07-04 15:50:27,515 fileinput INFO file_list=['input/cities.xml']
2018-07-04 15:50:27,517 output INFO cfg = {'class': 'outputs.fileoutput.FileOutput', 'file_path': 'output/gmlcities.gml'}
2018-07-04 15:50:27,517 fileoutput INFO working dir /Users/just/project/stetl/git/examples/basics/6_cmdargs
2018-07-04 15:50:27,517 chain INFO Running Chain: input_xml_file|transformer_xslt|output_file
2018-07-04 15:50:27,517 fileinput INFO Read/parse for start for file=input/cities.xml....
2018-07-04 15:50:27,517 fileinput INFO Read/parse ok for file=input/cities.xml
2018-07-04 15:50:27,517 fileinput INFO all files done
2018-07-04 15:50:27,517 xsltfilter INFO XSLT Transform OK
2018-07-04 15:50:27,518 fileoutput INFO writing to file output/gmlcities.gml
2018-07-04 15:50:27,518 fileoutput INFO written to output/gmlcities.gml
2018-07-04 15:50:27,518 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:27,518 component INFO XsltFilter invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:27,518 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:27,518 chain INFO DONE - 1 rounds - chain=input_xml_file|transformer_xslt|output_file
2018-07-04 15:50:27,518 util INFO Timer end: total ETL time=0.0 sec
2018-07-04 15:50:27,518 ETL INFO ALL DONE
2018-07-04 15:50:27,757 util INFO Found cStringIO, good!
2018-07-04 15:50:27,767 util INFO Found lxml.etree, native XML parsing, fabulous!
2018-07-04 15:50:27,803 util INFO Found GDAL/OGR Python bindings, super!!
2018-07-04 15:50:27,810 main INFO Stetl version = 1.2-rc3
2018-07-04 15:50:27,811 main INFO Found args file at: etl.args
2018-07-04 15:50:27,812 ETL INFO INIT - Stetl version is 1.2-rc3
2018-07-04 15:50:27,812 ETL INFO Config/working dir = /Users/just/project/stetl/git/examples/basics/6_cmdargs
2018-07-04 15:50:27,812 ETL INFO Reading config_file = etl.cfg
2018-07-04 15:50:27,812 ETL INFO Substituting 3 args in config file from args_dict: ['in_xml', 'out_xml', 'in_xsl']
2018-07-04 15:50:27,812 ETL INFO Substituting args OK
2018-07-04 15:50:27,812 ETL INFO START
2018-07-04 15:50:27,812 util INFO Timer start: total ETL
2018-07-04 15:50:27,813 chain INFO Assembling Chain: input_xml_file|transformer_xslt|output_file...
2018-07-04 15:50:27,815 input INFO cfg = {'class': 'inputs.fileinput.XmlFileInput', 'file_path': 'input/amsterdam.xml'}
2018-07-04 15:50:27,815 fileinput INFO file_list=['input/amsterdam.xml']
2018-07-04 15:50:27,816 output INFO cfg = {'class': 'outputs.fileoutput.FileOutput', 'file_path': 'output/gmlcities.gml'}
2018-07-04 15:50:27,816 fileoutput INFO working dir /Users/just/project/stetl/git/examples/basics/6_cmdargs
2018-07-04 15:50:27,817 chain INFO Running Chain: input_xml_file|transformer_xslt|output_file
2018-07-04 15:50:27,817 fileinput INFO Read/parse for start for file=input/amsterdam.xml....
2018-07-04 15:50:27,818 fileinput INFO Read/parse ok for file=input/amsterdam.xml
2018-07-04 15:50:27,818 fileinput INFO all files done
2018-07-04 15:50:27,819 xsltfilter INFO XSLT Transform OK
2018-07-04 15:50:27,819 fileoutput INFO writing to file output/gmlcities.gml
2018-07-04 15:50:27,819 fileoutput INFO written to output/gmlcities.gml
2018-07-04 15:50:27,819 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.002 0.002 0.002 0.002
2018-07-04 15:50:27,819 component INFO XsltFilter invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:27,819 component INFO FileOutput invokes=1 time(total, min, max, avg) = 0.001 0.001 0.001 0.001
2018-07-04 15:50:27,820 chain INFO DONE - 1 rounds - chain=input_xml_file|transformer_xslt|output_file
2018-07-04 15:50:27,820 util INFO Timer end: total ETL time=0.0 sec
2018-07-04 15:50:27,820 ETL INFO ALL DONE
~/project/stetl/git/examples/basics
~/project/stetl/git/examples/basics/7_mycomponent ~/project/stetl/git/examples/basics
==== running etl.sh for 7_mycomponent ====
2018-07-04 15:50:28,072 util INFO Found cStringIO, good!
2018-07-04 15:50:28,084 util INFO Found lxml.etree, native XML parsing, fabulous!
2018-07-04 15:50:28,120 util INFO Found GDAL/OGR Python bindings, super!!
2018-07-04 15:50:28,126 main INFO Stetl version = 1.2-rc3
2018-07-04 15:50:28,127 ETL INFO INIT - Stetl version is 1.2-rc3
2018-07-04 15:50:28,127 ETL INFO Config/working dir = /Users/just/project/stetl/git/examples/basics/7_mycomponent
2018-07-04 15:50:28,127 ETL INFO Reading config_file = etl.cfg
2018-07-04 15:50:28,129 ETL INFO START
2018-07-04 15:50:28,129 util INFO Timer start: total ETL
2018-07-04 15:50:28,129 chain INFO Assembling Chain: input_xml_file|my_filter|output_std...
2018-07-04 15:50:28,131 input INFO cfg = {'class': 'inputs.fileinput.XmlFileInput', 'file_path': 'input/cities.xml'}
2018-07-04 15:50:28,131 fileinput INFO file_list=['input/cities.xml']
2018-07-04 15:50:28,133 output INFO cfg = {'class': 'outputs.standardoutput.StandardXmlOutput'}
2018-07-04 15:50:28,133 chain INFO Running Chain: input_xml_file|my_filter|output_std
2018-07-04 15:50:28,133 fileinput INFO Read/parse for start for file=input/cities.xml....
2018-07-04 15:50:28,134 fileinput INFO Read/parse ok for file=input/cities.xml
2018-07-04 15:50:28,134 fileinput INFO all files done
2018-07-04 15:50:28,134 myfilter INFO CALLING MyFilter OK!!!!
2018-07-04 15:50:28,134 component INFO XmlFileInput invokes=1 time(total, min, max, avg) = 0.001 0.001 0.001 0.001
2018-07-04 15:50:28,134 component INFO MyFilter invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:28,134 component INFO StandardXmlOutput invokes=1 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:28,134 chain INFO DONE - 1 rounds - chain=input_xml_file|my_filter|output_std
2018-07-04 15:50:28,134 util INFO Timer end: total ETL time=0.0 sec
2018-07-04 15:50:28,134 ETL INFO ALL DONE
<?xml version='1.0' encoding='utf-8'?>
<cities>
<city>
<name>Amsterdam</name>
<lat>52.4</lat>
<lon>4.9</lon>
</city>
<city>
<name>Bonn</name>
<lat>50.7</lat>
<lon>7.1</lon>
</city>
<city>
<name>Rome</name>
<lat>41.9</lat>
<lon>12.5</lon>
</city>
</cities>
~/project/stetl/git/examples/basics
~/project/stetl/git/examples/basics/8_wfs ~/project/stetl/git/examples/basics
==== running etl.sh for 8_wfs ====
2018-07-04 15:50:28,375 util INFO Found cStringIO, good!
2018-07-04 15:50:28,384 util INFO Found lxml.etree, native XML parsing, fabulous!
2018-07-04 15:50:28,419 util INFO Found GDAL/OGR Python bindings, super!!
2018-07-04 15:50:28,425 main INFO Stetl version = 1.2-rc3
2018-07-04 15:50:28,426 ETL INFO INIT - Stetl version is 1.2-rc3
2018-07-04 15:50:28,426 ETL INFO Config/working dir = /Users/just/project/stetl/git/examples/basics/8_wfs
2018-07-04 15:50:28,426 ETL INFO Reading config_file = etl.cfg
2018-07-04 15:50:28,428 ETL INFO START
2018-07-04 15:50:28,428 util INFO Timer start: total ETL
2018-07-04 15:50:28,428 chain INFO Assembling Chain: input_wfs|output_std...
2018-07-04 15:50:28,434 input INFO cfg = {'url': 'http://geodata.nationaalgeoregister.nl/bag/wfs', 'class': 'inputs.httpinput.HttpInput', 'parameters': '{\n\'service\' : \'WFS\',\n\'version\' : \'1.1.0\',\n\'request\' : \'GetFeature\',\n\'srsName\' : \'EPSG:28992\',\n\'outputFormat\' : \'text/xml; subtype=gml/2.1.2\',\n\'typename\' : \'verblijfsobject\',\n\'filter\' :\'<ogc:Filter xmlns:ogc="http://www.opengis.net/ogc"><ogc:BBOX><gml:Envelope xmlns:gml="http://www.opengis.net/gml" srsName="EPSG:28992"><gml:lowerCorner>183774.83 450577.24</gml:lowerCorner><gml:upperCorner>184277.99 450809.92</gml:upperCorner></gml:Envelope></ogc:BBOX></ogc:Filter>\'\n}'}
2018-07-04 15:50:28,435 httpinput INFO url=http://geodata.nationaalgeoregister.nl/bag/wfs parameters={'srsName': 'EPSG:28992', 'outputFormat': 'text/xml; subtype=gml/2.1.2', 'service': 'WFS', 'request': 'GetFeature', 'filter': '<ogc:Filter xmlns:ogc="http://www.opengis.net/ogc"><ogc:BBOX><gml:Envelope xmlns:gml="http://www.opengis.net/gml" srsName="EPSG:28992"><gml:lowerCorner>183774.83 450577.24</gml:lowerCorner><gml:upperCorner>184277.99 450809.92</gml:upperCorner></gml:Envelope></ogc:BBOX></ogc:Filter>', 'typename': 'verblijfsobject', 'version': '1.1.0'}
2018-07-04 15:50:28,436 output INFO cfg = {'class': 'outputs.standardoutput.StandardOutput'}
2018-07-04 15:50:28,436 chain INFO Running Chain: input_wfs|output_std
2018-07-04 15:50:28,508 httpinput INFO EOF URL reading done
2018-07-04 15:50:28,508 component INFO HttpInput invokes=2 time(total, min, max, avg) = 0.072 0.072 0.072 0.036
2018-07-04 15:50:28,508 component INFO StandardOutput invokes=2 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:28,508 chain INFO DONE - 2 rounds - chain=input_wfs|output_std
2018-07-04 15:50:28,508 util INFO Timer end: total ETL time=0.0 sec
2018-07-04 15:50:28,509 ETL INFO ALL DONE
<?xml version="1.0" encoding="UTF-8"?><wfs:FeatureCollection xmlns="http://www.opengis.net/wfs" xmlns:wfs="http://www.opengis.net/wfs" xmlns:gml="http://www.opengis.net/gml" xmlns:bag="http://bag.geonovum.nl" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.opengis.net/wfs http://schemas.opengis.net/wfs/1.0.0/WFS-basic.xsd http://bag.geonovum.nl https://geodata.nationaalgeoregister.nl/bag/wfs?service=WFS&version=1.0.0&request=DescribeFeatureType&typeName=bag%3Averblijfsobject"><gml:boundedBy><gml:null>unknown</gml:null></gml:boundedBy><gml:featureMember><bag:verblijfsobject fid="verblijfsobject.1929662"><bag:identificatie>228010000047219</bag:identificatie><bag:oppervlakte>121</bag:oppervlakte><bag:status>Verblijfsobject in gebruik</bag:status><bag:gebruiksdoel>woonfunctie</bag:gebruiksdoel><bag:openbare_ruimte>Harderwijkerweg</bag:openbare_ruimte><bag:huisnummer>1</bag:huisnummer><bag:postcode>6731ST</bag:postcode><bag:woonplaats>Otterlo</bag:woonplaats><bag:bouwjaar>1947</bag:bouwjaar><bag:pandidentificatie>228100000027383</bag:pandidentificatie><bag:pandstatus>Pand in gebruik</bag:pandstatus><bag:geometrie><gml:Point srsName="http://www.opengis.net/gml/srs/epsg.xml#28992"><gml:coordinates xmlns:gml="http://www.opengis.net/gml" decimal="." cs="," ts=" ">183936,450637,0</gml:coordinates></gml:Point></bag:geometrie><bag:pandgeometrie><gml:MultiPolygon srsName="http://www.opengis.net/gml/srs/epsg.xml#28992"><gml:polygonMember><gml:Polygon><gml:outerBoundaryIs><gml:LinearRing><gml:coordinates xmlns:gml="http://www.opengis.net/gml" decimal="." cs="," ts=" ">183932.603,450639.512,0 183934.594,450634.73,0 183933.375,450634.222,0 183935.064,450630.167,0 183936.343,450630.691,0 183938.458,450625.344,0 183943.859,450627.593,0 183939.957,450636.963,0 183938.748,450636.46,0 183936.757,450641.242,0 183932.603,450639.512,0</gml:coordinates></gml:LinearRing></gml:outerBoundaryIs></gml:Polygon></gml:polygonMember></gml:MultiPolygon></bag:pandgeometrie></bag:verblijfsobject></gml:featureMember><gml:featureMember><bag:verblijfsobject fid="verblijfsobject.1933218"><bag:identificatie>228010000047281</bag:identificatie><bag:oppervlakte>71</bag:oppervlakte><bag:status>Verblijfsobject in gebruik</bag:status><bag:gebruiksdoel>woonfunctie</bag:gebruiksdoel><bag:openbare_ruimte>Harderwijkerweg</bag:openbare_ruimte><bag:huisnummer>2</bag:huisnummer><bag:postcode>6731ST</bag:postcode><bag:woonplaats>Otterlo</bag:woonplaats><bag:bouwjaar>1947</bag:bouwjaar><bag:pandidentificatie>228100000006908</bag:pandidentificatie><bag:pandstatus>Pand in gebruik</bag:pandstatus><bag:geometrie><gml:Point srsName="http://www.opengis.net/gml/srs/epsg.xml#28992"><gml:coordinates xmlns:gml="http://www.opengis.net/gml" decimal="." cs="," ts=" ">183987,450673,0</gml:coordinates></gml:Point></bag:geometrie><bag:pandgeometrie><gml:MultiPolygon srsName="http://www.opengis.net/gml/srs/epsg.xml#28992"><gml:polygonMember><gml:Polygon><gml:outerBoundaryIs><gml:LinearRing><gml:coordinates xmlns:gml="http://www.opengis.net/gml" decimal="." cs="," ts=" ">183980.433,450671.062,0 183984.017,450666.347,0 183995.069,450674.891,0 183991.349,450679.562,0 183980.433,450671.062,0</gml:coordinates></gml:LinearRing></gml:outerBoundaryIs></gml:Polygon></gml:polygonMember></gml:MultiPolygon></bag:pandgeometrie></bag:verblijfsobject></gml:featureMember></wfs:FeatureCollection>
~/project/stetl/git/examples/basics
~/project/stetl/git/examples/basics/9_string_templating ~/project/stetl/git/examples/basics
==== running etl.sh for 9_string_templating ====
2018-07-04 15:50:28,782 util INFO Found cStringIO, good!
2018-07-04 15:50:28,792 util INFO Found lxml.etree, native XML parsing, fabulous!
2018-07-04 15:50:28,828 util INFO Found GDAL/OGR Python bindings, super!!
2018-07-04 15:50:28,834 main INFO Stetl version = 1.2-rc3
2018-07-04 15:50:28,835 ETL INFO INIT - Stetl version is 1.2-rc3
2018-07-04 15:50:28,835 ETL INFO Config/working dir = /Users/just/project/stetl/git/examples/basics/9_string_templating
2018-07-04 15:50:28,836 ETL INFO Reading config_file = etl.cfg
2018-07-04 15:50:28,837 ETL INFO START
2018-07-04 15:50:28,837 util INFO Timer start: total ETL
2018-07-04 15:50:28,837 chain INFO Assembling Chain: input_csv|filter_template|output_file...
2018-07-04 15:50:28,839 input INFO cfg = {'output_format': 'record', 'class': 'inputs.fileinput.CsvFileInput', 'file_path': 'input/city.csv'}
2018-07-04 15:50:28,839 fileinput INFO file_list=['input/city.csv']
2018-07-04 15:50:28,840 output INFO cfg = {'class': 'outputs.fileoutput.FileOutput', 'file_path': 'output/city.xml'}
2018-07-04 15:50:28,840 fileoutput INFO working dir /Users/just/project/stetl/git/examples/basics/9_string_templating
2018-07-04 15:50:28,841 chain INFO Running Chain: input_csv|filter_template|output_file
2018-07-04 15:50:28,841 fileinput INFO Open CSV file: input/city.csv
2018-07-04 15:50:28,841 templatingfilter INFO Init: templating
2018-07-04 15:50:28,841 templatingfilter INFO Init: reading template file %s ..." % self.template_file
2018-07-04 15:50:28,841 templatingfilter INFO template file read OK: city_template.xml
2018-07-04 15:50:28,841 fileinput INFO CSV row nr 1 read: {'lat': '52.4', 'city': 'amsterdam', 'lon': '4.9'}
2018-07-04 15:50:28,841 fileoutput INFO writing to file output/city.xml
2018-07-04 15:50:28,842 fileoutput INFO written to output/city.xml
2018-07-04 15:50:28,842 component INFO CsvFileInput invokes=2 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:28,842 templatingfilter INFO Exit: templating
2018-07-04 15:50:28,842 component INFO StringTemplatingFilter invokes=2 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:28,842 component INFO FileOutput invokes=2 time(total, min, max, avg) = 0.000 9223372036854775808.000 0.000 0.000
2018-07-04 15:50:28,842 chain INFO DONE - 2 rounds - chain=input_csv|filter_template|output_file
2018-07-04 15:50:28,842 util INFO Timer end: total ETL time=0.0 sec
2018-07-04 15:50:28,842 ETL INFO ALL DONE
~/project/stetl/git/examples/basics
|