1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
|
# TODO
Some notes about what I intend to be working on next. You can sponsor any
and all of those ideas if you actually need them today, and you can also
sponsor new ideas not on the list yet.
## New Features
### Filtering
Add commands to pick different target tables depending on the data found
when reading from the source.
## Data Formats
### CSV
- see about schema discovery (column names and types)
### JSON
Propose to load JSON either in a "document" column, or to normalize it by
applying some advanced filtering.
Implement PostgreSQL JSON operators and functions in pgloader to help setup
the normalisation steps:
[PostgreSQL JSON Functions and Operators](http://www.postgresql.org/docs/9.3/interactive/functions-json.html).
### XML
Add an XML reader to load XML documents into the database as a column value,
and XSLT capabilities to normalize the XML contents into a proper relational
model.
### Other databases
Add support for full data and schema migrations for the following:
- SQL Server
- Sybase
- Oracle
## User Interface, User Experience
### Improve parse error messages
WIP, see https://github.com/nikodemus/esrap/issues/26
### Graphical User Interface
Most probably a web based tool, with guidance to setup the migration, maybe
not even something very sophisticated, but making the simple cases way
simpler.
## Database support
### MySQL Support
- Convert SQL dialect for SQL views
- Triggers and Stored Procedures
### SQLite support
- implement CAST rules support
## Compat
- add parsing for SQL*Loader file format
## Other
### error management
- add input line number to log file?
### data output
- PostgreSQL COPY Text format output for any supported input
### performances
- some more parallelizing options
- support for partitioning in pgloader itself
### UI
- add a web controller with pretty monitoring
- launch new jobs from the web controller
### crazy ideas
- MySQL replication, reading from the binlog directly
- plproxy (re-)sharding support
- partitioning support
- remote archiving support (with (delete returning *) insert into)
|
