No input or output step is defined:
- detect the source step automatically: use all input steps for this mapping step.
- detect the output step automatically: there can only be one MappingInput step in the mapping in this specific case.
Consider that all the transformations in a cluster schema are running now...
Now we should verify that they are all running as they should.
If a transformation has an error, we should kill them all..
This should happen in a separate thread to prevent blocking of the UI.
When the master and slave transformations have all finished, we should also run
a cleanup on those transformations to release sockets, etc.
Consider that all the transformations in a cluster schema are running
now...
Now we should verify that they are all running as they should.
If a transformation has an error, we should kill them all..
This should happen in a separate thread to prevent blocking of the UI.
When the master and slave transformations have all finished, we should also
run
a cleanup on those transformations to release sockets, etc.
Here are the steps that we need to take to make streaming loading possible for MySQL:
The following steps are carried out by the step at runtime:
- create a unique FIFO file (using mkfifo, LINUX ONLY FOLKS!)
- Create a target table using standard Kettle SQL generation
- Execute the LOAD DATA SQL Command to bulk load in a separate SQL thread in the background:
- Write to the FIFO file
- At the end, close the output stream to the FIFO file
* At the end, remove the FIFO file
Created on 24-oct-2007