org.pentaho.di.cluster
Class MasterSlaveTest

java.lang.Object
  junit.framework.Assert
      junit.framework.TestCase
          org.pentaho.di.cluster.BaseCluster
              org.pentaho.di.cluster.MasterSlaveTest

All Implemented Interfaces:

junit.framework.Test

public class MasterSlaveTest
extends BaseCluster

Constructor Summary

MasterSlaveTest()

Method Summary

void	runAllocatePorts()
void	runMultipleCopiesOnMultipleSlaves() This test reads a CSV file and sends the data to 3 copies on 3 slave servers.
void	runMultipleCopiesOnMultipleSlaves2() This test reads a CSV file and sends the data to 3 copies on 3 slave servers.
void	runOneStepClustered() This test generates rows on the master, generates random values clustered and brings them back the master. See also: PDI-6324 : Generate Rows to a clustered step ceases to work
void	runParallelFileReadOnMaster() This test reads a CSV file in parallel on the master in 1 copy. It then passes the data over to a dummy step on the slaves. We want to make sure that only 1 copy is considered.
void	runParallelFileReadOnMasterWithCopies() This test reads a CSV file in parallel on the master in 3 copies. It then passes the data over to a dummy step on the slaves.
void	runParallelFileReadOnSlaves() This test reads a CSV file in parallel on all 3 slaves, each with 1 copy. It then passes the data over to a dummy step on the slaves.
void	runParallelFileReadOnSlavesWithPartitioning() This test reads a CSV file in parallel on all 3 slaves, each with 4 partitions. It then passes the data over to a dummy step on the slaves.
void	runParallelFileReadOnSlavesWithPartitioning2() This test reads a CSV file in parallel on all 3 slaves, each with 4 partitions. This is a variation on the test right above, with 2 steps in sequence in clustering & partitioning. It then passes the data over to a dummy step on the slaves.
void	testAll()

Methods inherited from class org.pentaho.di.cluster.BaseCluster

createClusteredTransExecutionConfiguration, loadAndModifyTestTransformation, loadFileContent

Methods inherited from class junit.framework.TestCase

countTestCases, getName, run, run, runBare, setName, toString

Methods inherited from class junit.framework.Assert

assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertFalse, assertFalse, assertNotNull, assertNotNull, assertNotSame, assertNotSame, assertNull, assertNull, assertSame, assertSame, assertTrue, assertTrue, fail, fail, failNotEquals, failNotSame, failSame, format

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

MasterSlaveTest

public MasterSlaveTest()

Method Detail

testAll

public void testAll()
             throws Exception

Throws:

Exception

runAllocatePorts

public void runAllocatePorts()
                      throws Exception

Throws:

Exception

runParallelFileReadOnMaster

public void runParallelFileReadOnMaster()
                                 throws Exception

This test reads a CSV file in parallel on the master in 1 copy.
It then passes the data over to a dummy step on the slaves.
We want to make sure that only 1 copy is considered.

Throws:

Exception

runParallelFileReadOnMasterWithCopies

public void runParallelFileReadOnMasterWithCopies()
                                           throws Exception

This test reads a CSV file in parallel on the master in 3 copies.
It then passes the data over to a dummy step on the slaves.

Throws:

Exception

runParallelFileReadOnSlaves

public void runParallelFileReadOnSlaves()
                                 throws Exception

This test reads a CSV file in parallel on all 3 slaves, each with 1 copy.
It then passes the data over to a dummy step on the slaves.

Throws:

Exception

runParallelFileReadOnSlavesWithPartitioning

public void runParallelFileReadOnSlavesWithPartitioning()
                                                 throws Exception

This test reads a CSV file in parallel on all 3 slaves, each with 4 partitions.
It then passes the data over to a dummy step on the slaves.

Throws:

Exception

runParallelFileReadOnSlavesWithPartitioning2

public void runParallelFileReadOnSlavesWithPartitioning2()
                                                  throws Exception

This test reads a CSV file in parallel on all 3 slaves, each with 4 partitions.
This is a variation on the test right above, with 2 steps in sequence in clustering & partitioning.
It then passes the data over to a dummy step on the slaves.

Throws:

Exception

runMultipleCopiesOnMultipleSlaves2

public void runMultipleCopiesOnMultipleSlaves2()
                                        throws Exception

This test reads a CSV file and sends the data to 3 copies on 3 slave servers.

Throws:

Exception

runMultipleCopiesOnMultipleSlaves

public void runMultipleCopiesOnMultipleSlaves()
                                       throws Exception

This test reads a CSV file and sends the data to 3 copies on 3 slave servers.

Throws:

Exception

runOneStepClustered

public void runOneStepClustered()
                         throws Exception

This test generates rows on the master, generates random values clustered and brings them back the master.
See also: PDI-6324 : Generate Rows to a clustered step ceases to work

Throws:

Exception