Package org.pentaho.di.partition

Class PartitionSchema

java.lang.Object
org.pentaho.di.core.changed.ChangedFlag
org.pentaho.di.partition.PartitionSchema
All Implemented Interfaces:
Cloneable, ChangedFlagInterface, org.pentaho.di.core.xml.XMLInterface, org.pentaho.di.repository.RepositoryElementInterface, org.pentaho.di.repository.RepositoryObjectInterface, ResourceHolderInterface, org.pentaho.di.shared.SharedObjectInterface
public class PartitionSchema extends ChangedFlag implements Cloneable, org.pentaho.di.shared.SharedObjectInterface, ResourceHolderInterface, org.pentaho.di.repository.RepositoryElementInterface, org.pentaho.di.core.xml.XMLInterface
A partition schema allow you to partition a step according into a number of partitions that run independendly. It allows us to "map"
Author:
Matt

  • Field Details

    • XML_TAG

      public static final String XML_TAG
      See Also:

    • REPOSITORY_ELEMENT_TYPE

      public static final org.pentaho.di.repository.RepositoryObjectType REPOSITORY_ELEMENT_TYPE

  • Constructor Details

    • PartitionSchema

      public PartitionSchema()

    • PartitionSchema

      public PartitionSchema(String name, List<String> partitionIDs)
      Parameters:
      name -
      partitionIDs -

    • PartitionSchema

      public PartitionSchema(Node partitionSchemaNode)

  • Method Details

    • clone

      public Object clone()
      Overrides:
      clone in class Object

    • replaceMeta

      public void replaceMeta(PartitionSchema partitionSchema)

    • toString

      public String toString()
      Overrides:
      toString in class Object

    • equals

      public boolean equals(Object obj)
      Overrides:
      equals in class Object

    • hashCode

      public int hashCode()
      Overrides:
      hashCode in class Object

    • getName

      public String getName()
      Specified by:
      getName in interface org.pentaho.di.repository.RepositoryElementInterface
      Specified by:
      getName in interface org.pentaho.di.repository.RepositoryObjectInterface
      Specified by:
      getName in interface ResourceHolderInterface
      Specified by:
      getName in interface org.pentaho.di.shared.SharedObjectInterface
      Returns:
      the name

    • setName

      public void setName(String name)
      Specified by:
      setName in interface org.pentaho.di.repository.RepositoryElementInterface
      Parameters:
      name - the name to set

    • getPartitionIDs

      public List<String> getPartitionIDs()
      Returns:
      the partitionIDs

    • setPartitionIDs

      public void setPartitionIDs(List<String> partitionIDs)
      Parameters:
      partitionIDs - the partitionIDs to set

    • getXML

      public String getXML()
      Specified by:
      getXML in interface org.pentaho.di.shared.SharedObjectInterface
      Specified by:
      getXML in interface org.pentaho.di.core.xml.XMLInterface

    • isShared

      public boolean isShared()
      Specified by:
      isShared in interface org.pentaho.di.shared.SharedObjectInterface
      Returns:
      the shared

    • setShared

      public void setShared(boolean shared)
      Specified by:
      setShared in interface org.pentaho.di.shared.SharedObjectInterface
      Parameters:
      shared - the shared to set

    • getObjectId

      public org.pentaho.di.repository.ObjectId getObjectId()
      Specified by:
      getObjectId in interface org.pentaho.di.repository.RepositoryElementInterface
      Specified by:
      getObjectId in interface org.pentaho.di.repository.RepositoryObjectInterface
      Specified by:
      getObjectId in interface ResourceHolderInterface
      Returns:
      the id

    • getDescription

      public String getDescription()
      Specified by:
      getDescription in interface org.pentaho.di.repository.RepositoryElementInterface
      Specified by:
      getDescription in interface ResourceHolderInterface
      Returns:
      The description of the holder of the resource

    • getHolderType

      public String getHolderType()
      Description copied from interface: ResourceHolderInterface
      Gets the high-level type of resource holder.
      Specified by:
      getHolderType in interface ResourceHolderInterface
      Returns:
      JOBENTRY, STEP, etc.

    • getTypeId

      public String getTypeId()
      Specified by:
      getTypeId in interface ResourceHolderInterface
      Returns:
      The Type ID of the resource holder. The Type ID is the system-defined type identifier (like TRANS or SORT).

    • isDynamicallyDefined

      public boolean isDynamicallyDefined()
      Returns:
      the dynamicallyDefined

    • setDynamicallyDefined

      public void setDynamicallyDefined(boolean dynamicallyDefined)
      Parameters:
      dynamicallyDefined - the dynamicallyDefined to set

    • getNumberOfPartitionsPerSlave

      public String getNumberOfPartitionsPerSlave()
      Returns:
      the numberOfStepCopiesPerSlave

    • setNumberOfPartitionsPerSlave

      public void setNumberOfPartitionsPerSlave(String numberOfPartitionsPerSlave)
      Parameters:
      numberOfPartitionsPerSlave - the number of partitions per slave to set...

    • expandPartitionsDynamically

      public void expandPartitionsDynamically(int nrSlaves, org.pentaho.di.core.variables.VariableSpace space)

    • retainPartitionsForSlaveServer

      public void retainPartitionsForSlaveServer(int slaveCount, int slaveNumber)
      Slaves don't need ALL the partitions, they just need a few.
      So we should only retain those partitions that are of interest to the slave server.
      Divide the number of partitions (6) through the number of slaves (2)
      That gives you 0, 1, 2, 3, 4, 5
      Slave 0 : 0, 2, 4
      Slave 1 : 1, 3, 5
      --> slaveNumber == partitionNr % slaveCount
      Parameters:
      slaveCount -
      slaveNumber -

    • getRepositoryDirectory

      public org.pentaho.di.repository.RepositoryDirectoryInterface getRepositoryDirectory()
      Not supported for Partition schema, return the root.
      Specified by:
      getRepositoryDirectory in interface org.pentaho.di.repository.RepositoryElementInterface

    • setRepositoryDirectory

      public void setRepositoryDirectory(org.pentaho.di.repository.RepositoryDirectoryInterface repositoryDirectory)
      Specified by:
      setRepositoryDirectory in interface org.pentaho.di.repository.RepositoryElementInterface

    • getRepositoryElementType

      public org.pentaho.di.repository.RepositoryObjectType getRepositoryElementType()
      Specified by:
      getRepositoryElementType in interface org.pentaho.di.repository.RepositoryElementInterface

    • setObjectId

      public void setObjectId(org.pentaho.di.repository.ObjectId id)
      Specified by:
      setObjectId in interface org.pentaho.di.repository.RepositoryElementInterface

    • getObjectRevision

      public org.pentaho.di.repository.ObjectRevision getObjectRevision()
      Specified by:
      getObjectRevision in interface org.pentaho.di.repository.RepositoryElementInterface

    • setObjectRevision

      public void setObjectRevision(org.pentaho.di.repository.ObjectRevision objectRevision)
      Specified by:
      setObjectRevision in interface org.pentaho.di.repository.RepositoryElementInterface

    • setDescription

      public void setDescription(String description)
      Specified by:
      setDescription in interface org.pentaho.di.repository.RepositoryElementInterface

    • getChangedDate

      public Date getChangedDate()
      Specified by:
      getChangedDate in interface org.pentaho.di.shared.SharedObjectInterface
      Returns:
      the changedDate

    • setChangedDate

      public void setChangedDate(Date changedDate)
      Parameters:
      changedDate - the changedDate to set