Package org.pentaho.di.trans.steps.dimensionlookup

Class DimensionLookup

java.lang.Object

org.pentaho.di.trans.step.BaseStep

org.pentaho.di.trans.step.BaseDatabaseStep

org.pentaho.di.trans.steps.dimensionlookup.DimensionLookup

All Implemented Interfaces:

org.pentaho.di.core.ExtensionDataInterface, HasLogChannelInterface, org.pentaho.di.core.logging.LoggingObjectInterface, org.pentaho.di.core.logging.LoggingObjectLifecycleInterface, org.pentaho.di.core.variables.VariableSpace, StepInterface

public class DimensionLookup
extends BaseDatabaseStep
implements StepInterface

Manages a slowly changing dimension (lookup or update)

Since:

14-may-2003

Author:

Matt

Field Summary

Fields inherited from class org.pentaho.di.trans.step.BaseStep

deadLockCounter, extensionDataMap, first, linesInput, linesOutput, linesRead, linesRejected, linesSkipped, linesUpdated, linesWritten, log, metaStore, repository, rowListeners, safeStopped, terminator, terminator_rows, variables

Constructor Summary

Constructors

Constructor	Description
DimensionLookup(StepMeta stepMeta, StepDataInterface stepDataInterface, int copyNr, TransMeta transMeta, Trans trans)

Method Summary

Modifier and Type	Method	Description
void	checkDimZero()
Long	dimInsert(org.pentaho.di.core.row.RowMetaInterface inputRowMeta, Object[] row, Long technicalKey, boolean newEntry, Long versionNr, Date dateFrom, Date dateTo)	This inserts new record into dimension Optionally, if the entry already exists, update date range from previous version of the entry.
void	dimPunchThrough(org.pentaho.di.core.row.RowMetaInterface rowMeta, Object[] row)
void	dimUpdate(org.pentaho.di.core.row.RowMetaInterface rowMeta, Object[] row, Long dimkey, Date valueDate)
void	dispose(StepMetaInterface smi, StepDataInterface sdi)	Dispose of this step: close files, empty logs, etc.
protected Class<?>	getPKG()	Returns the specific step class needed for logging
boolean	init(StepMetaInterface smi, StepDataInterface sdi)	Initialize and do work where other steps need to wait for...
protected boolean	isAutoIncrement()
boolean	isDebug()	Checks if is debug.
boolean	isRowLevel()	Checks if is row level.
boolean	processRow(StepMetaInterface smi, StepDataInterface sdi)	Perform the equivalent of processing one row.
protected void	setData(DimensionLookupData data)
protected void	setMeta(DimensionLookupMeta meta)

Methods inherited from class org.pentaho.di.trans.step.BaseDatabaseStep

beforeStartProcessing, connectToDatabase, connectToDatabaseOrInitDataSource, getStepExecutionId, isConnectToDatabaseOnInit

Methods inherited from class org.pentaho.di.trans.step.BaseStep

addResultFile, addRowListener, addRowSetToInputRowSets, addRowSetToOutputRowSets, addStepListener, batchComplete, buildLog, canProcessOneRow, checkFeedback, cleanup, clearInputRowSets, clearOutputRowSets, closeQuietly, copyVariablesFrom, decrementLinesRead, decrementLinesWritten, dispatch, environmentSubstitute, environmentSubstitute, environmentSubstitute, fieldSubstitute, findInputRowSet, findInputRowSet, findOutputRowSet, findOutputRowSet, getBooleanValueOfVariable, getClusterSize, getContainerObjectId, getCopy, getCurrentInputRowSetNr, getCurrentOutputRowSetNr, getDispatcher, getErrorRowMeta, getErrors, getExtensionDataMap, getFilename, getFirstInputRowSet, getInputRowMeta, getInputRowSets, getLinesInput, getLinesOutput, getLinesRead, getLinesRejected, getLinesSkipped, getLinesUpdated, getLinesWritten, getLogChannel, getLogChannelId, getLogFields, getLogLevel, getMetaStore, getNextClassNr, getObjectCopy, getObjectId, getObjectName, getObjectRevision, getObjectType, getOutputRowSets, getParent, getParentVariableSpace, getPartitionID, getPartitionTargets, getPreviewRowMeta, getProcessed, getRegistrationDate, getRemoteInputSteps, getRemoteOutputSteps, getRepartitioning, getRepository, getRepositoryDirectory, getResultFiles, getRow, getRowFrom, getRowHandler, getRowListeners, getRuntime, getServerSockets, getSlaveNr, getSocketRepository, getStatus, getStatusDescription, getStepDataInterface, getStepID, getStepListeners, getStepMeta, getStepMetaInterface, getStepname, getTrans, getTransMeta, getTypeId, getUniqueStepCountAcrossSlaves, getUniqueStepNrAcrossSlaves, getVariable, getVariable, handleGetRowFrom, handlePutRowTo, identifyErrorOutput, incrementLinesInput, incrementLinesOutput, incrementLinesRead, incrementLinesRejected, incrementLinesSkipped, incrementLinesUpdated, incrementLinesWritten, initBeforeStart, initializeVariablesFrom, injectVariables, isBasic, isDetailed, isDistributed, isForcingSeparateLogging, isGatheringMetrics, isInitialising, isMapping, isPartitioned, isPaused, isRunning, isSafeStopped, isStopped, isUsingThreadPriorityManagment, listVariables, logBasic, logBasic, logDebug, logDebug, logDetailed, logDetailed, logError, logError, logError, logMinimal, logMinimal, logRowlevel, logRowlevel, logSummary, markStart, markStop, openRemoteInputStepSocketsOnce, openRemoteOutputStepSocketsOnce, outputIsDone, pauseRunning, putError, putRow, putRowTo, removeRowListener, resumeRunning, rowsetInputSize, rowsetOutputSize, safeModeChecking, safeModeChecking, setCarteObjectId, setCopy, setCurrentInputRowSetNr, setCurrentOutputRowSetNr, setDistributed, setErrorRowMeta, setErrors, setForcingSeparateLogging, setGatheringMetrics, setInputRowMeta, setInputRowSets, setInternalVariables, setLinesInput, setLinesOutput, setLinesRead, setLinesRejected, setLinesSkipped, setLinesUpdated, setLinesWritten, setLogLevel, setMetaStore, setOutputDone, setOutputRowSets, setParentVariableSpace, setPartitioned, setPartitionID, setPartitionTargets, setPaused, setPaused, setPreviewRowMeta, setRepartitioning, setRepository, setRowHandler, setRunning, setSafeStopped, setServerSockets, setSocketRepository, setStepDataInterface, setStepListeners, setStepMeta, setStepMetaInterface, setStepname, setStopped, setTransMeta, setUsingThreadPriorityManagment, setVariable, shareVariablesWith, stopAll, stopRunning, stopRunning, swapFirstInputRowSetIfExists, toString, verifyInputDeadLock, waitUntilTransformationIsStarted

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.pentaho.di.core.logging.LoggingObjectLifecycleInterface

callAfterLog, callBeforeLog

Methods inherited from interface org.pentaho.di.trans.step.StepInterface

addRowListener, addRowSetToInputRowSets, addRowSetToOutputRowSets, addStepListener, afterFinishProcessing, batchComplete, beforeStartProcessing, canProcessOneRow, cleanup, getCopy, getCurrentInputRowSetNr, getCurrentOutputRowSetNr, getErrors, getInputRowSets, getLinesInput, getLinesOutput, getLinesRead, getLinesRejected, getLinesUpdated, getLinesWritten, getLogChannel, getMetaStore, getOutputRowSets, getPartitionID, getProcessed, getRepository, getResultFiles, getRow, getRowListeners, getRuntime, getStatus, getStepID, getStepMeta, getStepname, getTrans, identifyErrorOutput, initBeforeStart, isMapping, isPartitioned, isPaused, isRunning, isSafeStopped, isStopped, isUsingThreadPriorityManagment, markStart, markStop, pauseRunning, putRow, removeRowListener, resumeRunning, rowsetInputSize, rowsetOutputSize, setCurrentInputRowSetNr, setCurrentOutputRowSetNr, setErrors, setLinesRejected, setMetaStore, setOutputDone, setPartitioned, setPartitionID, setRepartitioning, setRepository, setRunning, setSafeStopped, setStopped, setUsingThreadPriorityManagment, stopAll, stopRunning, subStatuses

Methods inherited from interface org.pentaho.di.core.variables.VariableSpace

copyVariablesFrom, environmentSubstitute, environmentSubstitute, environmentSubstitute, fieldSubstitute, getBooleanValueOfVariable, getParentVariableSpace, getVariable, getVariable, initializeVariablesFrom, injectVariables, listVariables, setParentVariableSpace, setVariable, shareVariablesWith

Constructor Details

DimensionLookup

public DimensionLookup(StepMeta stepMeta,
 StepDataInterface stepDataInterface,
 int copyNr,
 TransMeta transMeta,
 Trans trans)

Method Details

setMeta

protected void setMeta(DimensionLookupMeta meta)

setData

protected void setData(DimensionLookupData data)

processRow

public boolean processRow(StepMetaInterface smi,
 StepDataInterface sdi)
                   throws org.pentaho.di.core.exception.KettleException

Description copied from interface: StepInterface

Perform the equivalent of processing one row. Typically this means reading a row from input (getRow()) and passing a row to output (putRow)).

Specified by:

processRow in interface StepInterface

Overrides:

processRow in class BaseStep

Parameters:

smi - The steps metadata to work with

sdi - The steps temporary working data to work with (database connections, result sets, caches, temporary variables, etc.)

Returns:

false if no more rows can be processed or an error occurred.

Throws:

org.pentaho.di.core.exception.KettleException

isAutoIncrement

protected boolean isAutoIncrement()

dimInsert

public Long dimInsert(org.pentaho.di.core.row.RowMetaInterface inputRowMeta,
 Object[] row,
 Long technicalKey,
 boolean newEntry,
 Long versionNr,
 Date dateFrom,
 Date dateTo)
               throws org.pentaho.di.core.exception.KettleException

This inserts new record into dimension Optionally, if the entry already exists, update date range from previous version of the entry.

Throws:

org.pentaho.di.core.exception.KettleException

isRowLevel

public boolean isRowLevel()

Description copied from class: BaseStep

Checks if is row level.

Overrides:

isRowLevel in class BaseStep

Returns:

true, if is row level

isDebug

public boolean isDebug()

Description copied from class: BaseStep

Checks if is debug.

Overrides:

isDebug in class BaseStep

Returns:

true, if is debug

dimUpdate

public void dimUpdate(org.pentaho.di.core.row.RowMetaInterface rowMeta,
 Object[] row,
 Long dimkey,
 Date valueDate)
               throws org.pentaho.di.core.exception.KettleDatabaseException

Throws:

org.pentaho.di.core.exception.KettleDatabaseException

dimPunchThrough

public void dimPunchThrough(org.pentaho.di.core.row.RowMetaInterface rowMeta,
 Object[] row)
                     throws org.pentaho.di.core.exception.KettleDatabaseException

Throws:

org.pentaho.di.core.exception.KettleDatabaseException

checkDimZero

public void checkDimZero()
                  throws org.pentaho.di.core.exception.KettleException

Throws:

org.pentaho.di.core.exception.KettleException

init

public boolean init(StepMetaInterface smi,
 StepDataInterface sdi)

Description copied from interface: StepInterface

Initialize and do work where other steps need to wait for...

Specified by:

init in interface StepInterface

Overrides:

init in class BaseDatabaseStep

Parameters:

smi - The metadata to work with

sdi - The data to initialize

getPKG

protected Class<?> getPKG()

Description copied from class: BaseDatabaseStep

Returns the specific step class needed for logging

Specified by:

getPKG in class BaseDatabaseStep

Returns:

the specific step class needed for logging

dispose

public void dispose(StepMetaInterface smi,
 StepDataInterface sdi)

Description copied from interface: StepInterface

Dispose of this step: close files, empty logs, etc.

Specified by:

dispose in interface StepInterface

Overrides:

dispose in class BaseDatabaseStep

Parameters:

smi - The metadata to work with

sdi - The data to dispose of