Package org.pentaho.di.trans.steps.parallelgzipcsv

Class ParGzipCsvInputData

java.lang.Object
org.pentaho.di.trans.step.BaseStepData
org.pentaho.di.trans.steps.parallelgzipcsv.ParGzipCsvInputData
All Implemented Interfaces:
StepDataInterface
public class ParGzipCsvInputData extends BaseStepData implements StepDataInterface
Since:
3.2
Author:
Matt

  • Field Details

    • convertRowMeta

      public org.pentaho.di.core.row.RowMetaInterface convertRowMeta

    • outputRowMeta

      public org.pentaho.di.core.row.RowMetaInterface outputRowMeta

    • filenames

      public String[] filenames

    • filenr

      public int filenr

    • startFilenr

      public int startFilenr

    • binaryFilename

      public byte[] binaryFilename

    • fis

      public InputStream fis

    • isAddingRowNumber

      public boolean isAddingRowNumber

    • rowNumber

      public long rowNumber

    • stepNumber

      public int stepNumber

    • totalNumberOfSteps

      public int totalNumberOfSteps

    • parallel

      public boolean parallel

    • filenameFieldIndex

      public int filenameFieldIndex

    • rownumFieldIndex

      public int rownumFieldIndex

    • gzis

      public GZIPInputStream gzis

    • bufferSize

      public int bufferSize

    • delimiter

      public byte[] delimiter

    • enclosure

      public byte[] enclosure

    • startBuffer

      public int startBuffer

    • endBuffer

      public int endBuffer

    • maxBuffer

      public int maxBuffer

    • byteBuffer

      public byte[] byteBuffer
      This is the main byte buffer into which we're going to read chunks of data...

    • totalBytesRead

      public long totalBytesRead

    • blockSize

      public long blockSize

    • eofReached

      public boolean eofReached

    • fileReadPosition

      public long fileReadPosition

    • blockNr

      public int blockNr

  • Constructor Details

    • ParGzipCsvInputData

      public ParGzipCsvInputData()

  • Method Details

    • removeEscapedEnclosures

      public byte[] removeEscapedEnclosures(byte[] field, int nrEnclosuresFound)
      Returns:
      the byte array with escaped enclosures escaped.

    • getMoreData

      public boolean getMoreData() throws org.pentaho.di.core.exception.KettleException
      Read more data from our current file...
      Returns:
      Throws:
      org.pentaho.di.core.exception.KettleException