public class ByteTreeWriter extends TreeWriterBase
TreeWriter.Factory
bloomFilter, bloomFilterEntry, bloomFilterUtf8, context, createBloomFilter, encryption, fileStatistics, id, indexStatistics, isPresent, rowIndexPosition, schema, stripeColStatistics
Constructor and Description |
---|
ByteTreeWriter(TypeDescription schema,
WriterEncryptionVariant encryption,
WriterContext writer) |
Modifier and Type | Method and Description |
---|---|
long |
estimateMemory()
Estimate how much memory the writer is consuming excluding the streams.
|
void |
flushStreams()
Flush the TreeWriter stream
|
long |
getRawDataSize()
Estimate the memory used if the file was read into Hive's Writable
types.
|
void |
prepareStripe(int stripeId)
Set up for the next stripe.
|
void |
writeBatch(ColumnVector vector,
int offset,
int length)
Write the values from the given vector from offset for length elements.
|
void |
writeStripe(int requiredIndexEntries)
Write the stripe out to the file.
|
addStripeStatistics, createRowIndexEntry, getCurrentStatistics, getRowIndex, getRowIndexEntry, getStripeStatistics, writeFileStatistics, writeRootBatch
public ByteTreeWriter(TypeDescription schema, WriterEncryptionVariant encryption, WriterContext writer) throws IOException
IOException
public void writeBatch(ColumnVector vector, int offset, int length) throws IOException
TreeWriterBase
writeBatch
in interface TreeWriter
writeBatch
in class TreeWriterBase
vector
- the vector to write fromoffset
- the first value from the vector to writelength
- the number of values from the vector to writeIOException
public void writeStripe(int requiredIndexEntries) throws IOException
TreeWriter
writeStripe
in interface TreeWriter
writeStripe
in class TreeWriterBase
requiredIndexEntries
- the number of index entries that are
required. this is to check to make sure the
row index is well formed.IOException
public long estimateMemory()
TreeWriterBase
estimateMemory
in interface TreeWriter
estimateMemory
in class TreeWriterBase
public long getRawDataSize()
TreeWriter
public void flushStreams() throws IOException
TreeWriter
flushStreams
in interface TreeWriter
flushStreams
in class TreeWriterBase
IOException
public void prepareStripe(int stripeId)
TreeWriter
prepareStripe
in interface TreeWriter
prepareStripe
in class TreeWriterBase
stripeId
- the next stripe idCopyright © 2013–2021 The Apache Software Foundation. All rights reserved.