Constructor and Description |
---|
Options() |
Options(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
boolean |
allowPluginFilters() |
Reader.Options |
allowPluginFilters(boolean allowPluginFilters) |
Reader.Options |
allowSARGToFilter(boolean allowSARGToFilter)
Set allowSARGToFilter.
|
Reader.Options |
clone() |
Reader.Options |
dataReader(DataReader value)
Set dataReader.
|
Reader.Options |
forcePositionalEvolution(boolean value)
Set whether to force schema evolution to be positional instead of
based on the column names.
|
String[] |
getColumnNames() |
DataReader |
getDataReader() |
Consumer<OrcFilterContext> |
getFilterCallback() |
boolean |
getForcePositionalEvolution() |
boolean[] |
getInclude() |
boolean |
getIncludeAcidColumns() |
boolean |
getIsSchemaEvolutionCaseAware() |
long |
getLength() |
long |
getMaxOffset() |
long |
getOffset() |
int |
getPositionalEvolutionLevel() |
String[] |
getPreFilterColumnNames() |
TypeDescription |
getSchema() |
SearchArgument |
getSearchArgument() |
Boolean |
getSkipCorruptRecords() |
boolean |
getTolerateMissingSchema() |
Boolean |
getUseZeroCopy() |
Reader.Options |
include(boolean[] include)
Set the list of columns to read.
|
Reader.Options |
includeAcidColumns(boolean includeAcidColumns)
true if acid metadata columns should be decoded otherwise they will
be set to null . |
boolean |
isAllowSARGToFilter()
Get allowSARGToFilter value.
|
Reader.Options |
isSchemaEvolutionCaseAware(boolean value)
Set boolean flag to determine if the comparison of field names in schema
evolution is case sensitive
|
int |
minSeekSize() |
Reader.Options |
minSeekSize(int minSeekSize) |
double |
minSeekSizeTolerance() |
Reader.Options |
minSeekSizeTolerance(double value) |
Reader.Options |
positionalEvolutionLevel(int value)
Set number of levels to force schema evolution to be positional instead of
based on the column names.
|
Reader.Options |
range(long offset,
long length)
Set the range of bytes to read
|
Reader.Options |
schema(TypeDescription schema)
Set the schema on read type description.
|
Reader.Options |
searchArgument(SearchArgument sarg,
String[] columnNames)
Set search argument for predicate push down.
|
Reader.Options |
setRowFilter(String[] filterColumnNames,
Consumer<OrcFilterContext> filterCallback)
Set a row level filter.
|
Reader.Options |
skipCorruptRecords(boolean value)
Set whether to skip corrupt records.
|
Reader.Options |
tolerateMissingSchema(boolean value)
Set whether to make a best effort to tolerate schema evolution for files
which do not have an embedded schema because they were written with a'
pre-HIVE-4243 writer.
|
String |
toString() |
boolean |
useSelected() |
Reader.Options |
useSelected(boolean newValue) |
Reader.Options |
useZeroCopy(boolean value)
Set whether to use zero copy from HDFS.
|
public Options()
public Options(Configuration conf)
public Reader.Options include(boolean[] include)
include
- a list of columns to readpublic Reader.Options range(long offset, long length)
offset
- the starting byte offsetlength
- the number of bytes to readpublic Reader.Options schema(TypeDescription schema)
public Reader.Options setRowFilter(String[] filterColumnNames, Consumer<OrcFilterContext> filterCallback)
filterColumnNames
- a comma separated list of the column names that
are read before the filter is applied. Only top
level columns in the reader's schema can be used
here and they must not be duplicated.filterCallback
- a function callback to perform filtering during the call to
RecordReader.nextBatch. This function should not reference
any static fields nor modify the passed in ColumnVectors but
should set the filter output using the selected array.public Reader.Options searchArgument(SearchArgument sarg, String[] columnNames)
sarg
- the search argumentcolumnNames
- the column names forpublic Reader.Options allowSARGToFilter(boolean allowSARGToFilter)
allowSARGToFilter
- public boolean isAllowSARGToFilter()
public Reader.Options useZeroCopy(boolean value)
value
- the new zero copy flagpublic Reader.Options dataReader(DataReader value)
value
- the new dataReader.public Reader.Options skipCorruptRecords(boolean value)
value
- the new skip corrupt records flagpublic Reader.Options tolerateMissingSchema(boolean value)
value
- the new tolerance flagpublic Reader.Options forcePositionalEvolution(boolean value)
value
- force positional evolutionpublic Reader.Options positionalEvolutionLevel(int value)
value
- number of levels of positional schema evolutionpublic Reader.Options isSchemaEvolutionCaseAware(boolean value)
value
- the flag for schema evolution is case sensitive or not.public Reader.Options includeAcidColumns(boolean includeAcidColumns)
true
if acid metadata columns should be decoded otherwise they will
be set to null
.public boolean[] getInclude()
public long getOffset()
public long getLength()
public TypeDescription getSchema()
public SearchArgument getSearchArgument()
public Consumer<OrcFilterContext> getFilterCallback()
public String[] getPreFilterColumnNames()
public String[] getColumnNames()
public long getMaxOffset()
public Boolean getUseZeroCopy()
public Boolean getSkipCorruptRecords()
public DataReader getDataReader()
public boolean getForcePositionalEvolution()
public int getPositionalEvolutionLevel()
public boolean getIsSchemaEvolutionCaseAware()
public boolean getIncludeAcidColumns()
public Reader.Options clone()
public boolean getTolerateMissingSchema()
public boolean useSelected()
public Reader.Options useSelected(boolean newValue)
public boolean allowPluginFilters()
public Reader.Options allowPluginFilters(boolean allowPluginFilters)
public int minSeekSize()
public Reader.Options minSeekSize(int minSeekSize)
public double minSeekSizeTolerance()
public Reader.Options minSeekSizeTolerance(double value)
Copyright © 2013–2023 The Apache Software Foundation. All rights reserved.