Age | Commit message (Collapse) | Author |
|
- replaced all String path representation with org.apache.hadoop.fs.Path
- added PathSerDe.Se JSON serializer
- refactoring of DFSPartitionLocation code by leveraging existing listPartitionValues() functionality
closes #1657
|
|
closes #1207
|
|
planning phase.
1) Make directory-based pruning rule both work in calcite logical and drill logical planning phase.
2) Only apply directory-based pruning in logical phase when there is no metadata cache.
3) Make FileSelection constructor public, since FileSelection.create() would modify selectionRoot.
|
|
report table not found rather than failing.
Refactor FileSelection to eliminate redundancy, make it more managable
Fix WorkspaceSchemaFactory to handle empty folders.
Introduce ParquetFileSelection, a sub-class of FileSelection that carries along metadata cache
Fix MagicStringMatcher so that it operate on files only.
Unit test file selection
|
|
code
|
|
detection. Rename storage engine to storage plugin. Separate storage plugins from format plugins, updating Parquet and JSON to format engines. Refactor distribution logic and enable use within JSON format and all EasyFormatPlugins.
|