aboutsummaryrefslogtreecommitdiff
path: root/exec/java-exec/src/main
AgeCommit message (Collapse)Author
2014-09-11DRILL-634: Cleanup/organize Java imports and trailing whitespaces from Drill ↵Aditya Kishore
code
2014-09-11DRILL-1389: Incorrect results when reading nullable data out of parquetJason Altekruse
Fixed numerous issues in the nullable reader for parquet, removed some cruft from previous attempts to fix earlier issues that did not properly address the root causes. The reader overall is simpler and cleaner. Verified against a variety of existing a new files with complete result checks comparing against Steven's parquet reader that uses the higher level interface. Wrote some new test tooling to allow for comparisons of large result sets. Re-enabled the fixed binary support that was accidentally removed in some of the last changes before 0.5. Fixed a bug where we were initializing the column data reader to read the uncompressed size of the column chunk, rather than the on-disk size.
2014-09-11DRILL-1392: Include partition columns in star queriesSteven Phillips
2014-09-02DRILL-1369: Constrain code compilation cache.Jacques Nadeau
2014-08-31Decrease slice target to 100,000 records.Jacques Nadeau
2014-08-31Fix allocation errors and bug in external sortSteven Phillips
2014-08-31DRILL-1171: Create Drill's implementation of ReduceAggregatesRule, including ↵Aman Sinha
a new CastHigh function. DRILL-1342: Fix nullability handling of aggregate functions.
2014-08-29Fix for Parquet reader in larger files brought about by more aggressive ↵Jason Altekruse
memory management.
2014-08-29DRILL-1365: output unified coordinates at profile viewHanifi Gunes
2014-08-29DRILL-1307: add support for fixed binary columns in parquet reader.Jason Altekruse
DRILL-1314: Fix issue reading impala produced files DRILL-1304: Regression selecting a single column from a parquet file. Fixed issue with var length dictionary reading. Reduced memory usage by freeing buffers after we finish reading a page (except for dictionary pages which need to be kept in memory until the entire row group has been read) Rebased onto merge branch. Successfully backed out the changes that had changed the structure of the nullable column readers. This re-introduced some redundancy but avoided a bug that was holding up the release. Ended up falling back on the higher level reader API, only in the case where we are reading a dictionary column and then the next page is not dictionary encoded. This can be fixed to use the optimized read instead, but it doesn't conform to the overall structure of the current reader and is a bit difficult to fix.
2014-08-29DRILL-1334: Make sure to copy operator id while cloning ParquetGroupScanHanifi Gunes
2014-08-29DRILL-1329: External sort memory fixesSteven Phillips
2014-08-29DRILL-1299: Enable short circuit evaluation for case expressions in the ↵Jinfeng Ni
run-time generated code.
2014-08-29DRILL-1315: Allow complex zookeeper string for JDBC connections, same as ODBC.Jacques Nadeau
2014-08-29DRILL-1359 Fix reading and writing of repeated scalar types in ParquetParth Chandra
2014-08-29DRILL-1265: Drill may incorrectly return null when evaluates an expression ↵Jinfeng Ni
of repeated list. The fix is to correctly set offsets vectors for repeated list vector.
2014-08-29DRILL-1258 : Fix compile error in generated code when Drill evaluates an ↵Jinfeng Ni
expression returning a repeated list
2014-08-29DRILL-1355: Ensure Drill optimizer will use storage plugin specific rules, ↵Jinfeng Ni
when a new storage plugin is added.
2014-08-29DRILL-1309: Implement ProjectPastFilterPushdown and update DrillScanRel cost ↵Hanifi Gunes
model so that exclusive column so that star query is more expensive than exclusive column projection. Various fixes affecting record reaaders to handle `*` column as well as fixes to some test cases. exclude parquet files from rat check
2014-08-27DRILL-1354: Fix date truncate functions to use toString helper functions.Mehant Baid
Minor cleanup: move the truncate logic in a separate template
2014-08-27DRILL-1353: Fix decimal regressionsMehant Baid
2014-08-27DRILL-1313: All text mode for json readerJason Altekruse
Current implementation handles nulls that appear while in text mode differently depending if they appear in lists or maps. This allows for a null where a list or map is expected to act the same way it does without text mode enabled. For an expected map it just assumes that the field didn't exist, in which case the leaves below become null filled, and for a list it will default to showing an empty list. If we are actually inside of a list, a null in JSON will be treated the same as the string "null", which improves over the previous behavior of just dropping the null value all together, as we do not support null values within any of the repeated primitive vectors currently. Patch has been rebased on top of merge branch.
2014-08-27DRILL-1283: JSON project pushdown.Jason Altekruse
Allows for users to avoid reading columns of a JSON file, including those that include elements of JSON that drill does not currently support. This can be used to query a subset of an existing file while avoiding elements like schema changes in some columns or nulls in lists that are currently not compatible with Drill. Patch was revised based on Hanifi's review comments, and then rebased off of the merge branch.
2014-08-27Update RPC version number to correspond to changes in nullable buffer from ↵Jacques Nadeau
bitmap to bytes.
2014-08-27DRILL-1335: Fix merge join operator when compare null against null value.Jinfeng Ni
2014-08-27DRILL-1337 : Fix incorrect query result for TPCH Q13. Stop pulling up local ↵Jinfeng Ni
filter from an outer join condition.
2014-08-27DRILL-595, DRILL-811, DRILL-1029: Support select * in view, subquery, table ↵Jinfeng Ni
expression in with clause. Most fixes in Optiq.
2014-08-27Support for @inject in aggregation functionsMehant Baid
2014-08-25Fix initCap function to set outbound position correctly.Jacques Nadeau
2014-08-25Set the BitVector memory to zero on allocation.Aditya Kishore
2014-08-25Fixed the index check in DrillBuf.Aditya Kishore
2014-08-24Switch to DrillBufJacques Nadeau
Add @Inject DrillBuf Move comparison functions to memory sensitive ones Add scalar replacement functionality for value holders Simplify date parsing function Add local compiled code caching
2014-08-24DRILL-982: Return nulls for non-existent columns in parquet reader.Jason Altekruse
2014-08-24DRILL-1312: Use correct index to get partition vectors in ScanBatchMehant Baid
2014-08-24DRILL-1132: WriterPrel should not care about collation trait of the child.Aman Sinha
2014-08-24DRILL-1310: Fix assertion in ProjectRecordBatch for certain types of star ↵Aman Sinha
queries.
2014-08-24DRILL-1322: Fix memory leak when all records in a batch are filteredMehant Baid
2014-08-24Fix issue introduced by DRILL-1202 where allocators are being closed after ↵Jacques Nadeau
reporting success. Update ScreenRoot to cleanup before returning success. Update ScanBatch to cleanup reader in case of limit query to avoid memory leak in ParquetReader. Update allocators so that we don't have memory leak when using debug options. Update project record batch so that it doesn't try to return a released remainder.
2014-08-24Pass correct uncompressed data size to BytesInput ctor in ComplexParquetReaderParth Chandra
2014-08-24Skip static fields in PojoDataType.Jacques Nadeau
2014-08-20Use Direct Memory in Parquet WriterParth Chandra
2014-08-18DRILL-1281: Use ByteBuffer read codepath in complex parquet readerSteven Phillips
2014-08-18DRILL-1281: Read into Direct Memory in Parquet Reader. Requires Hadoop 2.4 ↵Parth Chandra
or above
2014-08-18DRILL-1295: Select returns null for non pivot fields with a nested selectMehant Baid
* Fix DrillTextRecordReader to handle the case when requested columns includes the entire group and a subset.
2014-08-18DRILL-1293: Fix assertion when selecting star column from view that also has ↵Aman Sinha
star column.
2014-08-18DRILL-1278: Fix selecting scalar field from a map with join clause.Mehant Baid
2014-08-18DRILL-1277: Rewrite compound identifiers in 'ON' clause as item operatorMehant Baid
2014-08-18DRILL-1241: Ensure that Limit produces at least 1 batch with the output schema.Aman Sinha
2014-08-18DRILL-1205: group by causes access to DeadBufHanifi Gunes
* Fix an issue that causes calls to splitAndTransferTo malfunction on repeated vector types
2014-08-18DRILL-1178: Double copy in setSafe for VariableLengthVectorsSudheesh Katkam