DRILL-6820: Msgpack format reader #1500
jcmcote
wants to merge
47 commits into
apache:master
from
jcmcote:master
added a msgpack format plugin and a zstd codec
482dbc91
add support to skip over malformed MAP
c63fefa4
moved project to format-msgpack
815f9dbd
returning error codes when parsing error detected
861730f2
added test case for batch with no columns
16b03fb6
avoiding creating the MapOrList instances
a536786c
simple clean ups
7cc9e474
added support for learning schema and applying it
00445080
less verbose message when record is not valid
eb3efd56
testing complete model
cc26f2a1
implemented apply schema so the reader knows what column types to output
3f004458
reader can skip records that do not match schema
d751fa44
when not using a schema the reader should ensureAtLeastOneField
c87a19d8
increased batch size to 16k
fed1fb2f
fixed import
d575bfda
clean up
9fbcfba1
drill timestamp is in milliseconds
bade33e9
ignoring junit test case which show internal drill issue
2594324b
support to skip invalid elements in a list
cf20d986
consolidated printing warnings into context class
417e41ed
support for coercing values according to schema
497e5e07
added discovery and loading of extended type readers
25169fa9
error handling is not using exceptions
69f74cc3
refactored the writing of values
e558be9a
refactored the writing of values
5629136f
work in progress
f2aff31e
better tracking of parsing
0626fd07
move schema to it's own package
b0fd31f9
code review fixes
4d748fac
refactoring, documentation and better logging
ed7373c6
documentation
d927316b
added example of using msgpack
ba39754f
unit test work
5e770be4
unit test work
1cd94704
using ColumnMetadata
fc2c8046
removed todo
8aedaecf
performance test
8dd32d4d
Merge remote-tracking branch 'upstream/master'
29affb8c
performance improvements
cea0d127
Merge branch 'master' of https://github.com/apache/drill
a07dfb26
using a map to cache the field names
df7b378a
performance optimization
859d1fd0
small code improvements
e1e802df
refactored FieldPathTracker
586a4d9d
fix usage of drillbuf and tupleschema
8f1cd783
serialize schema as JSON with ordered childrens
3e552fa9
working on msgpack
cba47ad2
Login to write a write a comment.
Login via GitHub