drill
DRILL-6845: Semi-Hash-Join to skip incoming build duplicates, automatically stop skipping if too few
#1606
Open

DRILL-6845: Semi-Hash-Join to skip incoming build duplicates, automatically stop skipping if too few #1606

Ben-Zvi wants to merge 10 commits into apache:master from Ben-Zvi:DRILL-6845
Ben-Zvi
Ben-Zvi Ben-Zvi requested a review from ilooner ilooner 5 years ago
ilooner
ilooner requested changes on 2019-01-10
ilooner
ilooner requested changes on 2019-01-11
ilooner
ilooner requested changes on 2019-01-14
ilooner
ilooner commented on 2019-01-14
Ben-Zvi Ben-Zvi force pushed from 36136895 to 823cebc6 5 years ago
Ben-Zvi
Ben-Zvi Ben-Zvi closed this 5 years ago
Ben-Zvi
Ben-Zvi Ben-Zvi reopened this 5 years ago
Ben-Zvi Ben-Zvi changed the title Drill 6845: Semi-Hash-Join to skip incoming build duplicates, automatically stop skipping if too few DRILL-6845: Semi-Hash-Join to skip incoming build duplicates, automatically stop skipping if too few 5 years ago
ilooner
ilooner requested changes on 2019-01-16
ilooner
Ben-Zvi Ben-Zvi force pushed from 6505826d to 7db9eec4 5 years ago
Ben-Zvi Ben-Zvi force pushed from 7db9eec4 to 030b1b36 5 years ago
Ben-Zvi DRILL-6845: Add option to skip inner duplicates for Semi Hash Join
1d58444b
Ben-Zvi DRILL-6845: Add heuristic to stop skipping duplicates when there are …
63a05752
Ben-Zvi DRILL-6845: Adjust the memory calculator for semi-join with duplicates
cb0c2f5d
Ben-Zvi added option min_batches_in_available_memory, and Some more changes
563caea9
Ben-Zvi DRILL-6845: Added option for stop skipping threshold, and reserved ou…
668209bb
Ben-Zvi DRILL-6845: Removed parameter to shouldSpill, use post build to check…
e25cfc75
Ben-Zvi DRILL-6845: Get numPartitionsSpilled from partitionStat, and also use…
2aeea132
Ben-Zvi DRILL-6845: Fixed a possible null pointer
c65a9aa6
Ben-Zvi DRILL-6845: Disable skipping when num partitions is 1, and (temp) use…
5b4f9475
Ben-Zvi DRILL-6845: Fix handling Retry from put() - for empty partition
552acdf6
Ben-Zvi Ben-Zvi force pushed from 030b1b36 to 552acdf6 5 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone