lp:~maria-captains/maria/10.0-mdev4170

Branch merges

Propose for merging

No branches dependent on this one.

Related source package recipes

No recipes using this branch. (?)

Create packaging recipe

Related snap packages

Related bugs

Related blueprints

3759. By Timour Katchaounov on 2013-11-19

MDEV-4170 Dynamic pushdown of subquery predicates
- fixed an error where the left-most pushdown tab was the left-most tab in a nest, instead of the tab where the condition can pushed the earliest
- fixed errors in the cost computation, mainly when the optimizer looks for optimal join order of the outer query,
  its subqueries may not be optimized yet, and their cost may not be known.
- fixed several valgrind errors

3758. By Timour Katchaounov on 2013-11-14

MDEV-4170 Dynamic pushdown of subquery predicates

- made improvements to, and fixed a number of errors in the selectivity
  and cost estimates
- improved the wrapping of conditions into dynamic conditions, especially
  wrt conditions attached to blocked joins
- removed the optimizer switch debug_record_cond_statistics
- added comments

3757. By Timour Katchaounov on 2013-11-08

MDEV-83

Minor pos-review fixes (renames, comments).

3756. By Timour Katchaounov on 2013-11-08

MDEV-83

Adress review comment that the cost of subqueries was computed incorrectly by just
summing all subquery costs.

The patch computes the cost of all subqueries in a JOIN by multiplying the cost of
each subquery by the number of times it will be executed, depending on the JOIN_TAB
where the subquery is pushed.

The added test case goes through the new cost computation logic, however there is
no way currently to show these intermediate costs at the SQL layer.

3755. By Timour Katchaounov on 2013-11-06

MDEV-5201, MDEV-83

- Fixed bug MDEV-5201

Analysis:
The cause for the crash was that the call to skip_record() evaluated a subquery,
which set join->cur_exec_tab to the JOIN_TAB of the subquery. Consequently the
assert at the top-level JOIN failed.

Solution:
Reset join->cur_exec_tab before each call skip_record().

- addressed review comment to MDEV-83 to make the default cost of an Item to be 0

3754. By Timour Katchaounov on 2013-11-04

MDEV-83

Addressed review comment from Sergey that subsequent calls to
JOIN::static_pushdown_cost will keep adding the same cost to
opt_pos in the case when opt_pos is part of a common prefix
for join plans with different extenstions.

To address this the cost of expensive predicates is added to
POSITION::expensive_pred_cost, which is reset during each call
to static_pushdown_cost. The total cost is returned by
POSITION::get_read_time() instead of accessing POSITION::read_time
directly.

3753. By Timour Katchaounov on 2013-11-01

MDEV-83

- commented out all system variables related to dynamic pushdown
- adjusted test cases

3752. By Timour Katchaounov on 2013-10-31

- Addressed review comments:
  - moved the calculation of the extra cost of subquery predicates during join optimization
    into a separate method JOIN::static_pushdown_cost()
  - fixed small errors in static_pushdown_cost()
  - added a call to this method into optimize_straight_join, so that SELECT STRAIGHT_JOIN
    is optimized in the same way as regular joins
  - added test cases for SELECT STRAIGHT_JOIN
- Fixed bug MDEV-5178 Valgrind warnings (Conditional jump or move depends on uninitialised value) with static_cond_pushdown=on, FROM subquery

3751. By Timour Katchaounov on 2013-10-22

MDEV-83 Cost-based choice for the pushdown of subqueries to joined tables

- Post-merge changes to make mdev-83 cooperate properly with the new EXPLAIN implementation.
- Moved setup_dynamic_conditions() to be called in the end of JOIN::optimize.
- Fixed wrong calculation of join_tab->exec_partial_join_records for blocked joins.
- Adjusted tests and test results.

3750. By Timour Katchaounov on 2013-10-18

MDEV-83 Cost-based choice for the pushdown of subqueries to joined tables

- Fixed a deficiency in the current implementation of both static and dynamic pushdown that
  didn't take into account that blocked join algorithms use
  - join_tab->cache_select->cond - to filter records before storing them in the current
                                   partial join buffer
  - join_tab->select->cond - to filter join records
- Added a new optimizer switch "record_cond_statistics" that wraps all conditions with dynamic
  and/or statistical Items, but doesn't "move" the conditions. This switch is useful only for
  debugging and measuring execution overhead of dynamic conditions.
- Renamed the following switches:
  - "expensive_pred_static_pushdown" -> "static_cond_pushdown"
  - "expensive_pred_dynamic_pushdown" -> "dynamic_cond_pushdown"
- Improved debug printing of execution statistics.