Merge lp:~hrvojem/percona-server/rn-5.5.39-36.0-5.5 into lp:percona-server/5.5

[Hrvoje Matijakovic]

[Laurynas Biveinis (laurynas-biveinis)]

review: Needs Fixing

[Laurynas Biveinis (laurynas-biveinis)]

review: Needs Fixing

[Laurynas Biveinis (laurynas-biveinis)]

review: Approve

=== modified file 'doc/source/management/audit_log_plugin.rst'
--- doc/source/management/audit_log_plugin.rst	2014-04-30 09:32:01 +0000
+++ doc/source/management/audit_log_plugin.rst	2014-08-28 13:26:38 +0000
@@ -87,7 +87,7 @@
 Log Format
 ==========
 
-Audit log plugin supports two formats. In one format (``OLD``) log record properties are saved as XML attributes and in the other (``NEW``) log recored properties are saved as XML tags. Audit log format can be set up with the :variable:`audit_log_format` variable.
+The audit log plugin supports four log formats: ``OLD``, ``NEW``, ``JSON``, and ``CSV``. ``OLD`` and ``NEW`` formats are based on XML, where the former outputs log record properties as XML attributes and the latter as XML tags. Information logged is the same in all four formats. The log format choice is controlled by :variable:`audit_log_format` variable.
 
 Example of the ``OLD`` format: ::
 
@@ -122,6 +122,25 @@
   <DB></DB>
  </AUDIT_RECORD>
 
+Example of the ``JSON`` format: ::
+
+ {"audit_record":{"name":"Query","record":"4707_2014-08-27T10:43:52","timestamp":"2014-08-27T10:44:19 UTC","command_class":"show_databases","connection_id":"37","status":0,"sqltext":"show databases","user":"root[root] @ localhost []","host":"localhost","os_user":"","ip":""}}
+
+Example of the ``CSV`` format: :: 
+
+ "Query","49284_2014-08-27T10:47:11","2014-08-27T10:47:23 UTC","show_databases","37",0,"show databases","root[root] @ localhost []","localhost","",""
+
+.. _streaming_to_syslog:
+
+Streaming the audit log to syslog
+=================================
+
+Ability to stream the audit log to `syslog <http://www.syslog.org/>`_ was implemented in |Percona Server| :rn:`5.5.39-36.0`. To stream the audit log to syslog you'll need to set :variable:`audit_log_handler` variable to ``SYSLOG``. To control the syslog file handler, the following variables can be used: :variable:`audit_log_syslog_ident`, :variable:`audit_log_syslog_facility`, and :variable:`audit_log_syslog_priority` These variables have the same meaning as appropriate parameters described in the `syslog(3) manual <http://linux.die.net/man/3/syslog>`_.
+
+.. note::
+
+   Variables: :variable:`audit_log_strategy`, :variable:`audit_log_buffer_size`, :variable:`audit_log_rotate_on_size`, :variable:`audit_log_rotations` have effect only with ``FILE`` handler. 
+
 System Variables
 ================
 
@@ -142,6 +161,8 @@
 * ``SEMISYNCHRONOUS`` - log directly to file, do not flush and sync every event
 * ``SYNCHRONOUS`` - log directly to file, flush and sync every event
 
+This variable has effect only when :variable:`audit_log_handler` is set to ``FILE``.
+
 .. variable:: audit_log_file
 
      :version 5.5.37-35.0: Implemented
@@ -173,19 +194,20 @@
      :vartype: Numeric
      :default: 4096
 
-This variable can be used to specify the size of memory buffer used for logging, used when :variable:`audit_log_strategy` variable is set to ``ASYNCHRONOUS`` or ``PERFORMANCE`` values.
+This variable can be used to specify the size of memory buffer used for logging, used when :variable:`audit_log_strategy` variable is set to ``ASYNCHRONOUS`` or ``PERFORMANCE`` values. This variable has effect only when :variable:`audit_log_handler` is set to ``FILE``.
 
 .. variable:: audit_log_format
 
-     :version 5.5.37-35.0: Implemented
+     :version 5.5.37-35.0: Original implementation
+     :version 5.5.39-36.0: Implemented support for ``CSV`` and  ``JSON`` log formats
      :cli: Yes
      :scope: Global
      :dyn: No 
      :vartype: String
      :default: OLD
-     :allowed values: ``OLD``, ``NEW``
+     :allowed values: ``OLD``, ``NEW``, ``CSV``, ``JSON``
 
-This variable is used to specify the audit log format. When this variable is set to ``OLD`` information will be logged as XML attributes, and when is set to ``NEW`` it will be logged as XML tags.
+This variable is used to specify the audit log format. The audit log plugin supports four log formats: ``OLD``, ``NEW``, ``JSON``, and ``CSV``. ``OLD`` and ``NEW`` formats are based on XML, where the former outputs log record properties as XML attributes and the latter as XML tags. Information logged is the same in all four formats.
 
 .. variable:: audit_log_policy
 
@@ -213,7 +235,7 @@
      :vartype: Numeric
      :default: 0 (don't rotate the log file)
 
-This variable is used to specify the size of the audit log file. When this size is reached log will get rotated. Old log can be found in the same directory, audit log sequential number will be appended to the name specified in the :variable:`audit_log_file` variable.
+This variable is used to specify the maximum audit log file size. Upon reaching this size the log will be rotated. The rotated log files will be present in the same same directory as the current log file. A sequence number will be appended to the log file name upon rotation. This variable has effect only when :variable:`audit_log_handler` is set to ``FILE``.
  
 .. variable:: audit_log_rotations
 
@@ -224,11 +246,61 @@
      :vartype: Numeric
      :default: 0 
 
-This variable is used to specify how many log files should be kept when :variable:`audit_log_rotate_on_size` variable is set to non-zero value.
+This variable is used to specify how many log files should be kept when :variable:`audit_log_rotate_on_size` variable is set to non-zero value. This variable has effect only when :variable:`audit_log_handler` is set to ``FILE``.
+
+.. variable:: audit_log_handler
+
+     :version 5.5.39-36.0: Implemented
+     :cli: Yes
+     :scope: Global
+     :dyn: No 
+     :vartype: String
+     :default: FILE
+     :allowed values: ``FILE``, ``SYSLOG``
+
+This variable is used to configure where the audit log will be written. If it is set to ``FILE``, the log will be written into a file specified by :variable:`audit_log_file` variable. If it is set to ``SYSLOG``, the audit log will be written to syslog.
+
+.. variable:: audit_log_syslog_ident
+
+   :version 5.5.39-36.0: Implemented
+   :cli: Yes
+   :scope: Global
+   :dyn: No 
+   :vartype: String
+   :default: percona-audit
+
+This variable is used to specify the ``ident`` value for syslog. This variable has the same meaning as the appropriate parameter described in the `syslog(3) manual <http://linux.die.net/man/3/syslog>`_.
+
+.. variable:: audit_log_syslog_facility
+   
+   :version 5.5.39-36.0: Implemented
+   :cli: Yes
+   :scope: Global
+   :dyn: No 
+   :vartype: String
+   :default: LOG_USER
+
+This variable is used to specify the ``facility`` value for syslog. This variable has the same meaning as the appropriate parameter described in the `syslog(3) manual <http://linux.die.net/man/3/syslog>`_.
+
+.. variable:: audit_log_syslog_priority
+
+   :version 5.5.39-36.0: Implemented
+   :cli: Yes
+   :scope: Global
+   :dyn: No 
+   :vartype: String
+   :default: LOG_INFO
+
+This variable is used to specify the ``priority`` value for syslog. This variable has the same meaning as the appropriate parameter described in the `syslog(3) manual <http://linux.die.net/man/3/syslog>`_.
 
 Version Specific Information
 ============================
 
   * :rn:`5.5.37-35.0`
     Audit Log plugin has been implemented in |Percona Server|.
+  * :rn:`5.5.39-36.0`
+    |Percona Server| :ref:`audit_log_plugin` now supports ``JSON`` and ``CSV`` log formats. 
+  * :rn:`5.5.39-36.0`
+    |Percona Server| :ref:`audit_log_plugin` now supports :ref:`streaming the audit log to syslog <streaming_to_syslog>`.
 
+ 
 
=== added file 'doc/source/release-notes/Percona-Server-5.5.39-36.0.rst'
--- doc/source/release-notes/Percona-Server-5.5.39-36.0.rst	1970-01-01 00:00:00 +0000
+++ doc/source/release-notes/Percona-Server-5.5.39-36.0.rst	2014-08-28 13:26:38 +0000
@@ -0,0 +1,35 @@
+.. rn:: 5.5.39-36.0
+
+==============================
+ |Percona Server| 5.5.39-36.0
+==============================
+
+Percona is glad to announce the release of |Percona Server| 5.5.39-36.0 on August 29th, 2014. Downloads are available `here <http://www.percona.com/downloads/Percona-Server-5.5/Percona-Server-5.5.39-36.0/>`_ and from the :doc:`Percona Software Repositories </installation>`.
+
+Based on `MySQL 5.5.39 <http://dev.mysql.com/doc/relnotes/mysql/5.5/en/news-5-5-39.html>`_, including all the bug fixes in it, |Percona Server| 5.5.39-36.0 is now the current stable release in the 5.5 series. All of |Percona|'s software is open-source and free, all the details of the release can be found in the `5.5.39-36.0 milestone at Launchpad <https://launchpad.net/percona-server/+milestone/5.5.39-36.0>`_. 
+
+New Features
+============
+
+ |Percona Server| :ref:`audit_log_plugin` now supports ``JSON`` and ``CSV`` formats. The format choice is controlled by :variable:`audit_log_format` variable.
+
+ |Percona Server| :ref:`audit_log_plugin` now supports :ref:`streaming the audit log to syslog <streaming_to_syslog>`.
+
+Bugs Fixed
+==========
+
+ Querying :table:`INNODB_CHANGED_PAGES` with a range condition ``START_LSN > x AND END_LSN < y`` would lead to a server crash if the range was empty with x greater than y. Bug fixed :bug:`1202252` (*Jan Lindström* and *Sergei Petrunia*).
+
+ With :ref:`changed_page_tracking` feature enabled, queries from the :table:`INNODB_CHANGED_PAGES` could read the bitmap data whose write was in still progress. This would cause the query to fail with an ``ER_CANT_FIND_SYSTEM_REC`` and a warning printed to the server error log. The workaround is to add an appropriate ``END_LSN``-limiting condition to the query. Bug fixed :bug:`1346122`.
+
+ ``mysqld-debug`` was missing from *Debian* packages. This regression was introduced in |Percona Server| :rn:`5.5.36-34.0`. Bug fixed :bug:`1290087`.
+
+ Fixed a memory leak in :ref:`slowlog_rotation`. Bug fixed :bug:`1314138`.
+
+ The audit log plugin would write log with XML syntax errors when ``OLD`` and ``NEW`` formats were used. Bug fixed :bug:`1320879`.
+
+ A server built with system OpenSSL support, such as the distributed Percona Server binaries, had SSL-related memory leaks. Bug fixed :bug:`1334743` (upstream :mysqlbug:`73126`).
+
+ If the bitmap directory has a bitmap file sequence with a start LSN of one file less than a start LSN of the previous file, a debug build would assert when queries were run on :table:`INNODB_CHANGED_PAGES` table. Bug fixed :bug:`1342494`.
+
+Other bugs fixed: :bug:`1337324`, :bug:`1151723`, :bug:`1182050`, :bug:`1182072`, :bug:`1280875`, :bug:`1182046`, :bug:`1328482` (upstream :mysqlbug:`73418`), and :bug:`1334317` (upstream :mysqlbug:`73111`).
 
=== modified file 'doc/source/release-notes/release-notes_index.rst'
--- doc/source/release-notes/release-notes_index.rst	2014-07-30 10:29:34 +0000
+++ doc/source/release-notes/release-notes_index.rst	2014-08-28 13:26:38 +0000
@@ -6,6 +6,7 @@
    :maxdepth: 1
    :glob:
 
+   Percona-Server-5.5.39-36.0
    Percona-Server-5.5.38-35.2
    Percona-Server-5.5.37-35.1
    Percona-Server-5.5.37-35.0
 
=== modified file 'doc/source/upstream-bug-fixes.rst'
--- doc/source/upstream-bug-fixes.rst	2014-07-30 10:29:34 +0000
+++ doc/source/upstream-bug-fixes.rst	2014-08-28 13:26:38 +0000
@@ -5,9 +5,27 @@
 =============================================================
 
 +-------------------------------------------------------------------------------------------------------------+
+|:Upstream bug: :mysqlbug:`73126` - Numerous Valgrind errors in OpenSSL                                       |
+|:Launchpad bug: :bug:`1334743`                                                                               |
+|:Upstream state: Verified (checked on 2014-08-28)                                                            |
+|:Fix Released: :rn:`5.5.39-36.0`                                                                             |
+|:Upstream fix: N/A                                                                                           |
++-------------------------------------------------------------------------------------------------------------+
+|:Upstream bug: :mysqlbug:`73111` - Suppression typo causing spurious MTR Valgrind failures                   |
+|:Launchpad bug: :bug:`1334317`                                                                               |
+|:Upstream state: Open (checked on 2014-08-28)                                                                |
+|:Fix Released: :rn:`5.5.39-36.0`                                                                             |
+|:Upstream fix: N/A                                                                                           |
++-------------------------------------------------------------------------------------------------------------+
+|:Upstream bug: :mysqlbug:`73418` - Add --manual-lldb option to mysql-test-run.pl                             |
+|:Launchpad bug: :bug:`1328482`                                                                               |
+|:Upstream state: Verified (checked on 2014-08-28)                                                            |
+|:Fix Released: :rn:`5.5.39-36.0`                                                                             |
+|:Upstream fix: N/A                                                                                           |
++-------------------------------------------------------------------------------------------------------------+
 |:Upstream bug: :mysqlbug:`60782` - Audit plugin API: no MYSQL_AUDIT_GENERAL_LOG notifications with general...|
 |:Launchpad bug: :bug:`1182535`                                                                               |
-|:Upstream state: Verified (checked on 2014-07-01)                                                            |
+|:Upstream state: Closed                                                                                      |
 |:Fix Released: :rn:`5.5.37-35.0`                                                                             |
 |:Upstream fix: N/A                                                                                           |
 +-------------------------------------------------------------------------------------------------------------+
@@ -25,13 +43,13 @@
 +-------------------------------------------------------------------------------------------------------------+
 |:Upstream bug: :mysqlbug:`71375` - Slave IO thread won't attempt auto reconnect to the master/error-code 1593|
 |:Launchpad bug: :bug:`1268735`                                                                               |
-|:Upstream state: Verified (checked on 2014-07-01)                                                            |
+|:Upstream state: Verified (checked on 2014-08-28)                                                            |
 |:Fix Released: :rn:`5.5.36-34.1`                                                                             |
 |:Upstream fix: N/A                                                                                           |
 +-------------------------------------------------------------------------------------------------------------+
 |:Upstream bug: :mysqlbug:`71374` - Slave IO thread won't attempt auto reconnect to the master/error-code 1159|
 |:Launchpad bug: :bug:`1268729`                                                                               |
-|:Upstream state: Verified (checked on 2014-07-01)                                                            |
+|:Upstream state: Verified (checked on 2014-08-28)                                                            |
 |:Fix Released: :rn:`5.5.36-34.1`                                                                             |
 |:Upstream fix: N/A                                                                                           |
 +-------------------------------------------------------------------------------------------------------------+
@@ -61,7 +79,7 @@
 +-------------------------------------------------------------------------------------------------------------+
 |:Upstream bug: :mysqlbug:`69639` - mysql failed to build with dtrace Sun D 1.11                              |
 |:Launchpad bug: :bug:`1196460`                                                                               |
-|:Upstream state: Open (checked on 2014-07-01)                                                                |
+|:Upstream state: Open (checked on 2014-08-28)                                                                |
 |:Fix Released: :rn:`5.5.33-31.1`                                                                             |
 |:Upstream fix: N/A                                                                                           |
 +-------------------------------------------------------------------------------------------------------------+
@@ -73,7 +91,7 @@
 +-------------------------------------------------------------------------------------------------------------+
 |:Upstream bug: :mysqlbug:`42415` - UPDATE/DELETE with LIMIT clause unsafe for SBL even with ORDER BY PK ...  |
 |:Launchpad bug: :bug:`1132194`                                                                               |
-|:Upstream state: Verified (checked on 2014-07-01)                                                            |
+|:Upstream state: Verified (checked on 2014-08-28)                                                            |
 |:Fix Released: :rn:`5.5.32-31.0`                                                                             |
 |:Upstream fix: N/A                                                                                           |
 +-------------------------------------------------------------------------------------------------------------+
@@ -85,7 +103,7 @@
 +-------------------------------------------------------------------------------------------------------------+
 |:Upstream bug: :mysqlbug:`68970` - fsp_reserve_free_extents switches from small to big tblspace handling ... |
 |:Launchpad bug: :bug:`1169494`                                                                               |
-|:Upstream state: Verified (checked on 2014-07-01)                                                            |
+|:Upstream state: Verified (checked on 2014-08-28)                                                            |
 |:Fix Released: :rn:`5.5.32-31.0`                                                                             |
 |:Upstream fix: N/A                                                                                           |
 +-------------------------------------------------------------------------------------------------------------+
@@ -97,7 +115,7 @@
 +-------------------------------------------------------------------------------------------------------------+
 |:Upstream bug: :mysqlbug:`68999` - SSL_OP_NO_COMPRESSION not defined                                         |
 |:Launchpad bug: :bug:`1183610`                                                                               |
-|:Upstream state: No Feedback (checked on 2014-07-01)                                                         |
+|:Upstream state: No Feedback (checked on 2014-08-28)                                                         |
 |:Fix Released: :rn:`5.5.31-30.3`                                                                             |
 |:Upstream fix: N/A                                                                                           |
 +-------------------------------------------------------------------------------------------------------------+
@@ -109,7 +127,7 @@
 +-------------------------------------------------------------------------------------------------------------+
 |:Upstream bug: :mysqlbug:`68845` - Unnecessary log_sys->mutex reacquisition in mtr_log_reserve_and_write()   |
 |:Launchpad bug: :bug:`1163439`                                                                               |
-|:Upstream state: Verified (checked on 2014-07-01)                                                            |
+|:Upstream state: Verified (checked on 2014-08-28)                                                            |
 |:Fix Released: :rn:`5.5.30-30.2`                                                                             |
 |:Upstream fix: N/A                                                                                           |
 +-------------------------------------------------------------------------------------------------------------+
@@ -139,13 +157,13 @@
 +-------------------------------------------------------------------------------------------------------------+
 |:Upstream bug: :mysqlbug:`68476` - Suboptimal code in my_strnxfrm_simple()                                   |
 |:Launchpad bug: :bug:`1132350`                                                                               |
-|:Upstream state: Verified (checked on 2014-07-01)                                                            |
+|:Upstream state: Verified (checked on 2014-08-28)                                                            |
 |:Fix Released: :rn:`5.5.30-30.1`                                                                             |
 |:Upstream fix: N/A                                                                                           |
 +-------------------------------------------------------------------------------------------------------------+
 |:Upstream bug: :mysqlbug:`68116` - InnoDB monitor may hit an assertion error in buf_page_get_gen in debug ...|
 |:Launchpad bug: :bug:`1100178`                                                                               |
-|:Upstream state: Verified (checked on 2014-07-01)                                                            |
+|:Upstream state: Verified (checked on 2014-08-28)                                                            |
 |:Fix Released: :rn:`5.5.29-30.0`                                                                             |
 |:Upstream fix: N/A                                                                                           |
 +-------------------------------------------------------------------------------------------------------------+
@@ -247,7 +265,7 @@
 +-------------------------------------------------------------------------------------------------------------+
 |:Upstream bug: :mysqlbug:`61178` - Incorrect implementation of intersect(ulonglong) in non-optimized Bitmap..|
 |:Launchpad bug: :bug:`1042517`                                                                               |
-|:Upstream state: Verified (checked on 2014-07-01)                                                            |
+|:Upstream state: Verified (checked on 2014-08-28)                                                            |
 |:Fix Released: :rn:`5.5.27-29.0`                                                                             |
 |:Upstream fix: N/A                                                                                           |
 +-------------------------------------------------------------------------------------------------------------+
@@ -259,7 +277,7 @@
 +-------------------------------------------------------------------------------------------------------------+
 |:Upstream bug: :mysqlbug:`64800` - mysqldump with --include-master-host-port putting quotes around port no.  | 
 |:Launchpad bug: :bug:`1013432`                                                                               |
-|:Upstream state: Verified (checked on 2014-07-01)                                                            |
+|:Upstream state: Verified (checked on 2014-08-28)                                                            |
 |:Fix Released: :rn:`5.5.27-28.0`                                                                             |
 |:Upstream fix: N/A                                                                                           |
 +-------------------------------------------------------------------------------------------------------------+
@@ -307,7 +325,7 @@
 +-------------------------------------------------------------------------------------------------------------+
 |:Upstream bug: :mysqlbug:`71183` - os_file_fsync() should handle fsync() returning EINTR                     |
 |:Launchpad bug: :bug:`1262651`                                                                               |
-|:Upstream state: Verified (checked on 2014-07-01)                                                            |
+|:Upstream state: Verified (checked on 2014-08-28)                                                            |
 |:Fix Released: :rn:`5.5.20-24.1`                                                                             |
 |:Upstream fix: N/A                                                                                           |
 +-------------------------------------------------------------------------------------------------------------+
@@ -331,13 +349,13 @@
 +-------------------------------------------------------------------------------------------------------------+
 |:Upstream bug: :mysqlbug:`62516` - Fast index creation does not update index statistics                      |
 |:Launchpad bug: :bug:`857590`                                                                                |
-|:Upstream state: Verified (checked on 2014-07-01)                                                            |
+|:Upstream state: Verified (checked on 2014-08-28)                                                            |
 |:Fix Released: :rn:`5.5.16-22.0`                                                                             |
 |:Upstream fix: N/A                                                                                           |
 +-------------------------------------------------------------------------------------------------------------+
 |:Upstream bug: :mysqlbug:`25007` - memory tables with dynamic rows format                                    |
 |:Launchpad bug: N/A                                                                                          |
-|:Upstream state: Verified (checked on 2014-07-01)                                                            |
+|:Upstream state: Verified (checked on 2014-08-28)                                                            |
 |:Fix Released: :rn:`5.5.15-21.0`                                                                             |
 |:Upstream fix: N/A                                                                                           |
 +-------------------------------------------------------------------------------------------------------------+
@@ -355,7 +373,7 @@
 +-------------------------------------------------------------------------------------------------------------+
 |:Upstream bug: :mysqlbug:`61595` - mysql-test/include/wait_for_slave_param.inc timeout logic is incorrect    |
 |:Launchpad bug: :bug:`800035`                                                                                |
-|:Upstream state: Verified (checked on 2014-07-01)                                                            |
+|:Upstream state: Verified (checked on 2014-08-28)                                                            |
 |:Fix Released: :rn:`5.5.13-20.4`                                                                             |
 |:Upstream fix: N/A                                                                                           |
 +-------------------------------------------------------------------------------------------------------------+
@@ -385,7 +403,7 @@
 +-------------------------------------------------------------------------------------------------------------+
 |:Upstream bug: :mysqlbug:`69146` - Optimization in buf_pool_get_oldest_modification if srv_buf_pool_instances|
 |:Launchpad bug: :bug:`1176496`                                                                               |
-|:Upstream state: Verified (checked on 2014-07-01)                                                            |
+|:Upstream state: Verified (checked on 2014-08-28)                                                            |
 |:Fix Released: :rn:`5.5.8-20.0`                                                                              |
 |:Upstream fix: N/A                                                                                           |
 +-------------------------------------------------------------------------------------------------------------+