Getting raw SQL query string from PDO prepared sta

问题:

Is there a way to get the raw SQL string executed when calling PDOStatement::execute() on a prepared statement? For debugging purposes this would be extremely useful.

回答1:

I assume you mean that you want the final SQL query, with parameter values interpolated into it. I understand that this would be useful for debugging, but it is not the way prepared statements work. Parameters are not combined with a prepared statement on the client-side, so PDO should never have access to the query string combined with its parameters.

The SQL statement is sent to the database server when you do prepare(), and the parameters are sent separately when you do execute(). MySQL\'s general query log does show the final SQL with values interpolated after you execute(). Below is an excerpt from my general query log. I ran the queries from the mysql CLI, not from PDO, but the principle is the same.

081016 16:51:28 2 Query       prepare s1 from \'select * from foo where i = ?\'
                2 Prepare     [2] select * from foo where i = ?
081016 16:51:39 2 Query       set @a =1
081016 16:51:47 2 Query       execute s1 using @a
                2 Execute     [2] select * from foo where i = 1

You can also get what you want if you set the PDO attribute PDO::ATTR_EMULATE_PREPARES. In this mode, PDO interpolate parameters into the SQL query and sends the whole query when you execute(). This is not a true prepared query. You will circumvent the benefits of prepared queries by interpolating variables into the SQL string before execute().

---

Re comment from @afilina:

No, the textual SQL query is not combined with the parameters during execution. So there\'s nothing for PDO to show you.

Internally, if you use PDO::ATTR_EMULATE_PREPARES, PDO makes a copy of the SQL query and interpolates parameter values into it before doing the prepare and execute. But PDO does not expose this modified SQL query.

The PDOStatement object has a property $queryString, but this is set only in the constructor for the PDOStatement, and it\'s not updated when the query is rewritten with parameters.

It would be a reasonable feature request for PDO to ask them to expose the rewritten query. But even that wouldn\'t give you the \"complete\" query unless you use PDO::ATTR_EMULATE_PREPARES.

This is why I show the workaround above of using the MySQL server\'s general query log, because in this case even a prepared query with parameter placeholders is rewritten on the server, with parameter values backfilled into the query string. But this is only done during logging, not during query execution.

回答2:

/**
 * Replaces any parameter placeholders in a query with the value of that
 * parameter. Useful for debugging. Assumes anonymous parameters from 
 * $params are are in the same order as specified in $query
 *
 * @param string $query The sql query with parameter placeholders
 * @param array $params The array of substitution parameters
 * @return string The interpolated query
 */
public static function interpolateQuery($query, $params) {
    $keys = array();

    # build a regular expression for each parameter
    foreach ($params as $key => $value) {
        if (is_string($key)) {
            $keys[] = \'/:\'.$key.\'/\';
        } else {
            $keys[] = \'/[?]/\';
        }
    }

    $query = preg_replace($keys, $params, $query, 1, $count);

    #trigger_error(\'replaced \'.$count.\' keys\');

    return $query;
}

回答3:

I modified the method to include handling output of arrays for statements like WHERE IN (?).

UPDATE: Just added check for NULL value and duplicated $params so actual $param values are not modified.

Great work bigwebguy and thanks!

/**
 * Replaces any parameter placeholders in a query with the value of that
 * parameter. Useful for debugging. Assumes anonymous parameters from 
 * $params are are in the same order as specified in $query
 *
 * @param string $query The sql query with parameter placeholders
 * @param array $params The array of substitution parameters
 * @return string The interpolated query
 */
public function interpolateQuery($query, $params) {
    $keys = array();
    $values = $params;

    # build a regular expression for each parameter
    foreach ($params as $key => $value) {
        if (is_string($key)) {
            $keys[] = \'/:\'.$key.\'/\';
        } else {
            $keys[] = \'/[?]/\';
        }

        if (is_string($value))
            $values[$key] = \"\'\" . $value . \"\'\";

        if (is_array($value))
            $values[$key] = \"\'\" . implode(\"\',\'\", $value) . \"\'\";

        if (is_null($value))
            $values[$key] = \'NULL\';
    }

    $query = preg_replace($keys, $values, $query);

    return $query;
}

回答4:

PDOStatement has a public property $queryString. It should be what you want.

I\'ve just notice that PDOStatement has an undocumented method debugDumpParams() which you may also want to look at.

回答5:

Added a little bit more to the code by Mike - walk the values to add single quotes

/**
 * Replaces any parameter placeholders in a query with the value of that
 * parameter. Useful for debugging. Assumes anonymous parameters from 
 * $params are are in the same order as specified in $query
 *
 * @param string $query The sql query with parameter placeholders
 * @param array $params The array of substitution parameters
 * @return string The interpolated query
 */
public function interpolateQuery($query, $params) {
    $keys = array();
    $values = $params;

    # build a regular expression for each parameter
    foreach ($params as $key => $value) {
        if (is_string($key)) {
            $keys[] = \'/:\'.$key.\'/\';
        } else {
            $keys[] = \'/[?]/\';
        }

        if (is_array($value))
            $values[$key] = implode(\',\', $value);

        if (is_null($value))
            $values[$key] = \'NULL\';
    }
    // Walk the array to see if we can add single-quotes to strings
    array_walk($values, create_function(\'&$v, $k\', \'if (!is_numeric($v) && $v!=\"NULL\") $v = \"\\\'\".$v.\"\\\'\";\'));

    $query = preg_replace($keys, $values, $query, 1, $count);

    return $query;
}

回答6:

A bit late probably but now there is PDOStatement::debugDumpParams

Dumps the informations contained by a prepared statement directly on the output. It will provide the SQL query in use, the number of parameters used (Params), the list of parameters, with their name, type (paramtype) as an integer, their key name or position, and the position in the query (if this is supported by the PDO driver, otherwise, it will be -1).

You can find more on the official php docs

Example:

<?php
/* Execute a prepared statement by binding PHP variables */
$calories = 150;
$colour = \'red\';
$sth = $dbh->prepare(\'SELECT name, colour, calories
    FROM fruit
    WHERE calories < :calories AND colour = :colour\');
$sth->bindParam(\':calories\', $calories, PDO::PARAM_INT);
$sth->bindValue(\':colour\', $colour, PDO::PARAM_STR, 12);
$sth->execute();

$sth->debugDumpParams();

?>

回答7:

I spent a good deal of time researching this situation for my own needs. This and several other SO threads helped me a great deal, so I wanted to share what I came up with.

While having access to the interpolated query string is a significant benefit while troubleshooting, we wanted to be able to maintain a log of only certain queries (therefore, using the database logs for this purpose was not ideal). We also wanted to be able to use the logs to recreate the condition of the tables at any given time, therefore, we needed to make certain the interpolated strings were escaped properly. Finally, we wanted to extend this functionality to our entire code base having to re-write as little of it as possible (deadlines, marketing, and such; you know how it is).

My solution was to extend the functionality of the default PDOStatement object to cache the parameterized values (or references), and when the statement is executed, use the functionality of the PDO object to properly escape the parameters when they are injected back in to the query string. We could then tie in to execute method of the statement object and log the actual query that was executed at that time (or at least as faithful of a reproduction as possible).

As I said, we didn\'t want to modify the entire code base to add this functionality, so we overwrite the default bindParam() and bindValue() methods of the PDOStatement object, do our caching of the bound data, then call parent::bindParam() or parent::bindValue(). This allowed our existing code base to continue to function as normal.

Finally, when the execute() method is called, we perform our interpolation and provide the resultant string as a new property E_PDOStatement->fullQuery. This can be output to view the query or, for example, written to a log file.

The extension, along with installation and configuration instructions, are available on github:

https://github.com/noahheck/E_PDOStatement

DISCLAIMER:
Obviously, as I mentioned, I wrote this extension. Because it was developed with help from many threads here, I wanted to post my solution here in case anyone else comes across these threads, just as I did.

回答8:

You can extend PDOStatement class to capture the bounded variables and store them for later use. Then 2 methods may be added, one for variable sanitizing ( debugBindedVariables ) and another to print the query with those variables ( debugQuery ):

class DebugPDOStatement extends \\PDOStatement{
  private $bound_variables=array();
  protected $pdo;

  protected function __construct($pdo) {
    $this->pdo = $pdo;
  }

  public function bindValue($parameter, $value, $data_type=\\PDO::PARAM_STR){
    $this->bound_variables[$parameter] = (object) array(\'type\'=>$data_type, \'value\'=>$value);
    return parent::bindValue($parameter, $value, $data_type);
  }

  public function bindParam($parameter, &$variable, $data_type=\\PDO::PARAM_STR, $length=NULL , $driver_options=NULL){
    $this->bound_variables[$parameter] = (object) array(\'type\'=>$data_type, \'value\'=>&$variable);
    return parent::bindParam($parameter, $variable, $data_type, $length, $driver_options);
  }

  public function debugBindedVariables(){
    $vars=array();

    foreach($this->bound_variables as $key=>$val){
      $vars[$key] = $val->value;

      if($vars[$key]===NULL)
        continue;

      switch($val->type){
        case \\PDO::PARAM_STR: $type = \'string\'; break;
        case \\PDO::PARAM_BOOL: $type = \'boolean\'; break;
        case \\PDO::PARAM_INT: $type = \'integer\'; break;
        case \\PDO::PARAM_NULL: $type = \'null\'; break;
        default: $type = FALSE;
      }

      if($type !== FALSE)
        settype($vars[$key], $type);
    }

    if(is_numeric(key($vars)))
      ksort($vars);

    return $vars;
  }

  public function debugQuery(){
    $queryString = $this->queryString;

    $vars=$this->debugBindedVariables();
    $params_are_numeric=is_numeric(key($vars));

    foreach($vars as $key=>&$var){
      switch(gettype($var)){
        case \'string\': $var = \"\'{$var}\'\"; break;
        case \'integer\': $var = \"{$var}\"; break;
        case \'boolean\': $var = $var ? \'TRUE\' : \'FALSE\'; break;
        case \'NULL\': $var = \'NULL\';
        default:
      }
    }

    if($params_are_numeric){
      $queryString = preg_replace_callback( \'/\\?/\', function($match) use( &$vars) { return array_shift($vars); }, $queryString);
    }else{
      $queryString = strtr($queryString, $vars);
    }

    echo $queryString.PHP_EOL;
  }
}


class DebugPDO extends \\PDO{
  public function __construct($dsn, $username=\"\", $password=\"\", $driver_options=array()) {
    $driver_options[\\PDO::ATTR_STATEMENT_CLASS] = array(\'DebugPDOStatement\', array($this));
    $driver_options[\\PDO::ATTR_PERSISTENT] = FALSE;
    parent::__construct($dsn,$username,$password, $driver_options);
  }
}

And then you can use this inherited class for debugging purpouses.

$dbh = new DebugPDO(\'mysql:host=localhost;dbname=test;\',\'user\',\'pass\');

$var=\'user_test\';
$sql=$dbh->prepare(\"SELECT user FROM users WHERE user = :test\");
$sql->bindValue(\':test\', $var, PDO::PARAM_STR);
$sql->execute();

$sql->debugQuery();
print_r($sql->debugBindedVariables());

Resulting in

SELECT user FROM users WHERE user = \'user_test\'

Array ( [:test] => user_test )

回答9:

The $queryString property mentioned will probably only return the query passed in, without the parameters replaced with their values. In .Net, I have the catch part of my query executer do a simple search replace on the parameters with their values which was supplied so that the error log can show actual values that were being used for the query. You should be able to enumerate the parameters in PHP, and replace the parameters with their assigned value.

回答10:

Somewhat related... if you are just trying to sanitize a particular variable you can use PDO::quote. For example, to search for multiple partial LIKE conditions if you\'re stuck with a limited framework like CakePHP:

$pdo = $this->getDataSource()->getConnection();
$results = $this->find(\'all\', array(
    \'conditions\' => array(
        \'Model.name LIKE \' . $pdo->quote(\"%{$keyword1}%\"),
        \'Model.name LIKE \' . $pdo->quote(\"%{$keyword2}%\"),
    ),
);

回答11:

I need to log full query string after bind param so this is a piece in my code. Hope, it is useful for everyone hat has the same issue.

/**
 * 
 * @param string $str
 * @return string
 */
public function quote($str) {
    if (!is_array($str)) {
        return $this->pdo->quote($str);
    } else {
        $str = implode(\',\', array_map(function($v) {
                    return $this->quote($v);
                }, $str));

        if (empty($str)) {
            return \'NULL\';
        }

        return $str;
    }
}

/**
 * 
 * @param string $query
 * @param array $params
 * @return string
 * @throws Exception
 */
public function interpolateQuery($query, $params) {
    $ps = preg_split(\"/\'/is\", $query);
    $pieces = [];
    $prev = null;
    foreach ($ps as $p) {
        $lastChar = substr($p, strlen($p) - 1);

        if ($lastChar != \"\\\\\") {
            if ($prev === null) {
                $pieces[] = $p;
            } else {
                $pieces[] = $prev . \"\'\" . $p;
                $prev = null;
            }
        } else {
            $prev .= ($prev === null ? \'\' : \"\'\") . $p;
        }
    }

    $arr = [];
    $indexQuestionMark = -1;
    $matches = [];

    for ($i = 0; $i < count($pieces); $i++) {
        if ($i % 2 !== 0) {
            $arr[] = \"\'\" . $pieces[$i] . \"\'\";
        } else {
            $st = \'\';
            $s = $pieces[$i];
            while (!empty($s)) {
                if (preg_match(\"/(\\?|:[A-Z0-9_\\-]+)/is\", $s, $matches, PREG_OFFSET_CAPTURE)) {
                    $index = $matches[0][1];
                    $st .= substr($s, 0, $index);
                    $key = $matches[0][0];
                    $s = substr($s, $index + strlen($key));

                    if ($key == \'?\') {
                        $indexQuestionMark++;
                        if (array_key_exists($indexQuestionMark, $params)) {
                            $st .= $this->quote($params[$indexQuestionMark]);
                        } else {
                            throw new Exception(\'Wrong params in query at \' . $index);
                        }
                    } else {
                        if (array_key_exists($key, $params)) {
                            $st .= $this->quote($params[$key]);
                        } else {
                            throw new Exception(\'Wrong params in query with key \' . $key);
                        }
                    }
                } else {
                    $st .= $s;
                    $s = null;
                }
            }
            $arr[] = $st;
        }
    }

    return implode(\'\', $arr);
}

回答12:

A solution is to voluntarily put an error in the query and to print the error\'s message:

//Connection to the database
$co = new PDO(\'mysql:dbname=myDB;host=localhost\',\'root\',\'\');
//We allow to print the errors whenever there is one
$co->setAttribute(PDO::ATTR_ERRMODE, PDO::ERRMODE_EXCEPTION);

//We create our prepared statement
$stmt = $co->prepare(\"ELECT * FROM Person WHERE age=:age\"); //I removed the \'S\' of \'SELECT\'
$stmt->bindValue(\':age\',\'18\',PDO::PARAM_STR);
try {
    $stmt->execute();
} catch (PDOException $e) {
    echo $e->getMessage();
}

Standard output:

SQLSTATE[42000]: Syntax error or access violation: [...] near \'ELECT * FROM Person WHERE age=18\' at line 1

It is important to note that it only prints the first 80 characters of the query.

回答13:

I know this question is a bit old, but, I\'m using this code since lot time ago (I\'ve used response from @chris-go), and now, these code are obsolete with PHP 7.2

I\'ll post an updated version of these code (Credit for the main code are from @bigwebguy, @mike and @chris-go, all of them answers of this question):

/**
 * Replaces any parameter placeholders in a query with the value of that
 * parameter. Useful for debugging. Assumes anonymous parameters from 
 * $params are are in the same order as specified in $query
 *
 * @param string $query The sql query with parameter placeholders
 * @param array $params The array of substitution parameters
 * @return string The interpolated query
 */
public function interpolateQuery($query, $params) {
    $keys = array();
    $values = $params;

    # build a regular expression for each parameter
    foreach ($params as $key => $value) {
        if (is_string($key)) {
            $keys[] = \'/:\'.$key.\'/\';
        } else {
            $keys[] = \'/[?]/\';
        }

        if (is_array($value))
            $values[$key] = implode(\',\', $value);

        if (is_null($value))
            $values[$key] = \'NULL\';
    }
    // Walk the array to see if we can add single-quotes to strings
    array_walk($values, function(&$v, $k) { if (!is_numeric($v) && $v != \"NULL\") $v = \"\\\'\" . $v . \"\\\'\"; });

    $query = preg_replace($keys, $values, $query, 1, $count);

    return $query;
}

Note the change on the code are on array_walk() function, replacing create_function by an anonymous function. This make these good piece of code functional and compatible with PHP 7.2 (and hope future versions too).

回答14:

Mike\'s answer is working good until you are using the \"re-use\" bind value.
For example:

SELECT * FROM `an_modules` AS `m` LEFT JOIN `an_module_sites` AS `ms` ON m.module_id = ms.module_id WHERE 1 AND `module_enable` = :module_enable AND `site_id` = :site_id AND (`module_system_name` LIKE :search OR `module_version` LIKE :search)

The Mike\'s answer can only replace first :search but not the second.
So, I rewrite his answer to work with multiple parameters that can re-used properly.

public function interpolateQuery($query, $params) {
    $keys = array();
    $values = $params;
    $values_limit = [];

    $words_repeated = array_count_values(str_word_count($query, 1, \':_\'));

    # build a regular expression for each parameter
    foreach ($params as $key => $value) {
        if (is_string($key)) {
            $keys[] = \'/:\'.$key.\'/\';
            $values_limit[$key] = (isset($words_repeated[\':\'.$key]) ? intval($words_repeated[\':\'.$key]) : 1);
        } else {
            $keys[] = \'/[?]/\';
            $values_limit = [];
        }

        if (is_string($value))
            $values[$key] = \"\'\" . $value . \"\'\";

        if (is_array($value))
            $values[$key] = \"\'\" . implode(\"\',\'\", $value) . \"\'\";

        if (is_null($value))
            $values[$key] = \'NULL\';
    }

    if (is_array($values)) {
        foreach ($values as $key => $val) {
            if (isset($values_limit[$key])) {
                $query = preg_replace([\'/:\'.$key.\'/\'], [$val], $query, $values_limit[$key], $count);
            } else {
                $query = preg_replace([\'/:\'.$key.\'/\'], [$val], $query, 1, $count);
            }
        }
        unset($key, $val);
    } else {
        $query = preg_replace($keys, $values, $query, 1, $count);
    }
    unset($keys, $values, $values_limit, $words_repeated);

    return $query;
}

回答15:

preg_replace didn\'t work for me and when binding_ was over 9, binding_1 and binding_10 was replaced with str_replace (leaving the 0 behind), so I made the replacements backwards:

public function interpolateQuery($query, $params) {
$keys = array();
    $length = count($params)-1;
    for ($i = $length; $i >=0; $i--) {
            $query  = str_replace(\':binding_\'.(string)$i, \'\\\'\'.$params[$i][\'val\'].\'\\\'\', $query);
           }
        // $query  = str_replace(\'SQL_CALC_FOUND_ROWS\', \'\', $query, $count);
        return $query;

}

Hope someone finds it useful.