我发现为什么这发生,请查看我的回答
这是出现这种情况的唯一域名,我在一堆网址,运行curl_multi,这一次回来与404 HTTP_CODE http://www.breakingnews.com
但是,当我在浏览器中访问它是200 OK(需要一段时间来加载)甚至不看起来像一个重定向。
任何人都知道这是怎么回事? 这是个常见的问题吗
这里有一个的var_dump:
["info"]=> array(22) { ["url"]=> string(27) "http://www.breakingnews.com" ["content_type"]=> string(24) "text/html; charset=utf-8" ["http_code"]=> int(404) ["header_size"]=> int(337) ["request_size"]=> int(128) ["filetime"]=> int(-1) ["ssl_verify_result"]=> int(0) ["redirect_count"]=> int(0) ["total_time"]=> float(1.152229) ["namelookup_time"]=> float(0.001261) ["connect_time"]=> float(0.020121) ["pretransfer_time"]=> float(0.020179) ["size_upload"]=> float(0) ["size_download"]=> float(9755) ["speed_download"]=> float(8466) ["speed_upload"]=> float(0) ["download_content_length"]=> float(-1) ["upload_content_length"]=> float(0) ["starttransfer_time"]=> float(1.133522) ["redirect_time"]=> float(0) ["certinfo"]=> array(0) { } ["redirect_url"]=> string(0) "" } ["error"]=> string(0) ""
更新:这实际上看起来像一个PHP错误与curl_setopt($ CH,CURLOPT_NOBODY,真正的); https://bugs.php.net/bug.php?id=39611
编辑:这不是一个错误。
我发现这里评论答案http://w-shadow.com/blog/2007/08/02/how-to-check-if-page-exists-with-curl/comment-page-1/#comment -12186通过设置CURLOPT_NOBODY为true,袅袅会用头的要求,其中一些服务器不喜欢(例如,福布斯)将返回“从服务器Emply答复”。 要解决您还需要设置CURLOPT_HTTPGET重置回GET请求。
/* don’t download the page, just the header (much faster in this case) */
curl_setopt($ch, CURLOPT_NOBODY, true);
curl_setopt($ch, CURLOPT_HEADER, true);
curl_setopt($ch, CURLOPT_HTTPGET, true); //this is needed to fix the issue
我不知道你的代码的样子,但能正常工作
$url = "http://www.breakingnews.com";
$ch = curl_init ( $url );
curl_setopt ( $ch, CURLOPT_USERAGENT, "Mozilla/5.0 (Windows; U; Windows NT 5.1; pl; rv:1.9) Gecko/2008052906 Firefox/3.0" );
curl_setopt ( $ch, CURLOPT_AUTOREFERER, true );
curl_setopt ( $ch, CURLOPT_FOLLOWLOCATION, true );
curl_setopt ( $ch, CURLOPT_RETURNTRANSFER, 1 );
curl_exec ( $ch );
var_dump ( curl_getinfo ( $ch ) );
if (curl_errno ( $ch )) {
print curl_error ( $ch );
} else {
curl_close ( $ch );
}
产量
array
'url' => string 'http://www.breakingnews.com' (length=27)
'content_type' => string 'text/html; charset=utf-8' (length=24)
'http_code' => int 200
'header_size' => int 330
'request_size' => int 154
'filetime' => int -1
'ssl_verify_result' => int 0
'redirect_count' => int 0
'total_time' => float 4.243
'namelookup_time' => float 0.171
'connect_time' => float 0.374
'pretransfer_time' => float 0.374
'size_upload' => float 0
'size_download' => float 68638
'speed_download' => float 16176
'speed_upload' => float 0
'download_content_length' => float -1
'upload_content_length' => float 0
'starttransfer_time' => float 3.681
'redirect_time' => float 0
'certinfo' =>
array
empty
'redirect_url' => string '' (length=0)