0

我有以下名为的简单网络表单login.php，其中包含：

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
 <meta name="robots" content="noindex,nofollow">
  <meta http-equiv="x-dns-prefetch-control" content="off">
</head>
  <form action="action.php" method="post"> 
    <!-- Input: Input box -->
    Name:     <input name="userName" type="text"/>
    <br>
    Password: <input name="userPassword" type="password"/>
    <br>
    <!-- Submit form -->
    <input type="submit"/> <input type="reset"/>
  </form>
</body>
</html>

然后我有一个非常简单的文件action.php来处理通过它传递给它的数据POST，这里是代码：

<?php
print_r ($_POST);
?>

这非常有效，如果我尝试以用户名"foo"和密码登录，"bar"我会得到：

Array ( [userName] => foo [userPassword] => bar )

我想要的是能够POST通过 curl 直接将内容发送到action.php. 所以我有第三个文件命名scraper.php它的代码在这里：

<?php

// SLIGHTLY MODIFIED CODE FROM: http://www.phpcodester.com/2011/01/scraping-a-password-protected-website-with-curl/
$ch=login('http://localhost/scraper_post/action.php','userName=foo&userPassword=bar');
$html=downloadUrl('http://localhost/scraper_post/action.php', $ch);
echo $html;

function downloadUrl($Url, $ch){
  curl_setopt($ch, CURLOPT_URL, $Url);
  curl_setopt($ch, CURLOPT_POST, 0);
  curl_setopt($ch, CURLOPT_REFERER, "http://localhost/scraper_post/login.php");
  curl_setopt($ch, CURLOPT_USERAGENT, "MozillaXYZ/1.0");
  curl_setopt($ch, CURLOPT_HEADER, 0);
  curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
  curl_setopt($ch, CURLOPT_TIMEOUT, 10);
  $output = curl_exec($ch);
  return $output;
}

// ALSO TRIED WITH $postData ON SEPARATE LINES AS IT IS IN ORIGINAL TUTORIAL
function login($url,$postData){
  $ch = curl_init();
  curl_setopt($ch, CURLOPT_URL, $url);
  curl_setopt ($ch, CURLOPT_POST, 1);
  // ALSO TRIED WITH FOLLOWING, AS SUGGESTED IN ORIGINAL TUTORIAL COMMENTS: curl_setopt ($ch, CURLOPT_POSTFIELDS, urlencode($postData));
  curl_setopt ($ch, CURLOPT_POSTFIELDS, $postData);
  curl_setopt ($ch, CURLOPT_COOKIEJAR, 'cookie.txt');
  curl_setopt ($ch, CURLOPT_RETURNTRANSFER, 1);
  $store = curl_exec ($ch);
  return $ch;
}
?>

问题是，当我打电话时，我在文件中scraper.php得到了空$_POST变量。action.php换句话说scraper.php不发送任何POST数据action.php，我不知道为什么。这一切才刚刚开始为需要登录的页面编写更大的网络爬虫，但正如你所看到的，我一开始就被卡住了。谢谢你。

4

1 回答 1

0

您不需要该downloadUrl()功能，您的login()功能已经登录并获取内容。做return $store;，login()它将是来自网站的 html

我对代码的建议：

<?php

$html=login('http://localhost/scrapper_post/action.php','userName=foo&userPassword=bar');
echo $html;

function login($url,$postData){
    $ch = curl_init();
    curl_setopt($ch, CURLOPT_URL, $url);
    curl_setopt($ch, CURLOPT_POST, true);
    curl_setopt($ch, CURLOPT_POSTFIELDS, urlencode($postData));
    curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
    curl_setopt($ch, CURLOPT_REFERER, "http://localhost/scrapper_post/login.php");
    curl_setopt($ch, CURLOPT_USERAGENT, "MozillaXYZ/1.0");
    curl_setopt($ch, CURLOPT_HEADER, 0);
    curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
    curl_setopt($ch, CURLOPT_TIMEOUT, 10);
    $output = curl_exec($ch);
    curl_close($ch);
    return $output;
}
?>
于 2013-09-26T15:59:55.973 回答