4

我正在根据用户的请求使用 Mechanize 来抓取受密码保护的网站。我试图通过运行一个登录站点并将 cookie 保存到数据库中的 Rake 任务来分离登录和搜索功能，该数据库可供后续的 Mechanize 请求重用。

我的问题是该cookie_jar.save方法不会将会话 cookie/令牌保存到 cookie 文件中。下面是一个简单的例子来说明这一点：

require 'mechanize'

# Setup Mechanize agents
agent1 = Mechanize.new
agent2 = Mechanize.new

# Fetch page and save cookies to local file
agent1.get ('http://www.my-secure-website.com')
agent1.post('http://www.my-secure-website.com/login', {
    'user[login]' => 'my_login',
    'user[password]' => 'my_password',
    'submit' => 'Login'
})

# Verify and save cookies
agent1.cookie_jar.save_as 'cookies'
p agent1.cookie_jar
# #<Mechanize::CookieJar:0x8cf60b8 @jar={"www.my-secure-website.com"=>{"/"=>{"JSESSIONID"=>JSESSIONID=1NqLRc4dm0Qp5465N82Zwz4N0yXxy5jP1pXpyKp9jG8ssX2nMp5q!-334818122}, "/login/"=>{"Account"=>Account=my_account_number}}, "evr.my-secure-website.com"=>{"/APBDBQ"=>{"JSESSIONID"=>JSESSIONID=A74D230DEAFF50098557FBE76DD2E0C5}}}


########################################################
# Now let's load cookies into the second Mechanize agent

# Version 1 - This works only partially. Session cookies are missing:
agent2.cookie_jar.load 'cookies'
p agent2.cookies
# [
#    [0] Account=my_account_number
# ]
p agent2.cookie_jar
# #<Mechanize::CookieJar:0x914c658 @jar={"www.my-secure-website.com"=>{"/"=>{}, "/login/"=>{"Account"=>Account=my_account_number}}, "evr.my-secure-website.com"=>{"/APBDBQ"=>{}}}>


# Version 2 - This works, but cannot be saved into file/db!
agent2.cookie_jar = agent1.cookie_jar
p agent2.cookies
# [
#    [0] JSESSIONID=1NqLRc4dm0Qp5465N82Zwz4N0yXxy5jP1pXpyKp9jG8ssX2nMp5q!-334818122,
#    [1] Account=my_account_number,
#    [2] JSESSIONID=A74D230DEAFF50098557FBE76DD2E0C5
# ]
p agent2.cookie_jar
# #<Mechanize::CookieJar:0x8cf60b8 @jar={"www.my-secure-website.com"=>{"/"=>{"JSESSIONID"=>JSESSIONID=1NqLRc4dm0Qp5465N82Zwz4N0yXxy5jP1pXpyKp9jG8ssX2nMp5q!-334818122}, "/login/"=>{"Account"=>Account=my_account_number}}, "evr.my-secure-website.com"=>{"/APBDBQ"=>{"JSESSIONID"=>JSESSIONID=A74D230DEAFF50098557FBE76DD2E0C5}}}>

这就是我保存的 cookie 文件的样子：

---
www.my-secure-website.com:
  /: {}
  /login/:
    Account: !ruby/object:Mechanize::Cookie
     version: 0
     port: 
     discard: 
     comment_url: 
     expires: Thu, 22 May 2014 07:48:46 GMT
     max_age: 
     comment: 
     secure: true
     path: /login/
     domain: www.my-secure-website.com
     accessed_at: 2013-05-22 00:48:47.227628764 -07:00
     created_at: 2013-05-22 00:48:47.227628764 -07:00
     name: Account
     value: S4633
     for_domain: false
     domain_name: !ruby/object:DomainName
       ipaddr: 
       hostname: www.my-secure-website.com
       uri_host: www.my-secure-website.com
       tld: com
       canonical_tld_p: true
       domain: my-secure-website.com
     session: false
evr.my-secure-website.com:
  /APBDBQ: {}

您可以在控制台输出中看到会话令牌 ( JSESSIONID)，但本地 cookie 文件中缺少它。我的问题是，我该如何Mechanize.cookie_jar.save_as保存会话数据？

4

1 回答 1

7

从机械化版本 2.6.0 开始。该cookie_jar.save_as方法还允许传递:session选项以启用保存会话 cookie：

agent1.cookie_jar.save_as 'cookies', :session => true, :format => :yaml

PS 我使用的是 v2.5.1，它缺少这个功能。

于 2013-05-22T18:32:26.130 回答