10

我正在使用 cucumber + capybara 进行一些网络自动化测试。我希望能够连接我自己的标签(类似于场景之前的@all_browsers),并让它针对我设置的网络驱动程序列表(celerity、firefox 上的 selenium、ie 和 chrome)运行。我不想用 4 个不同的标签在 4 个不同的时间编写场景。我已经考虑尝试使用我通过以下方式注册的新驱动程序来做到这一点:

Capybara.register_driver :all_browsers do |app|
 # What would even work in here? I don't think anything will.
end  

然后跟进:

Before('@all_browsers') do
 # Same problem here.
end

但我不太确定在可能实际工作的 Before 方法中放入什么。

我试过使用黄瓜钩,特别是:

Around('@all_browsers') do |scenario, block|
  Capybara.current_driver = :selenium_firefox
  block.call

  Capybara.current_driver = :selenium_chrome
  block.call
  # etc
end

但这并不像我希望的那样。它使用相同的驱动程序并使用它运行场景两次。

沿着钩线,黄瓜文档中有这个:
You may also provide an AfterConfiguration hook that will be run after Cucumber has been configured. This hook will run only once; after support has been loaded but before features are loaded. You can use this hook to extend Cucumber, for example you could affect how features are loaded...
这可能是一个潜在的途径,但我也没有设法想出任何可以在这里工作的东西。

我已经研究过自定义格式化程序,但它们实际上只是看起来确实是这样做的——格式化输出,而不是指定功能的实际运行方式。

我已经研究过覆盖黄瓜的功能运行器,但这看起来并不容易或友好。
请帮忙?任何人?

4

4 回答 4

9

所以,我最终推出了自己的解决方案。不确定这是否是最好或最优雅的方法,但实际上我刚刚结束:

  1. 将所有常见的环境内容抽象为env.rb
  2. 使用需要特定环境文件(例如 firefox.rb)的 Cucumber 配置文件,env.rb然后将 Capybara 的默认驱动程序设置为适当的驱动程序。
  3. 编写了一个大型的 ol' thor类,其中包含捆绑一堆黄瓜命令并调用以正确配置文件运行坏男孩的任务。
  4. 编写了一个捆绑命令的“all_browsers”任务,然后调用每个特定的驱动程序任务,因此我现在可以有一个任务运行我在所有支持的驱动程序上提供的任何一组场景。

像魅力一样工作,我认为最终可能比我上面尝试的任何东西都更好,因为在 Thor 文件中,我能够添加诸如基准测试选项之类的东西,以及是否拆分功能运行分成多个线程。仍然很好奇是否有其他人为此提出了解决方案。

cucumber.yaml:
在这里,all_features 文件只包含以 .feature 结尾的所有内容,因为如果我拉入整个 features 目录,它将拉入它下面的所有内容,包括所有配置文件等,这不是什么我想要,因为每个配置文件都将默认的水豚驱动程序设置为不同的值。一旦您指定-rcucumber 的选项,任何文件的所有自动加载都将停止。

default: --format pretty

chrome: --format pretty -r features/support/profiles/chrome.rb -r features/all_features -r features/step_definitions

firefox: --format pretty -r features/support/profiles/firefox.rb -r features/all_features -r features/step_definitions

celerity: --format pretty -r features/support/profiles/celerity.rb -r features/all_features -r features/step_definitions

firefox.rb(“配置文件”文件):

require File.dirname(__FILE__) + "/../env.rb"

Capybara.configure do |config|
  config.default_driver = :selenium_firefox
end

selenium_firefox.rb (我在其中注册驱动程序,并设置了一些我现在不需要的标签功能,因为@selenium_firefox标签是我在问题中发布的最初尝试的一部分):

# Register a specific selenium driver for firefox
Capybara.register_driver :selenium_firefox do |app|
  Capybara::Driver::Selenium.new(app, :browser => :firefox)
end

# Allows the use of a tag @selenium_firefox before a scenario to run it in selenium with firefox
Before('@selenium_firefox') do
  Capybara.current_driver = :selenium_firefox
end

feature_runner.thor:

require 'benchmark'

class FeatureRunner < Thor
  APP_ROOT = File.expand_path(File.dirname(__FILE__) + "/../")

  # One place to keep all the common feature runner options, since every runner in here uses them.
  # Modify here, and all runners below will reflect the changes, as they all call this proc.
  feature_runner_options = lambda { 
    method_option :verbose, :type => :boolean, :default => true, :aliases => "-v"
    method_option :tags, :type => :string
    method_option :formatter, :type => :string
    method_option :other_cucumber_args, :type => :string
  }


  desc "all_drivers_runner", "Run features in all available browsers"
  method_option :benchmark, :type => :boolean, :default => false
  method_option :threaded, :type => :boolean, :default => true
  feature_runner_options.call # Set up common feature runner options defined above
  def all_drivers_runner
    if options[:threaded]
      feature_run = lambda { 
        thread_pool = []

        t = Thread.new do |n|
          invoke :firefox_runner
        end
        thread_pool << t

        t = Thread.new do |n|
          invoke :chrome_runner
        end
        thread_pool << t

        t = Thread.new do |n|
          invoke :celerity_runner
        end
        thread_pool << t

        thread_pool.each {|th| th.join}
      }
    else
      feature_run = lambda { 
        invoke "feature_runner:firefox_runner", options
        invoke "feature_runner:chrome_runner", options
        invoke "feature_runner:celerity_runner", options
      }
    end

    if options[:benchmark]
      puts "Benchmarking feature run"
      measure = Benchmark.measure { feature_run.call }
      puts "Benchmark Results (in seconds):"
      puts "CPU Time: #{measure.utime}"
      puts "System CPU TIME: #{measure.stime}"
      puts "Elasped Real Time: #{measure.real}"
    else
      feature_run.call
    end
  end

  desc "firefox_runner", "Run features on firefox"
  feature_runner_options.call # Set up common feature runner options defined above
  def firefox_runner
    command = build_cucumber_command("firefox", options)
    run_command(command, options[:verbose])
  end

  desc "chrome_runner", "Run features on chrome"
  feature_runner_options.call # Set up common feature runner options defined above
  def chrome_runner
    command = build_cucumber_command("chrome", options)
    run_command(command, options[:verbose])
  end

  desc "celerity_runner", "Run features on celerity"
  feature_runner_options.call # Set up common feature runner options defined above
  def celerity_runner
    command = build_cucumber_command("celerity", options)
    run_command(command, options[:verbose])
  end

  private
  def build_cucumber_command(profile, options)
    command = "cd #{APP_ROOT} && ./bin/cucumber -p #{profile}"
    command += " --tags=#{options[:tags]}" if options[:tags]
    command += " --formatter=#{options[:formatter]}" if options[:formatter]
    command += " #{options[:other_cucumber_args]}" if options[:other_cucumber_args]
    command
  end

  def run_command(command, verbose)
    puts "Running: #{command}" if verbose
    output = `#{command}`
    puts output if verbose
  end

end

就根目录而言,一切都结束了:

.
|____cucumber.yml
|____features
| |____all_features.rb
| |____google_search.feature
| |____step_definitions
| | |____google_steps.rb
| | |____web_steps.rb
| |____support
| | |____custom_formatters
| | | |____blah.rb
| | |____env.rb
| | |____paths.rb
| | |____profiles
| | | |____celerity.rb
| | | |____chrome.rb
| | | |____firefox.rb
| | |____selenium_drivers
| | | |____selenium_chrome.rb
| | | |____selenium_firefox.rb
| | | |____selenium_ie.rb
| | | |____selenium_remote.rb
| | |____selenium_drivers.rb
|____tasks
| |____feature_runner.thor
| |____server_task.rb  

的输出thor -T

feature_runner
--------------
thor feature_runner:all_drivers_runner  # Run features in all available browsers
thor feature_runner:celerity_runner     # Run features on celerity
thor feature_runner:chrome_runner       # Run features on chrome
thor feature_runner:firefox_runner      # Run features on firefox  

现在我可以运行类似的东西:
thor feature_runner:all_drivers_runner --benchmark
这将在每个驱动程序的线程中运行所有水豚驱动程序的所有功能,并对结果进行基准测试。

或者
thor feature_runner:celerity_runner
这将仅在 celerity 上运行所有功能。

但是我现在还可以为 thor 命令提供一些其他选项,这些选项会传递给 cucumber,例如:
--tags=@all_browsers
--formatter=hotpants
--other_cucumber_args="--dry-run --guess --etc"

功能文件现在的样子:

Feature: Start up browser
  @all_browsers
  Scenario: Search Google
   Given I am on the home page
   When I fill in the search bar with "Capybara"
   And I press "Search"
   Then I should see "Capybara"

似乎有很多设置,但现在如果我用@all_browsers 标记一个功能,我可以构建一个套件来测试所有水豚驱动程序,在多线程环境中,使用一个 thor 命令:
thor feature_runner:all_drivers_runner --threaded --tags=@all_browsers

或者构建一个快速运行的冒烟测试套件:
thor feature_runner:celerity_runner --tags=@smoke_test

于 2010-12-09T22:47:38.077 回答
0

这可以通过 SauceLabs 的托管服务实现。Cucumber Sauce gem 为您提供并行的多浏览器测试。

或者,如果您想自己实现它,您可以从该 gem 的源代码中借用它。

于 2010-12-08T13:11:35.990 回答
0

这是我的技巧:(我的情况是证明一个功能可以在打开和关闭 javascript 的情况下工作)

  1. 将每个场景放入其自己的功能文件中。
  2. 将除最后一行之外的每一行移至“背景:”部分。
  3. 将最后一行放入每个浏览器的场景中
  4. 适当地标记每个场景

    Feature: a feature
    
    Background:
    Given a user "Jim" exists
    Given a user "Mike" exists
    
    When I login as "mike"
    And I follow "Lesson 1"
    
    And I follow "Upload a video"
    Then "#upload_a_video" should be active
    
    And I fill in "video_title" with "my film"
    And I attach the file "video.mov" to "video_upload"
    And I press "Post"
    
    Scenario: normal
    And I should see "my film"
    
    @javascript
    
    Scenario: javascript
    And I should see "my film"
    
于 2010-12-09T23:32:42.270 回答
0

我按照“watir”项目推荐的方式进行操作。我require parallel_cucumber在我的 Rakefile 中使用,然后每个 Cucumber 场景都有自己的并行线程(在这种情况下最多 20 个):

task :run_cucumber do
  FileUtils.mkpath(ENV['OUT_DIR'])
  begin
    # cannot format report as HTML because of parallel forking
    threads = 20
    @result = system "parallel_cucumber features -o \"--format junit --out #{ENV['OUT_DIR']} --format pretty --tag @sauce\" -n #{threads}"
  ensure
    @success &= @result
  end
end

然后,您的 Cucumber 项目的其余部分可以照常编写!!很简单!我在这里的完整示例: https ://github.com/djangofan/cuke-parallel-starter

于 2017-02-22T23:37:56.687 回答